Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6384295 2021-09-10 18:28:06 2021-09-11 06:52:36 2021-09-11 07:20:25 0:27:49 0:18:31 0:09:18 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6384296 2021-09-10 18:28:07 2021-09-11 06:53:16 2021-09-11 07:14:16 0:21:00 0:10:50 0:10:10 smithi master ubuntu 16.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} tasks/rados_cls_all} 2
pass 6384297 2021-09-10 18:28:08 2021-09-11 06:53:27 2021-09-11 07:16:27 0:23:00 0:13:40 0:09:20 smithi master ubuntu 16.04 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384298 2021-09-10 18:28:09 2021-09-11 06:53:37 2021-09-11 07:08:41 0:15:04 0:04:42 0:10:22 smithi master centos 7.8 rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi077.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.math.princeton.edu\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.pit.teraswitch.com\\n * updates: mirror.siena.edu\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384299 2021-09-10 18:28:10 2021-09-11 06:53:47 2021-09-11 07:12:37 0:18:50 0:10:24 0:08:26 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/filestore-xfs openstack settings/optimized workloads/fio_4M_rand_read} 1
dead 6384300 2021-09-10 18:28:11 2021-09-11 06:53:47 2021-09-11 07:05:26 0:11:39 0:04:05 0:07:34 smithi master rhel 7.9 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_7} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'smithi013.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384301 2021-09-10 18:28:12 2021-09-11 06:54:18 2021-09-11 07:05:26 0:11:08 0:03:51 0:07:17 smithi master rhel 7.9 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi116.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384302 2021-09-10 18:28:13 2021-09-11 06:54:18 2021-09-11 07:31:44 0:37:26 0:26:37 0:10:49 smithi master ubuntu 16.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6384303 2021-09-10 18:28:14 2021-09-11 06:54:48 2021-09-11 07:26:22 0:31:34 0:21:57 0:09:37 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} 2
pass 6384304 2021-09-10 18:28:15 2021-09-11 06:54:59 2021-09-11 08:11:56 1:16:57 1:05:33 0:11:24 smithi master ubuntu 16.04 rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}} 2
dead 6384305 2021-09-10 18:28:17 2021-09-11 06:56:59 2021-09-11 07:08:41 0:11:42 0:04:04 0:07:38 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384306 2021-09-10 18:28:18 2021-09-11 06:57:00 2021-09-11 07:21:02 0:24:02 0:11:25 0:12:37 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6384307 2021-09-10 18:28:19 2021-09-11 06:57:50 2021-09-11 07:12:48 0:14:58 0:07:18 0:07:40 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{ubuntu_16.04}} 1
pass 6384308 2021-09-10 18:28:20 2021-09-11 06:58:10 2021-09-11 07:36:55 0:38:45 0:28:38 0:10:07 smithi master ubuntu 16.04 rados/singleton/{all/thrash-eio msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}} 2
dead 6384309 2021-09-10 18:28:21 2021-09-11 06:58:10 2021-09-11 07:10:23 0:12:13 0:04:04 0:08:09 smithi master rhel 7.9 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_7} tasks/module_selftest} 2
Failure Reason:

{'Failure object was': {'smithi007.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384310 2021-09-10 18:28:22 2021-09-11 06:58:41 2021-09-11 08:00:21 1:01:40 0:49:56 0:11:44 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/async-v1only rados thrashers/mapgap thrashosds-health workloads/radosbench} 4
pass 6384311 2021-09-10 18:28:23 2021-09-11 06:59:21 2021-09-11 07:16:32 0:17:11 0:06:40 0:10:31 smithi master ubuntu 16.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} tasks/mon_clock_no_skews} 2
dead 6384312 2021-09-10 18:28:23 2021-09-11 06:59:31 2021-09-11 07:12:08 0:12:37 0:04:06 0:08:31 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} tasks/rados_python} 2
Failure Reason:

{'Failure object was': {'smithi025.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384313 2021-09-10 18:28:24 2021-09-11 07:00:12 2021-09-11 07:32:19 0:32:07 0:21:33 0:10:34 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 6384314 2021-09-10 18:28:25 2021-09-11 07:00:42 2021-09-11 07:19:27 0:18:45 0:09:53 0:08:52 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/fio_4M_rand_rw} 1
pass 6384315 2021-09-10 18:28:26 2021-09-11 07:00:42 2021-09-11 07:16:19 0:15:37 0:06:13 0:09:24 smithi master ubuntu 16.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_16.04}} 1
dead 6384316 2021-09-10 18:28:28 2021-09-11 07:01:03 2021-09-11 07:19:29 0:18:26 0:04:45 0:13:41 smithi master centos 7.8 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

{'Failure object was': {'smithi169.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.jaleco.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: us.mirror.nsec.pt\\n * updates: mirror.jaleco.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384317 2021-09-10 18:28:29 2021-09-11 07:02:23 2021-09-11 07:34:26 0:32:03 0:21:08 0:10:55 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6384318 2021-09-10 18:28:30 2021-09-11 07:03:03 2021-09-11 07:31:19 0:28:16 0:18:31 0:09:45 smithi master ubuntu 16.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04}} 2
pass 6384319 2021-09-10 18:28:31 2021-09-11 07:04:24 2021-09-11 07:33:28 0:29:04 0:19:19 0:09:45 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
dead 6384320 2021-09-10 18:28:32 2021-09-11 07:04:34 2021-09-11 07:16:19 0:11:45 0:03:54 0:07:51 smithi master rhel 7.9 rados/standalone/{supported-random-distro$/{rhel_7} workloads/mon} 1
Failure Reason:

{'Failure object was': {'smithi111.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384321 2021-09-10 18:28:33 2021-09-11 07:04:34 2021-09-11 07:16:26 0:11:52 0:04:07 0:07:45 smithi master rhel 7.9 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}} 2
Failure Reason:

{'Failure object was': {'smithi013.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

fail 6384322 2021-09-10 18:28:34 2021-09-11 07:05:35 2021-09-11 07:18:54 0:13:19 0:03:22 0:09:57 smithi master rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d9fd12e20e6fc0d2e8c7b8c944bf87497819c9f0

pass 6384323 2021-09-10 18:28:35 2021-09-11 07:05:35 2021-09-11 07:28:38 0:23:03 0:11:08 0:11:55 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache} 2
dead 6384324 2021-09-10 18:28:36 2021-09-11 07:07:35 2021-09-11 07:18:44 0:11:09 0:04:05 0:07:04 smithi master rhel 7.9 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi062.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384325 2021-09-10 18:28:37 2021-09-11 07:07:36 2021-09-11 07:28:19 0:20:43 0:12:12 0:08:31 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/fio_4M_rand_write} 1
dead 6384326 2021-09-10 18:28:38 2021-09-11 07:07:36 2021-09-11 07:19:10 0:11:34 0:04:02 0:07:32 smithi master rhel 7.9 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

{'Failure object was': {'smithi061.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384327 2021-09-10 18:28:39 2021-09-11 07:07:46 2021-09-11 07:23:10 0:15:24 0:06:33 0:08:51 smithi master ubuntu 18.04 rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384328 2021-09-10 18:28:40 2021-09-11 07:07:46 2021-09-11 08:01:53 0:54:07 0:44:07 0:10:00 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 6384329 2021-09-10 18:28:41 2021-09-11 07:08:27 2021-09-11 07:30:36 0:22:09 0:09:50 0:12:19 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6384330 2021-09-10 18:28:42 2021-09-11 07:08:37 2021-09-11 07:29:34 0:20:57 0:12:26 0:08:31 smithi master ubuntu 16.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} tasks/rados_stress_watch} 2
dead 6384331 2021-09-10 18:28:43 2021-09-11 07:08:47 2021-09-11 07:23:58 0:15:11 0:05:02 0:10:09 smithi master centos 7.8 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_latest} tasks/orchestrator_cli} 2
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.atl.genesisadaptive.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.pit.teraswitch.com\\n * updates: ewr.edge.kernel.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384332 2021-09-10 18:28:44 2021-09-11 07:08:48 2021-09-11 07:45:04 0:36:16 0:25:54 0:10:22 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
dead 6384333 2021-09-10 18:28:45 2021-09-11 07:09:58 2021-09-11 07:20:57 0:10:59 0:04:08 0:06:51 smithi master rhel 7.9 rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi008.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384334 2021-09-10 18:28:46 2021-09-11 07:09:58 2021-09-11 07:26:16 0:16:18 0:05:40 0:10:38 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/random no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
dead 6384335 2021-09-10 18:28:47 2021-09-11 07:10:29 2021-09-11 07:21:38 0:11:09 0:03:52 0:07:17 smithi master rhel 7.9 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi136.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384336 2021-09-10 18:28:48 2021-09-11 07:10:29 2021-09-11 07:48:24 0:37:55 0:27:40 0:10:15 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384337 2021-09-10 18:28:49 2021-09-11 07:10:29 2021-09-11 07:26:46 0:16:17 0:07:55 0:08:22 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384338 2021-09-10 18:28:50 2021-09-11 07:10:29 2021-09-11 07:24:37 0:14:08 0:04:11 0:09:57 smithi master rhel 7.9 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'Failure object was': {'smithi043.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384339 2021-09-10 18:28:51 2021-09-11 07:12:40 2021-09-11 07:28:15 0:15:35 0:05:03 0:10:32 smithi master centos 7.8 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi067.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384340 2021-09-10 18:28:52 2021-09-11 07:12:40 2021-09-11 07:49:41 0:37:01 0:28:20 0:08:41 smithi master ubuntu 16.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
dead 6384341 2021-09-10 18:28:53 2021-09-11 07:13:00 2021-09-11 07:27:54 0:14:54 0:04:44 0:10:10 smithi master centos 7.8 rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi124.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: www.gtlib.gatech.edu\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384342 2021-09-10 18:28:54 2021-09-11 07:13:01 2021-09-11 07:33:14 0:20:13 0:11:08 0:09:05 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/radosbench_4K_rand_read} 1
pass 6384343 2021-09-10 18:28:55 2021-09-11 07:14:21 2021-09-11 07:49:46 0:35:25 0:25:30 0:09:55 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
dead 6384344 2021-09-10 18:28:56 2021-09-11 07:14:31 2021-09-11 07:26:28 0:11:57 0:04:07 0:07:50 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

{'Failure object was': {'smithi038.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384345 2021-09-10 18:28:57 2021-09-11 07:14:32 2021-09-11 07:33:36 0:19:04 0:04:48 0:14:16 smithi master centos 7.8 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_latest} msgr-failures/fastclose msgr/async rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 4
Failure Reason:

{'Failure object was': {'smithi172.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384346 2021-09-10 18:28:58 2021-09-11 07:16:22 2021-09-11 07:33:43 0:17:21 0:07:49 0:09:32 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors msgr-failures/many msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384347 2021-09-10 18:28:59 2021-09-11 07:16:32 2021-09-11 07:27:56 0:11:24 0:04:05 0:07:19 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7} tasks/rados_striper} 2
Failure Reason:

{'Failure object was': {'smithi063.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384348 2021-09-10 18:29:00 2021-09-11 07:16:33 2021-09-11 07:31:19 0:14:46 0:04:57 0:09:49 smithi master centos 7.8 rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi013.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384349 2021-09-10 18:29:01 2021-09-11 07:16:33 2021-09-11 07:28:19 0:11:46 0:03:54 0:07:52 smithi master rhel 7.9 rados/standalone/{supported-random-distro$/{rhel_7} workloads/osd} 1
Failure Reason:

{'Failure object was': {'smithi105.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384350 2021-09-10 18:29:02 2021-09-11 07:17:13 2021-09-11 07:33:27 0:16:14 0:04:40 0:11:34 smithi master centos 7.8 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
Failure Reason:

{'Failure object was': {'smithi184.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384351 2021-09-10 18:29:03 2021-09-11 07:18:24 2021-09-11 07:40:35 0:22:11 0:09:11 0:13:00 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 6384352 2021-09-10 18:29:04 2021-09-11 07:19:14 2021-09-11 07:34:26 0:15:12 0:04:43 0:10:29 smithi master centos 7.8 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits} 2
Failure Reason:

{'Failure object was': {'smithi169.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.rackspace.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384353 2021-09-10 18:29:05 2021-09-11 07:19:35 2021-09-11 07:30:45 0:11:10 0:03:52 0:07:18 smithi master rhel 7.9 rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi107.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384354 2021-09-10 18:29:06 2021-09-11 07:19:36 2021-09-11 07:30:48 0:11:12 0:03:50 0:07:22 smithi master rhel 7.9 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi112.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384355 2021-09-10 18:29:07 2021-09-11 07:19:36 2021-09-11 07:31:59 0:12:23 0:03:56 0:08:27 smithi master rhel 7.9 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_7} tasks/progress} 2
Failure Reason:

{'Failure object was': {'smithi167.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384356 2021-09-10 18:29:08 2021-09-11 07:20:26 2021-09-11 07:37:36 0:17:10 0:08:53 0:08:17 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/radosbench_4K_seq_read} 1
dead 6384357 2021-09-10 18:29:09 2021-09-11 07:20:27 2021-09-11 07:36:18 0:15:51 0:04:44 0:11:07 smithi master centos 7.8 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_latest} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'smithi166.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384358 2021-09-10 18:29:10 2021-09-11 07:21:07 2021-09-11 07:32:24 0:11:17 0:03:51 0:07:26 smithi master rhel 7.9 rados/singleton/{all/dump-stuck msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi106.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384359 2021-09-10 18:29:11 2021-09-11 07:21:07 2021-09-11 07:43:28 0:22:21 0:10:16 0:12:05 smithi master ubuntu 18.04 rados/multimon/{clusters/9 msgr-failures/few msgr/simple no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6384360 2021-09-10 18:29:12 2021-09-11 07:21:28 2021-09-11 08:29:40 1:08:12 0:56:00 0:12:12 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 6384361 2021-09-10 18:29:13 2021-09-11 07:21:28 2021-09-11 08:00:06 0:38:38 0:30:31 0:08:07 smithi master ubuntu 16.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_16.04}} 1
pass 6384362 2021-09-10 18:29:14 2021-09-11 07:21:28 2021-09-11 07:43:48 0:22:20 0:10:10 0:12:10 smithi master ubuntu 16.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
dead 6384363 2021-09-10 18:29:15 2021-09-11 07:22:39 2021-09-11 07:38:22 0:15:43 0:04:43 0:11:00 smithi master centos 7.8 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi183.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384364 2021-09-10 18:29:16 2021-09-11 07:23:19 2021-09-11 07:35:32 0:12:13 0:04:07 0:08:06 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7} tasks/rados_workunit_loadgen_big} 2
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384365 2021-09-10 18:29:17 2021-09-11 07:23:59 2021-09-11 07:39:03 0:15:04 0:04:46 0:10:18 smithi master centos 7.8 rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi160.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384366 2021-09-10 18:29:18 2021-09-11 07:24:10 2021-09-11 07:36:25 0:12:15 0:04:02 0:08:13 smithi master rhel 7.9 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi023.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384367 2021-09-10 18:29:18 2021-09-11 07:24:40 2021-09-11 07:41:00 0:16:20 0:04:44 0:11:36 smithi master centos 7.8 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_latest}} 2
Failure Reason:

{'Failure object was': {'smithi162.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384368 2021-09-10 18:29:19 2021-09-11 07:25:50 2021-09-11 07:44:52 0:19:02 0:11:12 0:07:50 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/radosbench_4M_rand_read} 1
dead 6384369 2021-09-10 18:29:20 2021-09-11 07:25:51 2021-09-11 07:37:58 0:12:07 0:03:53 0:08:14 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/redirect} 2
Failure Reason:

{'Failure object was': {'smithi178.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384370 2021-09-10 18:29:21 2021-09-11 07:26:21 2021-09-11 07:36:59 0:10:38 0:04:07 0:06:31 smithi master rhel 7.9 rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi043.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

fail 6384371 2021-09-10 18:29:22 2021-09-11 07:26:21 2021-09-11 07:39:31 0:13:10 0:03:23 0:09:47 smithi master rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d9fd12e20e6fc0d2e8c7b8c944bf87497819c9f0

dead 6384372 2021-09-10 18:29:23 2021-09-11 07:26:32 2021-09-11 07:44:40 0:18:08 0:05:04 0:13:04 smithi master centos 7.8 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} msgr-failures/few msgr/random rados thrashers/none thrashosds-health workloads/snaps-few-objects} 4
Failure Reason:

{'Failure object was': {'smithi007.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384373 2021-09-10 18:29:24 2021-09-11 07:27:42 2021-09-11 07:42:57 0:15:15 0:04:58 0:10:17 smithi master centos 7.8 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} tasks/prometheus} 2
Failure Reason:

{'Failure object was': {'smithi063.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

fail 6384374 2021-09-10 18:29:25 2021-09-11 07:28:02 2021-09-11 08:01:10 0:33:08 0:23:58 0:09:10 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi124 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d9fd12e20e6fc0d2e8c7b8c944bf87497819c9f0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

dead 6384375 2021-09-10 18:29:26 2021-09-11 07:28:03 2021-09-11 07:43:15 0:15:12 0:05:03 0:10:09 smithi master centos 7.8 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

{'Failure object was': {'smithi031.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384376 2021-09-10 18:29:27 2021-09-11 07:28:23 2021-09-11 07:40:08 0:11:45 0:04:08 0:07:37 smithi master rhel 7.9 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'Failure object was': {'smithi068.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384377 2021-09-10 18:29:28 2021-09-11 07:28:43 2021-09-11 07:43:48 0:15:05 0:04:44 0:10:21 smithi master centos 7.8 rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi114.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384378 2021-09-10 18:29:29 2021-09-11 07:28:44 2021-09-11 08:12:04 0:43:20 0:32:52 0:10:28 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
dead 6384379 2021-09-10 18:29:30 2021-09-11 07:28:44 2021-09-11 07:40:38 0:11:54 0:04:04 0:07:50 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

{'Failure object was': {'smithi025.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384380 2021-09-10 18:29:31 2021-09-11 07:28:44 2021-09-11 09:01:13 1:32:29 1:21:56 0:10:33 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
dead 6384381 2021-09-10 18:29:32 2021-09-11 07:29:45 2021-09-11 07:42:07 0:12:22 0:03:56 0:08:26 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7} tasks/rados_workunit_loadgen_mix} 2
Failure Reason:

{'Failure object was': {'smithi188.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384382 2021-09-10 18:29:34 2021-09-11 07:30:45 2021-09-11 07:46:08 0:15:23 0:06:08 0:09:15 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384383 2021-09-10 18:29:35 2021-09-11 07:30:45 2021-09-11 07:48:39 0:17:54 0:08:58 0:08:56 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/radosbench_4M_seq_read} 1
dead 6384384 2021-09-10 18:29:36 2021-09-11 07:30:46 2021-09-11 07:41:52 0:11:06 0:03:54 0:07:12 smithi master rhel 7.9 rados/singleton/{all/lost-unfound msgr-failures/many msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi107.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384385 2021-09-10 18:29:37 2021-09-11 07:30:46 2021-09-11 07:41:58 0:11:12 0:03:53 0:07:19 smithi master rhel 7.9 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_7} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'smithi112.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384386 2021-09-10 18:29:38 2021-09-11 07:30:56 2021-09-11 07:48:23 0:17:27 0:07:19 0:10:08 smithi master ubuntu 16.04 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} tasks/mon_clock_no_skews} 3
dead 6384387 2021-09-10 18:29:39 2021-09-11 07:31:26 2021-09-11 07:44:20 0:12:54 0:04:40 0:08:14 smithi master centos 7.8 rados/objectstore/{backends/objectstore supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi110.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384388 2021-09-10 18:29:40 2021-09-11 07:31:27 2021-09-11 07:49:05 0:17:38 0:04:47 0:12:51 smithi master centos 7.8 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'Failure object was': {'smithi170.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384389 2021-09-10 18:29:41 2021-09-11 07:31:57 2021-09-11 07:43:23 0:11:26 0:03:55 0:07:31 smithi master rhel 7.9 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi161.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384390 2021-09-10 18:29:42 2021-09-11 07:32:07 2021-09-11 07:46:54 0:14:47 0:05:50 0:08:57 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384391 2021-09-10 18:29:43 2021-09-11 07:32:08 2021-09-11 07:47:35 0:15:27 0:04:44 0:10:43 smithi master centos 7.8 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
Failure Reason:

{'Failure object was': {'smithi106.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384392 2021-09-10 18:29:44 2021-09-11 07:32:28 2021-09-11 07:48:26 0:15:58 0:05:00 0:10:58 smithi master centos 7.8 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
Failure Reason:

{'Failure object was': {'smithi065.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384393 2021-09-10 18:29:45 2021-09-11 07:33:18 2021-09-11 07:52:18 0:19:00 0:11:15 0:07:45 smithi master ubuntu 16.04 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384394 2021-09-10 18:29:46 2021-09-11 07:33:28 2021-09-11 07:48:16 0:14:48 0:05:01 0:09:47 smithi master centos 7.8 rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi017.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384395 2021-09-10 18:29:47 2021-09-11 07:33:29 2021-09-11 07:45:08 0:11:39 0:03:52 0:07:47 smithi master rhel 7.9 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_7} tasks/ssh_orchestrator} 2
Failure Reason:

{'Failure object was': {'smithi172.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384396 2021-09-10 18:29:48 2021-09-11 07:33:39 2021-09-11 07:50:20 0:16:41 0:09:09 0:07:32 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/radosbench_4M_write} 1
dead 6384397 2021-09-10 18:29:49 2021-09-11 07:33:39 2021-09-11 07:46:49 0:13:10 0:04:43 0:08:27 smithi master centos 7.8 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi152.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384398 2021-09-10 18:29:50 2021-09-11 07:33:40 2021-09-11 07:48:39 0:14:59 0:04:42 0:10:17 smithi master centos 7.8 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} 2
Failure Reason:

{'Failure object was': {'smithi192.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384399 2021-09-10 18:29:51 2021-09-11 07:33:50 2021-09-11 07:55:59 0:22:09 0:10:01 0:12:08 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 6384400 2021-09-10 18:29:52 2021-09-11 07:34:30 2021-09-11 07:47:23 0:12:53 0:04:02 0:08:51 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384401 2021-09-10 18:29:53 2021-09-11 07:35:41 2021-09-11 07:55:21 0:19:40 0:11:08 0:08:32 smithi master ubuntu 16.04 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384402 2021-09-10 18:29:54 2021-09-11 07:36:21 2021-09-11 07:48:15 0:11:54 0:04:06 0:07:48 smithi master rhel 7.9 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7} thrashers/sync-many workloads/pool-create-delete} 2
Failure Reason:

{'Failure object was': {'smithi023.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384403 2021-09-10 18:29:55 2021-09-11 07:36:31 2021-09-11 07:59:58 0:23:27 0:11:35 0:11:52 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/simple rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 4
dead 6384404 2021-09-10 18:29:56 2021-09-11 07:37:02 2021-09-11 07:52:26 0:15:24 0:05:00 0:10:24 smithi master centos 7.8 rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi062.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384405 2021-09-10 18:29:57 2021-09-11 07:37:42 2021-09-11 08:05:38 0:27:56 0:17:39 0:10:17 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 2
dead 6384406 2021-09-10 18:29:58 2021-09-11 07:38:03 2021-09-11 07:53:09 0:15:06 0:04:45 0:10:21 smithi master centos 7.8 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 2
Failure Reason:

{'Failure object was': {'smithi136.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384407 2021-09-10 18:29:59 2021-09-11 07:38:23 2021-09-11 08:00:21 0:21:58 0:11:16 0:10:42 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/filestore-xfs openstack settings/optimized workloads/sample_fio} 1
pass 6384408 2021-09-10 18:30:00 2021-09-11 07:39:13 2021-09-11 08:36:06 0:56:53 0:47:28 0:09:25 smithi master ubuntu 16.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_16.04} tasks/dashboard} 2
pass 6384409 2021-09-10 18:30:01 2021-09-11 07:39:34 2021-09-11 07:55:29 0:15:55 0:06:21 0:09:34 smithi master ubuntu 18.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 6384410 2021-09-10 18:30:02 2021-09-11 07:40:14 2021-09-11 07:57:25 0:17:11 0:07:13 0:09:58 smithi master ubuntu 18.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
dead 6384411 2021-09-10 18:30:03 2021-09-11 07:40:14 2021-09-11 07:55:00 0:14:46 0:04:45 0:10:01 smithi master centos 7.8 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi193.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384412 2021-09-10 18:30:04 2021-09-11 07:40:14 2021-09-11 07:55:11 0:14:57 0:04:44 0:10:13 smithi master centos 7.8 rados/singleton-flat/valgrind-leaks 1
Failure Reason:

{'Failure object was': {'smithi115.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384413 2021-09-10 18:30:05 2021-09-11 07:40:15 2021-09-11 07:52:42 0:12:27 0:04:08 0:08:19 smithi master rhel 7.9 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi025.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384414 2021-09-10 18:30:06 2021-09-11 07:40:45 2021-09-11 07:53:26 0:12:41 0:04:43 0:07:58 smithi master centos 7.8 rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} 1
Failure Reason:

{'Failure object was': {'smithi082.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384415 2021-09-10 18:30:07 2021-09-11 07:40:45 2021-09-11 07:51:55 0:11:10 0:03:54 0:07:16 smithi master rhel 7.9 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

{'Failure object was': {'smithi116.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384416 2021-09-10 18:30:08 2021-09-11 07:40:45 2021-09-11 08:14:31 0:33:46 0:22:55 0:10:51 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6384417 2021-09-10 18:30:09 2021-09-11 07:41:06 2021-09-11 08:11:02 0:29:56 0:19:59 0:09:57 smithi master ubuntu 16.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} 2
fail 6384418 2021-09-10 18:30:10 2021-09-11 07:41:56 2021-09-11 10:11:14 2:29:18 2:17:23 0:11:55 smithi master ubuntu 16.04 rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-nautilus 8-workload/{rbd-python rgw-swift snaps-many-objects} supported-random-distro$/{ubuntu_16.04} thrashosds-health} 4
Failure Reason:

Command failed on smithi188 with status 2: 'cd /home/ubuntu/cephtest/swift && ./bootstrap'

pass 6384419 2021-09-10 18:30:11 2021-09-11 07:42:17 2021-09-11 08:00:22 0:18:05 0:07:45 0:10:20 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384420 2021-09-10 18:30:12 2021-09-11 07:43:07 2021-09-11 07:54:18 0:11:11 0:04:09 0:07:02 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7} tasks/readwrite} 2
Failure Reason:

{'Failure object was': {'smithi031.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384421 2021-09-10 18:30:13 2021-09-11 07:43:17 2021-09-11 07:58:32 0:15:15 0:04:50 0:10:25 smithi master centos 7.8 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

{'Failure object was': {'smithi167.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384422 2021-09-10 18:30:14 2021-09-11 07:43:28 2021-09-11 08:17:45 0:34:17 0:23:54 0:10:23 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
dead 6384423 2021-09-10 18:30:15 2021-09-11 07:43:38 2021-09-11 07:58:09 0:14:31 0:05:03 0:09:28 smithi master centos 7.8 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_latest} tasks/workunits} 2
Failure Reason:

{'Failure object was': {'smithi026.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: centos.mirror.constant.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384424 2021-09-10 18:30:16 2021-09-11 07:43:38 2021-09-11 07:55:10 0:11:32 0:03:57 0:07:35 smithi master rhel 7.9 rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi140.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

fail 6384425 2021-09-10 18:30:17 2021-09-11 07:43:48 2021-09-11 07:57:02 0:13:14 0:03:30 0:09:44 smithi master rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d9fd12e20e6fc0d2e8c7b8c944bf87497819c9f0

pass 6384426 2021-09-10 18:30:18 2021-09-11 07:43:49 2021-09-11 08:06:06 0:22:17 0:10:13 0:12:04 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6384427 2021-09-10 18:30:19 2021-09-11 07:44:49 2021-09-11 08:03:39 0:18:50 0:10:00 0:08:50 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/sample_radosbench} 1
pass 6384428 2021-09-10 18:30:20 2021-09-11 07:44:51 2021-09-11 08:02:14 0:17:23 0:07:17 0:10:06 smithi master ubuntu 18.04 rados/singleton/{all/mon-config msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384429 2021-09-10 18:30:21 2021-09-11 07:44:51 2021-09-11 07:56:14 0:11:23 0:03:58 0:07:25 smithi master rhel 7.9 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7} thrashers/sync workloads/rados_5925} 2
Failure Reason:

{'Failure object was': {'smithi191.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384430 2021-09-10 18:30:22 2021-09-11 07:45:01 2021-09-11 08:01:30 0:16:29 0:08:21 0:08:08 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_16.04}} 1
pass 6384431 2021-09-10 18:30:23 2021-09-11 07:45:01 2021-09-11 08:08:06 0:23:05 0:13:05 0:10:00 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6384432 2021-09-10 18:30:24 2021-09-11 07:45:02 2021-09-11 08:10:22 0:25:20 0:16:17 0:09:03 smithi master ubuntu 16.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} tasks/repair_test} 2
pass 6384433 2021-09-10 18:30:25 2021-09-11 07:45:12 2021-09-11 08:08:51 0:23:39 0:13:14 0:10:25 smithi master ubuntu 18.04 rados/singleton/{all/osd-backfill msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384434 2021-09-10 18:30:25 2021-09-11 07:45:12 2021-09-11 07:57:36 0:12:24 0:04:09 0:08:15 smithi master rhel 7.9 rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_7} tasks/mon_recovery} 2
Failure Reason:

{'Failure object was': {'smithi049.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384435 2021-09-10 18:30:26 2021-09-11 07:46:13 2021-09-11 07:58:13 0:12:00 0:03:59 0:08:01 smithi master rhel 7.9 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi152.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384436 2021-09-10 18:30:27 2021-09-11 07:46:53 2021-09-11 07:59:08 0:12:15 0:04:14 0:08:01 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384437 2021-09-10 18:30:28 2021-09-11 07:47:33 2021-09-11 08:04:34 0:17:01 0:05:04 0:11:57 smithi master centos 7.8 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'Failure object was': {'smithi019.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384438 2021-09-10 18:30:29 2021-09-11 07:47:44 2021-09-11 08:23:19 0:35:35 0:25:19 0:10:16 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 6384439 2021-09-10 18:30:30 2021-09-11 07:48:24 2021-09-11 08:05:55 0:17:31 0:05:05 0:12:26 smithi master centos 7.8 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} msgr-failures/fastclose msgr/simple rados thrashers/careful thrashosds-health workloads/cache-snaps} 4
Failure Reason:

{'Failure object was': {'smithi017.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384440 2021-09-10 18:30:31 2021-09-11 07:48:24 2021-09-11 08:11:29 0:23:05 0:13:28 0:09:37 smithi master ubuntu 16.04 rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}} 1
pass 6384441 2021-09-10 18:30:34 2021-09-11 07:48:25 2021-09-11 08:12:09 0:23:44 0:14:12 0:09:32 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/cosbench_64K_read_write} 1
pass 6384442 2021-09-10 18:30:35 2021-09-11 07:48:25 2021-09-11 08:17:29 0:29:04 0:19:19 0:09:45 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 6384443 2021-09-10 18:30:35 2021-09-11 07:48:35 2021-09-11 07:59:42 0:11:07 0:04:00 0:07:07 smithi master rhel 7.9 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_7} tasks/crash} 2
Failure Reason:

{'Failure object was': {'smithi192.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384444 2021-09-10 18:30:36 2021-09-11 07:48:46 2021-09-11 08:45:55 0:57:09 0:46:30 0:10:39 smithi master ubuntu 16.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_16.04} tasks/dashboard} 2
dead 6384445 2021-09-10 18:30:37 2021-09-11 07:49:06 2021-09-11 08:00:11 0:11:05 0:03:59 0:07:06 smithi master rhel 7.9 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi099.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

fail 6384446 2021-09-10 18:30:38 2021-09-11 07:49:06 2021-09-11 08:22:52 0:33:46 0:24:14 0:09:32 smithi master ubuntu 16.04 rados/singleton/{all/osd-recovery msgr-failures/many msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}} 1
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 6384447 2021-09-10 18:30:40 2021-09-11 07:49:07 2021-09-11 08:31:04 0:41:57 0:31:41 0:10:16 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 6384448 2021-09-10 18:30:42 2021-09-11 07:49:47 2021-09-11 08:13:37 0:23:50 0:11:19 0:12:31 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 6384449 2021-09-10 18:30:43 2021-09-11 07:50:27 2021-09-11 08:06:54 0:16:27 0:04:43 0:11:44 smithi master centos 7.8 rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi200.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384450 2021-09-10 18:30:44 2021-09-11 07:51:58 2021-09-11 08:07:22 0:15:24 0:04:59 0:10:25 smithi master centos 7.8 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

{'Failure object was': {'smithi062.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384451 2021-09-10 18:30:45 2021-09-11 07:52:28 2021-09-11 08:08:23 0:15:55 0:04:58 0:10:57 smithi master centos 7.8 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rgw_snaps} 2
Failure Reason:

{'Failure object was': {'smithi025.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: centos.mirror.constant.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384452 2021-09-10 18:30:46 2021-09-11 07:52:48 2021-09-11 08:07:52 0:15:04 0:04:43 0:10:21 smithi master centos 7.8 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi194.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384453 2021-09-10 18:30:47 2021-09-11 07:52:59 2021-09-11 08:04:12 0:11:13 0:03:56 0:07:17 smithi master rhel 7.9 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
Failure Reason:

{'Failure object was': {'smithi120.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384454 2021-09-10 18:30:48 2021-09-11 07:52:59 2021-09-11 08:07:55 0:14:56 0:07:27 0:07:29 smithi master ubuntu 16.04 rados/singleton/{all/peer msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384455 2021-09-10 18:30:49 2021-09-11 07:53:19 2021-09-11 08:08:25 0:15:06 0:04:46 0:10:20 smithi master centos 7.8 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
Failure Reason:

{'Failure object was': {'smithi183.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384456 2021-09-10 18:30:50 2021-09-11 07:53:30 2021-09-11 08:18:14 0:24:44 0:16:34 0:08:10 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/cosbench_64K_write} 1
pass 6384457 2021-09-10 18:30:51 2021-09-11 07:54:21 2021-09-11 08:17:46 0:23:25 0:14:22 0:09:03 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
dead 6384458 2021-09-10 18:30:52 2021-09-11 07:55:02 2021-09-11 08:06:23 0:11:21 0:03:55 0:07:26 smithi master rhel 7.9 rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}} 2
Failure Reason:

{'Failure object was': {'smithi140.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384459 2021-09-10 18:30:53 2021-09-11 07:55:12 2021-09-11 08:10:53 0:15:41 0:06:23 0:09:18 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384460 2021-09-10 18:30:54 2021-09-11 07:55:12 2021-09-11 08:13:13 0:18:01 0:05:57 0:12:04 smithi master ubuntu 18.04 rados/multimon/{clusters/9 msgr-failures/few msgr/random no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6384461 2021-09-10 18:30:55 2021-09-11 07:55:33 2021-09-11 08:15:36 0:20:03 0:09:49 0:10:14 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 6384462 2021-09-10 18:30:56 2021-09-11 07:56:03 2021-09-11 08:11:00 0:14:57 0:06:43 0:08:14 smithi master ubuntu 16.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_16.04}} 1
dead 6384463 2021-09-10 18:30:57 2021-09-11 07:56:04 2021-09-11 08:07:36 0:11:32 0:03:55 0:07:37 smithi master rhel 7.9 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

{'Failure object was': {'smithi191.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384464 2021-09-10 18:30:58 2021-09-11 07:56:25 2021-09-11 08:11:56 0:15:31 0:04:48 0:10:43 smithi master centos 7.8 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi132.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384465 2021-09-10 18:30:59 2021-09-11 07:57:05 2021-09-11 08:12:06 0:15:01 0:05:06 0:09:55 smithi master centos 7.8 rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 2
Failure Reason:

{'Failure object was': {'smithi029.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384466 2021-09-10 18:31:00 2021-09-11 07:57:05 2021-09-11 08:26:41 0:29:36 0:19:59 0:09:37 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
dead 6384467 2021-09-10 18:31:01 2021-09-11 07:57:26 2021-09-11 08:12:43 0:15:17 0:04:58 0:10:19 smithi master centos 7.8 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} tasks/scrub_test} 2
Failure Reason:

{'Failure object was': {'smithi049.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384468 2021-09-10 18:31:02 2021-09-11 07:57:47 2021-09-11 08:29:55 0:32:08 0:21:34 0:10:34 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6384469 2021-09-10 18:31:03 2021-09-11 07:58:18 2021-09-11 08:18:54 0:20:36 0:12:37 0:07:59 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/fio_4K_rand_read} 1
pass 6384470 2021-09-10 18:31:04 2021-09-11 07:58:18 2021-09-11 08:53:53 0:55:35 0:46:10 0:09:25 smithi master ubuntu 16.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/dashboard} 2
pass 6384471 2021-09-10 18:31:05 2021-09-11 07:58:58 2021-09-11 08:22:33 0:23:35 0:11:15 0:12:20 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 6384472 2021-09-10 18:31:06 2021-09-11 07:59:19 2021-09-11 08:10:48 0:11:29 0:03:54 0:07:35 smithi master rhel 7.9 rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/random objectstore/filestore-xfs rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi096.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384473 2021-09-10 18:31:07 2021-09-11 07:59:49 2021-09-11 09:04:58 1:05:09 0:54:52 0:10:17 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_16.04} msgr-failures/few msgr/async-v1only rados thrashers/default thrashosds-health workloads/radosbench} 4
fail 6384474 2021-09-10 18:31:08 2021-09-11 07:59:59 2021-09-11 08:13:06 0:13:07 0:03:24 0:09:43 smithi master rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/random objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d9fd12e20e6fc0d2e8c7b8c944bf87497819c9f0

pass 6384475 2021-09-10 18:31:09 2021-09-11 07:59:59 2021-09-11 08:14:53 0:14:54 0:06:14 0:08:40 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_16.04}} 1
pass 6384476 2021-09-10 18:31:09 2021-09-11 08:00:10 2021-09-11 08:21:06 0:20:56 0:12:36 0:08:20 smithi master ubuntu 16.04 rados/singleton/{all/radostool msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04}} 1
dead 6384477 2021-09-10 18:31:10 2021-09-11 08:00:20 2021-09-11 08:15:40 0:15:20 0:04:56 0:10:24 smithi master centos 7.8 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

{'Failure object was': {'smithi063.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384478 2021-09-10 18:31:11 2021-09-11 08:00:30 2021-09-11 08:15:20 0:14:50 0:04:47 0:10:03 smithi master centos 7.8 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

{'Failure object was': {'smithi160.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384479 2021-09-10 18:31:12 2021-09-11 08:00:31 2021-09-11 08:14:49 0:14:18 0:05:02 0:09:16 smithi master centos 7.8 rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} 1
Failure Reason:

{'Failure object was': {'smithi060.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384480 2021-09-10 18:31:13 2021-09-11 08:00:31 2021-09-11 08:23:00 0:22:29 0:13:56 0:08:33 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/fio_4K_rand_rw} 1
pass 6384481 2021-09-10 18:31:14 2021-09-11 08:00:31 2021-09-11 08:30:37 0:30:06 0:19:35 0:10:31 smithi master ubuntu 18.04 rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 6384482 2021-09-10 18:31:15 2021-09-11 08:01:32 2021-09-11 08:31:35 0:30:03 0:19:43 0:10:20 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 6384483 2021-09-10 18:31:16 2021-09-11 08:02:02 2021-09-11 08:24:42 0:22:40 0:10:34 0:12:06 smithi master ubuntu 16.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_16.04} tasks/insights} 2
dead 6384484 2021-09-10 18:31:17 2021-09-11 08:03:42 2021-09-11 08:16:04 0:12:22 0:04:09 0:08:13 smithi master rhel 7.9 rados/multimon/{clusters/21 msgr-failures/many msgr/simple no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7} tasks/mon_clock_with_skews} 3
Failure Reason:

{'Failure object was': {'smithi019.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384485 2021-09-10 18:31:18 2021-09-11 08:04:43 2021-09-11 08:33:26 0:28:43 0:19:47 0:08:56 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
dead 6384486 2021-09-10 18:31:19 2021-09-11 08:04:43 2021-09-11 08:21:11 0:16:28 0:04:43 0:11:45 smithi master centos 7.8 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi178.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: centos.mirror.constant.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384487 2021-09-10 18:31:20 2021-09-11 08:05:43 2021-09-11 08:43:17 0:37:34 0:27:53 0:09:41 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
dead 6384488 2021-09-10 18:31:21 2021-09-11 08:05:44 2021-09-11 08:17:46 0:12:02 0:03:53 0:08:09 smithi master rhel 7.9 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{rhel_7}} 1
Failure Reason:

{'Failure object was': {'smithi157.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384489 2021-09-10 18:31:22 2021-09-11 08:06:05 2021-09-11 08:23:14 0:17:09 0:04:58 0:12:11 smithi master centos 7.8 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'Failure object was': {'smithi017.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384490 2021-09-10 18:31:23 2021-09-11 08:06:05 2021-09-11 08:39:41 0:33:36 0:22:48 0:10:48 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 6384491 2021-09-10 18:31:24 2021-09-11 08:06:16 2021-09-11 08:21:11 0:14:55 0:05:05 0:09:50 smithi master centos 7.8 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

{'Failure object was': {'smithi007.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384492 2021-09-10 18:31:25 2021-09-11 08:06:16 2021-09-11 08:19:16 0:13:00 0:04:38 0:08:22 smithi master centos 7.8 rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi115.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384493 2021-09-10 18:31:26 2021-09-11 08:06:26 2021-09-11 08:21:54 0:15:28 0:04:43 0:10:45 smithi master centos 7.8 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

{'Failure object was': {'smithi200.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384494 2021-09-10 18:31:27 2021-09-11 08:06:57 2021-09-11 08:18:48 0:11:51 0:03:59 0:07:52 smithi master rhel 7.9 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'Failure object was': {'smithi191.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384495 2021-09-10 18:31:28 2021-09-11 08:07:37 2021-09-11 08:22:15 0:14:38 0:04:59 0:09:39 smithi master centos 7.8 rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

{'Failure object was': {'smithi062.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384496 2021-09-10 18:31:29 2021-09-11 08:07:38 2021-09-11 08:31:45 0:24:07 0:08:22 0:15:45 smithi master ubuntu 18.04 rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/fio_4M_rand_read} 1
dead 6384497 2021-09-10 18:31:30 2021-09-11 08:07:38 2021-09-11 08:19:11 0:11:33 0:03:54 0:07:39 smithi master rhel 7.9 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/cache} 2
Failure Reason:

{'Failure object was': {'smithi136.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

dead 6384498 2021-09-10 18:31:31 2021-09-11 08:07:58 2021-09-11 08:23:09 0:15:11 0:05:04 0:10:07 smithi master centos 7.8 rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi016.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: mirror.rackspace.com\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384499 2021-09-10 18:31:32 2021-09-11 08:08:08 2021-09-11 09:01:41 0:53:33 0:43:21 0:10:12 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
dead 6384500 2021-09-10 18:31:33 2021-09-11 08:08:29 2021-09-11 08:20:23 0:11:54 0:04:04 0:07:50 smithi master rhel 7.9 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_7} tasks/rados_cls_all} 2
Failure Reason:

{'Failure object was': {'smithi025.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384501 2021-09-10 18:31:34 2021-09-11 08:08:29 2021-09-11 08:28:26 0:19:57 0:07:12 0:12:45 smithi master ubuntu 18.04 rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 6384502 2021-09-10 18:31:35 2021-09-11 08:10:30 2021-09-11 08:48:33 0:38:03 0:28:16 0:09:47 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 6384503 2021-09-10 18:31:36 2021-09-11 08:10:50 2021-09-11 08:34:20 0:23:30 0:12:11 0:11:19 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/async rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 4
pass 6384504 2021-09-10 18:31:37 2021-09-11 08:11:11 2021-09-11 08:27:16 0:16:05 0:06:36 0:09:29 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384505 2021-09-10 18:31:38 2021-09-11 08:11:31 2021-09-11 08:46:51 0:35:20 0:25:00 0:10:20 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6384506 2021-09-10 18:31:39 2021-09-11 08:12:01 2021-09-11 08:45:18 0:33:17 0:22:57 0:10:20 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 6384507 2021-09-10 18:31:40 2021-09-11 08:12:02 2021-09-11 08:29:33 0:17:31 0:08:51 0:08:40 smithi master ubuntu 16.04 rados/singleton/{all/test-crash msgr-failures/many msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}} 1
pass 6384508 2021-09-10 18:31:41 2021-09-11 08:12:12 2021-09-11 08:42:59 0:30:47 0:22:47 0:08:00 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04} workloads/misc} 1
pass 6384509 2021-09-10 18:31:42 2021-09-11 08:12:12 2021-09-11 08:31:16 0:19:04 0:08:49 0:10:15 smithi master ubuntu 16.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} tasks/mon_recovery} 2
pass 6384510 2021-09-10 18:31:43 2021-09-11 08:12:12 2021-09-11 08:31:10 0:18:58 0:09:56 0:09:02 smithi master ubuntu 16.04 rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/fio_4M_rand_rw} 1
pass 6384511 2021-09-10 18:31:44 2021-09-11 08:12:13 2021-09-11 10:29:52 2:17:39 2:07:42 0:09:57 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} 1
dead 6384512 2021-09-10 18:31:45 2021-09-11 08:12:53 2021-09-11 08:24:23 0:11:30 0:03:57 0:07:33 smithi master rhel 7.9 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

{'Failure object was': {'smithi192.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-54.el7_8.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-54.el7_8.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-120.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-23.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-44.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7_2.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-22.el7.x86_64 providing xfsprogs is already installed', 'xfsprogs-devel-4.5.0-22.el7.x86_64 providing xfsprogs-devel is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', '7:lvm2-2.02.187-6.el7.x86_64 providing lvm2 is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-65.el7_9.1.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'lsof-4.87-6.el7.x86_64 providing lsof is already installed', 'iozone-3.424-2_ceph.el7.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-65.el7_9.1.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-97.el7_9.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-97.el7_9.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-97.el7_9.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-97.el7_9.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.68.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-90.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_8.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-299.el7_9.noarch providing perl-CPAN is already installed', 'podman-1.6.4-29.el7_9.x86_64 providing podman is already installed', 'python3-3.6.8-18.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\nLoading mirror speeds from cached hostfile\\n * epel: download-cc-rdu01.fedoraproject.org\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7 will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7 rhel-7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 rhel-7-server-rpms 39 k\\n librados2 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 rhel-7-server-rpms 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 rhel-7-server-rpms 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'xfsprogs-devel', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'lvm2', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'ant', 'lsof', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'podman', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below knowledge base article\n\nhttps://access.redhat.com/solutions/69319\n\nIf above article doesn't help to resolve this issue please open a ticket with Red Hat Support.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-rhel7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}

pass 6384513 2021-09-10 18:31:46 2021-09-11 08:13:13 2021-09-11 08:46:28 0:33:15 0:23:32 0:09:43 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6384514 2021-09-10 18:31:47 2021-09-11 08:13:14 2021-09-11 08:36:41 0:23:27 0:13:01 0:10:26 smithi master ubuntu 18.04 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6384515 2021-09-10 18:31:48 2021-09-11 08:13:14 2021-09-11 08:45:03 0:31:49 0:20:49 0:11:00 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 6384516 2021-09-10 18:31:49 2021-09-11 08:13:44 2021-09-11 08:48:15 0:34:31 0:25:44 0:08:47 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
dead 6384517 2021-09-10 18:31:50 2021-09-11 08:13:45 2021-09-11 08:32:00 0:18:15 0:05:04 0:13:11 smithi master centos 7.8 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'Failure object was': {'smithi060.front.sepia.ceph.com': {'changed': False, 'results': ['yum-plugin-priorities-1.1.31-53.el7.noarch providing yum-plugin-priorities is already installed', 'yum-plugin-fastestmirror-1.1.31-53.el7.noarch providing yum-plugin-fastestmirror is already installed', 'redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed', 'sysstat-10.1.5-19.el7.x86_64 providing sysstat is already installed', 'gdb-7.6.1-119.el7.x86_64 providing gdb is already installed', 'git-all-1.8.3.1-22.el7_8.noarch providing git-all is already installed', 'python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed', 'gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed', 'libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed', 'openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed', 'boost-thread-1.53.0-28.el7.x86_64 providing boost-thread is already installed', 'xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed', 'gdisk-0.8.10-3.el7.x86_64 providing gdisk is already installed', 'parted-3.1-32.el7.x86_64 providing parted is already installed', 'libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed', 'fuse-2.9.2-11.el7.x86_64 providing fuse is already installed', 'fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', '1:openssl-1.0.2k-19.el7.x86_64 providing openssl is already installed', 'libuuid-2.23.2-63.el7.x86_64 providing libuuid is already installed', 'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed', 'attr-2.4.46-13.el7.x86_64 providing attr is already installed', '1:valgrind-3.15.0-11.el7.x86_64 providing valgrind is already installed', 'python-nose-1.3.7-1.el7.noarch providing python-nose is already installed', 'mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed', 'podman-1.6.4-16.el7_8.x86_64 providing podman is already installed', 'podman-docker-1.6.4-16.el7_8.noarch providing podman-docker is already installed', 'ant-1.9.4-2.el7.noarch providing ant is already installed', 'iozone-3.424-2_ceph.el7.centos.x86_64 providing iozone is already installed', 'libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed', 'automake-1.13.4-3.el7.noarch providing automake is already installed', 'gettext-0.19.8.1-3.el7.x86_64 providing gettext is already installed', 'libuuid-devel-2.23.2-63.el7.x86_64 providing libuuid-devel is already installed', 'libacl-devel-2.2.51-15.el7.x86_64 providing libacl-devel is already installed', 'bc-1.06.95-13.el7.x86_64 providing bc is already installed', 'xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed', 'xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed', 'blktrace-1.0.5-9.el7.x86_64 providing blktrace is already installed', '1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed', 'python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed', 'usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed', 'genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed', 'httpd-2.4.6-93.el7.centos.x86_64 providing httpd is already installed', 'httpd-devel-2.4.6-93.el7.centos.x86_64 providing httpd-devel is already installed', 'httpd-tools-2.4.6-93.el7.centos.x86_64 providing httpd-tools is already installed', '1:mod_ssl-2.4.6-93.el7.centos.x86_64 providing mod_ssl is already installed', 'libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed', 'perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed', '1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed', 'junit-4.11-8.el7.noarch providing junit4 is already installed', '1:nfs-utils-1.3.0-0.66.el7.x86_64 providing nfs-utils is already installed', 'ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed', 'python-devel-2.7.5-88.el7.x86_64 providing python-devel is already installed', 'python-virtualenv-15.1.0-4.el7_7.noarch providing python-virtualenv is already installed', 'perl-CPAN-1.9800-295.el7.noarch providing perl-CPAN is already installed', 'python3-3.6.8-13.el7.x86_64 providing python3 is already installed', 'Loaded plugins: fastestmirror, langpacks, priorities, product-id, search-\\n : disabled-repos, subscription-manager\\n\\nThis system is not registered with an entitlement server. You can use subscription-manager to register.\\n\\nLoading mirror speeds from cached hostfile\\n * base: nyc.mirrors.clouvider.net\\n * epel: download-cc-rdu01.fedoraproject.org\\n * extras: mirror.ash.fastserv.com\\n * updates: mirrors.advancedhosters.com\\nResolving Dependencies\\n--> Running transaction check\\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\\n---> Package qemu-kvm.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: qemu-img = 10:1.5.3-175.el7_9.4 for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-175.el7_9.4.x86_64\\n--> Running transaction check\\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\\n---> Package qemu-img.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n---> Package qemu-kvm-common.x86_64 10:1.5.3-175.el7_9.4 will be installed\\n--> Running transaction check\\n---> Package boost-random.x86_64 0:1.53.0-28.el7 will be installed\\n--> Finished Dependency Resolution\\n\\nDependencies Resolved\\n\\n================================================================================\\n Package Arch Version Repository Size\\n================================================================================\\nInstalling:\\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\\n qemu-kvm x86_64 10:1.5.3-175.el7_9.4 updates 1.9 M\\nInstalling for dependencies:\\n boost-random x86_64 1.53.0-28.el7 base 39 k\\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\\n qemu-img x86_64 10:1.5.3-175.el7_9.4 updates 705 k\\n qemu-kvm-common x86_64 10:1.5.3-175.el7_9.4 updates 440 k\\n\\nTransaction Summary\\n================================================================================\\nInstall 2 Packages (+5 Dependent packages)\\n\\nTotal download size: 7.3 M\\nInstalled size: 22 M\\nDownloading packages:\\n'], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'present', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['@core', '@base', 'yum-plugin-priorities', 'yum-plugin-fastestmirror', 'redhat-lsb', 'sysstat', 'gdb', 'git-all', 'python-configobj', 'gcc-c++', 'libedit', 'openssl098e', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse', 'fuse-libs', 'python-virtualenv', 'openssl', 'libuuid', 'btrfs-progs', 'attr', 'valgrind', 'python-nose', 'mpich', 'podman', 'podman-docker', 'ant', 'iozone', 'libtool', 'automake', 'gettext', 'libuuid-devel', 'libacl-devel', 'bc', 'xfsdump', 'xfsprogs-devel', 'blktrace', 'numpy', 'python-matplotlib', 'qemu-kvm', 'usbredir', 'genisoimage', 'httpd', 'httpd-devel', 'httpd-tools', 'mod_ssl', 'mod_fastcgi-2.4.7-1.ceph.el7.centos', 'libev-devel', 'perl-XML-Twig', 'java-1.6.0-openjdk-devel', 'junit4', 'nfs-utils', 'ncurses-devel', 'python-devel', 'python-virtualenv', 'perl-CPAN', 'python3'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': [], 'security': False, 'validate_certs': True}}, 'changes': {'installed': ['qemu-kvm', 'mod_fastcgi-2.4.7-1.ceph.el7.centos']}, 'msg': "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\nTo address this issue please refer to the below wiki article\n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/x86_64/mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64.rpm: [Errno 14] HTTP Error 403 - Forbidden\nTrying other mirror.\n\n\nError downloading packages:\n mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64: [Errno 256] No more mirrors to try.\n\n", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'changed')"}