Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6480720 2021-11-03 08:32:08 2021-11-03 09:50:27 2021-11-03 10:17:40 0:27:13 0:20:07 0:07:06 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6480721 2021-11-03 08:32:08 2021-11-03 09:50:58 2021-11-03 10:14:59 0:24:01 0:13:09 0:10:52 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6480722 2021-11-03 08:32:09 2021-11-03 09:52:19 2021-11-03 10:20:38 0:28:19 0:19:35 0:08:44 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 6480723 2021-11-03 08:32:10 2021-11-03 09:55:20 2021-11-03 10:54:59 0:59:39 0:48:54 0:10:45 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6480724 2021-11-03 08:32:11 2021-11-03 09:55:30 2021-11-03 10:32:16 0:36:46 0:29:03 0:07:43 smithi master centos 8.3 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} 1
dead 6480725 2021-11-03 08:32:12 2021-11-03 09:55:30 2021-11-03 10:10:31 0:15:01 0:04:21 0:10:40 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} 1
Failure Reason:

{'Failure object was': {'smithi150.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6480726 2021-11-03 08:32:13 2021-11-03 09:56:21 2021-11-03 10:15:47 0:19:26 0:11:01 0:08:25 smithi master centos 8.3 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6480727 2021-11-03 08:32:14 2021-11-03 09:56:21 2021-11-03 10:41:47 0:45:26 0:38:47 0:06:39 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6480728 2021-11-03 08:32:15 2021-11-03 09:56:31 2021-11-03 10:36:41 0:40:10 0:35:21 0:04:49 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 6480729 2021-11-03 08:32:16 2021-11-03 09:56:31 2021-11-03 10:22:29 0:25:58 0:18:53 0:07:05 smithi master rhel 8.4 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
pass 6480730 2021-11-03 08:32:17 2021-11-03 09:57:12 2021-11-03 10:22:40 0:25:28 0:19:37 0:05:51 smithi master rhel 8.4 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
dead 6480731 2021-11-03 08:32:18 2021-11-03 09:57:12 2021-11-03 10:14:03 0:16:51 0:04:20 0:12:31 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
Failure Reason:

{'Failure object was': {'smithi197.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6480732 2021-11-03 08:32:19 2021-11-03 10:00:03 2021-11-03 10:45:24 0:45:21 0:39:09 0:06:12 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
dead 6480733 2021-11-03 08:32:20 2021-11-03 10:00:23 2021-11-03 10:17:04 0:16:41 0:04:20 0:12:21 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

{'Failure object was': {'smithi196.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

dead 6480734 2021-11-03 08:32:21 2021-11-03 10:01:04 2021-11-03 10:17:12 0:16:08 0:04:20 0:11:48 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
Failure Reason:

{'Failure object was': {'smithi093.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6480735 2021-11-03 08:32:22 2021-11-03 10:01:04 2021-11-03 10:23:01 0:21:57 0:13:05 0:08:52 smithi master centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6480736 2021-11-03 08:32:23 2021-11-03 10:01:04 2021-11-03 10:23:52 0:22:48 0:13:30 0:09:18 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} 1
dead 6480737 2021-11-03 08:32:24 2021-11-03 10:01:05 2021-11-03 10:15:56 0:14:51 0:04:21 0:10:30 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'Failure object was': {'smithi167.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6480738 2021-11-03 08:32:25 2021-11-03 10:01:45 2021-11-03 10:39:27 0:37:42 0:30:35 0:07:07 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
dead 6480739 2021-11-03 08:32:26 2021-11-03 10:01:45 2021-11-03 10:18:02 0:16:17 0:04:21 0:11:56 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/insights} 2
Failure Reason:

{'Failure object was': {'smithi089.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6480740 2021-11-03 08:32:27 2021-11-03 10:01:56 2021-11-03 11:00:07 0:58:11 0:46:08 0:12:03 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 6480741 2021-11-03 08:32:28 2021-11-03 10:04:47 2021-11-03 10:52:46 0:47:59 0:40:38 0:07:21 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6480742 2021-11-03 08:32:29 2021-11-03 10:05:17 2021-11-03 10:50:15 0:44:58 0:33:23 0:11:35 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6480743 2021-11-03 08:32:30 2021-11-03 10:06:48 2021-11-03 10:28:23 0:21:35 0:08:46 0:12:49 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

Command failed on smithi102 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 18071d68-3c90-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6480744 2021-11-03 08:32:31 2021-11-03 10:09:08 2021-11-03 10:40:06 0:30:58 0:16:05 0:14:53 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.0} 3
pass 6480745 2021-11-03 08:32:32 2021-11-03 10:10:49 2021-11-03 10:53:47 0:42:58 0:32:03 0:10:55 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6480746 2021-11-03 08:32:33 2021-11-03 10:12:19 2021-11-03 11:03:48 0:51:29 0:40:59 0:10:30 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} 2
pass 6480747 2021-11-03 08:32:34 2021-11-03 10:12:20 2021-11-03 10:37:17 0:24:57 0:17:37 0:07:20 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6480748 2021-11-03 08:32:35 2021-11-03 10:14:00 2021-11-03 10:59:53 0:45:53 0:35:46 0:10:07 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/snaps-few-objects} 2
pass 6480749 2021-11-03 08:32:35 2021-11-03 10:14:10 2021-11-03 10:54:29 0:40:19 0:28:16 0:12:03 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 6480750 2021-11-03 08:32:36 2021-11-03 10:15:01 2021-11-03 10:48:17 0:33:16 0:23:31 0:09:45 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6480751 2021-11-03 08:32:37 2021-11-03 10:15:01 2021-11-03 10:52:20 0:37:19 0:30:36 0:06:43 smithi master rhel 8.4 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6480752 2021-11-03 08:32:38 2021-11-03 10:15:02 2021-11-03 11:52:52 1:37:50 1:30:08 0:07:42 smithi master rhel 8.4 rados/upgrade/parallel/{0-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6480753 2021-11-03 08:32:39 2021-11-03 10:15:52 2021-11-03 10:45:32 0:29:40 0:23:10 0:06:30 smithi master rhel 8.4 rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6480754 2021-11-03 08:32:40 2021-11-03 10:16:02 2021-11-03 10:40:30 0:24:28 0:13:04 0:11:24 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6480755 2021-11-03 08:32:41 2021-11-03 10:17:03 2021-11-03 11:26:50 1:09:47 0:58:43 0:11:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6480756 2021-11-03 08:32:42 2021-11-03 10:17:13 2021-11-03 10:47:10 0:29:57 0:22:51 0:07:06 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480757 2021-11-03 08:32:43 2021-11-03 10:17:44 2021-11-03 10:59:00 0:41:16 0:31:14 0:10:02 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6480758 2021-11-03 08:32:44 2021-11-03 10:17:44 2021-11-03 10:41:38 0:23:54 0:12:26 0:11:28 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} tasks/rados_striper} 2
pass 6480759 2021-11-03 08:32:45 2021-11-03 10:18:05 2021-11-03 11:08:27 0:50:22 0:38:38 0:11:44 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
pass 6480760 2021-11-03 08:32:46 2021-11-03 10:18:15 2021-11-03 10:40:52 0:22:37 0:12:29 0:10:08 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6480761 2021-11-03 08:32:47 2021-11-03 10:18:35 2021-11-03 11:26:23 1:07:48 0:58:41 0:09:07 smithi master ubuntu 20.04 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480762 2021-11-03 08:32:48 2021-11-03 10:18:36 2021-11-03 10:38:46 0:20:10 0:08:21 0:11:49 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
dead 6480763 2021-11-03 08:32:49 2021-11-03 10:20:46 2021-11-03 22:31:45 12:10:59 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6480764 2021-11-03 08:32:50 2021-11-03 10:21:47 2021-11-03 10:59:45 0:37:58 0:28:03 0:09:55 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6480765 2021-11-03 08:32:51 2021-11-03 10:22:27 2021-11-03 11:34:04 1:11:37 1:00:58 0:10:39 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 6480766 2021-11-03 08:32:52 2021-11-03 10:22:37 2021-11-03 10:45:53 0:23:16 0:13:46 0:09:30 smithi master centos 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 6480767 2021-11-03 08:32:53 2021-11-03 10:22:38 2021-11-03 10:45:30 0:22:52 0:11:27 0:11:25 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 6480768 2021-11-03 08:32:54 2021-11-03 10:22:48 2021-11-03 10:49:10 0:26:22 0:19:06 0:07:16 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 3
pass 6480769 2021-11-03 08:32:55 2021-11-03 10:23:28 2021-11-03 11:30:55 1:07:27 1:01:06 0:06:21 smithi master rhel 8.4 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
fail 6480770 2021-11-03 08:32:56 2021-11-03 10:23:29 2021-11-03 10:43:51 0:20:22 0:08:47 0:11:35 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi165 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 68709098-3c92-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6480771 2021-11-03 08:32:57 2021-11-03 10:24:09 2021-11-03 10:55:36 0:31:27 0:23:53 0:07:34 smithi master rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6480772 2021-11-03 08:32:58 2021-11-03 10:24:09 2021-11-03 11:44:15 1:20:06 1:10:47 0:09:19 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/mon} 1
pass 6480773 2021-11-03 08:32:59 2021-11-03 10:24:50 2021-11-03 10:48:02 0:23:12 0:16:17 0:06:55 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 6480774 2021-11-03 08:33:00 2021-11-03 10:24:50 2021-11-03 10:59:43 0:34:53 0:21:04 0:13:49 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 6480775 2021-11-03 08:33:00 2021-11-03 10:29:25 2021-11-03 10:51:36 0:22:11 0:10:32 0:11:39 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_adoption} 1
pass 6480776 2021-11-03 08:33:01 2021-11-03 10:32:26 2021-11-03 11:23:26 0:51:00 0:40:41 0:10:19 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/module_selftest} 2
pass 6480777 2021-11-03 08:33:02 2021-11-03 10:35:57 2021-11-03 11:09:44 0:33:47 0:23:33 0:10:14 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 6480778 2021-11-03 08:33:03 2021-11-03 10:36:47 2021-11-03 11:00:35 0:23:48 0:13:31 0:10:17 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/redirect} 2
pass 6480779 2021-11-03 08:33:04 2021-11-03 10:37:17 2021-11-03 11:24:30 0:47:13 0:38:29 0:08:44 smithi master centos 8.3 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6480780 2021-11-03 08:33:05 2021-11-03 10:37:18 2021-11-03 11:05:01 0:27:43 0:20:31 0:07:12 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6480781 2021-11-03 08:33:06 2021-11-03 10:37:28 2021-11-03 11:02:00 0:24:32 0:11:20 0:13:12 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6480782 2021-11-03 08:33:07 2021-11-03 10:38:49 2021-11-03 11:16:41 0:37:52 0:26:46 0:11:06 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6480783 2021-11-03 08:33:08 2021-11-03 10:39:29 2021-11-03 10:58:29 0:19:00 0:07:46 0:11:14 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480784 2021-11-03 08:33:09 2021-11-03 10:39:49 2021-11-03 11:04:07 0:24:18 0:16:46 0:07:32 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6480785 2021-11-03 08:33:10 2021-11-03 10:40:10 2021-11-03 11:15:22 0:35:12 0:25:11 0:10:01 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} 2
pass 6480786 2021-11-03 08:33:11 2021-11-03 10:40:10 2021-11-03 11:22:28 0:42:18 0:30:36 0:11:42 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} 2
pass 6480787 2021-11-03 08:33:12 2021-11-03 10:40:30 2021-11-03 11:02:57 0:22:27 0:11:31 0:10:56 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6480788 2021-11-03 08:33:13 2021-11-03 10:41:01 2021-11-03 11:15:31 0:34:30 0:22:07 0:12:23 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6480789 2021-11-03 08:33:14 2021-11-03 10:41:01 2021-11-03 11:07:05 0:26:04 0:18:52 0:07:12 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6480790 2021-11-03 08:33:15 2021-11-03 10:41:42 2021-11-03 11:07:04 0:25:22 0:15:35 0:09:47 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} 2
pass 6480791 2021-11-03 08:33:16 2021-11-03 10:41:52 2021-11-03 11:08:04 0:26:12 0:15:25 0:10:47 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6480792 2021-11-03 08:33:16 2021-11-03 10:42:52 2021-11-03 11:02:47 0:19:55 0:10:57 0:08:58 smithi master centos 8.stream rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
pass 6480793 2021-11-03 08:33:17 2021-11-03 10:43:53 2021-11-03 11:12:48 0:28:55 0:16:31 0:12:24 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6480794 2021-11-03 08:33:18 2021-11-03 10:45:33 2021-11-03 11:13:46 0:28:13 0:13:57 0:14:16 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480795 2021-11-03 08:33:19 2021-11-03 10:45:34 2021-11-03 11:02:53 0:17:19 0:08:35 0:08:44 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6480796 2021-11-03 08:33:20 2021-11-03 10:45:44 2021-11-03 11:10:40 0:24:56 0:15:54 0:09:02 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 6480797 2021-11-03 08:33:21 2021-11-03 10:45:44 2021-11-03 11:34:40 0:48:56 0:37:36 0:11:20 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6480798 2021-11-03 08:33:22 2021-11-03 10:47:15 2021-11-03 11:22:27 0:35:12 0:23:39 0:11:33 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 6480799 2021-11-03 08:33:23 2021-11-03 10:47:15 2021-11-03 11:10:01 0:22:46 0:10:11 0:12:35 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 6480800 2021-11-03 08:33:24 2021-11-03 10:48:05 2021-11-03 11:21:29 0:33:24 0:24:24 0:09:00 smithi master centos 8.3 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} 1
pass 6480801 2021-11-03 08:33:25 2021-11-03 10:48:26 2021-11-03 11:16:34 0:28:08 0:14:32 0:13:36 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6480802 2021-11-03 08:33:26 2021-11-03 10:49:16 2021-11-03 11:06:57 0:17:41 0:07:50 0:09:51 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480803 2021-11-03 08:33:27 2021-11-03 10:49:16 2021-11-03 11:14:23 0:25:07 0:12:40 0:12:27 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 6480804 2021-11-03 08:33:28 2021-11-03 10:50:17 2021-11-03 11:17:44 0:27:27 0:14:08 0:13:19 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6480805 2021-11-03 08:33:29 2021-11-03 10:51:37 2021-11-03 11:15:49 0:24:12 0:12:47 0:11:25 smithi master centos 8.stream rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 2
pass 6480806 2021-11-03 08:33:29 2021-11-03 10:52:38 2021-11-03 11:34:46 0:42:08 0:30:13 0:11:55 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6480807 2021-11-03 08:33:30 2021-11-03 10:52:48 2021-11-03 11:16:15 0:23:27 0:10:11 0:13:16 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 2
dead 6480808 2021-11-03 08:33:31 2021-11-03 10:53:49 2021-11-03 23:05:54 12:12:05 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6480809 2021-11-03 08:33:32 2021-11-03 10:54:39 2021-11-03 11:15:19 0:20:40 0:10:01 0:10:39 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6480810 2021-11-03 08:33:33 2021-11-03 10:55:09 2021-11-03 11:14:35 0:19:26 0:10:19 0:09:07 smithi master centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6480811 2021-11-03 08:33:34 2021-11-03 10:55:10 2021-11-03 15:27:14 4:32:04 4:22:20 0:09:44 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} 1
pass 6480812 2021-11-03 08:33:35 2021-11-03 10:55:40 2021-11-03 11:32:32 0:36:52 0:27:15 0:09:37 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6480813 2021-11-03 08:33:36 2021-11-03 10:57:21 2021-11-03 11:30:43 0:33:22 0:20:38 0:12:44 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} 2
pass 6480814 2021-11-03 08:33:37 2021-11-03 10:58:31 2021-11-03 11:22:13 0:23:42 0:12:41 0:11:01 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6480815 2021-11-03 08:33:38 2021-11-03 10:59:01 2021-11-03 11:32:44 0:33:43 0:22:21 0:11:22 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/progress} 2
pass 6480816 2021-11-03 08:33:39 2021-11-03 10:59:12 2021-11-03 11:33:02 0:33:50 0:25:58 0:07:52 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 6480817 2021-11-03 08:33:40 2021-11-03 10:59:42 2021-11-03 11:41:21 0:41:39 0:31:00 0:10:39 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6480818 2021-11-03 08:33:41 2021-11-03 10:59:53 2021-11-03 11:25:15 0:25:22 0:18:32 0:06:50 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6480819 2021-11-03 08:33:42 2021-11-03 10:59:53 2021-11-03 11:39:37 0:39:44 0:28:08 0:11:36 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6480820 2021-11-03 08:33:43 2021-11-03 11:00:03 2021-11-03 11:35:16 0:35:13 0:25:57 0:09:16 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6480821 2021-11-03 08:33:44 2021-11-03 11:00:04 2021-11-03 11:19:40 0:19:36 0:10:04 0:09:32 smithi master centos 8.stream rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6480822 2021-11-03 08:33:45 2021-11-03 11:00:14 2021-11-03 11:17:10 0:16:56 0:07:15 0:09:41 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 6480823 2021-11-03 08:33:45 2021-11-03 11:00:14 2021-11-03 13:26:20 2:26:06 2:14:32 0:11:34 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} 2
pass 6480824 2021-11-03 08:33:46 2021-11-03 11:00:45 2021-11-03 11:25:16 0:24:31 0:12:38 0:11:53 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6480825 2021-11-03 08:33:47 2021-11-03 11:02:05 2021-11-03 11:20:02 0:17:57 0:07:45 0:10:12 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480826 2021-11-03 08:33:48 2021-11-03 11:02:05 2021-11-03 11:23:24 0:21:19 0:09:20 0:11:59 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} 2
pass 6480827 2021-11-03 08:33:49 2021-11-03 11:02:56 2021-11-03 11:49:24 0:46:28 0:35:06 0:11:22 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6480828 2021-11-03 08:33:50 2021-11-03 11:03:56 2021-11-03 11:38:57 0:35:01 0:22:39 0:12:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 6480829 2021-11-03 08:33:51 2021-11-03 11:04:17 2021-11-03 11:30:54 0:26:37 0:12:11 0:14:26 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480830 2021-11-03 08:33:52 2021-11-03 11:05:07 2021-11-03 11:52:26 0:47:19 0:36:03 0:11:16 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 6480831 2021-11-03 08:33:53 2021-11-03 11:06:58 2021-11-03 11:38:17 0:31:19 0:25:32 0:05:47 smithi master rhel 8.4 rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6480832 2021-11-03 08:33:54 2021-11-03 11:07:08 2021-11-03 11:50:32 0:43:24 0:33:01 0:10:23 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
pass 6480833 2021-11-03 08:33:55 2021-11-03 11:07:08 2021-11-03 11:43:25 0:36:17 0:26:12 0:10:05 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6480834 2021-11-03 08:33:56 2021-11-03 11:08:09 2021-11-03 11:27:35 0:19:26 0:10:42 0:08:44 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6480835 2021-11-03 08:33:57 2021-11-03 11:08:29 2021-11-03 11:32:46 0:24:17 0:13:34 0:10:43 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6480836 2021-11-03 08:33:58 2021-11-03 11:09:50 2021-11-03 13:48:10 2:38:20 2:15:32 0:22:48 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} 1
pass 6480837 2021-11-03 08:33:59 2021-11-03 11:09:50 2021-11-03 11:50:20 0:40:30 0:29:38 0:10:52 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480838 2021-11-03 08:34:00 2021-11-03 11:10:10 2021-11-03 11:29:36 0:19:26 0:10:47 0:08:39 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6480839 2021-11-03 08:34:01 2021-11-03 11:10:11 2021-11-03 11:36:32 0:26:21 0:17:17 0:09:04 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6480840 2021-11-03 08:34:02 2021-11-03 11:52:46 1792 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} 1
pass 6480841 2021-11-03 08:34:03 2021-11-03 11:12:51 2021-11-03 11:53:35 0:40:44 0:27:21 0:13:23 smithi master centos 8.3 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 2
pass 6480842 2021-11-03 08:34:04 2021-11-03 11:13:52 2021-11-03 11:47:21 0:33:29 0:23:47 0:09:42 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6480843 2021-11-03 08:34:05 2021-11-03 11:13:52 2021-11-03 11:46:04 0:32:12 0:22:23 0:09:49 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 6480844 2021-11-03 08:34:05 2021-11-03 11:14:33 2021-11-03 11:42:34 0:28:01 0:20:14 0:07:47 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
pass 6480845 2021-11-03 08:34:06 2021-11-03 11:15:23 2021-11-03 11:56:52 0:41:29 0:29:44 0:11:45 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6480846 2021-11-03 08:34:07 2021-11-03 11:15:24 2021-11-03 11:33:24 0:18:00 0:06:55 0:11:05 smithi master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
fail 6480847 2021-11-03 08:34:08 2021-11-03 11:15:24 2021-11-03 11:45:01 0:29:37 0:18:53 0:10:44 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6480848 2021-11-03 08:34:09 2021-11-03 11:15:34 2021-11-03 11:43:06 0:27:32 0:19:54 0:07:38 smithi master rhel 8.4 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6480849 2021-11-03 08:34:10 2021-11-03 11:15:55 2021-11-03 11:47:11 0:31:16 0:22:42 0:08:34 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
fail 6480850 2021-11-03 08:34:11 2021-11-03 11:15:55 2021-11-03 11:34:21 0:18:26 0:09:27 0:08:59 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi045 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6cdff1e4-3c99-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6480851 2021-11-03 08:34:12 2021-11-03 11:16:05 2021-11-03 11:51:58 0:35:53 0:29:20 0:06:33 smithi master rhel 8.4 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6480852 2021-11-03 08:34:13 2021-11-03 11:16:15 2021-11-03 11:46:21 0:30:06 0:23:14 0:06:52 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 6480853 2021-11-03 08:34:14 2021-11-03 11:16:36 2021-11-03 11:56:44 0:40:08 0:29:38 0:10:30 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6480854 2021-11-03 08:34:15 2021-11-03 11:16:46 2021-11-03 11:56:28 0:39:42 0:32:07 0:07:35 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} 2
pass 6480855 2021-11-03 08:34:16 2021-11-03 11:17:17 2021-11-03 11:42:58 0:25:41 0:18:42 0:06:59 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6480856 2021-11-03 08:34:17 2021-11-03 11:17:47 2021-11-03 12:01:00 0:43:13 0:37:25 0:05:48 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6480857 2021-11-03 08:34:18 2021-11-03 11:17:47 2021-11-03 11:46:59 0:29:12 0:20:44 0:08:28 smithi master rhel 8.4 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6480858 2021-11-03 08:34:19 2021-11-03 11:19:48 2021-11-03 14:43:36 3:23:48 3:13:27 0:10:21 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/osd} 1
pass 6480859 2021-11-03 08:34:20 2021-11-03 11:20:08 2021-11-03 11:51:30 0:31:22 0:21:43 0:09:39 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6480860 2021-11-03 08:34:21 2021-11-03 11:22:19 2021-11-03 12:00:31 0:38:12 0:25:28 0:12:44 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6480861 2021-11-03 08:34:22 2021-11-03 11:22:29 2021-11-03 12:29:59 1:07:30 0:56:48 0:10:42 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6480862 2021-11-03 08:34:23 2021-11-03 11:22:30 2021-11-03 11:46:28 0:23:58 0:11:34 0:12:24 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} 2
pass 6480863 2021-11-03 08:34:24 2021-11-03 11:23:30 2021-11-03 12:02:59 0:39:29 0:33:35 0:05:54 smithi master rhel 8.4 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6480864 2021-11-03 08:34:25 2021-11-03 11:23:30 2021-11-03 12:05:07 0:41:37 0:35:31 0:06:06 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 6480865 2021-11-03 08:34:26 2021-11-03 11:23:41 2021-11-03 12:05:39 0:41:58 0:29:56 0:12:02 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/force-sync-many workloads/rados_api_tests} 2
dead 6480866 2021-11-03 08:34:27 2021-11-03 11:24:01 2021-11-03 23:36:49 12:12:48 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6480867 2021-11-03 08:34:28 2021-11-03 11:25:22 2021-11-03 11:49:18 0:23:56 0:11:27 0:12:29 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6480868 2021-11-03 08:34:29 2021-11-03 11:25:22 2021-11-03 12:06:50 0:41:28 0:29:28 0:12:00 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6480869 2021-11-03 08:34:30 2021-11-03 11:25:23 2021-11-03 11:52:20 0:26:57 0:13:19 0:13:38 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480870 2021-11-03 08:34:31 2021-11-03 11:26:53 2021-11-03 11:49:49 0:22:56 0:14:19 0:08:37 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6480871 2021-11-03 08:34:31 2021-11-03 11:26:53 2021-11-03 11:52:55 0:26:02 0:15:08 0:10:54 smithi master centos 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 6480872 2021-11-03 08:34:32 2021-11-03 11:27:44 2021-11-03 11:50:55 0:23:11 0:11:56 0:11:15 smithi master centos 8.stream rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 2
pass 6480873 2021-11-03 08:34:33 2021-11-03 11:29:45 2021-11-03 11:54:08 0:24:23 0:16:31 0:07:52 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 6480874 2021-11-03 08:34:34 2021-11-03 11:30:45 2021-11-03 14:16:24 2:45:39 2:14:36 0:31:03 smithi master centos 8.3 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} 1
pass 6480875 2021-11-03 08:34:35 2021-11-03 11:30:45 2021-11-03 11:52:06 0:21:21 0:15:40 0:05:41 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 6480876 2021-11-03 08:34:36 2021-11-03 11:30:56 2021-11-03 11:59:40 0:28:44 0:17:17 0:11:27 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6480877 2021-11-03 08:34:37 2021-11-03 11:30:56 2021-11-03 11:55:47 0:24:51 0:17:32 0:07:19 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6480878 2021-11-03 08:34:38 2021-11-03 11:32:37 2021-11-03 11:57:43 0:25:06 0:15:49 0:09:17 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6480879 2021-11-03 08:34:39 2021-11-03 11:32:47 2021-11-03 12:13:57 0:41:10 0:31:01 0:10:09 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6480880 2021-11-03 08:34:40 2021-11-03 11:32:47 2021-11-03 12:02:54 0:30:07 0:18:09 0:11:58 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6480881 2021-11-03 08:34:41 2021-11-03 11:33:08 2021-11-03 11:52:34 0:19:26 0:10:31 0:08:55 smithi master centos 8.3 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6480882 2021-11-03 08:34:42 2021-11-03 11:33:08 2021-11-03 11:54:33 0:21:25 0:13:08 0:08:17 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 6480883 2021-11-03 08:34:43 2021-11-03 11:33:28 2021-11-03 11:54:05 0:20:37 0:07:14 0:13:23 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
fail 6480884 2021-11-03 08:34:44 2021-11-03 11:34:09 2021-11-03 12:04:16 0:30:07 0:17:48 0:12:19 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

No module named 'tasks.thrashosds'

pass 6480885 2021-11-03 08:34:45 2021-11-03 11:34:49 2021-11-03 12:02:05 0:27:16 0:17:19 0:09:57 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6480886 2021-11-03 08:34:46 2021-11-03 11:34:49 2021-11-03 11:56:35 0:21:46 0:11:19 0:10:27 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} tasks/workunits} 2
pass 6480887 2021-11-03 08:34:47 2021-11-03 11:35:20 2021-11-03 12:14:08 0:38:48 0:26:48 0:12:00 smithi master centos 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} 2
fail 6480888 2021-11-03 08:34:48 2021-11-03 11:36:40 2021-11-03 12:05:47 0:29:07 0:17:27 0:11:40 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

No module named 'tasks.thrashosds'

pass 6480889 2021-11-03 08:34:49 2021-11-03 11:38:21 2021-11-03 12:19:27 0:41:06 0:28:44 0:12:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
fail 6480890 2021-11-03 08:34:50 2021-11-03 11:39:01 2021-11-03 12:04:52 0:25:51 0:17:51 0:08:00 smithi master rhel 8.4 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

No module named 'tasks.ceph'

pass 6480891 2021-11-03 08:34:51 2021-11-03 11:39:42 2021-11-03 12:02:10 0:22:28 0:11:25 0:11:03 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
fail 6480892 2021-11-03 08:34:52 2021-11-03 11:39:42 2021-11-03 12:08:48 0:29:06 0:19:32 0:09:34 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

No module named 'tasks.cephadm'

pass 6480893 2021-11-03 08:34:53 2021-11-03 11:41:23 2021-11-03 12:16:25 0:35:02 0:23:05 0:11:57 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 6480894 2021-11-03 08:34:54 2021-11-03 11:42:43 2021-11-03 12:02:15 0:19:32 0:08:49 0:10:43 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
Failure Reason:

No module named 'tasks.thrashosds'

fail 6480895 2021-11-03 08:34:55 2021-11-03 11:43:03 2021-11-03 12:02:49 0:19:46 0:07:47 0:11:59 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

No module named 'tasks.ceph'

fail 6480896 2021-11-03 08:34:56 2021-11-03 11:43:34 2021-11-03 12:03:49 0:20:15 0:09:05 0:11:10 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

No module named 'tasks.ceph'

pass 6480897 2021-11-03 08:34:57 2021-11-03 11:44:24 2021-11-03 12:24:21 0:39:57 0:29:12 0:10:45 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 6480898 2021-11-03 08:34:58 2021-11-03 11:45:05 2021-11-03 12:13:17 0:28:12 0:17:27 0:10:45 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

No module named 'tasks.ceph'

fail 6480899 2021-11-03 08:34:59 2021-11-03 11:46:05 2021-11-03 12:04:06 0:18:01 0:05:52 0:12:09 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

No module named 'tasks.nvme_loop'

fail 6480900 2021-11-03 08:35:00 2021-11-03 11:46:26 2021-11-03 12:03:57 0:17:31 0:07:42 0:09:49 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
Failure Reason:

Command failed on smithi161 with status 1: 'sudo yum -y install cephfs-java'

fail 6480901 2021-11-03 08:35:01 2021-11-03 11:46:36 2021-11-03 12:02:32 0:15:56 0:05:38 0:10:18 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
Failure Reason:

No module named 'tasks.workunit'

fail 6480902 2021-11-03 08:35:02 2021-11-03 11:46:36 2021-11-03 12:04:27 0:17:51 0:06:31 0:11:20 smithi master centos 8.3 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
Failure Reason:

Command failed on smithi098 with status 1: 'sudo yum -y install cephfs-java'

fail 6480903 2021-11-03 08:35:03 2021-11-03 11:47:17 2021-11-03 12:05:42 0:18:25 0:06:49 0:11:36 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

Command failed on smithi110 with status 1: 'sudo yum -y install cephfs-java'

pass 6480904 2021-11-03 08:35:04 2021-11-03 14:31:58 2021-11-03 15:10:41 0:38:43 0:27:25 0:11:18 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6480905 2021-11-03 08:35:05 2021-11-03 14:32:59 2021-11-03 15:03:06 0:30:07 0:22:03 0:08:04 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 6480906 2021-11-03 08:35:06 2021-11-03 14:33:39 2021-11-03 15:00:35 0:26:56 0:14:27 0:12:29 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6480907 2021-11-03 08:35:07 2021-11-03 14:35:30 2021-11-03 15:06:46 0:31:16 0:23:13 0:08:03 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480908 2021-11-03 08:35:08 2021-11-03 14:37:20 2021-11-03 15:02:44 0:25:24 0:17:33 0:07:51 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6480909 2021-11-03 08:35:09 2021-11-03 14:39:21 2021-11-03 15:21:00 0:41:39 0:31:02 0:10:37 smithi master centos 8.stream rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8.stream}} 1
dead 6480910 2021-11-03 08:35:10 2021-11-03 14:39:21 2021-11-04 02:53:07 12:13:46 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6480911 2021-11-03 08:35:11 2021-11-03 14:41:02 2021-11-03 15:02:37 0:21:35 0:10:48 0:10:47 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6480912 2021-11-03 08:35:12 2021-11-03 14:43:42 2021-11-03 15:27:54 0:44:12 0:33:32 0:10:40 smithi master centos 8.stream rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 2
pass 6480913 2021-11-03 08:35:13 2021-11-03 14:44:23 2021-11-03 15:10:48 0:26:25 0:14:59 0:11:26 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6480914 2021-11-03 08:35:14 2021-11-03 14:45:33 2021-11-03 15:04:56 0:19:23 0:10:12 0:09:11 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 6480915 2021-11-03 08:35:15 2021-11-03 14:45:53 2021-11-03 15:14:10 0:28:17 0:14:58 0:13:19 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6480916 2021-11-03 08:35:16 2021-11-03 14:48:14 2021-11-03 15:13:39 0:25:25 0:17:05 0:08:20 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6480917 2021-11-03 08:35:17 2021-11-03 14:50:25 2021-11-03 15:11:50 0:21:25 0:11:47 0:09:38 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6480918 2021-11-03 08:35:18 2021-11-03 14:50:25 2021-11-03 15:50:00 0:59:35 0:52:53 0:06:42 smithi master rhel 8.4 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6480919 2021-11-03 08:35:19 2021-11-03 14:50:55 2021-11-03 15:40:34 0:49:39 0:36:48 0:12:51 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 6480920 2021-11-03 08:35:20 2021-11-03 15:40:37 2021-11-03 16:11:59 0:31:22 0:20:24 0:10:58 smithi master centos 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 6480921 2021-11-03 08:35:21 2021-11-03 15:40:48 2021-11-03 16:19:57 0:39:09 0:26:00 0:13:09 smithi master centos 8.stream rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 3
pass 6480922 2021-11-03 08:35:22 2021-11-03 15:42:58 2021-11-03 16:21:26 0:38:28 0:26:23 0:12:05 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 6480923 2021-11-03 08:35:23 2021-11-03 15:43:08 2021-11-03 16:06:47 0:23:39 0:13:42 0:09:57 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8.stream} tasks/crash} 2
pass 6480924 2021-11-03 08:35:24 2021-11-03 15:43:29 2021-11-03 16:11:07 0:27:38 0:20:42 0:06:56 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6480925 2021-11-03 08:35:25 2021-11-03 15:43:39 2021-11-03 16:08:14 0:24:35 0:13:06 0:11:29 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 6480926 2021-11-03 08:35:26 2021-11-03 15:43:49 2021-11-03 16:27:00 0:43:11 0:29:25 0:13:46 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480927 2021-11-03 08:35:27 2021-11-03 15:47:30 2021-11-03 16:14:07 0:26:37 0:14:17 0:12:20 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6480928 2021-11-03 08:35:28 2021-11-03 15:48:11 2021-11-03 16:33:42 0:45:31 0:38:26 0:07:05 smithi master rhel 8.4 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6480929 2021-11-03 08:35:29 2021-11-03 15:48:31 2021-11-03 16:08:21 0:19:50 0:09:44 0:10:06 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480930 2021-11-03 08:35:30 2021-11-03 15:48:51 2021-11-03 16:11:28 0:22:37 0:10:13 0:12:24 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 6480931 2021-11-03 08:35:31 2021-11-03 15:49:32 2021-11-03 18:35:21 2:45:49 2:39:32 0:06:17 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 6480932 2021-11-03 08:35:32 2021-11-03 15:49:52 2021-11-03 16:15:41 0:25:49 0:15:19 0:10:30 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6480933 2021-11-03 08:35:33 2021-11-03 15:50:02 2021-11-03 16:21:31 0:31:29 0:22:08 0:09:21 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6480934 2021-11-03 08:35:34 2021-11-03 15:51:53 2021-11-03 16:29:41 0:37:48 0:28:09 0:09:39 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6480935 2021-11-03 08:35:35 2021-11-03 15:52:13 2021-11-03 16:20:15 0:28:02 0:16:49 0:11:13 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} 2
pass 6480936 2021-11-03 08:35:36 2021-11-03 15:52:34 2021-11-03 16:21:24 0:28:50 0:16:00 0:12:50 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/host rook/1.7.0} 3
pass 6480937 2021-11-03 08:35:37 2021-11-03 15:53:14 2021-11-03 16:16:25 0:23:11 0:15:02 0:08:09 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} 1
pass 6480938 2021-11-03 08:35:38 2021-11-03 15:53:15 2021-11-03 16:22:41 0:29:26 0:16:24 0:13:02 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6480939 2021-11-03 08:35:39 2021-11-03 15:54:45 2021-11-03 16:25:17 0:30:32 0:20:04 0:10:28 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} 2
pass 6480940 2021-11-03 08:35:40 2021-11-03 15:56:06 2021-11-03 16:29:36 0:33:30 0:27:38 0:05:52 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 6480941 2021-11-03 08:35:41 2021-11-03 15:56:26 2021-11-03 16:40:20 0:43:54 0:32:00 0:11:54 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 6480942 2021-11-03 08:35:42 2021-11-03 15:56:36 2021-11-03 16:13:51 0:17:15 0:08:58 0:08:17 smithi master centos 8.3 rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6480943 2021-11-03 08:35:43 2021-11-03 15:56:37 2021-11-03 16:25:55 0:29:18 0:13:51 0:15:27 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 6480944 2021-11-03 08:35:44 2021-11-03 16:00:28 2021-11-03 16:34:10 0:33:42 0:23:29 0:10:13 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6480945 2021-11-03 08:35:45 2021-11-03 16:00:58 2021-11-03 16:26:09 0:25:11 0:19:44 0:05:27 smithi master rhel 8.4 rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} 1
pass 6480946 2021-11-03 08:35:46 2021-11-03 16:00:58 2021-11-03 16:22:59 0:22:01 0:11:13 0:10:48 smithi master ubuntu 20.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 6480947 2021-11-03 08:35:47 2021-11-03 16:01:19 2021-11-03 16:28:57 0:27:38 0:18:11 0:09:27 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6480948 2021-11-03 08:35:48 2021-11-03 16:01:49 2021-11-03 16:24:00 0:22:11 0:11:46 0:10:25 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
pass 6480949 2021-11-03 08:35:49 2021-11-03 16:02:19 2021-11-03 17:40:19 1:38:00 1:28:09 0:09:51 smithi master rhel 8.4 rados/upgrade/parallel/{0-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6480950 2021-11-03 08:35:50 2021-11-03 16:04:40 2021-11-03 16:39:56 0:35:16 0:26:22 0:08:54 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6480951 2021-11-03 08:35:51 2021-11-03 16:04:40 2021-11-03 16:48:48 0:44:08 0:30:26 0:13:42 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6480952 2021-11-03 08:35:52 2021-11-03 16:06:51 2021-11-03 16:27:06 0:20:15 0:09:31 0:10:44 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6480953 2021-11-03 08:35:53 2021-11-03 16:07:21 2021-11-03 16:31:52 0:24:31 0:13:09 0:11:22 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6480954 2021-11-03 08:35:54 2021-11-03 16:08:22 2021-11-03 16:51:47 0:43:25 0:32:09 0:11:16 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
fail 6480955 2021-11-03 08:35:55 2021-11-03 16:08:22 2021-11-03 16:27:52 0:19:30 0:08:45 0:10:45 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

Command failed on smithi162 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 539447e8-3cc2-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6480956 2021-11-03 08:35:56 2021-11-03 16:08:22 2021-11-03 16:30:29 0:22:07 0:07:01 0:15:06 smithi master ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480957 2021-11-03 08:35:57 2021-11-03 16:11:13 2021-11-03 17:00:46 0:49:33 0:37:50 0:11:43 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6480958 2021-11-03 08:35:58 2021-11-03 16:11:33 2021-11-03 16:53:35 0:42:02 0:31:33 0:10:29 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6480959 2021-11-03 08:35:59 2021-11-03 16:12:04 2021-11-03 16:33:14 0:21:10 0:11:53 0:09:17 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6480960 2021-11-03 08:36:00 2021-11-03 16:12:04 2021-11-03 16:59:32 0:47:28 0:36:08 0:11:20 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
dead 6480961 2021-11-03 08:36:01 2021-11-03 16:14:05 2021-11-04 04:23:12 12:09:07 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6480962 2021-11-03 08:36:02 2021-11-03 16:14:15 2021-11-03 16:43:24 0:29:09 0:19:49 0:09:20 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 6480963 2021-11-03 08:36:03 2021-11-03 16:15:45 2021-11-03 16:43:41 0:27:56 0:20:29 0:07:27 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 6480964 2021-11-03 08:36:04 2021-11-03 16:16:16 2021-11-03 16:43:52 0:27:36 0:15:50 0:11:46 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6480965 2021-11-03 08:36:06 2021-11-03 16:16:26 2021-11-03 16:57:30 0:41:04 0:28:54 0:12:10 smithi master centos 8.stream rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 1
fail 6480966 2021-11-03 08:36:07 2021-11-03 16:20:07 2021-11-03 16:57:33 0:37:26 0:26:38 0:10:48 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Found coredumps on ubuntu@smithi100.front.sepia.ceph.com

pass 6480967 2021-11-03 08:36:07 2021-11-03 16:20:07 2021-11-03 16:40:21 0:20:14 0:09:10 0:11:04 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480968 2021-11-03 08:36:09 2021-11-03 16:20:18 2021-11-03 16:45:53 0:25:35 0:11:31 0:14:04 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 6480969 2021-11-03 08:36:10 2021-11-03 16:21:28 2021-11-03 17:04:53 0:43:25 0:37:41 0:05:44 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 6480970 2021-11-03 08:36:11 2021-11-03 16:21:28 2021-11-03 16:42:55 0:21:27 0:15:47 0:05:40 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 6480971 2021-11-03 08:36:12 2021-11-03 16:21:29 2021-11-03 16:47:18 0:25:49 0:19:15 0:06:34 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6480972 2021-11-03 08:36:13 2021-11-03 16:21:39 2021-11-03 16:53:17 0:31:38 0:21:49 0:09:49 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6480973 2021-11-03 08:36:14 2021-11-03 16:21:39 2021-11-03 16:39:40 0:18:01 0:07:46 0:10:15 smithi master ubuntu 20.04 rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480974 2021-11-03 08:36:15 2021-11-03 16:22:00 2021-11-03 16:42:55 0:20:55 0:08:56 0:11:59 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6480975 2021-11-03 08:36:16 2021-11-03 16:22:00 2021-11-03 17:06:28 0:44:28 0:32:25 0:12:03 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6480976 2021-11-03 08:36:17 2021-11-03 16:23:00 2021-11-03 17:09:54 0:46:54 0:38:16 0:08:38 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6480977 2021-11-03 08:36:18 2021-11-03 17:04:57 2021-11-03 17:56:14 0:51:17 0:40:38 0:10:39 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} 2
pass 6480978 2021-11-03 08:36:19 2021-11-03 17:05:07 2021-11-03 17:21:13 0:16:06 0:06:56 0:09:10 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 6480979 2021-11-03 08:36:20 2021-11-03 17:05:47 2021-11-03 17:23:35 0:17:48 0:07:53 0:09:55 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480980 2021-11-03 08:36:21 2021-11-03 17:05:48 2021-11-03 17:28:00 0:22:12 0:11:17 0:10:55 smithi master ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
pass 6480981 2021-11-03 08:36:22 2021-11-03 17:05:48 2021-11-03 17:30:09 0:24:21 0:13:02 0:11:19 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6480982 2021-11-03 08:36:23 2021-11-03 17:06:38 2021-11-03 17:45:54 0:39:16 0:33:07 0:06:09 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 6480983 2021-11-03 08:36:24 2021-11-03 17:06:39 2021-11-03 17:28:28 0:21:49 0:11:27 0:10:22 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} 2
pass 6480984 2021-11-03 08:36:25 2021-11-03 17:06:49 2021-11-03 17:32:37 0:25:48 0:11:02 0:14:46 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6480985 2021-11-03 08:36:26 2021-11-03 17:08:30 2021-11-03 17:32:29 0:23:59 0:13:16 0:10:43 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6480986 2021-11-03 08:36:27 2021-11-03 17:09:30 2021-11-03 17:27:46 0:18:16 0:08:10 0:10:06 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6480987 2021-11-03 08:36:28 2021-11-03 17:09:30 2021-11-03 17:33:30 0:24:00 0:16:44 0:07:16 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6480988 2021-11-03 08:36:29 2021-11-03 17:10:01 2021-11-03 17:29:14 0:19:13 0:10:00 0:09:13 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6480989 2021-11-03 08:36:30 2021-11-03 17:10:31 2021-11-03 17:41:47 0:31:16 0:21:42 0:09:34 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} 1
pass 6480990 2021-11-03 08:36:31 2021-11-03 17:10:31 2021-11-03 18:08:36 0:58:05 0:46:57 0:11:08 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 6480991 2021-11-03 08:36:32 2021-11-03 17:11:12 2021-11-03 17:47:55 0:36:43 0:24:20 0:12:23 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6480992 2021-11-03 08:36:33 2021-11-03 17:12:42 2021-11-03 17:54:53 0:42:11 0:32:07 0:10:04 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 6480993 2021-11-03 08:36:34 2021-11-03 17:13:13 2021-11-03 17:49:06 0:35:53 0:25:39 0:10:14 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 6480994 2021-11-03 08:36:35 2021-11-03 17:13:23 2021-11-03 17:40:50 0:27:27 0:21:16 0:06:11 smithi master rhel 8.4 rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6480995 2021-11-03 08:36:36 2021-11-03 17:13:23 2021-11-03 17:39:19 0:25:56 0:19:09 0:06:47 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 6480996 2021-11-03 08:36:37 2021-11-03 17:13:54 2021-11-03 19:01:47 1:47:53 1:35:28 0:12:25 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 6480997 2021-11-03 08:36:38 2021-11-03 17:14:14 2021-11-03 17:41:26 0:27:12 0:20:02 0:07:10 smithi master rhel 8.4 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6480998 2021-11-03 08:36:39 2021-11-03 17:14:15 2021-11-03 17:45:51 0:31:36 0:22:39 0:08:57 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_nfs} 1
pass 6480999 2021-11-03 08:36:40 2021-11-03 17:14:35 2021-11-03 17:45:49 0:31:14 0:25:28 0:05:46 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6481000 2021-11-03 08:36:41 2021-11-03 17:14:35 2021-11-03 17:37:02 0:22:27 0:09:45 0:12:42 smithi master centos 8.3 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 2
pass 6481001 2021-11-03 08:36:42 2021-11-03 17:15:36 2021-11-03 17:48:23 0:32:47 0:22:26 0:10:21 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6481002 2021-11-03 08:36:43 2021-11-03 17:16:26 2021-11-03 17:41:14 0:24:48 0:17:44 0:07:04 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6481003 2021-11-03 08:36:44 2021-11-03 17:16:26 2021-11-03 17:43:23 0:26:57 0:20:45 0:06:12 smithi master rhel 8.4 rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6481004 2021-11-03 08:36:45 2021-11-03 17:16:27 2021-11-03 17:39:48 0:23:21 0:12:43 0:10:38 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} 2
pass 6481005 2021-11-03 08:36:46 2021-11-03 17:16:37 2021-11-03 17:59:51 0:43:14 0:30:29 0:12:45 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6481006 2021-11-03 08:36:47 2021-11-03 17:17:07 2021-11-03 17:50:24 0:33:17 0:20:32 0:12:45 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6481007 2021-11-03 08:36:48 2021-11-03 17:18:38 2021-11-03 18:03:13 0:44:35 0:31:33 0:13:02 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6481008 2021-11-03 08:36:49 2021-11-03 17:19:39 2021-11-03 17:38:43 0:19:04 0:10:28 0:08:36 smithi master centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6481009 2021-11-03 08:36:50 2021-11-03 17:19:59 2021-11-03 17:44:09 0:24:10 0:17:03 0:07:07 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6481010 2021-11-03 08:36:51 2021-11-03 17:21:19 2021-11-03 17:55:42 0:34:23 0:21:25 0:12:58 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6481011 2021-11-03 08:36:52 2021-11-03 17:22:30 2021-11-03 17:48:26 0:25:56 0:13:23 0:12:33 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6481012 2021-11-03 08:36:53 2021-11-03 17:22:40 2021-11-03 17:58:54 0:36:14 0:24:11 0:12:03 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6481013 2021-11-03 08:36:54 2021-11-03 17:23:41 2021-11-03 17:52:38 0:28:57 0:16:16 0:12:41 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6481014 2021-11-03 08:36:55 2021-11-03 17:24:41 2021-11-03 18:00:29 0:35:48 0:24:29 0:11:19 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 6481015 2021-11-03 08:36:56 2021-11-03 17:25:02 2021-11-03 19:24:22 1:59:20 1:53:52 0:05:28 smithi master rhel 8.4 rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6481016 2021-11-03 08:36:57 2021-11-03 17:25:22 2021-11-03 17:44:33 0:19:11 0:09:24 0:09:47 smithi master centos 8.3 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 6481017 2021-11-03 08:36:58 2021-11-03 17:25:22 2021-11-03 17:47:15 0:21:53 0:10:49 0:11:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 6481018 2021-11-03 08:36:59 2021-11-03 17:25:33 2021-11-03 18:08:25 0:42:52 0:30:52 0:12:00 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6481019 2021-11-03 08:37:00 2021-11-03 17:27:13 2021-11-03 17:55:53 0:28:40 0:10:55 0:17:45 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6481020 2021-11-03 08:37:01 2021-11-03 17:28:34 2021-11-03 18:09:57 0:41:23 0:29:33 0:11:50 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/rados_api_tests} 2
pass 6481021 2021-11-03 08:37:02 2021-11-03 17:28:44 2021-11-03 17:56:20 0:27:36 0:20:41 0:06:55 smithi master rhel 8.4 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6481022 2021-11-03 08:37:03 2021-11-03 17:29:24 2021-11-03 18:23:41 0:54:17 0:46:02 0:08:15 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6481023 2021-11-03 08:37:04 2021-11-03 17:30:15 2021-11-03 18:00:02 0:29:47 0:16:56 0:12:51 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/rados_cls_all} 2
fail 6481024 2021-11-03 08:37:05 2021-11-03 17:32:35 2021-11-03 17:52:17 0:19:42 0:09:04 0:10:38 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi039 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4274409c-3cce-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6481025 2021-11-03 08:37:06 2021-11-03 17:32:36 2021-11-03 18:46:35 1:13:59 1:02:49 0:11:10 smithi master ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6481026 2021-11-03 08:37:07 2021-11-03 17:32:46 2021-11-03 18:12:44 0:39:58 0:29:07 0:10:51 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6481027 2021-11-03 08:37:08 2021-11-03 17:32:46 2021-11-03 18:02:28 0:29:42 0:19:01 0:10:41 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/on distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6481028 2021-11-03 08:37:09 2021-11-03 17:32:47 2021-11-03 17:55:29 0:22:42 0:11:46 0:10:56 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6481029 2021-11-03 08:37:10 2021-11-03 17:33:37 2021-11-03 18:01:38 0:28:01 0:15:49 0:12:12 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 2
pass 6481030 2021-11-03 08:37:11 2021-11-03 17:34:07 2021-11-03 17:57:18 0:23:11 0:13:34 0:09:37 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 6481031 2021-11-03 08:37:12 2021-11-03 17:34:08 2021-11-03 17:55:16 0:21:08 0:08:42 0:12:26 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6481032 2021-11-03 08:37:13 2021-11-03 17:34:48 2021-11-03 19:14:24 1:39:36 1:29:46 0:09:50 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/erasure-code} 1
pass 6481033 2021-11-03 08:37:14 2021-11-03 17:34:48 2021-11-03 18:02:48 0:28:00 0:15:33 0:12:27 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6481034 2021-11-03 08:37:15 2021-11-03 17:37:09 2021-11-03 18:04:04 0:26:55 0:19:45 0:07:10 smithi master rhel 8.4 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
fail 6481035 2021-11-03 08:37:16 2021-11-03 17:38:50 2021-11-03 18:18:42 0:39:52 0:30:27 0:09:25 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi083 with status 22: 'kubectl -n rook-ceph exec rook-ceph-tools-698545dc56-mssh4 -- ceph orch ls -f json'

pass 6481036 2021-11-03 08:37:17 2021-11-03 17:39:00 2021-11-03 18:02:46 0:23:46 0:17:09 0:06:37 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6481037 2021-11-03 08:37:18 2021-11-03 17:39:20 2021-11-03 18:20:58 0:41:38 0:32:02 0:09:36 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8.stream} tasks/module_selftest} 2
fail 6481038 2021-11-03 08:37:19 2021-11-03 17:39:31 2021-11-03 18:01:01 0:21:30 0:10:50 0:10:40 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi120 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 25f8f1b4-3ccf-11ec-8c28-001a4aab830c -- ceph osd stat -f json'

pass 6481039 2021-11-03 08:37:20 2021-11-03 17:39:51 2021-11-03 18:07:23 0:27:32 0:12:53 0:14:39 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
fail 6481040 2021-11-03 08:37:21 2021-11-03 17:40:21 2021-11-03 18:10:39 0:30:18 0:19:31 0:10:47 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6481041 2021-11-03 08:37:22 2021-11-03 17:41:12 2021-11-03 18:00:34 0:19:22 0:09:40 0:09:42 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6481042 2021-11-03 08:37:23 2021-11-03 17:41:12 2021-11-03 18:30:45 0:49:33 0:42:57 0:06:36 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6481043 2021-11-03 08:37:24 2021-11-03 17:41:23 2021-11-03 18:19:05 0:37:42 0:28:00 0:09:42 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6481044 2021-11-03 08:37:25 2021-11-03 17:41:53 2021-11-03 19:15:35 1:33:42 1:22:55 0:10:47 smithi master ubuntu 20.04 rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6481045 2021-11-03 08:37:26 2021-11-03 17:43:33 2021-11-03 18:31:27 0:47:54 0:38:20 0:09:34 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6481046 2021-11-03 08:37:27 2021-11-03 17:44:14 2021-11-03 18:27:22 0:43:08 0:34:49 0:08:19 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6481047 2021-11-03 08:37:28 2021-11-03 17:45:54 2021-11-03 20:09:15 2:23:21 2:14:14 0:09:07 smithi master centos 8.3 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} 1
pass 6481048 2021-11-03 08:37:28 2021-11-03 17:45:55 2021-11-03 18:17:07 0:31:12 0:20:55 0:10:17 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6481049 2021-11-03 08:37:30 2021-11-03 17:45:55 2021-11-03 18:32:43 0:46:48 0:33:39 0:13:09 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6481050 2021-11-03 08:37:31 2021-11-03 17:47:26 2021-11-03 18:29:24 0:41:58 0:32:03 0:09:55 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6481051 2021-11-03 08:37:31 2021-11-03 17:47:56 2021-11-03 18:07:52 0:19:56 0:10:18 0:09:38 smithi master centos 8.3 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6481052 2021-11-03 08:37:32 2021-11-03 17:48:26 2021-11-03 18:11:58 0:23:32 0:17:12 0:06:20 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6481053 2021-11-03 08:37:34 2021-11-03 17:48:37 2021-11-03 18:14:33 0:25:56 0:13:47 0:12:09 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
fail 6481054 2021-11-03 08:37:35 2021-11-03 17:49:07 2021-11-04 00:38:11 6:49:04 6:37:57 0:11:07 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi183 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6481055 2021-11-03 08:37:35 2021-11-03 17:50:28 2021-11-03 18:25:52 0:35:24 0:22:35 0:12:49 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 6481056 2021-11-03 08:37:36 2021-11-03 17:52:18 2021-11-03 18:31:39 0:39:21 0:24:57 0:14:24 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 6481057 2021-11-03 08:37:37 2021-11-03 17:52:39 2021-11-03 18:14:40 0:22:01 0:10:13 0:11:48 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
dead 6481058 2021-11-03 08:37:39 2021-11-03 17:54:59 2021-11-04 06:05:04 12:10:05 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6481059 2021-11-03 08:37:39 2021-11-03 17:55:20 2021-11-03 19:14:45 1:19:25 1:10:21 0:09:04 smithi master centos 8.3 rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6481060 2021-11-03 08:37:40 2021-11-03 17:55:30 2021-11-03 18:20:56 0:25:26 0:11:02 0:14:24 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6481061 2021-11-03 08:37:41 2021-11-03 17:56:00 2021-11-03 18:53:27 0:57:27 0:50:30 0:06:57 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 6481062 2021-11-03 08:37:42 2021-11-03 17:56:01 2021-11-03 18:20:46 0:24:45 0:11:31 0:13:14 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 6481063 2021-11-03 08:37:44 2021-11-03 17:56:21 2021-11-03 18:32:49 0:36:28 0:24:17 0:12:11 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6481064 2021-11-03 08:37:45 2021-11-03 17:57:22 2021-11-03 18:23:46 0:26:24 0:14:59 0:11:25 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6481065 2021-11-03 08:37:46 2021-11-03 17:58:22 2021-11-03 18:22:28 0:24:06 0:13:55 0:10:11 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6481066 2021-11-03 08:37:47 2021-11-03 17:59:03 2021-11-03 18:20:14 0:21:11 0:12:24 0:08:47 smithi master centos 8.2 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 6481067 2021-11-03 08:37:48 2021-11-03 17:59:03 2021-11-03 18:18:04 0:19:01 0:06:56 0:12:05 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6481068 2021-11-03 08:37:49 2021-11-03 17:59:54 2021-11-03 18:47:04 0:47:10 0:36:36 0:10:34 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6481069 2021-11-03 08:37:50 2021-11-03 18:00:04 2021-11-03 18:19:45 0:19:41 0:10:44 0:08:57 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_adoption} 1
pass 6481070 2021-11-03 08:37:51 2021-11-03 18:00:04 2021-11-03 18:25:00 0:24:56 0:13:47 0:11:09 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6481071 2021-11-03 08:37:52 2021-11-03 18:00:35 2021-11-03 18:25:31 0:24:56 0:15:14 0:09:42 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6481072 2021-11-03 08:37:53 2021-11-03 18:00:35 2021-11-03 18:26:08 0:25:33 0:15:23 0:10:10 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 6481073 2021-11-03 08:37:54 2021-11-03 18:01:05 2021-11-03 18:35:47 0:34:42 0:25:18 0:09:24 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6481074 2021-11-03 08:37:54 2021-11-03 18:01:06 2021-11-03 18:25:13 0:24:07 0:17:24 0:06:43 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6481075 2021-11-03 08:37:56 2021-11-03 18:01:46 2021-11-03 18:33:48 0:32:02 0:20:50 0:11:12 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} 2
pass 6481076 2021-11-03 08:37:56 2021-11-03 18:02:36 2021-11-03 18:25:58 0:23:22 0:14:06 0:09:16 smithi master centos 8.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} 1
pass 6481077 2021-11-03 08:37:57 2021-11-03 18:02:47 2021-11-03 18:32:39 0:29:52 0:19:32 0:10:20 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6481078 2021-11-03 08:37:58 2021-11-03 18:02:57 2021-11-03 18:24:36 0:21:39 0:07:24 0:14:15 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6481079 2021-11-03 08:37:59 2021-11-03 18:03:17 2021-11-03 19:15:38 1:12:21 1:00:22 0:11:59 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench} 2
pass 6481080 2021-11-03 08:38:00 2021-11-03 18:04:08 2021-11-03 18:32:55 0:28:47 0:14:51 0:13:56 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6481081 2021-11-03 08:38:01 2021-11-03 18:07:29 2021-11-03 18:29:36 0:22:07 0:12:01 0:10:06 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6481082 2021-11-03 08:38:02 2021-11-03 18:07:29 2021-11-03 18:38:27 0:30:58 0:17:08 0:13:50 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
pass 6481083 2021-11-03 08:38:03 2021-11-03 18:08:29 2021-11-03 18:33:56 0:25:27 0:15:30 0:09:57 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_cephadm} 1
pass 6481084 2021-11-03 08:38:04 2021-11-03 18:08:30 2021-11-03 18:50:08 0:41:38 0:31:42 0:09:56 smithi master centos 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} 2
pass 6481085 2021-11-03 08:38:05 2021-11-03 18:08:40 2021-11-03 20:49:26 2:40:46 2:29:34 0:11:12 smithi master centos 8.3 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 6481086 2021-11-03 08:38:06 2021-11-03 18:10:01 2021-11-03 18:41:16 0:31:15 0:24:24 0:06:51 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6481087 2021-11-03 08:38:07 2021-11-03 18:10:01 2021-11-03 18:36:00 0:25:59 0:14:09 0:11:50 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6481088 2021-11-03 08:38:08 2021-11-03 18:10:41 2021-11-03 18:42:10 0:31:29 0:21:59 0:09:30 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 6481089 2021-11-03 08:38:09 2021-11-03 18:10:52 2021-11-03 18:59:19 0:48:27 0:35:49 0:12:38 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6481090 2021-11-03 08:38:10 2021-11-03 18:12:02 2021-11-03 18:43:54 0:31:52 0:23:24 0:08:28 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6481091 2021-11-03 08:38:11 2021-11-03 18:14:43 2021-11-03 18:55:21 0:40:38 0:25:05 0:15:33 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6481092 2021-11-03 08:38:12 2021-11-03 18:17:14 2021-11-03 18:45:28 0:28:14 0:16:38 0:11:36 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 6481093 2021-11-03 08:38:13 2021-11-03 18:18:14 2021-11-03 18:51:40 0:33:26 0:20:17 0:13:09 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 6481094 2021-11-03 08:38:14 2021-11-03 18:19:15 2021-11-03 19:10:39 0:51:24 0:38:46 0:12:38 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6481095 2021-11-03 08:38:15 2021-11-03 18:19:55 2021-11-03 18:46:30 0:26:35 0:13:09 0:13:26 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6481096 2021-11-03 08:38:16 2021-11-03 18:21:06 2021-11-03 18:56:15 0:35:09 0:29:14 0:05:55 smithi master rhel 8.4 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6481097 2021-11-03 08:38:17 2021-11-03 18:21:06 2021-11-03 18:42:44 0:21:38 0:11:40 0:09:58 smithi master centos 8.stream rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6481098 2021-11-03 08:38:18 2021-11-03 18:21:06 2021-11-03 18:58:31 0:37:25 0:27:38 0:09:47 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6481099 2021-11-03 08:38:19 2021-11-03 18:21:06 2021-11-03 19:02:04 0:40:58 0:29:50 0:11:08 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
pass 6481100 2021-11-03 08:38:20 2021-11-03 18:22:37 2021-11-03 18:48:59 0:26:22 0:14:51 0:11:31 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6481101 2021-11-03 08:38:21 2021-11-03 18:23:47 2021-11-03 19:06:14 0:42:27 0:29:51 0:12:36 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 6481102 2021-11-03 08:38:22 2021-11-03 18:23:48 2021-11-03 18:50:20 0:26:32 0:15:05 0:11:27 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 6481103 2021-11-03 08:38:23 2021-11-03 18:24:38 2021-11-03 19:08:36 0:43:58 0:31:59 0:11:59 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6481104 2021-11-03 08:38:24 2021-11-03 18:25:09 2021-11-03 18:44:47 0:19:38 0:09:28 0:10:10 smithi master centos 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6481105 2021-11-03 08:38:25 2021-11-03 18:25:09 2021-11-03 18:46:46 0:21:37 0:12:41 0:08:56 smithi master centos 8.stream rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
pass 6481106 2021-11-03 08:38:26 2021-11-03 18:25:19 2021-11-03 19:15:43 0:50:24 0:37:24 0:13:00 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
fail 6481107 2021-11-03 08:38:27 2021-11-03 18:26:00 2021-11-03 18:46:56 0:20:56 0:11:19 0:09:37 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi013 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b6d4954-3cd5-11ec-8c28-001a4aab830c -- ceph osd stat -f json'

pass 6481108 2021-11-03 08:38:28 2021-11-03 18:26:00 2021-11-03 18:49:46 0:23:46 0:12:49 0:10:57 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1