yuriw-2022-10-19_18:35:19-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi

User	Scheduled	Started	Updated	Runtime	Suite	Branch	Machine Type	Revision	Pass	Fail	Dead
yuriw	2022-10-19 18:35:19	2022-10-19 23:46:13	2022-10-20 15:10:53	15:24:40	rados	wip-yuri10-testing-2022-10-19-0810	smithi	b40a3be	288	23	9

Average wait time: 0:08:28

See other runs of suite 'rados' on branch 'wip-yuri10-testing-2022-10-19-0810'?

See other runs on branch 'wip-yuri10-testing-2022-10-19-0810'?

See other runs scheduled on 2022-10-19?

See detail view?

Status	Job ID	Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Description	Nodes
pass	7074726	2022-10-19 18:36:45	2022-10-19 23:46:13	2022-10-20 00:06:43	0:20:30	0:15:31	0:04:59	smithi	main	rhel	8.6	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/workunits}	2
pass	7074727	2022-10-19 18:36:46	2022-10-19 23:46:13	2022-10-20 00:09:06	0:22:53	0:12:56	0:09:57	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}	1
pass	7074728	2022-10-19 18:36:47	2022-10-19 23:48:06	2022-10-20 00:14:58	0:26:52	0:21:28	0:05:24	smithi	main	centos	8.stream	rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}	1
pass	7074729	2022-10-19 18:36:49	2022-10-19 23:48:07	2022-10-20 00:26:59	0:38:52	0:31:24	0:07:28	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon}	5
fail	7074730	2022-10-19 18:36:50	2022-10-19 23:48:07	2022-10-20 00:08:27	0:20:20	0:11:59	0:08:21	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}	2
Failure Reason: Command failed on smithi111 with status 1: 'sudo yum -y install ceph-radosgw'
pass	7074731	2022-10-19 18:36:51	2022-10-19 23:48:07	2022-10-20 00:32:15	0:44:08	0:36:30	0:07:38	smithi	main	rhel	8.6	rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}}	1
pass	7074732	2022-10-19 18:36:52	2022-10-19 23:48:08	2022-10-20 00:41:44	0:53:36	0:44:02	0:09:34	smithi	main	ubuntu	20.04	rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune}	2
fail	7074733	2022-10-19 18:36:54	2022-10-19 23:48:08	2022-10-20 00:05:49	0:17:41	0:11:05	0:06:36	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_api_tests}	2
Failure Reason: Command failed on smithi061 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp'
pass	7074734	2022-10-19 18:36:55	2022-10-19 23:48:08	2022-10-20 00:34:39	0:46:31	0:39:07	0:07:24	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind}	2
pass	7074735	2022-10-19 18:36:56	2022-10-19 23:48:09	2022-10-20 00:27:08	0:38:59	0:29:55	0:09:04	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}	2
pass	7074736	2022-10-19 18:36:58	2022-10-19 23:48:09	2022-10-20 00:08:56	0:20:47	0:12:14	0:08:33	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074737	2022-10-19 18:36:59	2022-10-19 23:48:09	2022-10-20 00:22:50	0:34:41	0:21:51	0:12:50	smithi	main	ubuntu	20.04	rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}	2
pass	7074738	2022-10-19 18:37:00	2022-10-19 23:48:10	2022-10-20 00:10:11	0:22:01	0:11:47	0:10:14	smithi	main	ubuntu	20.04	rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}	1
fail	7074739	2022-10-19 18:37:01	2022-10-19 23:48:10	2022-10-19 23:56:54	0:08:44			smithi	main	centos	8.stream	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
Failure Reason: Stale jobs detected, aborting.
pass	7074740	2022-10-19 18:37:03	2022-10-19 23:48:10	2022-10-20 01:09:25	1:21:15	1:09:56	0:11:19	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench}	2
pass	7074741	2022-10-19 18:37:04	2022-10-19 23:48:11	2022-10-20 00:32:42	0:44:31	0:33:22	0:11:09	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}	3
pass	7074742	2022-10-19 18:37:05	2022-10-19 23:48:11	2022-10-20 00:12:30	0:24:19	0:16:15	0:08:04	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption}	1
dead	7074743	2022-10-19 18:37:06	2022-10-19 23:48:11	2022-10-19 23:56:53	0:08:42			smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
Failure Reason: SSH connection to smithi175 was lost: 'sudo apt-get update'
fail	7074744	2022-10-19 18:37:08	2022-10-19 23:48:12	2022-10-19 23:56:43	0:08:31			smithi	main	rhel	8.6	rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}	2
Failure Reason: Command failed on smithi133 with status 100: 'sudo apt-get clean'
dead	7074745	2022-10-19 18:37:09	2022-10-19 23:48:12	2022-10-20 00:00:31	0:12:19			smithi	main	ubuntu	20.04	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}	2
Failure Reason: SSH connection to smithi133 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'
fail	7074746	2022-10-19 18:37:10	2022-10-19 23:48:13	2022-10-20 00:07:55	0:19:42	0:12:19	0:07:23	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect}	2
Failure Reason: Command failed on smithi110 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp'
fail	7074747	2022-10-19 18:37:12	2022-10-19 23:48:13	2022-10-19 23:57:05	0:08:52			smithi	main	ubuntu	20.04	rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}	2
Failure Reason: Command failed on smithi106 with status 100: 'sudo apt-get clean'
pass	7074748	2022-10-19 18:37:13	2022-10-19 23:48:13	2022-10-20 00:11:33	0:23:20	0:13:57	0:09:23	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}	1
pass	7074749	2022-10-19 18:37:14	2022-10-19 23:48:14	2022-10-20 00:22:48	0:34:34	0:26:28	0:08:06	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}	3
pass	7074750	2022-10-19 18:37:15	2022-10-19 23:48:14	2022-10-20 00:13:46	0:25:32	0:17:41	0:07:51	smithi	main	centos	8.stream	rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}	1
dead	7074751	2022-10-19 18:37:17	2022-10-19 23:48:14	2022-10-20 00:06:51	0:18:37	0:09:33	0:09:04	smithi	main	centos	8.stream	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
Failure Reason: {'smithi078.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}}
pass	7074752	2022-10-19 18:37:18	2022-10-19 23:48:15	2022-10-20 00:08:31	0:20:16	0:15:01	0:05:15	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074753	2022-10-19 18:37:19	2022-10-19 23:48:15	2022-10-20 00:32:43	0:44:28	0:38:25	0:06:03	smithi	main	rhel	8.6	rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}	1
fail	7074754	2022-10-19 18:37:21	2022-10-19 23:48:15	2022-10-20 00:11:30	0:23:15	0:13:41	0:09:34	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests}	2
Failure Reason: {'smithi033.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHIYJZRAzmG893Ll6BPPO3aM2JRw6fqQti'], 'labels': [], 'masters': [], 'uuids': ['3169c7b9-07fd-4857-bac5-d594d388ce07']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'sgdisk --zap-all /dev/dm-1 \|\| sgdisk --zap-all /dev/dm-1', 'delta': '0:00:01.478320', 'end': '2022-10-20 00:06:39.572678', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'sgdisk --zap-all /dev/dm-1 \|\| sgdisk --zap-all /dev/dm-1', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHIYJZRAzmG893Ll6BPPO3aM2JRw6fqQti'], 'labels': [], 'masters': [], 'uuids': ['3169c7b9-07fd-4857-bac5-d594d388ce07']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-10-20 00:06:38.094358', 'stderr': '', 'stderr_lines': [], 'stdout': 'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', 'stdout_lines': ['Creating new GPT entries.', 'Warning: The kernel is still using the old partition table.', 'The new table will be used at the next reboot or after you', 'run partprobe(8) or kpartx(8)', 'GPT data structures destroyed! You may now partition the disk using fdisk or', 'other utilities.']}, {'_ansible_item_label': {'key': 'nvme0n1', 'value': {'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'links': {'ids': ['lvm-pv-uuid-l03ImE-Q6rq-5kiQ-eH5g-cjUJ-51NM-vdfIdl', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN', 'nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001'], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'uuids': []}, 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'sgdisk --zap-all /dev/nvme0n1 \|\| sgdisk --zap-all /dev/nvme0n1', 'delta': '0:00:01.066519', 'end': '2022-10-20 00:06:41.094909', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'sgdisk --zap-all /dev/nvme0n1 \|\| sgdisk --zap-all /dev/nvme0n1', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'nvme0n1', 'value': {'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'links': {'ids': ['lvm-pv-uuid-l03ImE-Q6rq-5kiQ-eH5g-cjUJ-51NM-vdfIdl', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN', 'nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001'], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'uuids': []}, 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-10-20 00:06:40.028390', 'stderr': '', 'stderr_lines': [], 'stdout': 'Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', 'stdout_lines': ['Creating new GPT entries.', 'GPT data structures destroyed! You may now partition the disk using fdisk or', 'other utilities.']}, {'_ansible_item_label': {'key': 'dm-4', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHv9FI1UL5pr7osacSvgfamxl9mq1LRiuL'], 'labels': [], 'masters': [], 'uuids': ['399e9bf3-cace-48a0-af4e-8697849ae37c']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'sgdisk --zap-all /dev/dm-4 \|\| sgdisk --zap-all /dev/dm-4', 'delta': '0:00:01.115901', 'end': '2022-10-20 00:06:42.840513', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'sgdisk --zap-all /dev/dm-4 \|\| sgdisk --zap-all /dev/dm-4', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'dm-4', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHv9FI1UL5pr7osacSvgfamxl9mq1LRiuL'], 'labels': [], 'masters': [], 'uuids': ['399e9bf3-cace-48a0-af4e-8697849ae37c']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-10-20 00:06:41.724612', 'stderr': '', 'stderr_lines': [], 'stdout': 'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', 'stdout_lines': ['Creating new GPT entries.', 'Warning: The kernel is still using the old partition table.', 'The new table will be used at the next reboot or after you', 'run partprobe(8) or kpartx(8)', 'GPT data structures destroyed! You may now partition the disk using fdisk or', 'other utilities.']}, {'_ansible_item_label': {'key': 'dm-2', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOH30V0ldaNhJSTZGbdD32GDbf6GDGYXFS6'], 'labels': [], 'masters': [], 'uuids': ['837ae0b0-74ef-4757-9096-4b80f1cd5058']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-2', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOH30V0ldaNhJSTZGbdD32GDbf6GDGYXFS6'], 'labels': [], 'masters': [], 'uuids': ['837ae0b0-74ef-4757-9096-4b80f1cd5058']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi033.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, {'_ansible_item_label': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHfC3MzcMOeINAIODCiFYSJogeIlUuCvhZ'], 'labels': [], 'masters': [], 'uuids': ['bb714dbb-2505-4c7a-9b9e-0d6b5e661a5b']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHfC3MzcMOeINAIODCiFYSJogeIlUuCvhZ'], 'labels': [], 'masters': [], 'uuids': ['bb714dbb-2505-4c7a-9b9e-0d6b5e661a5b']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi033.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, {'_ansible_item_label': {'key': 'sda', 'value': {'holders': [], 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HQ2L', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HQ2L', 'scsi-35000c500871a8992', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HQ2L', 'wwn-0x5000c500871a8992'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'ST1000NM0033-9ZM', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HQ2L-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'scsi-35000c500871a8992-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HQ2L-part1', 'wwn-0x5000c500871a8992-part1'], 'labels': [], 'masters': [], 'uuids': ['78886b72-f581-4b1d-8578-0d8161fd4ca1']}, 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'start': '2048', 'uuid': '78886b72-f581-4b1d-8578-0d8161fd4ca1'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'serial': 'Z1W4HQ2L', 'size': '931.51 GB', 'support_discard': '0', 'vendor': 'ATA', 'virtual': 1, 'wwn': '0x5000c500871a8992'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HQ2L', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HQ2L', 'scsi-35000c500871a8992', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HQ2L', 'wwn-0x5000c500871a8992'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'ST1000NM0033-9ZM', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HQ2L-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'scsi-35000c500871a8992-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HQ2L-part1', 'wwn-0x5000c500871a8992-part1'], 'labels': [], 'masters': [], 'uuids': ['78886b72-f581-4b1d-8578-0d8161fd4ca1']}, 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'start': '2048', 'uuid': '78886b72-f581-4b1d-8578-0d8161fd4ca1'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'serial': 'Z1W4HQ2L', 'size': '931.51 GB', 'support_discard': '0', 'vendor': 'ATA', 'virtual': 1, 'wwn': '0x5000c500871a8992'}}, 'skip_reason': 'Conditional result was False', 'skipped': True}, {'_ansible_item_label': {'key': 'dm-3', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHkDF6UPQWTAdu2vDxJrfAa4hzTibsXTmM'], 'labels': [], 'masters': [], 'uuids': ['a1081113-b3ce-4784-a9e9-b4067f9e5675']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-3', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-YlN7Djx6ZToQOg6KOe0bOoeiPdIcEoOHkDF6UPQWTAdu2vDxJrfAa4hzTibsXTmM'], 'labels': [], 'masters': [], 'uuids': ['a1081113-b3ce-4784-a9e9-b4067f9e5675']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi033.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}]}}
pass	7074755	2022-10-19 18:37:22	2022-10-19 23:48:16	2022-10-20 00:10:48	0:22:32	0:16:12	0:06:20	smithi	main	centos	8.stream	rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}	2
fail	7074756	2022-10-19 18:37:23	2022-10-19 23:48:16	2022-10-20 00:08:48	0:20:32	0:11:25	0:09:07	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all}	2
Failure Reason: {'smithi078.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'checksum': 'bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79', 'dest': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt', 'diff': {'after': {'path': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt'}, 'before': {'path': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt'}}, 'failed': False, 'gid': 0, 'group': 'root', 'invocation': {'module_args': {'_diff_peek': None, '_original_basename': 'tmpf1s1ekkp', 'access_time': None, 'access_time_format': '%Y%m%d%H%M.%S', 'attributes': None, 'dest': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt', 'follow': True, 'force': False, 'group': None, 'mode': None, 'modification_time': None, 'modification_time_format': '%Y%m%d%H%M.%S', 'owner': None, 'path': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt', 'recurse': False, 'selevel': None, 'serole': None, 'setype': None, 'seuser': None, 'src': None, 'state': 'file', 'unsafe_writes': False}}, 'item': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000', 'mode': '0644', 'owner': 'root', 'path': '/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt', 'secontext': 'system_u:object_r:cert_t:s0', 'size': 2334, 'state': 'file', 'uid': 0}, {'_ansible_item_label': '/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000', 'ansible_loop_var': 'item', 'item': '/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000', 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi078.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}]}}
dead	7074757	2022-10-19 18:37:25	2022-10-19 23:48:16	2022-10-20 00:08:40	0:20:24	0:11:44	0:08:40	smithi	main	rhel	8.6	rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery}	3
Failure Reason: {'smithi203.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}}
pass	7074758	2022-10-19 18:37:26	2022-10-19 23:48:27	2022-10-20 00:08:02	0:19:35	0:12:31	0:07:04	smithi	main	centos	8.stream	rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}	1
pass	7074759	2022-10-19 18:37:27	2022-10-19 23:49:07	2022-10-20 01:19:49	1:30:42	1:20:01	0:10:41	smithi	main	centos	8.stream	rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/dashboard}	2
pass	7074760	2022-10-19 18:37:28	2022-10-19 23:52:38	2022-10-20 00:17:34	0:24:56	0:17:29	0:07:27	smithi	main	centos	8.stream	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/crash}	2
pass	7074761	2022-10-19 18:37:30	2022-10-19 23:52:38	2022-10-20 00:11:46	0:19:08	0:10:31	0:08:37	smithi	main	ubuntu	20.04	rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}}	1
pass	7074762	2022-10-19 18:37:31	2022-10-19 23:52:39	2022-10-20 00:17:39	0:25:00	0:19:28	0:05:32	smithi	main	rhel	8.6	rados/rest/{mgr-restful supported-random-distro$/{rhel_8}}	1
fail	7074763	2022-10-19 18:37:32	2022-10-19 23:52:39	2022-10-20 00:12:09	0:19:30	0:07:46	0:11:44	smithi	main	ubuntu	20.04	rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}	1
Failure Reason: Command failed on smithi107 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'
pass	7074764	2022-10-19 18:37:33	2022-10-19 23:52:39	2022-10-20 00:22:45	0:30:06	0:18:15	0:11:51	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074765	2022-10-19 18:37:34	2022-10-19 23:52:40	2022-10-20 00:16:05	0:23:25	0:14:25	0:09:00	smithi	main	ubuntu	20.04	rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c}	1
pass	7074766	2022-10-19 18:37:36	2022-10-19 23:52:40	2022-10-20 01:27:29	1:34:49	1:28:11	0:06:38	smithi	main	rhel	8.6	rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}	2
pass	7074767	2022-10-19 18:37:37	2022-10-19 23:52:40	2022-10-20 00:29:20	0:36:40	0:30:14	0:06:26	smithi	main	centos	8.stream	rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}	1
pass	7074768	2022-10-19 18:37:38	2022-10-19 23:52:41	2022-10-20 00:29:35	0:36:54	0:29:52	0:07:02	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm}	1
pass	7074769	2022-10-19 18:37:40	2022-10-19 23:52:41	2022-10-20 00:21:50	0:29:09	0:19:34	0:09:35	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object}	2
pass	7074770	2022-10-19 18:37:41	2022-10-19 23:52:41	2022-10-20 00:32:41	0:40:00	0:31:45	0:08:15	smithi	main	centos	8.stream	rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits}	2
dead	7074771	2022-10-19 18:37:42	2022-10-19 23:52:42	2022-10-20 00:07:58	0:15:16			smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep}	2
Failure Reason: SSH connection to smithi133 was lost: 'sudo apt-get update'
pass	7074772	2022-10-19 18:37:43	2022-10-19 23:56:53	2022-10-20 00:18:21	0:21:28	0:14:29	0:06:59	smithi	main	centos	8.stream	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
fail	7074773	2022-10-19 18:37:45	2022-10-19 23:57:14	2022-10-20 00:07:59	0:10:45			smithi	main	ubuntu	20.04	rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}	1
Failure Reason: Command failed on smithi133 with status 100: 'sudo apt-get clean'
pass	7074774	2022-10-19 18:37:46	2022-10-20 00:00:37	2022-10-20 00:28:20	0:27:43	0:15:54	0:11:49	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}	2
pass	7074775	2022-10-19 18:37:47	2022-10-20 00:05:00	2022-10-20 00:21:56	0:16:56	0:11:27	0:05:29	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074776	2022-10-19 18:37:49	2022-10-20 00:05:01	2022-10-20 00:29:32	0:24:31	0:16:20	0:08:11	smithi	main	rhel	8.6	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}	3
pass	7074777	2022-10-19 18:37:50	2022-10-20 00:06:52	2022-10-20 00:24:15	0:17:23	0:08:35	0:08:48	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}	1
fail	7074778	2022-10-19 18:37:51	2022-10-20 00:06:52	2022-10-20 00:23:52	0:17:00	0:04:44	0:12:16	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read}	2
Failure Reason: {'smithi078.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}}
pass	7074779	2022-10-19 18:37:52	2022-10-20 00:06:52	2022-10-20 00:43:05	0:36:13	0:27:58	0:08:15	smithi	main	rhel	8.6	rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}	2
pass	7074780	2022-10-19 18:37:54	2022-10-20 00:08:03	2022-10-20 00:35:17	0:27:14	0:16:53	0:10:21	smithi	main	ubuntu	20.04	rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}	1
pass	7074781	2022-10-19 18:37:55	2022-10-20 00:08:03	2022-10-20 00:45:20	0:37:17	0:27:19	0:09:58	smithi	main	ubuntu	20.04	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}	2
pass	7074782	2022-10-19 18:37:56	2022-10-20 00:08:04	2022-10-20 00:43:56	0:35:52	0:27:40	0:08:12	smithi	main	centos	8.stream	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}	2
pass	7074783	2022-10-19 18:37:57	2022-10-20 00:08:34	2022-10-20 00:27:22	0:18:48	0:13:09	0:05:39	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}}	1
dead	7074784	2022-10-19 18:37:59	2022-10-20 00:08:35	2022-10-20 00:18:11	0:09:36			smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced}	2
Failure Reason: SSH connection to smithi033 was lost: 'sudo apt-get update'
pass	7074785	2022-10-19 18:38:00	2022-10-20 00:08:45	2022-10-20 00:34:13	0:25:28	0:15:38	0:09:50	smithi	main	ubuntu	20.04	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}	2
fail	7074786	2022-10-19 18:38:01	2022-10-20 00:08:45	2022-10-20 00:25:47	0:17:02	0:09:28	0:07:34	smithi	main	centos	8.stream	rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}	2
Failure Reason: Cannot connect to remote host smithi078
pass	7074787	2022-10-19 18:38:02	2022-10-20 00:08:56	2022-10-20 00:42:33	0:33:37	0:25:52	0:07:45	smithi	main	centos	8.stream	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074788	2022-10-19 18:38:04	2022-10-20 00:09:16	2022-10-20 00:33:31	0:24:15	0:16:33	0:07:42	smithi	main	centos	8.stream	rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}	1
pass	7074789	2022-10-19 18:38:05	2022-10-20 00:10:16	2022-10-20 00:29:53	0:19:37	0:09:28	0:10:09	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074790	2022-10-19 18:38:06	2022-10-20 00:10:57	2022-10-20 00:41:00	0:30:03	0:19:49	0:10:14	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized}	2
fail	7074791	2022-10-19 18:38:07	2022-10-20 00:11:37	2022-10-20 00:18:13	0:06:36			smithi	main	ubuntu	20.04	rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}	1
Failure Reason: Command failed on smithi033 with status 100: 'sudo apt-get clean'
pass	7074792	2022-10-19 18:38:09	2022-10-20 00:11:38	2022-10-20 00:26:34	0:14:56	0:06:00	0:08:56	smithi	main	ubuntu	20.04	rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos}	1
pass	7074793	2022-10-19 18:38:10	2022-10-20 00:11:38	2022-10-20 00:29:43	0:18:05	0:07:57	0:10:08	smithi	main	ubuntu	20.04	rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}	2
pass	7074794	2022-10-19 18:38:11	2022-10-20 00:12:18	2022-10-20 01:11:58	0:59:40	0:49:13	0:10:27	smithi	main	ubuntu	20.04	rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074795	2022-10-19 18:38:12	2022-10-20 00:12:39	2022-10-20 00:33:05	0:20:26	0:08:47	0:11:39	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}	1
pass	7074796	2022-10-19 18:38:14	2022-10-20 00:13:49	2022-10-20 00:39:26	0:25:37	0:16:20	0:09:17	smithi	main	centos	8.stream	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/failover}	2
pass	7074797	2022-10-19 18:38:15	2022-10-20 00:16:10	2022-10-20 00:57:16	0:41:06	0:28:56	0:12:10	smithi	main	ubuntu	20.04	rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}	2
pass	7074798	2022-10-19 18:38:16	2022-10-20 00:17:41	2022-10-20 00:34:47	0:17:06	0:09:48	0:07:18	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074799	2022-10-19 18:38:18	2022-10-20 00:17:41	2022-10-20 00:49:42	0:32:01	0:21:17	0:10:44	smithi	main	ubuntu	20.04	rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush}	1
pass	7074800	2022-10-19 18:38:19	2022-10-20 00:18:22	2022-10-20 00:47:29	0:29:07	0:22:29	0:06:38	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects}	2
pass	7074801	2022-10-19 18:38:20	2022-10-20 00:18:22	2022-10-20 01:01:18	0:42:56	0:35:43	0:07:13	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}	3
fail	7074802	2022-10-19 18:38:22	2022-10-20 00:18:23	2022-10-20 01:36:49	1:18:26	1:07:23	0:11:03	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}	2
Failure Reason: Command failed (workunit test rados/test.sh) on smithi059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b40a3bed7bdeff6224dd522c5b540bbe0d11c858 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
pass	7074803	2022-10-19 18:38:23	2022-10-20 00:21:54	2022-10-20 00:46:56	0:25:02	0:16:29	0:08:33	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}	2
pass	7074804	2022-10-19 18:38:24	2022-10-20 00:22:54	2022-10-20 00:47:03	0:24:09	0:12:35	0:11:34	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
dead	7074805	2022-10-19 18:38:25	2022-10-20 00:22:55	2022-10-20 00:33:30	0:10:35			smithi	main	rhel	8.6	rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}	2
Failure Reason: SSH connection to smithi078 was lost: 'sudo apt-get update'
fail	7074806	2022-10-19 18:38:27	2022-10-20 00:23:55	2022-10-20 00:33:31	0:09:36			smithi	main	ubuntu	20.04	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}	3
Failure Reason: Command failed on smithi078 with status 100: 'sudo apt-get clean'
pass	7074807	2022-10-19 18:38:28	2022-10-20 00:25:56	2022-10-20 00:46:56	0:21:00	0:14:57	0:06:03	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}	1
pass	7074808	2022-10-19 18:38:29	2022-10-20 00:25:56	2022-10-20 01:02:34	0:36:38	0:25:55	0:10:43	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced}	2
pass	7074809	2022-10-19 18:38:31	2022-10-20 00:27:07	2022-10-20 00:44:31	0:17:24	0:11:19	0:06:05	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074810	2022-10-19 18:38:32	2022-10-20 00:27:07	2022-10-20 00:50:05	0:22:58	0:17:17	0:05:41	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch}	2
pass	7074811	2022-10-19 18:38:33	2022-10-20 00:27:08	2022-10-20 00:45:33	0:18:25	0:12:26	0:05:59	smithi	main	centos	8.stream	rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}	1
pass	7074812	2022-10-19 18:38:35	2022-10-20 00:27:08	2022-10-20 01:06:02	0:38:54	0:31:45	0:07:09	smithi	main	centos	8.stream	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}	2
pass	7074813	2022-10-19 18:38:36	2022-10-20 00:27:19	2022-10-20 00:51:44	0:24:25	0:17:25	0:07:00	smithi	main	rhel	8.6	rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}	2
pass	7074814	2022-10-19 18:38:37	2022-10-20 00:28:29	2022-10-20 01:04:25	0:35:56	0:27:35	0:08:21	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized}	2
pass	7074815	2022-10-19 18:38:38	2022-10-20 00:29:30	2022-10-20 00:46:46	0:17:16	0:11:00	0:06:16	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074816	2022-10-19 18:38:40	2022-10-20 00:29:40	2022-10-20 00:47:02	0:17:22	0:08:38	0:08:44	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}	1
pass	7074817	2022-10-19 18:38:41	2022-10-20 00:29:40	2022-10-20 01:06:24	0:36:44	0:30:48	0:05:56	smithi	main	centos	8.stream	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074818	2022-10-19 18:38:43	2022-10-20 00:29:41	2022-10-20 00:46:41	0:17:00	0:11:16	0:05:44	smithi	main	centos	8.stream	rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}	1
pass	7074819	2022-10-19 18:38:44	2022-10-20 00:29:51	2022-10-20 00:55:18	0:25:27	0:18:47	0:06:40	smithi	main	rhel	8.6	rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}	2
pass	7074820	2022-10-19 18:38:45	2022-10-20 00:30:02	2022-10-20 00:49:46	0:19:44	0:10:18	0:09:26	smithi	main	centos	8.stream	rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}}	1
pass	7074821	2022-10-19 18:38:46	2022-10-20 00:32:22	2022-10-20 01:10:22	0:38:00	0:26:50	0:11:10	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}	2
pass	7074822	2022-10-19 18:38:48	2022-10-20 00:32:43	2022-10-20 00:51:45	0:19:02	0:12:34	0:06:28	smithi	main	rhel	8.6	rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}	2
pass	7074823	2022-10-19 18:38:49	2022-10-20 00:32:43	2022-10-20 00:49:19	0:16:36	0:11:06	0:05:30	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074824	2022-10-19 18:38:51	2022-10-20 00:32:44	2022-10-20 01:04:54	0:32:10	0:24:47	0:07:23	smithi	main	centos	8.stream	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}	2
pass	7074825	2022-10-19 18:38:52	2022-10-20 00:33:14	2022-10-20 01:08:51	0:35:37	0:28:40	0:06:57	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs}	1
fail	7074826	2022-10-19 18:38:53	2022-10-20 00:33:34	2022-10-20 00:53:54	0:20:20	0:09:30	0:10:50	smithi	main	ubuntu	20.04	rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}	1
Failure Reason: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi066 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b40a3bed7bdeff6224dd522c5b540bbe0d11c858 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
pass	7074827	2022-10-19 18:38:55	2022-10-20 00:33:35	2022-10-20 00:59:16	0:25:41	0:19:01	0:06:40	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}	2
pass	7074828	2022-10-19 18:38:56	2022-10-20 00:34:15	2022-10-20 01:19:16	0:45:01	0:32:46	0:12:15	smithi	main	ubuntu	20.04	rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}	2
pass	7074829	2022-10-19 18:38:58	2022-10-20 00:34:46	2022-10-20 00:58:03	0:23:17	0:17:39	0:05:38	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed}	2
pass	7074830	2022-10-19 18:38:59	2022-10-20 00:34:56	2022-10-20 01:04:43	0:29:47	0:19:28	0:10:19	smithi	main	rhel	8.6	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/insights}	2
pass	7074831	2022-10-19 18:39:00	2022-10-20 00:39:27	2022-10-20 01:05:12	0:25:45	0:13:15	0:12:30	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074832	2022-10-19 18:39:01	2022-10-20 00:41:48	2022-10-20 01:01:54	0:20:06	0:12:34	0:07:32	smithi	main	rhel	8.6	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper}	2
pass	7074833	2022-10-19 18:39:03	2022-10-20 00:42:39	2022-10-20 01:23:37	0:40:58	0:33:37	0:07:21	smithi	main	centos	8.stream	rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}	1
pass	7074834	2022-10-19 18:39:04	2022-10-20 00:42:39	2022-10-20 01:06:16	0:23:37	0:16:12	0:07:25	smithi	main	rhel	8.6	rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}	2
pass	7074835	2022-10-19 18:39:05	2022-10-20 00:43:10	2022-10-20 01:04:12	0:21:02	0:10:15	0:10:47	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074836	2022-10-19 18:39:06	2022-10-20 00:44:00	2022-10-20 02:23:12	1:39:12	1:30:29	0:08:43	smithi	main	ubuntu	20.04	rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code}	1
pass	7074837	2022-10-19 18:39:08	2022-10-20 00:44:00	2022-10-20 02:12:53	1:28:53	1:18:11	0:10:42	smithi	main	ubuntu	20.04	rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}	2
pass	7074838	2022-10-19 18:39:09	2022-10-20 00:45:21	2022-10-20 01:10:29	0:25:08	0:13:09	0:11:59	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}	3
pass	7074839	2022-10-19 18:39:11	2022-10-20 00:46:42	2022-10-20 01:37:02	0:50:20	0:42:43	0:07:37	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests}	2
pass	7074840	2022-10-19 18:39:12	2022-10-20 00:47:02	2022-10-20 01:06:16	0:19:14	0:09:53	0:09:21	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}	1
pass	7074841	2022-10-19 18:39:13	2022-10-20 00:47:02	2022-10-20 01:12:03	0:25:01	0:18:38	0:06:23	smithi	main	rhel	8.6	rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}	2
pass	7074842	2022-10-19 18:39:14	2022-10-20 00:47:03	2022-10-20 01:18:53	0:31:50	0:24:26	0:07:24	smithi	main	centos	8.stream	rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e}	2
fail	7074843	2022-10-19 18:39:16	2022-10-20 00:47:13	2022-10-20 01:25:28	0:38:15	0:27:06	0:11:09	smithi	main	ubuntu	20.04	rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}	3
Failure Reason: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
pass	7074844	2022-10-19 18:39:17	2022-10-20 00:47:33	2022-10-20 01:06:23	0:18:50	0:11:37	0:07:13	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074845	2022-10-19 18:39:18		2022-10-20 02:27:17		5251		smithi	main	ubuntu	20.04	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench}	2
pass	7074846	2022-10-19 18:39:19	2022-10-20 00:49:44	2022-10-20 01:33:11	0:43:27	0:36:14	0:07:13	smithi	main	centos	8.stream	rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}	2
pass	7074847	2022-10-19 18:39:21	2022-10-20 00:50:15	2022-10-20 02:15:11	1:24:56	1:17:28	0:07:28	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}	3
pass	7074848	2022-10-19 18:39:22	2022-10-20 00:51:46	2022-10-20 01:16:22	0:24:36	0:19:36	0:05:00	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli}	1
pass	7074849	2022-10-19 18:39:23	2022-10-20 00:51:46	2022-10-20 01:25:58	0:34:12	0:24:10	0:10:02	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big}	2
pass	7074850	2022-10-19 18:39:24	2022-10-20 00:53:57	2022-10-20 01:32:57	0:39:00	0:28:26	0:10:34	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074851	2022-10-19 18:39:26	2022-10-20 00:55:27	2022-10-20 03:20:28	2:25:01	2:17:15	0:07:46	smithi	main	centos	8.stream	rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}}	1
pass	7074852	2022-10-19 18:39:27	2022-10-20 00:57:18	2022-10-20 01:29:39	0:32:21	0:20:43	0:11:38	smithi	main	ubuntu	20.04	rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}	2
pass	7074853	2022-10-19 18:39:28		2022-10-20 01:19:13		913		smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}}	1
pass	7074854	2022-10-19 18:39:29	2022-10-20 00:58:09	2022-10-20 01:20:26	0:22:17	0:13:41	0:08:36	smithi	main	centos	8.stream	rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}	1
pass	7074855	2022-10-19 18:39:31	2022-10-20 00:59:20	2022-10-20 01:28:27	0:29:07	0:20:11	0:08:56	smithi	main	rhel	8.6	rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery}	3
pass	7074856	2022-10-19 18:39:32	2022-10-20 01:01:20	2022-10-20 01:27:45	0:26:25	0:14:49	0:11:36	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small}	2
pass	7074857	2022-10-19 18:39:33	2022-10-20 01:02:01	2022-10-20 01:44:11	0:42:10	0:31:11	0:10:59	smithi	main	ubuntu	20.04	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big}	2
pass	7074858	2022-10-19 18:39:35	2022-10-20 01:02:41	2022-10-20 01:35:46	0:33:05	0:23:54	0:09:11	smithi	main	centos	8.stream	rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}	2
pass	7074859	2022-10-19 18:39:36	2022-10-20 01:04:22	2022-10-20 01:27:23	0:23:01	0:16:13	0:06:48	smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}}	1
pass	7074860	2022-10-19 18:39:37	2022-10-20 01:04:32	2022-10-20 01:27:59	0:23:27	0:16:21	0:07:06	smithi	main	rhel	8.6	rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}	2
pass	7074861	2022-10-19 18:39:38	2022-10-20 01:04:53	2022-10-20 02:02:45	0:57:52	0:50:44	0:07:08	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}	2
pass	7074862	2022-10-19 18:39:40	2022-10-20 01:05:03	2022-10-20 01:24:18	0:19:15	0:09:55	0:09:20	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}	1
pass	7074863	2022-10-19 18:39:41	2022-10-20 01:05:04	2022-10-20 01:30:19	0:25:15	0:17:37	0:07:38	smithi	main	centos	8.stream	rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete}	2
pass	7074864	2022-10-19 18:39:42	2022-10-20 01:05:14	2022-10-20 01:29:27	0:24:13	0:13:30	0:10:43	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074865	2022-10-19 18:39:43	2022-10-20 01:06:05	2022-10-20 01:41:02	0:34:57	0:29:38	0:05:19	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}	2
pass	7074866	2022-10-19 18:39:45	2022-10-20 01:06:25	2022-10-20 01:47:52	0:41:27	0:31:35	0:09:52	smithi	main	ubuntu	20.04	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/module_selftest}	2
pass	7074867	2022-10-19 18:39:46	2022-10-20 01:06:25	2022-10-20 01:23:31	0:17:06	0:11:22	0:05:44	smithi	main	centos	8.stream	rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}	1
pass	7074868	2022-10-19 18:39:47	2022-10-20 01:06:26	2022-10-20 01:45:52	0:39:26	0:28:45	0:10:41	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon}	5
pass	7074869	2022-10-19 18:39:48	2022-10-20 01:10:27	2022-10-20 01:52:08	0:41:41	0:34:44	0:06:57	smithi	main	rhel	8.6	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}	3
pass	7074870	2022-10-19 18:39:50	2022-10-20 01:10:37	2022-10-20 01:35:28	0:24:51	0:19:15	0:05:36	smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}}	1
pass	7074871	2022-10-19 18:39:51	2022-10-20 01:10:38	2022-10-20 01:39:08	0:28:30	0:19:57	0:08:33	smithi	main	rhel	8.6	rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr}	1
pass	7074872	2022-10-19 18:39:52	2022-10-20 01:12:08	2022-10-20 02:02:51	0:50:43	0:43:55	0:06:48	smithi	main	centos	8.stream	rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}	1
pass	7074873	2022-10-19 18:39:53	2022-10-20 01:12:08	2022-10-20 01:59:51	0:47:43	0:33:50	0:13:53	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}	2
pass	7074874	2022-10-19 18:39:55	2022-10-20 01:16:30	2022-10-20 01:50:41	0:34:11	0:23:49	0:10:22	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps}	2
pass	7074875	2022-10-19 18:39:56	2022-10-20 01:19:01	2022-10-20 01:55:54	0:36:53	0:24:34	0:12:19	smithi	main	ubuntu	20.04	rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}	2
pass	7074876	2022-10-19 18:39:57	2022-10-20 01:19:21	2022-10-20 01:49:06	0:29:45	0:23:19	0:06:26	smithi	main	centos	8.stream	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced}	2
pass	7074877	2022-10-19 18:39:58	2022-10-20 01:19:52	2022-10-20 01:37:01	0:17:09	0:10:37	0:06:32	smithi	main	centos	8.stream	rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}	1
pass	7074878	2022-10-19 18:40:00	2022-10-20 01:19:52	2022-10-20 01:56:39	0:36:47	0:26:23	0:10:24	smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}}	2
pass	7074879	2022-10-19 18:40:01	2022-10-20 01:23:33	2022-10-20 04:11:16	2:47:43	2:38:02	0:09:41	smithi	main	ubuntu	20.04	rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}}	1
pass	7074880	2022-10-19 18:40:02	2022-10-20 01:23:43	2022-10-20 01:54:53	0:31:10	0:19:59	0:11:11	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced}	2
pass	7074881	2022-10-19 18:40:04	2022-10-20 01:25:34	2022-10-20 02:12:54	0:47:20	0:40:04	0:07:16	smithi	main	rhel	8.6	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074882	2022-10-19 18:40:05	2022-10-20 01:25:34	2022-10-20 01:58:22	0:32:48	0:24:01	0:08:47	smithi	main	rhel	8.6	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix}	2
pass	7074883	2022-10-19 18:40:07	2022-10-20 01:26:05	2022-10-20 01:48:52	0:22:47	0:10:57	0:11:50	smithi	main	ubuntu	20.04	rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption}	1
pass	7074884	2022-10-19 18:40:08	2022-10-20 01:27:25	2022-10-20 02:02:51	0:35:26	0:25:22	0:10:04	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}	1
pass	7074885	2022-10-19 18:40:09	2022-10-20 01:27:36	2022-10-20 01:58:33	0:30:57	0:23:14	0:07:43	smithi	main	ubuntu	20.04	rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074886	2022-10-19 18:40:10	2022-10-20 01:27:36	2022-10-20 01:57:28	0:29:52	0:19:38	0:10:14	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074887	2022-10-19 18:40:12	2022-10-20 01:27:46	2022-10-20 01:47:37	0:19:51	0:09:42	0:10:09	smithi	main	ubuntu	20.04	rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}	3
pass	7074888	2022-10-19 18:40:13	2022-10-20 01:28:07	2022-10-20 01:56:18	0:28:11	0:17:21	0:10:50	smithi	main	ubuntu	20.04	rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}	2
pass	7074889	2022-10-19 18:40:14	2022-10-20 01:28:37	2022-10-20 02:02:55	0:34:18	0:23:05	0:11:13	smithi	main	ubuntu	20.04	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps}	2
pass	7074890	2022-10-19 18:40:15	2022-10-20 01:29:28	2022-10-20 01:58:15	0:28:47	0:23:14	0:05:33	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}	3
pass	7074891	2022-10-19 18:40:17	2022-10-20 01:29:28	2022-10-20 01:52:48	0:23:20	0:15:52	0:07:28	smithi	main	rhel	8.6	rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}	1
pass	7074892	2022-10-19 18:40:18	2022-10-20 01:29:48	2022-10-20 02:03:34	0:33:46	0:27:15	0:06:31	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}	2
pass	7074893	2022-10-19 18:40:19	2022-10-20 01:30:29	2022-10-20 01:56:36	0:26:07	0:17:25	0:08:42	smithi	main	rhel	8.6	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074894	2022-10-19 18:40:20	2022-10-20 01:33:20	2022-10-20 01:57:03	0:23:43	0:11:55	0:11:48	smithi	main	ubuntu	20.04	rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}	2
pass	7074895	2022-10-19 18:40:21	2022-10-20 01:35:31	2022-10-20 01:59:15	0:23:44	0:16:06	0:07:38	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}	2
pass	7074896	2022-10-19 18:40:23	2022-10-20 01:35:51	2022-10-20 01:55:35	0:19:44	0:13:13	0:06:31	smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}}	1
pass	7074897	2022-10-19 18:40:24	2022-10-20 01:36:52	2022-10-20 02:00:08	0:23:16	0:17:18	0:05:58	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache}	2
pass	7074898	2022-10-19 18:40:25	2022-10-20 01:37:02	2022-10-20 02:05:12	0:28:10	0:20:49	0:07:21	smithi	main	centos	8.stream	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/progress}	2
pass	7074899	2022-10-19 18:40:26	2022-10-20 01:37:12	2022-10-20 02:01:58	0:24:46	0:13:59	0:10:47	smithi	main	centos	8.stream	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}	3
pass	7074900	2022-10-19 18:40:28	2022-10-20 01:41:03	2022-10-20 02:05:14	0:24:11	0:14:20	0:09:51	smithi	main	rhel	8.6	rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}	1
fail	7074901	2022-10-19 18:40:29	2022-10-20 01:44:14	2022-10-20 02:07:20	0:23:06	0:16:34	0:06:32	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm}	1
Failure Reason: SELinux denials found on ubuntu@smithi182.front.sepia.ceph.com: ['type=AVC msg=audit(1666231491.596:19146): avc: denied { ioctl } for pid=120321 comm="iptables" path="/var/lib/containers/storage/overlay/0f2a233aaa8244c503adeedfa6cf6c9f502772384bd6aab554712a00fa5a5e0e/merged" dev="overlay" ino=3281450 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1666231491.708:19149): avc: denied { ioctl } for pid=120337 comm="iptables" path="/var/lib/containers/storage/overlay/0f2a233aaa8244c503adeedfa6cf6c9f502772384bd6aab554712a00fa5a5e0e/merged" dev="overlay" ino=3281450 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']
pass	7074902	2022-10-19 18:40:30	2022-10-20 01:44:15	2022-10-20 02:27:37	0:43:22	0:31:36	0:11:46	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074903	2022-10-19 18:40:31	2022-10-20 01:45:55	2022-10-20 02:53:05	1:07:10	1:00:59	0:06:11	smithi	main	centos	8.stream	rados/standalone/{supported-random-distro$/{centos_8} workloads/misc}	1
pass	7074904	2022-10-19 18:40:33	2022-10-20 01:45:55	2022-10-20 02:07:15	0:21:20	0:13:42	0:07:38	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed}	2
pass	7074905	2022-10-19 18:40:34	2022-10-20 01:45:56	2022-10-20 02:23:03	0:37:07	0:27:39	0:09:28	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread}	2
pass	7074906	2022-10-19 18:40:35	2022-10-20 01:47:47	2022-10-20 02:08:43	0:20:56	0:11:35	0:09:21	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}	1
pass	7074907	2022-10-19 18:40:37	2022-10-20 01:47:47	2022-10-20 02:19:03	0:31:16	0:23:28	0:07:48	smithi	main	centos	8.stream	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read}	2
pass	7074908	2022-10-19 18:40:38		2022-10-20 02:05:12		607		smithi	main	centos	8.stream	rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}}	1
pass	7074909	2022-10-19 18:40:39	2022-10-20 01:47:58	2022-10-20 02:09:58	0:22:00	0:14:10	0:07:50	smithi	main	rhel	8.6	rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}	1
pass	7074910	2022-10-19 18:40:41	2022-10-20 01:48:58	2022-10-20 02:08:23	0:19:25	0:13:10	0:06:15	smithi	main	centos	8.stream	rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}	2
pass	7074911	2022-10-19 18:40:42	2022-10-20 01:49:08	2022-10-20 02:33:41	0:44:33	0:37:24	0:07:09	smithi	main	rhel	8.6	rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}	1
pass	7074912	2022-10-19 18:40:43	2022-10-20 01:50:49	2022-10-20 02:29:55	0:39:06	0:27:53	0:11:13	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074913	2022-10-19 18:40:44	2022-10-20 01:52:10	2022-10-20 02:15:55	0:23:45	0:16:20	0:07:25	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps}	2
pass	7074914	2022-10-19 18:40:46	2022-10-20 01:52:10	2022-10-20 02:11:56	0:19:46	0:13:09	0:06:37	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074915	2022-10-19 18:40:47	2022-10-20 01:52:50	2022-10-20 02:30:29	0:37:39	0:25:22	0:12:17	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}	2
pass	7074916	2022-10-19 18:40:48	2022-10-20 01:55:01	2022-10-20 02:19:45	0:24:44	0:16:27	0:08:17	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}	2
pass	7074917	2022-10-19 18:40:50	2022-10-20 01:56:02	2022-10-20 02:16:52	0:20:50	0:15:01	0:05:49	smithi	main	rhel	8.6	rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}	1
pass	7074918	2022-10-19 18:40:51	2022-10-20 01:56:02	2022-10-20 02:15:23	0:19:21	0:12:58	0:06:23	smithi	main	rhel	8.6	rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}	2
pass	7074919	2022-10-19 18:40:52	2022-10-20 01:56:22	2022-10-20 02:31:48	0:35:26	0:29:17	0:06:09	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects}	2
pass	7074920	2022-10-19 18:40:54	2022-10-20 01:56:43	2022-10-20 03:17:44	1:21:01	1:14:09	0:06:52	smithi	main	centos	8.stream	rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard}	2
fail	7074921	2022-10-19 18:40:55	2022-10-20 01:56:43	2022-10-20 02:14:09	0:17:26	0:06:46	0:10:40	smithi	main	ubuntu	20.04	rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}	1
Failure Reason: Command failed on smithi107 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'
pass	7074922	2022-10-19 18:40:56	2022-10-20 01:56:44	2022-10-20 02:26:27	0:29:43	0:19:03	0:10:40	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074923	2022-10-19 18:40:57	2022-10-20 01:56:44	2022-10-20 03:28:10	1:31:26	1:25:38	0:05:48	smithi	main	rhel	8.6	rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}	2
pass	7074924	2022-10-19 18:40:59	2022-10-20 01:57:04	2022-10-20 02:12:52	0:15:48	0:07:56	0:07:52	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos}	1
pass	7074925	2022-10-19 18:41:00	2022-10-20 01:57:35	2022-10-20 03:06:14	1:08:39	0:57:23	0:11:16	smithi	main	ubuntu	20.04	rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}	1
fail	7074926	2022-10-19 18:41:01	2022-10-20 01:58:25	2022-10-20 07:09:02	5:10:37	5:02:34	0:08:03	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}	2
Failure Reason: Command failed (workunit test cls/test_cls_rgw.sh) on smithi043 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b40a3bed7bdeff6224dd522c5b540bbe0d11c858 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh'
pass	7074927	2022-10-19 18:41:03	2022-10-20 01:58:26	2022-10-20 02:23:02	0:24:36	0:13:41	0:10:55	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074928	2022-10-19 18:41:04	2022-10-20 01:59:16	2022-10-20 02:38:53	0:39:37	0:32:27	0:07:10	smithi	main	rhel	8.6	rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests}	2
pass	7074929	2022-10-19 18:41:05	2022-10-20 01:59:57	2022-10-20 02:18:54	0:18:57	0:10:22	0:08:35	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}	1
pass	7074930	2022-10-19 18:41:06	2022-10-20 01:59:57	2022-10-20 02:43:24	0:43:27	0:36:04	0:07:23	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests}	2
pass	7074931	2022-10-19 18:41:08	2022-10-20 02:00:18	2022-10-20 02:25:08	0:24:50	0:15:54	0:08:56	smithi	main	rhel	8.6	rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}	1
pass	7074932	2022-10-19 18:41:09	2022-10-20 02:02:08	2022-10-20 02:25:15	0:23:07	0:14:21	0:08:46	smithi	main	ubuntu	20.04	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}	2
pass	7074933	2022-10-19 18:41:10	2022-10-20 02:02:08	2022-10-20 02:22:32	0:20:24	0:12:14	0:08:10	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074934	2022-10-19 18:41:11	2022-10-20 02:02:49	2022-10-20 02:46:02	0:43:13	0:36:52	0:06:21	smithi	main	rhel	8.6	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}	3
pass	7074935	2022-10-19 18:41:13	2022-10-20 02:02:59	2022-10-20 03:12:04	1:09:05	1:00:04	0:09:01	smithi	main	ubuntu	20.04	rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074936	2022-10-19 18:41:14	2022-10-20 02:03:00	2022-10-20 02:27:04	0:24:04	0:13:37	0:10:27	smithi	main	ubuntu	20.04	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/prometheus}	2
pass	7074937	2022-10-19 18:41:15	2022-10-20 02:03:40	2022-10-20 02:51:24	0:47:44	0:38:26	0:09:18	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}	3
pass	7074938	2022-10-19 18:41:17	2022-10-20 02:05:21	2022-10-20 02:26:41	0:21:20	0:14:23	0:06:57	smithi	main	centos	8.stream	rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}	2
pass	7074939	2022-10-19 18:41:18	2022-10-20 02:05:21	2022-10-20 02:32:14	0:26:53	0:17:54	0:08:59	smithi	main	rhel	8.6	rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}}	1
pass	7074940	2022-10-19 18:41:19	2022-10-20 02:07:22	2022-10-20 02:52:40	0:45:18	0:38:34	0:06:44	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency}	2
pass	7074941	2022-10-19 18:41:21	2022-10-20 02:07:23	2022-10-20 02:42:10	0:34:47	0:24:21	0:10:26	smithi	main	ubuntu	20.04	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes}	2
pass	7074942	2022-10-19 18:41:22	2022-10-20 02:08:33	2022-10-20 02:29:41	0:21:08	0:12:04	0:09:04	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074943	2022-10-19 18:41:23	2022-10-20 02:08:44	2022-10-20 03:35:10	1:26:26	1:18:16	0:08:10	smithi	main	centos	8.stream	rados/standalone/{supported-random-distro$/{centos_8} workloads/mon}	1
pass	7074944	2022-10-19 18:41:25	2022-10-20 02:10:04	2022-10-20 02:31:31	0:21:27	0:09:31	0:11:56	smithi	main	ubuntu	20.04	rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074945	2022-10-19 18:41:26	2022-10-20 02:12:05	2022-10-20 02:38:24	0:26:19	0:18:45	0:07:34	smithi	main	rhel	8.6	rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}	2
pass	7074946	2022-10-19 18:41:27	2022-10-20 02:12:56	2022-10-20 02:48:02	0:35:06	0:28:45	0:06:21	smithi	main	centos	8.stream	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7074947	2022-10-19 18:41:28	2022-10-20 02:12:56	2022-10-20 03:29:36	1:16:40	1:08:23	0:08:17	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench}	2
pass	7074948	2022-10-19 18:41:30	2022-10-20 02:14:17	2022-10-20 03:22:36	1:08:19	1:01:16	0:07:03	smithi	main	rhel	8.6	rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}	1
pass	7074949	2022-10-19 18:41:31	2022-10-20 02:15:17	2022-10-20 02:34:19	0:19:02	0:11:48	0:07:14	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074950	2022-10-19 18:41:32	2022-10-20 02:15:18	2022-10-20 02:36:43	0:21:25	0:12:07	0:09:18	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}	1
fail	7074951	2022-10-19 18:41:34	2022-10-20 02:15:18	2022-10-20 02:28:37	0:13:19	0:06:06	0:07:13	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}	1
Failure Reason: Command failed on smithi203 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'
pass	7074952	2022-10-19 18:41:35	2022-10-20 02:15:28	2022-10-20 02:41:38	0:26:10	0:17:56	0:08:14	smithi	main	rhel	8.6	rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery}	2
pass	7074953	2022-10-19 18:41:36	2022-10-20 02:15:59	2022-10-20 02:43:52	0:27:53	0:20:38	0:07:15	smithi	main	rhel	8.6	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test}	2
pass	7074954	2022-10-19 18:41:37	2022-10-20 02:16:59	2022-10-20 02:42:16	0:25:17	0:16:23	0:08:54	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect}	2
pass	7074955	2022-10-19 18:41:39	2022-10-20 02:19:10	2022-10-20 02:48:39	0:29:29	0:18:08	0:11:21	smithi	main	rhel	8.6	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074956	2022-10-19 18:41:40	2022-10-20 02:22:41	2022-10-20 02:44:17	0:21:36	0:14:19	0:07:17	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}	2
pass	7074957	2022-10-19 18:41:41	2022-10-20 02:23:12	2022-10-20 04:00:43	1:37:31	1:31:24	0:06:07	smithi	main	centos	8.stream	rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}	1
pass	7074958	2022-10-19 18:41:43	2022-10-20 02:23:12	2022-10-20 03:27:58	1:04:46	0:59:21	0:05:25	smithi	main	centos	8.stream	rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune}	2
pass	7074959	2022-10-19 18:41:44	2022-10-20 02:23:12	2022-10-20 03:01:37	0:38:25	0:33:30	0:04:55	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}	1
pass	7074960	2022-10-19 18:41:45	2022-10-20 02:23:13	2022-10-20 02:44:19	0:21:06	0:11:07	0:09:59	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074961	2022-10-19 18:41:46	2022-10-20 02:23:13	2022-10-20 03:00:07	0:36:54	0:29:40	0:07:14	smithi	main	rhel	8.6	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}	2
pass	7074962	2022-10-19 18:41:48	2022-10-20 02:25:24	2022-10-20 02:53:34	0:28:10	0:20:43	0:07:27	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests}	2
pass	7074963	2022-10-19 18:41:49	2022-10-20 02:26:35	2022-10-20 02:52:21	0:25:46	0:18:03	0:07:43	smithi	main	rhel	8.6	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}	3
pass	7074964	2022-10-19 18:41:50	2022-10-20 02:27:05	2022-10-20 02:48:25	0:21:20	0:13:32	0:07:48	smithi	main	centos	8.stream	rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}	2
pass	7074965	2022-10-19 18:41:52	2022-10-20 02:27:25	2022-10-20 02:46:16	0:18:51	0:12:25	0:06:26	smithi	main	centos	8.stream	rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}	1
pass	7074966	2022-10-19 18:41:53	2022-10-20 02:27:26	2022-10-20 03:09:21	0:41:55	0:32:39	0:09:16	smithi	main	ubuntu	20.04	rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}}	1
pass	7074967	2022-10-19 18:41:54	2022-10-20 02:27:46	2022-10-20 02:47:44	0:19:58	0:13:01	0:06:57	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074968	2022-10-19 18:41:55	2022-10-19 23:45:54	2022-10-20 00:04:56	0:19:02	0:11:59	0:07:03	smithi	main	centos	8.stream	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/workunits}	2
pass	7074969	2022-10-19 18:41:57	2022-10-20 02:28:47	2022-10-20 03:03:15	0:34:28	0:26:15	0:08:13	smithi	main	rhel	8.6	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects}	2
pass	7074970	2022-10-19 18:41:58	2022-10-20 02:29:57	2022-10-20 02:53:41	0:23:44	0:16:18	0:07:26	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object}	2
pass	7074971	2022-10-19 18:41:59	2022-10-20 02:30:38	2022-10-20 02:56:38	0:26:00	0:18:16	0:07:44	smithi	main	rhel	8.6	rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}	2
pass	7074972	2022-10-19 18:42:01	2022-10-20 02:31:38	2022-10-20 02:53:30	0:21:52	0:11:24	0:10:28	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}	1
pass	7074973	2022-10-19 18:42:02	2022-10-20 02:31:59	2022-10-20 02:55:05	0:23:06	0:16:37	0:06:29	smithi	main	rhel	8.6	rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}	1
pass	7074974	2022-10-19 18:42:03	2022-10-20 02:31:59	2022-10-20 02:51:46	0:19:47	0:09:06	0:10:41	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074975	2022-10-19 18:42:04	2022-10-20 02:32:19	2022-10-20 07:11:14	4:38:55	4:27:46	0:11:09	smithi	main	ubuntu	20.04	rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill}	1
pass	7074976	2022-10-19 18:42:06	2022-10-20 02:33:50	2022-10-20 03:19:25	0:45:35	0:37:44	0:07:51	smithi	main	centos	8.stream	rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}	1
pass	7074977	2022-10-19 18:42:07	2022-10-20 02:34:20	2022-10-20 03:11:56	0:37:36	0:27:20	0:10:16	smithi	main	rhel	8.6	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
fail	7074978	2022-10-19 18:42:08	2022-10-20 02:38:31	2022-10-20 03:08:01	0:29:30	0:18:55	0:10:35	smithi	main	ubuntu	20.04	rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}	1
Failure Reason: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI)
pass	7074979	2022-10-19 18:42:09	2022-10-20 02:38:32	2022-10-20 02:57:57	0:19:25	0:13:03	0:06:22	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test}	2
pass	7074980	2022-10-19 18:42:11	2022-10-20 02:39:02	2022-10-20 03:05:23	0:26:21	0:16:14	0:10:07	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read}	2
pass	7074981	2022-10-19 18:42:12	2022-10-20 02:41:43	2022-10-20 03:07:33	0:25:50	0:19:06	0:06:44	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}	3
pass	7074982	2022-10-19 18:42:13	2022-10-20 02:42:24	2022-10-20 03:03:58	0:21:34	0:12:23	0:09:11	smithi	main	ubuntu	20.04	rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}	1
pass	7074983	2022-10-19 18:42:15	2022-10-20 02:42:24	2022-10-20 03:03:16	0:20:52	0:09:10	0:11:42	smithi	main	ubuntu	20.04	rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}	3
pass	7074984	2022-10-19 18:42:16	2022-10-20 02:43:54	2022-10-20 03:00:20	0:16:26	0:11:21	0:05:05	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}}	1
pass	7074985	2022-10-19 18:42:17	2022-10-20 02:43:55	2022-10-20 03:19:49	0:35:54	0:25:43	0:10:11	smithi	main	ubuntu	20.04	rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}	2
pass	7074986	2022-10-19 18:42:18	2022-10-20 02:44:25	2022-10-20 03:07:21	0:22:56	0:13:58	0:08:58	smithi	main	centos	8.stream	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7074987	2022-10-19 18:42:20	2022-10-20 02:46:06	2022-10-20 03:29:27	0:43:21	0:36:53	0:06:28	smithi	main	rhel	8.6	rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}	1
pass	7074988	2022-10-19 18:42:21	2022-10-20 02:46:26	2022-10-20 03:19:06	0:32:40	0:25:11	0:07:29	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced}	2
pass	7074989	2022-10-19 18:42:22	2022-10-20 02:48:07	2022-10-20 03:53:31	1:05:24	0:59:30	0:05:54	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}	2
pass	7074990	2022-10-19 18:42:24	2022-10-20 02:48:27	2022-10-20 03:28:29	0:40:02	0:32:31	0:07:31	smithi	main	centos	8.stream	rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits}	2
pass	7074991	2022-10-19 18:42:25	2022-10-20 02:48:48	2022-10-20 03:10:45	0:21:57	0:14:05	0:07:52	smithi	main	centos	8.stream	rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}	1
pass	7074992	2022-10-19 18:42:26	2022-10-20 02:48:48	2022-10-20 03:11:49	0:23:01	0:16:46	0:06:15	smithi	main	rhel	8.6	rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}	2
pass	7074993	2022-10-19 18:42:27	2022-10-20 02:48:49	2022-10-20 03:10:29	0:21:40	0:12:09	0:09:31	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7074994	2022-10-19 18:42:29	2022-10-20 02:51:29	2022-10-20 03:10:49	0:19:20	0:10:15	0:09:05	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}	1
dead	7074995	2022-10-19 18:42:30	2022-10-20 02:51:30	2022-10-20 15:10:53	12:19:23			smithi	main	centos	8.stream	rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}}	1
Failure Reason: hit max job timeout
pass	7074996	2022-10-19 18:42:31	2022-10-20 02:51:30	2022-10-20 03:46:13	0:54:43	0:43:12	0:11:31	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}	3
pass	7074997	2022-10-19 18:42:33	2022-10-20 02:52:30	2022-10-20 03:22:06	0:29:36	0:22:55	0:06:41	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized}	2
pass	7074998	2022-10-19 18:42:34	2022-10-20 02:52:41	2022-10-20 03:13:47	0:21:06	0:15:31	0:05:35	smithi	main	rhel	8.6	rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}	1
pass	7074999	2022-10-19 18:42:35	2022-10-20 02:52:41	2022-10-20 03:26:48	0:34:07	0:25:48	0:08:19	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}	5
dead	7075000	2022-10-19 18:42:37	2022-10-20 02:53:42	2022-10-20 15:06:32	12:12:50			smithi	main	rhel	8.6	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}	2
Failure Reason: hit max job timeout
pass	7075001	2022-10-19 18:42:38	2022-10-20 02:55:13	2022-10-20 03:27:50	0:32:37	0:24:10	0:08:27	smithi	main	centos	8.stream	rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e}	2
pass	7075002	2022-10-19 18:42:39	2022-10-20 02:56:43	2022-10-20 03:21:04	0:24:21	0:16:47	0:07:34	smithi	main	rhel	8.6	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/crash}	2
fail	7075003	2022-10-19 18:42:41	2022-10-20 02:58:04	2022-10-20 03:37:24	0:39:20	0:27:41	0:11:39	smithi	main	ubuntu	20.04	rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}	3
Failure Reason: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
pass	7075004	2022-10-19 18:42:42	2022-10-20 03:00:25	2022-10-20 03:18:41	0:18:16	0:08:46	0:09:30	smithi	main	ubuntu	20.04	rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}	1
pass	7075005	2022-10-19 18:42:43	2022-10-20 03:01:45	2022-10-20 03:26:40	0:24:55	0:17:24	0:07:31	smithi	main	centos	8.stream	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/libcephsqlite}	2
pass	7075006	2022-10-19 18:42:44	2022-10-20 03:03:16	2022-10-20 03:38:18	0:35:02	0:28:09	0:06:53	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects}	2
pass	7075007	2022-10-19 18:42:46	2022-10-20 03:03:16	2022-10-20 03:39:13	0:35:57	0:29:20	0:06:37	smithi	main	rhel	8.6	rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}	2
pass	7075008	2022-10-19 18:42:47	2022-10-20 03:04:07	2022-10-20 03:29:07	0:25:00	0:16:02	0:08:58	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}	2
pass	7075009	2022-10-19 18:42:48	2022-10-20 03:05:27	2022-10-20 03:30:00	0:24:33	0:14:07	0:10:26	smithi	main	ubuntu	20.04	rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}	1
pass	7075010	2022-10-19 18:42:50	2022-10-20 03:06:18	2022-10-20 03:45:29	0:39:11	0:28:44	0:10:27	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7075011	2022-10-19 18:42:51	2022-10-20 03:07:28	2022-10-20 03:26:14	0:18:46	0:12:31	0:06:15	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7075012	2022-10-19 18:42:52	2022-10-20 03:07:29	2022-10-20 06:32:05	3:24:36	3:19:13	0:05:23	smithi	main	rhel	8.6	rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd}	1
pass	7075013	2022-10-19 18:42:54	2022-10-20 03:07:29	2022-10-20 03:44:47	0:37:18	0:30:07	0:07:11	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced}	2
pass	7075014	2022-10-19 18:42:55	2022-10-20 03:07:39	2022-10-20 03:30:30	0:22:51	0:16:16	0:06:35	smithi	main	rhel	8.6	rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}	1
pass	7075015	2022-10-19 18:42:56	2022-10-20 03:07:40	2022-10-20 03:27:07	0:19:27	0:11:41	0:07:46	smithi	main	centos	8.stream	rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}	1
pass	7075016	2022-10-19 18:42:58	2022-10-20 03:08:10	2022-10-20 03:28:55	0:20:45	0:10:21	0:10:24	smithi	main	centos	8.stream	rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}	3
pass	7075017	2022-10-19 18:42:59	2022-10-20 03:10:51	2022-10-20 03:30:22	0:19:31	0:10:06	0:09:25	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}	1
pass	7075018	2022-10-19 18:43:00	2022-10-20 03:10:51	2022-10-20 03:33:28	0:22:37	0:13:57	0:08:40	smithi	main	centos	8.stream	rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}	4
pass	7075019	2022-10-19 18:43:01	2022-10-20 03:12:02	2022-10-20 03:40:59	0:28:57	0:19:36	0:09:21	smithi	main	centos	8.stream	rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep}	2
pass	7075020	2022-10-19 18:43:03	2022-10-20 03:13:53	2022-10-20 03:40:45	0:26:52	0:15:51	0:11:01	smithi	main	rhel	8.6	rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}	2
pass	7075021	2022-10-19 18:43:04	2022-10-20 03:17:54	2022-10-20 03:41:27	0:23:33	0:16:45	0:06:48	smithi	main	rhel	8.6	rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}}	1
pass	7075022	2022-10-19 18:43:05	2022-10-20 03:18:44	2022-10-20 03:54:16	0:35:32	0:28:17	0:07:15	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized}	2
pass	7075023	2022-10-19 18:43:07	2022-10-20 03:19:15	2022-10-20 03:58:57	0:39:42	0:32:59	0:06:43	smithi	main	rhel	8.6	rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects}	2
pass	7075024	2022-10-19 18:43:08	2022-10-20 03:19:55	2022-10-20 04:29:29	1:09:34	1:00:02	0:09:32	smithi	main	ubuntu	20.04	rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}	1
pass	7075025	2022-10-19 18:43:09	2022-10-20 03:19:56	2022-10-20 06:10:08	2:50:12	2:21:15	0:28:57	smithi	main	ubuntu	20.04	rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}}	1
pass	7075026	2022-10-19 18:43:10	2022-10-20 03:20:36	2022-10-20 04:01:24	0:40:48	0:31:50	0:08:58	smithi	main	centos	8.stream	rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}	3
pass	7075027	2022-10-19 18:43:12	2022-10-20 03:22:07	2022-10-20 03:40:47	0:18:40	0:11:42	0:06:58	smithi	main	centos	8.stream	rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}	1
pass	7075028	2022-10-19 18:43:13	2022-10-20 03:22:07	2022-10-20 03:48:31	0:26:24	0:10:50	0:15:34	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}	3
pass	7075029	2022-10-19 18:43:14	2022-10-20 03:26:48	2022-10-20 04:03:52	0:37:04	0:30:15	0:06:49	smithi	main	rhel	8.6	rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests}	2
pass	7075030	2022-10-19 18:43:15	2022-10-20 03:26:59	2022-10-20 04:02:13	0:35:14	0:28:47	0:06:27	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects}	2
pass	7075031	2022-10-19 18:43:17	2022-10-20 03:26:59	2022-10-20 03:51:21	0:24:22	0:17:29	0:06:53	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}}	1
pass	7075032	2022-10-19 18:43:18	2022-10-20 03:26:59	2022-10-20 04:22:18	0:55:19	0:49:18	0:06:01	smithi	main	centos	8.stream	rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}	1
pass	7075033	2022-10-19 18:43:19	2022-10-20 03:27:00	2022-10-20 03:50:42	0:23:42	0:16:17	0:07:25	smithi	main	centos	8.stream	rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}	2
pass	7075034	2022-10-19 18:43:20	2022-10-20 03:28:00	2022-10-20 04:01:04	0:33:04	0:27:09	0:05:55	smithi	main	centos	8.stream	rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}	2
pass	7075035	2022-10-19 18:43:22	2022-10-20 03:28:01	2022-10-20 03:53:25	0:25:24	0:18:18	0:07:06	smithi	main	rhel	8.6	rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed}	2
pass	7075036	2022-10-19 18:43:23	2022-10-20 03:28:21	2022-10-20 03:52:11	0:23:50	0:15:58	0:07:52	smithi	main	centos	8.stream	rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/failover}	2
pass	7075037	2022-10-19 18:43:24	2022-10-20 03:28:31	2022-10-20 03:58:00	0:29:29	0:21:45	0:07:44	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}}	2
pass	7075038	2022-10-19 18:43:25	2022-10-20 03:29:02	2022-10-20 03:59:00	0:29:58	0:23:04	0:06:54	smithi	main	centos	8.stream	rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}	1
pass	7075039	2022-10-19 18:43:27	2022-10-20 03:29:02	2022-10-20 03:48:33	0:19:31	0:10:10	0:09:21	smithi	main	ubuntu	20.04	rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}	1
pass	7075040	2022-10-19 18:43:28	2022-10-20 03:29:03	2022-10-20 04:05:28	0:36:25	0:25:12	0:11:13	smithi	main	ubuntu	20.04	rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}	2
pass	7075041	2022-10-19 18:43:29	2022-10-20 03:29:13	2022-10-20 03:54:24	0:25:11	0:19:37	0:05:34	smithi	main	rhel	8.6	rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}	1
pass	7075042	2022-10-19 18:43:30	2022-10-20 03:29:33	2022-10-20 03:59:09	0:29:36	0:22:53	0:06:43	smithi	main	centos	8.stream	rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests}	2
pass	7075043	2022-10-19 18:43:32	2022-10-20 03:29:44	2022-10-20 03:50:11	0:20:27	0:10:34	0:09:53	smithi	main	ubuntu	20.04	rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}	2
pass	7075044	2022-10-19 18:43:33	2022-10-20 03:30:24	2022-10-20 03:49:25	0:19:01	0:12:52	0:06:09	smithi	main	rhel	8.6	rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}	1
pass	7075045	2022-10-19 18:43:34	2022-10-20 03:30:35	2022-10-20 04:00:42	0:30:07	0:20:29	0:09:38	smithi	main	centos	8.stream	rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}}	1