Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6612164 2022-01-13 05:30:56 2022-01-13 11:06:03 2022-01-13 11:26:27 0:20:24 0:08:44 0:11:40 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} 2
pass 6612165 2022-01-13 05:30:57 2022-01-13 11:06:43 2022-01-13 11:30:53 0:24:10 0:12:43 0:11:27 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6612166 2022-01-13 05:30:58 2022-01-13 11:06:43 2022-01-13 12:40:08 1:33:25 1:18:25 0:15:00 smithi master centos 8.3 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6612167 2022-01-13 05:30:59 2022-01-13 11:07:04 2022-01-13 11:28:14 0:21:10 0:11:34 0:09:36 smithi master centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6612168 2022-01-13 05:31:00 2022-01-13 11:07:04 2022-01-13 12:07:20 1:00:16 0:40:25 0:19:51 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6612169 2022-01-13 05:31:01 2022-01-13 11:08:14 2022-01-13 11:47:48 0:39:34 0:32:21 0:07:13 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6612170 2022-01-13 05:31:02 2022-01-13 11:08:45 2022-01-13 11:34:14 0:25:29 0:15:53 0:09:36 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/rados_cls_all} 2
pass 6612171 2022-01-13 05:31:03 2022-01-13 11:08:55 2022-01-13 11:44:45 0:35:50 0:25:28 0:10:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6612172 2022-01-13 05:31:04 2022-01-13 11:09:26 2022-01-13 12:42:35 1:33:09 1:17:51 0:15:18 smithi master centos 8.3 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6612173 2022-01-13 05:31:05 2022-01-13 11:09:26 2022-01-13 12:32:45 1:23:19 1:13:50 0:09:29 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} 2
pass 6612174 2022-01-13 05:31:06 2022-01-13 11:09:26 2022-01-13 11:30:14 0:20:48 0:09:48 0:11:00 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 6612175 2022-01-13 05:31:07 2022-01-13 11:10:17 2022-01-13 11:29:41 0:19:24 0:07:11 0:12:13 smithi master ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 6612176 2022-01-13 05:31:08 2022-01-13 11:10:17 2022-01-13 11:33:33 0:23:16 0:12:54 0:10:22 smithi master centos 8.stream rados/rest/{mgr-restful supported-random-distro$/{centos_8.stream}} 1
pass 6612177 2022-01-13 05:31:08 2022-01-13 11:10:17 2022-01-13 11:36:02 0:25:45 0:16:10 0:09:35 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 6612178 2022-01-13 05:31:09 2022-01-13 11:10:28 2022-01-13 12:02:04 0:51:36 0:32:02 0:19:34 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
Failure Reason:

No module named 'tasks.ceph'

pass 6612179 2022-01-13 05:31:10 2022-01-13 11:10:28 2022-01-13 11:56:22 0:45:54 0:26:49 0:19:05 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6612180 2022-01-13 05:31:11 2022-01-13 11:11:08 2022-01-13 11:56:20 0:45:12 0:39:31 0:05:41 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612181 2022-01-13 05:31:12 2022-01-13 11:11:09 2022-01-13 12:51:59 1:40:50 1:21:18 0:19:32 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} 2
pass 6612182 2022-01-13 05:31:13 2022-01-13 11:12:19 2022-01-13 11:57:42 0:45:23 0:38:32 0:06:51 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
pass 6612183 2022-01-13 05:31:14 2022-01-13 11:12:29 2022-01-13 11:31:56 0:19:27 0:10:02 0:09:25 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6612184 2022-01-13 05:31:15 2022-01-13 11:12:30 2022-01-13 11:29:05 0:16:35 0:06:04 0:10:31 smithi master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 6612185 2022-01-13 05:31:16 2022-01-13 11:12:50 2022-01-13 11:32:23 0:19:33 0:09:29 0:10:04 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6612186 2022-01-13 05:31:17 2022-01-13 11:12:50 2022-01-13 12:03:23 0:50:33 0:28:12 0:22:21 smithi master centos 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} 2
pass 6612187 2022-01-13 05:31:18 2022-01-13 11:14:11 2022-01-13 11:47:10 0:32:59 0:23:45 0:09:14 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612188 2022-01-13 05:31:19 2022-01-13 11:15:51 2022-01-13 13:21:27 2:05:36 1:44:39 0:20:57 smithi master centos 8.3 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6612189 2022-01-13 05:31:20 2022-01-13 11:16:12 2022-01-13 11:52:40 0:36:28 0:23:22 0:13:06 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6612190 2022-01-13 05:31:21 2022-01-13 11:19:22 2022-01-13 11:42:54 0:23:32 0:13:24 0:10:08 smithi master centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6612191 2022-01-13 05:31:22 2022-01-13 11:19:23 2022-01-13 12:04:56 0:45:33 0:28:33 0:17:00 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_python} 2
pass 6612192 2022-01-13 05:31:23 2022-01-13 11:19:43 2022-01-13 12:07:21 0:47:38 0:40:42 0:06:56 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 6612193 2022-01-13 05:31:24 2022-01-13 11:20:04 2022-01-13 13:03:36 1:43:32 1:27:57 0:15:35 smithi master centos 8.3 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6612194 2022-01-13 05:31:25 2022-01-13 11:20:04 2022-01-13 11:42:21 0:22:17 0:11:41 0:10:36 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 6612195 2022-01-13 05:31:26 2022-01-13 11:20:04 2022-01-13 13:29:39 2:09:35 1:58:31 0:11:04 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 6612196 2022-01-13 05:31:27 2022-01-13 11:20:05 2022-01-13 11:39:08 0:19:03 0:09:59 0:09:04 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6612197 2022-01-13 05:31:28 2022-01-13 11:20:15 2022-01-13 12:17:35 0:57:20 0:51:37 0:05:43 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 6612198 2022-01-13 05:31:29 2022-01-13 11:20:25 2022-01-13 11:44:51 0:24:26 0:13:00 0:11:26 smithi master centos 8.stream rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8.stream}} 1
pass 6612199 2022-01-13 05:31:30 2022-01-13 11:21:56 2022-01-13 11:37:21 0:15:25 0:06:38 0:08:47 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612200 2022-01-13 05:31:31 2022-01-13 11:21:56 2022-01-13 11:45:11 0:23:15 0:09:28 0:13:47 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6612201 2022-01-13 05:31:32 2022-01-13 11:24:47 2022-01-13 11:46:58 0:22:11 0:12:13 0:09:58 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect} 2
pass 6612202 2022-01-13 05:31:32 2022-01-13 11:25:47 2022-01-13 12:15:55 0:50:08 0:33:58 0:16:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} 2
pass 6612203 2022-01-13 05:31:33 2022-01-13 11:26:38 2022-01-13 12:06:05 0:39:27 0:27:09 0:12:18 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6612204 2022-01-13 05:31:34 2022-01-13 11:28:08 2022-01-13 12:06:45 0:38:37 0:27:11 0:11:26 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612205 2022-01-13 05:31:35 2022-01-13 11:28:19 2022-01-13 12:10:00 0:41:41 0:30:46 0:10:55 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6612206 2022-01-13 05:31:36 2022-01-13 11:28:49 2022-01-13 12:00:33 0:31:44 0:23:52 0:07:52 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6612207 2022-01-13 05:31:37 2022-01-13 11:29:09 2022-01-13 11:51:17 0:22:08 0:12:23 0:09:45 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6612208 2022-01-13 05:31:38 2022-01-13 11:29:10 2022-01-13 11:57:21 0:28:11 0:20:33 0:07:38 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 6612209 2022-01-13 05:31:39 2022-01-13 11:30:10 2022-01-13 12:28:44 0:58:34 0:35:50 0:22:44 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612210 2022-01-13 05:31:40 2022-01-13 11:36:34 2022-01-13 11:54:35 0:18:01 0:07:20 0:10:41 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612211 2022-01-13 05:31:41 2022-01-13 11:36:54 2022-01-13 12:28:32 0:51:38 0:45:44 0:05:54 smithi master rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6612212 2022-01-13 05:31:42 2022-01-13 11:36:54 2022-01-13 12:12:29 0:35:35 0:26:55 0:08:40 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6612213 2022-01-13 05:31:43 2022-01-13 11:38:45 2022-01-13 12:01:45 0:23:00 0:14:08 0:08:52 smithi master centos 8.stream rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 1
pass 6612214 2022-01-13 05:31:44 2022-01-13 11:38:45 2022-01-13 12:02:42 0:23:57 0:13:15 0:10:42 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 6612215 2022-01-13 05:31:45 2022-01-13 11:39:16 2022-01-13 13:15:55 1:36:39 1:16:02 0:20:37 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 6612216 2022-01-13 05:31:46 2022-01-13 11:40:26 2022-01-13 12:25:36 0:45:10 0:25:13 0:19:57 smithi master centos 8.3 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6612217 2022-01-13 05:31:47 2022-01-13 11:42:27 2022-01-13 12:02:08 0:19:41 0:10:06 0:09:35 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6612218 2022-01-13 05:31:48 2022-01-13 11:42:27 2022-01-13 12:18:02 0:35:35 0:20:10 0:15:25 smithi master centos 8.3 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6612219 2022-01-13 05:31:49 2022-01-13 11:42:57 2022-01-13 12:23:39 0:40:42 0:33:03 0:07:39 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6612220 2022-01-13 05:31:50 2022-01-13 11:43:58 2022-01-13 12:36:01 0:52:03 0:33:39 0:18:24 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 6612221 2022-01-13 05:31:51 2022-01-13 11:44:48 2022-01-13 12:25:56 0:41:08 0:25:12 0:15:56 smithi master centos 8.3 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 6612222 2022-01-13 05:31:52 2022-01-13 11:44:58 2022-01-13 12:12:42 0:27:44 0:20:42 0:07:02 smithi master rhel 8.4 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 6612223 2022-01-13 05:31:53 2022-01-13 11:45:19 2022-01-13 12:01:30 0:16:11 0:05:17 0:10:54 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

No module named 'tasks.ceph'

pass 6612224 2022-01-13 05:31:54 2022-01-13 11:45:49 2022-01-13 12:30:16 0:44:27 0:26:03 0:18:24 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_striper} 2
fail 6612225 2022-01-13 05:31:55 2022-01-13 11:47:00 2022-01-13 12:04:46 0:17:46 0:06:48 0:10:58 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

Command failed on smithi176 with status 1: 'sudo yum -y install cephfs-java'

pass 6612226 2022-01-13 05:31:56 2022-01-13 11:47:20 2022-01-13 12:36:34 0:49:14 0:42:25 0:06:49 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/module_selftest} 2
pass 6612227 2022-01-13 05:31:57 2022-01-13 11:47:21 2022-01-13 13:00:46 1:13:25 0:57:37 0:15:48 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} 2
pass 6612228 2022-01-13 05:31:58 2022-01-13 11:47:31 2022-01-13 12:34:54 0:47:23 0:27:25 0:19:58 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6612229 2022-01-13 05:31:58 2022-01-13 11:47:41 2022-01-13 12:21:02 0:33:21 0:23:00 0:10:21 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612230 2022-01-13 05:32:00 2022-01-13 11:47:52 2022-01-13 12:39:43 0:51:51 0:33:38 0:18:13 smithi master centos 8.3 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6612231 2022-01-13 05:32:01 2022-01-13 11:48:52 2022-01-13 12:06:33 0:17:41 0:08:09 0:09:32 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612232 2022-01-13 05:32:01 2022-01-13 11:48:52 2022-01-13 12:28:53 0:40:01 0:31:12 0:08:49 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6612233 2022-01-13 05:32:02 2022-01-13 11:51:23 2022-01-13 12:15:29 0:24:06 0:10:35 0:13:31 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 6612234 2022-01-13 05:32:03 2022-01-13 11:52:44 2022-01-13 12:10:25 0:17:41 0:05:12 0:12:29 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
Failure Reason:

No module named 'tasks'

pass 6612235 2022-01-13 05:32:04 2022-01-13 11:54:44 2022-01-13 12:23:45 0:29:01 0:17:29 0:11:32 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6612236 2022-01-13 05:32:05 2022-01-13 11:55:35 2022-01-13 12:25:36 0:30:01 0:23:42 0:06:19 smithi master rhel 8.4 rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6612237 2022-01-13 05:32:06 2022-01-13 11:56:25 2022-01-13 12:45:38 0:49:13 0:31:57 0:17:16 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6612238 2022-01-13 05:32:07 2022-01-13 11:56:25 2022-01-13 12:32:23 0:35:58 0:24:49 0:11:09 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6612239 2022-01-13 05:32:08 2022-01-13 11:56:26 2022-01-13 12:34:35 0:38:09 0:25:46 0:12:23 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 6612240 2022-01-13 05:32:09 2022-01-13 11:57:16 2022-01-13 12:52:38 0:55:22 0:48:17 0:07:05 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6612241 2022-01-13 05:32:10 2022-01-13 11:57:27 2022-01-13 12:23:02 0:25:35 0:15:39 0:09:56 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6612242 2022-01-13 05:32:11 2022-01-13 11:57:47 2022-01-13 12:43:00 0:45:13 0:29:19 0:15:54 smithi master centos 8.3 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6612243 2022-01-13 05:32:12 2022-01-13 11:57:47 2022-01-13 14:49:44 2:51:57 2:44:15 0:07:42 smithi master rhel 8.4 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 6612244 2022-01-13 05:32:13 2022-01-13 11:58:08 2022-01-13 12:40:16 0:42:08 0:31:43 0:10:25 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6612245 2022-01-13 05:32:14 2022-01-13 11:58:18 2022-01-13 13:01:54 1:03:36 0:47:10 0:16:26 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6612246 2022-01-13 05:32:15 2022-01-13 12:01:13 2022-01-13 12:40:47 0:39:34 0:33:20 0:06:14 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 6612247 2022-01-13 05:32:16 2022-01-13 12:01:43 2022-01-13 12:19:12 0:17:29 0:07:53 0:09:36 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612248 2022-01-13 05:32:17 2022-01-13 12:01:43 2022-01-13 12:30:48 0:29:05 0:18:25 0:10:40 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6612249 2022-01-13 05:32:18 2022-01-13 12:02:14 2022-01-13 12:42:27 0:40:13 0:29:16 0:10:57 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} 2
pass 6612250 2022-01-13 05:32:19 2022-01-13 12:02:44 2022-01-13 12:28:36 0:25:52 0:16:33 0:09:19 smithi master centos 8.stream rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} 2
pass 6612251 2022-01-13 05:32:20 2022-01-13 12:03:25 2022-01-13 12:54:53 0:51:28 0:41:01 0:10:27 smithi master ubuntu 20.04 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612252 2022-01-13 05:32:21 2022-01-13 12:03:25 2022-01-13 12:44:10 0:40:45 0:24:08 0:16:37 smithi master centos 8.3 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6612253 2022-01-13 05:32:22 2022-01-13 12:04:56 2022-01-13 12:24:39 0:19:43 0:09:48 0:09:55 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6612254 2022-01-13 05:32:23 2022-01-13 12:04:56 2022-01-13 12:46:19 0:41:23 0:34:00 0:07:23 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 6612255 2022-01-13 05:32:24 2022-01-13 12:05:06 2022-01-13 13:07:22 1:02:16 0:38:53 0:23:23 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 6612256 2022-01-13 05:32:25 2022-01-13 12:06:07 2022-01-13 13:06:13 1:00:06 0:52:47 0:07:19 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6612257 2022-01-13 05:32:26 2022-01-13 12:06:47 2022-01-13 12:44:55 0:38:08 0:26:30 0:11:38 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612258 2022-01-13 05:32:26 2022-01-13 12:07:28 2022-01-13 12:40:39 0:33:11 0:23:40 0:09:31 smithi master centos 8.stream rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 1
pass 6612259 2022-01-13 05:32:27 2022-01-13 12:07:28 2022-01-13 12:34:25 0:26:57 0:21:03 0:05:54 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 6612260 2022-01-13 05:32:28 2022-01-13 12:07:28 2022-01-13 12:30:53 0:23:25 0:10:20 0:13:05 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612261 2022-01-13 05:32:29 2022-01-13 12:09:19 2022-01-13 12:59:22 0:50:03 0:31:38 0:18:25 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6612262 2022-01-13 05:32:30 2022-01-13 12:10:09 2022-01-13 12:48:14 0:38:05 0:26:56 0:11:09 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6612263 2022-01-13 05:32:31 2022-01-13 12:10:30 2022-01-13 12:42:13 0:31:43 0:17:10 0:14:33 smithi master centos 8.3 rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6612264 2022-01-13 05:32:32 2022-01-13 12:11:10 2022-01-13 13:03:01 0:51:51 0:36:55 0:14:56 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6612265 2022-01-13 05:32:33 2022-01-13 12:12:00 2022-01-13 13:02:12 0:50:12 0:42:03 0:08:09 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} 2
pass 6612266 2022-01-13 05:32:34 2022-01-13 12:12:31 2022-01-13 12:54:17 0:41:46 0:28:37 0:13:09 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6612267 2022-01-13 05:32:35 2022-01-13 12:12:51 2022-01-13 12:45:42 0:32:51 0:19:13 0:13:38 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} 2
pass 6612268 2022-01-13 05:32:36 2022-01-13 12:15:32 2022-01-13 14:46:57 2:31:25 2:22:29 0:08:56 smithi master centos 8.stream rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8.stream}} 1
pass 6612269 2022-01-13 05:32:37 2022-01-13 12:15:32 2022-01-13 13:17:01 1:01:29 0:45:14 0:16:15 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6612270 2022-01-13 05:32:38 2022-01-13 12:16:03 2022-01-13 13:04:56 0:48:53 0:32:59 0:15:54 smithi master centos 8.3 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 6612271 2022-01-13 05:32:39 2022-01-13 12:16:43 2022-01-13 12:51:25 0:34:42 0:23:43 0:10:59 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6612272 2022-01-13 05:32:40 2022-01-13 12:17:43 2022-01-13 12:40:00 0:22:17 0:10:29 0:11:48 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6612273 2022-01-13 05:32:41 2022-01-13 12:18:04 2022-01-13 12:59:17 0:41:13 0:31:39 0:09:34 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
pass 6612274 2022-01-13 05:32:42 2022-01-13 12:18:14 2022-01-13 12:55:33 0:37:19 0:30:12 0:07:07 smithi master rhel 8.4 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6612275 2022-01-13 05:32:43 2022-01-13 12:18:14 2022-01-13 12:52:28 0:34:14 0:22:27 0:11:47 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6612276 2022-01-13 05:32:44 2022-01-13 12:21:05 2022-01-13 12:54:21 0:33:16 0:25:56 0:07:20 smithi master rhel 8.4 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6612277 2022-01-13 05:32:45 2022-01-13 12:21:05 2022-01-13 13:20:24 0:59:19 0:41:38 0:17:41 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
fail 6612278 2022-01-13 05:32:46 2022-01-13 12:23:06 2022-01-13 14:06:59 1:43:53 1:21:17 0:22:36 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=32895a39ac05c41f9b0de6ba1771417124c205c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6612279 2022-01-13 05:32:47 2022-01-13 12:23:46 2022-01-13 12:44:58 0:21:12 0:09:51 0:11:21 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6612280 2022-01-13 05:32:48 2022-01-13 12:24:47 2022-01-13 13:11:02 0:46:15 0:37:48 0:08:27 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612281 2022-01-13 05:32:49 2022-01-13 12:25:37 2022-01-13 12:44:53 0:19:16 0:09:31 0:09:45 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6612282 2022-01-13 05:32:50 2022-01-13 12:25:58 2022-01-13 13:03:50 0:37:52 0:18:41 0:19:11 smithi master centos 8.3 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6612283 2022-01-13 05:32:51 2022-01-13 12:28:38 2022-01-13 12:44:49 0:16:11 0:06:00 0:10:11 smithi master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 6612284 2022-01-13 05:32:52 2022-01-13 12:28:39 2022-01-13 12:52:07 0:23:28 0:10:21 0:13:07 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612285 2022-01-13 05:32:53 2022-01-13 12:28:49 2022-01-13 13:18:13 0:49:24 0:28:56 0:20:28 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/workunits} 2
pass 6612286 2022-01-13 05:32:54 2022-01-13 12:28:59 2022-01-13 12:52:13 0:23:14 0:12:10 0:11:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6612287 2022-01-13 05:32:55 2022-01-13 12:30:00 2022-01-13 13:29:34 0:59:34 0:43:17 0:16:17 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6612288 2022-01-13 05:32:56 2022-01-13 12:30:20 2022-01-13 13:18:08 0:47:48 0:40:38 0:07:10 smithi master rhel 8.4 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6612289 2022-01-13 05:32:57 2022-01-13 12:30:51 2022-01-13 12:51:33 0:20:42 0:09:40 0:11:02 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6612290 2022-01-13 05:32:58 2022-01-13 12:30:51 2022-01-13 13:09:51 0:39:00 0:32:11 0:06:49 smithi master rhel 8.4 rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6612291 2022-01-13 05:32:58 2022-01-13 12:31:02 2022-01-13 13:10:14 0:39:12 0:30:05 0:09:07 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/snaps-few-objects} 2
pass 6612292 2022-01-13 05:32:59 2022-01-13 12:31:02 2022-01-13 13:15:47 0:44:45 0:37:01 0:07:44 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6612293 2022-01-13 05:33:00 2022-01-13 12:32:33 2022-01-13 13:18:19 0:45:46 0:39:43 0:06:03 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6612294 2022-01-13 05:33:01 2022-01-13 12:32:53 2022-01-13 12:52:19 0:19:26 0:10:07 0:09:19 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612295 2022-01-13 05:33:02 2022-01-13 12:32:53 2022-01-13 13:29:32 0:56:39 0:39:15 0:17:24 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 6612296 2022-01-13 05:33:03 2022-01-13 12:34:34 2022-01-13 13:14:25 0:39:51 0:32:05 0:07:46 smithi master rhel 8.4 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 2
pass 6612297 2022-01-13 05:33:04 2022-01-13 12:34:44 2022-01-13 13:58:21 1:23:37 1:13:13 0:10:24 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
pass 6612298 2022-01-13 05:33:05 2022-01-13 12:35:04 2022-01-13 13:07:02 0:31:58 0:24:32 0:07:26 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/crash} 2
pass 6612299 2022-01-13 05:33:06 2022-01-13 12:36:05 2022-01-13 13:15:17 0:39:12 0:33:04 0:06:08 smithi master rhel 8.4 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6612300 2022-01-13 05:33:07 2022-01-13 12:36:05 2022-01-13 12:59:46 0:23:41 0:13:56 0:09:45 smithi master centos 8.stream rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6612301 2022-01-13 05:33:08 2022-01-13 12:36:36 2022-01-13 13:37:00 1:00:24 0:42:57 0:17:27 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 6612302 2022-01-13 05:33:09 2022-01-13 12:39:46 2022-01-13 13:33:30 0:53:44 0:31:32 0:22:12 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 6612303 2022-01-13 05:33:10 2022-01-13 12:40:17 2022-01-13 13:20:05 0:39:48 0:29:16 0:10:32 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6612304 2022-01-13 05:33:11 2022-01-13 12:40:48 2022-01-13 13:36:17 0:55:29 0:39:37 0:15:52 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612305 2022-01-13 05:33:12 2022-01-13 12:40:48 2022-01-13 13:23:26 0:42:38 0:24:35 0:18:03 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} 2
pass 6612306 2022-01-13 05:33:12 2022-01-13 12:42:29 2022-01-13 13:02:25 0:19:56 0:09:06 0:10:50 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6612307 2022-01-13 05:33:13 2022-01-13 12:42:29 2022-01-13 13:06:42 0:24:13 0:11:33 0:12:40 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612308 2022-01-13 05:33:14 2022-01-13 12:45:00 2022-01-13 14:16:16 1:31:16 1:17:24 0:13:52 smithi master centos 8.3 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6612309 2022-01-13 05:33:15 2022-01-13 12:45:00 2022-01-13 13:32:29 0:47:29 0:28:54 0:18:35 smithi master centos 8.3 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 6612310 2022-01-13 05:33:16 2022-01-13 12:45:00 2022-01-13 13:03:00 0:18:00 0:07:50 0:10:10 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612311 2022-01-13 05:33:17 2022-01-13 12:45:01 2022-01-13 13:16:11 0:31:10 0:25:39 0:05:31 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6612312 2022-01-13 05:33:18 2022-01-13 12:45:01 2022-01-13 13:48:06 1:03:05 0:46:09 0:16:56 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6612313 2022-01-13 05:33:19 2022-01-13 12:45:51 2022-01-13 13:29:35 0:43:44 0:23:35 0:20:09 smithi master centos 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 2
pass 6612314 2022-01-13 05:33:20 2022-01-13 12:46:22 2022-01-13 13:11:48 0:25:26 0:13:59 0:11:27 smithi master centos 8.stream rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} 2
pass 6612315 2022-01-13 05:33:21 2022-01-13 12:48:22 2022-01-13 13:19:34 0:31:12 0:24:40 0:06:32 smithi master rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6612316 2022-01-13 05:33:22 2022-01-13 12:48:23 2022-01-13 13:39:17 0:50:54 0:33:21 0:17:33 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} 2
pass 6612317 2022-01-13 05:33:23 2022-01-13 12:51:33 2022-01-13 13:34:03 0:42:30 0:30:38 0:11:52 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6612318 2022-01-13 05:33:24 2022-01-13 12:52:04 2022-01-13 13:39:42 0:47:38 0:32:26 0:15:12 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/failover} 2
pass 6612319 2022-01-13 05:33:25 2022-01-13 12:52:14 2022-01-13 13:41:37 0:49:23 0:36:57 0:12:26 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6612320 2022-01-13 05:33:26 2022-01-13 12:52:14 2022-01-13 13:21:41 0:29:27 0:22:17 0:07:10 smithi master rhel 8.4 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6612321 2022-01-13 05:33:27 2022-01-13 12:52:15 2022-01-13 13:10:11 0:17:56 0:07:30 0:10:26 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612322 2022-01-13 05:33:28 2022-01-13 12:52:15 2022-01-13 13:25:58 0:33:43 0:23:26 0:10:17 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6612323 2022-01-13 05:33:29 2022-01-13 12:52:15 2022-01-13 13:17:48 0:25:33 0:16:31 0:09:02 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/repair_test} 2
pass 6612324 2022-01-13 05:33:30 2022-01-13 12:52:36 2022-01-13 13:23:58 0:31:22 0:21:40 0:09:42 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6612325 2022-01-13 05:33:31 2022-01-13 12:52:46 2022-01-13 13:21:47 0:29:01 0:21:56 0:07:05 smithi master rhel 8.4 rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6612326 2022-01-13 05:33:32 2022-01-13 12:52:47 2022-01-13 14:18:01 1:25:14 1:03:15 0:21:59 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 6612327 2022-01-13 05:33:33 2022-01-13 12:54:27 2022-01-13 13:15:34 0:21:07 0:09:50 0:11:17 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6612328 2022-01-13 05:33:33 2022-01-13 12:55:38 2022-01-13 13:35:06 0:39:28 0:24:55 0:14:33 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612329 2022-01-13 05:33:34 2022-01-13 12:59:28 2022-01-13 13:40:44 0:41:16 0:32:31 0:08:45 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 1
pass 6612330 2022-01-13 05:33:35 2022-01-13 12:59:29 2022-01-13 13:24:29 0:25:00 0:10:30 0:14:30 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612331 2022-01-13 05:33:36 2022-01-13 13:01:59 2022-01-13 13:29:57 0:27:58 0:20:54 0:07:04 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
pass 6612332 2022-01-13 05:33:37 2022-01-13 13:02:20 2022-01-13 13:47:25 0:45:05 0:29:19 0:15:46 smithi master centos 8.3 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6612333 2022-01-13 05:33:38 2022-01-13 13:02:30 2022-01-13 13:32:22 0:29:52 0:19:26 0:10:26 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6612334 2022-01-13 05:33:39 2022-01-13 13:03:11 2022-01-13 13:44:16 0:41:05 0:35:41 0:05:24 smithi master rhel 8.4 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6612335 2022-01-13 05:33:40 2022-01-13 13:03:11 2022-01-13 13:31:20 0:28:09 0:20:57 0:07:12 smithi master rhel 8.4 rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6612336 2022-01-13 05:33:41 2022-01-13 13:03:41 2022-01-13 13:29:13 0:25:32 0:14:38 0:10:54 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8.stream} tasks/insights} 2
pass 6612337 2022-01-13 05:33:42 2022-01-13 13:05:02 2022-01-13 13:28:43 0:23:41 0:12:51 0:10:50 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6612338 2022-01-13 05:33:43 2022-01-13 13:05:02 2022-01-13 14:32:53 1:27:51 1:15:35 0:12:16 smithi master ubuntu 20.04 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 6612339 2022-01-13 05:33:44 2022-01-13 13:06:23 2022-01-13 13:36:24 0:30:01 0:21:50 0:08:11 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} 2
pass 6612340 2022-01-13 05:33:45 2022-01-13 13:06:43 2022-01-13 14:02:27 0:55:44 0:35:02 0:20:42 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6612341 2022-01-13 05:33:46 2022-01-13 13:06:43 2022-01-13 13:24:24 0:17:41 0:06:38 0:11:03 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612342 2022-01-13 05:33:47 2022-01-13 13:06:44 2022-01-13 14:00:02 0:53:18 0:41:17 0:12:01 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6612343 2022-01-13 05:33:48 2022-01-13 13:07:04 2022-01-13 13:30:39 0:23:35 0:15:49 0:07:46 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
pass 6612344 2022-01-13 05:33:49 2022-01-13 13:07:24 2022-01-13 14:23:09 1:15:45 0:55:25 0:20:20 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 6612345 2022-01-13 05:33:50 2022-01-13 13:09:55 2022-01-14 01:22:29 12:12:34 smithi master centos 8.3 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 2
Failure Reason:

hit max job timeout

pass 6612346 2022-01-13 05:33:51 2022-01-13 13:10:15 2022-01-13 13:48:14 0:37:59 0:25:56 0:12:03 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6612347 2022-01-13 05:33:52 2022-01-13 13:11:06 2022-01-13 13:29:12 0:18:06 0:07:19 0:10:47 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612348 2022-01-13 05:33:53 2022-01-13 13:11:06 2022-01-13 13:45:12 0:34:06 0:26:45 0:07:21 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} 2
pass 6612349 2022-01-13 05:33:54 2022-01-13 13:11:56 2022-01-13 14:00:07 0:48:11 0:31:31 0:16:40 smithi master centos 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
pass 6612350 2022-01-13 05:33:55 2022-01-13 13:14:27 2022-01-13 14:15:07 1:00:40 0:47:39 0:13:01 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 6612351 2022-01-13 05:33:56 2022-01-13 13:15:38 2022-01-13 13:57:46 0:42:08 0:31:46 0:10:22 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6612352 2022-01-13 05:33:57 2022-01-13 13:15:48 2022-01-13 13:52:25 0:36:37 0:26:24 0:10:13 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612353 2022-01-13 05:33:58 2022-01-13 13:15:58 2022-01-13 13:56:57 0:40:59 0:31:07 0:09:52 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8.stream} tasks/module_selftest} 2
dead 6612354 2022-01-13 05:33:59 2022-01-13 13:15:59 2022-01-13 15:14:44 1:58:45 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

pass 6612355 2022-01-13 05:34:00 2022-01-13 13:17:09 2022-01-13 13:45:16 0:28:07 0:21:48 0:06:19 smithi master rhel 8.4 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6612356 2022-01-13 05:34:01 2022-01-13 13:17:50 2022-01-13 13:37:31 0:19:41 0:09:17 0:10:24 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6612357 2022-01-13 05:34:01 2022-01-13 13:17:50 2022-01-13 13:34:30 0:16:40 0:06:09 0:10:31 smithi master ubuntu 20.04 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 6612358 2022-01-13 05:34:02 2022-01-13 13:18:21 2022-01-13 13:39:21 0:21:00 0:11:47 0:09:13 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 6612359 2022-01-13 05:34:03 2022-01-13 13:18:21 2022-01-13 13:48:53 0:30:32 0:19:47 0:10:45 smithi master centos 8.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 2
pass 6612360 2022-01-13 05:34:04 2022-01-13 13:19:41 2022-01-13 13:46:22 0:26:41 0:15:00 0:11:41 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
pass 6612361 2022-01-13 05:34:05 2022-01-13 13:20:12 2022-01-13 13:47:19 0:27:07 0:20:57 0:06:10 smithi master rhel 8.4 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6612362 2022-01-13 05:34:06 2022-01-13 13:20:12 2022-01-13 13:47:43 0:27:31 0:21:00 0:06:31 smithi master rhel 8.4 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6612363 2022-01-13 05:34:07 2022-01-13 13:20:32 2022-01-13 14:05:01 0:44:29 0:34:00 0:10:29 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/rados_api_tests} 2
pass 6612364 2022-01-13 05:34:08 2022-01-13 13:21:33 2022-01-13 13:55:19 0:33:46 0:27:09 0:06:37 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 6612365 2022-01-13 05:34:09 2022-01-13 13:21:53 2022-01-13 14:08:47 0:46:54 0:39:12 0:07:42 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6612366 2022-01-13 05:34:10 2022-01-13 13:23:34 2022-01-13 14:01:16 0:37:42 0:22:35 0:15:07 smithi master centos 8.3 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6612367 2022-01-13 05:34:11 2022-01-13 13:24:04 2022-01-13 13:41:30 0:17:26 0:07:44 0:09:42 smithi master ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612368 2022-01-13 05:34:12 2022-01-13 13:24:05 2022-01-13 13:57:00 0:32:55 0:21:03 0:11:52 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6612369 2022-01-13 05:34:13 2022-01-13 13:24:35 2022-01-13 14:09:46 0:45:11 0:39:18 0:05:53 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6612370 2022-01-13 05:34:14 2022-01-13 13:24:35 2022-01-13 13:46:16 0:21:41 0:12:10 0:09:31 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6612371 2022-01-13 05:34:15 2022-01-13 13:24:36 2022-01-13 14:14:04 0:49:28 0:26:34 0:22:54 smithi master centos 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 6612372 2022-01-13 05:34:16 2022-01-13 13:35:09 2022-01-13 14:07:31 0:32:22 0:25:01 0:07:21 smithi master rhel 8.4 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6612373 2022-01-13 05:34:17 2022-01-13 13:36:20 2022-01-13 14:16:17 0:39:57 0:29:07 0:10:50 smithi master ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612374 2022-01-13 05:34:18 2022-01-13 13:36:20 2022-01-13 16:34:08 2:57:48 2:43:22 0:14:26 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
pass 6612375 2022-01-13 05:34:19 2022-01-13 13:36:30 2022-01-13 14:22:14 0:45:44 0:26:09 0:19:35 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6612376 2022-01-13 05:34:20 2022-01-13 13:37:01 2022-01-13 14:14:53 0:37:52 0:27:58 0:09:54 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612377 2022-01-13 05:34:20 2022-01-13 13:37:41 2022-01-13 14:04:04 0:26:23 0:13:22 0:13:01 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612378 2022-01-13 05:34:21 2022-01-13 13:39:22 2022-01-13 14:41:21 1:01:59 0:42:22 0:19:37 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
pass 6612379 2022-01-13 05:34:22 2022-01-13 13:39:53 2022-01-13 14:25:02 0:45:09 0:37:41 0:07:28 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6612380 2022-01-13 05:34:23 2022-01-13 13:41:33 2022-01-13 14:29:03 0:47:30 0:34:54 0:12:36 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 6612381 2022-01-13 05:34:24 2022-01-13 13:41:43 2022-01-13 14:03:34 0:21:51 0:11:43 0:10:08 smithi master centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 2
pass 6612382 2022-01-13 05:34:25 2022-01-13 13:42:14 2022-01-13 14:13:50 0:31:36 0:21:59 0:09:37 smithi master rhel 8.4 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6612383 2022-01-13 05:34:26 2022-01-13 13:44:24 2022-01-13 15:06:34 1:22:10 1:14:24 0:07:46 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6612384 2022-01-13 05:34:27 2022-01-13 13:45:15 2022-01-13 14:37:15 0:52:00 0:42:16 0:09:44 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/sync-many workloads/rados_mon_osdmap_prune} 2
pass 6612385 2022-01-13 05:34:28 2022-01-13 13:45:55 2022-01-13 14:31:43 0:45:48 0:28:56 0:16:52 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6612386 2022-01-13 05:34:29 2022-01-13 13:46:26 2022-01-13 14:15:37 0:29:11 0:22:23 0:06:48 smithi master rhel 8.4 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6612387 2022-01-13 05:34:30 2022-01-13 13:46:26 2022-01-13 14:40:44 0:54:18 0:37:14 0:17:04 smithi master centos 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} 2
pass 6612388 2022-01-13 05:34:31 2022-01-13 13:47:26 2022-01-13 14:11:23 0:23:57 0:12:55 0:11:02 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6612389 2022-01-13 05:34:32 2022-01-13 13:47:27 2022-01-13 14:47:05 0:59:38 0:44:16 0:15:22 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6612390 2022-01-13 05:34:33 2022-01-13 13:47:47 2022-01-13 15:41:25 1:53:38 1:44:39 0:08:59 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 6612391 2022-01-13 05:34:34 2022-01-13 13:48:07 2022-01-13 14:07:58 0:19:51 0:08:38 0:11:13 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612392 2022-01-13 05:34:35 2022-01-13 13:48:18 2022-01-13 15:46:15 1:57:57 1:41:21 0:16:36 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 6612393 2022-01-13 05:34:36 2022-01-13 13:48:58 2022-01-13 14:34:23 0:45:25 0:28:50 0:16:35 smithi master centos 8.3 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6612394 2022-01-13 05:34:37 2022-01-13 13:48:58 2022-01-13 14:18:58 0:30:00 0:15:22 0:14:38 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 6612395 2022-01-13 05:34:38 2022-01-13 13:52:29 2022-01-13 14:41:29 0:49:00 0:33:27 0:15:33 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 6612396 2022-01-13 05:34:39 2022-01-13 13:54:10 2022-01-13 14:30:32 0:36:22 0:19:33 0:16:49 smithi master centos 8.3 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6612397 2022-01-13 05:34:40 2022-01-13 13:55:20 2022-01-13 14:34:54 0:39:34 0:28:21 0:11:13 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6612398 2022-01-13 05:34:41 2022-01-13 13:57:01 2022-01-13 14:38:26 0:41:25 0:35:41 0:05:44 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6612399 2022-01-13 05:34:42 2022-01-13 13:57:01 2022-01-13 14:29:34 0:32:33 0:24:39 0:07:54 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6612400 2022-01-13 05:34:43 2022-01-13 13:58:22 2022-01-13 14:35:15 0:36:53 0:23:19 0:13:34 smithi master centos 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6612401 2022-01-13 05:34:44 2022-01-13 13:58:22 2022-01-13 14:23:27 0:25:05 0:11:30 0:13:35 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} 2
pass 6612402 2022-01-13 05:34:45 2022-01-13 14:00:13 2022-01-13 14:22:34 0:22:21 0:08:42 0:13:39 smithi master centos 8.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_no_skews} 3
pass 6612403 2022-01-13 05:34:46 2022-01-13 14:02:33 2022-01-13 14:53:24 0:50:51 0:31:28 0:19:23 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/workunits} 2
dead 6612404 2022-01-13 05:34:47 2022-01-13 14:03:44 2022-01-13 14:17:09 0:13:25 0:03:32 0:09:53 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
Failure Reason:

{'Failure object was': {'smithi058.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6fc2011361437a9dfe4e45b50de224392eed8abc/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6612405 2022-01-13 05:34:48 2022-01-13 14:03:44 2022-01-13 14:34:39 0:30:55 0:18:48 0:12:07 smithi master ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6612406 2022-01-13 05:34:49 2022-01-13 14:04:14 2022-01-13 15:03:28 0:59:14 0:40:57 0:18:17 smithi master centos 8.3 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6612407 2022-01-13 05:34:50 2022-01-13 14:04:15 2022-01-13 14:29:30 0:25:15 0:13:42 0:11:33 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 6612408 2022-01-13 05:34:51 2022-01-13 14:04:15 2022-01-13 14:43:54 0:39:39 0:28:26 0:11:13 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} 2