Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6563198 2021-12-15 03:30:46 2021-12-15 03:31:23 2021-12-15 03:49:40 0:18:17 0:05:58 0:12:19 smithi master centos 8.2 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} 2
Failure Reason:

Command failed on smithi158 with status 5: 'sudo systemctl stop ceph-ea8c4ec2-5d59-11ec-8c31-001a4aab830c@mon.a'

pass 6563199 2021-12-15 03:30:47 2021-12-15 03:31:23 2021-12-15 03:58:38 0:27:15 0:13:22 0:13:53 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunk-promote-flush} 2
pass 6563200 2021-12-15 03:30:47 2021-12-15 03:31:24 2021-12-15 04:11:57 0:40:33 0:31:53 0:08:40 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 6563201 2021-12-15 03:30:48 2021-12-15 03:31:24 2021-12-15 03:57:04 0:25:40 0:14:43 0:10:57 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} 2
pass 6563202 2021-12-15 03:30:49 2021-12-15 03:31:24 2021-12-15 03:59:07 0:27:43 0:14:13 0:13:30 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} 2
pass 6563203 2021-12-15 03:30:49 2021-12-15 03:31:24 2021-12-15 03:54:15 0:22:51 0:17:19 0:05:32 smithi master rhel 8.3 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_8}} 1
pass 6563204 2021-12-15 03:30:50 2021-12-15 03:31:25 2021-12-15 04:15:17 0:43:52 0:28:59 0:14:53 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_18.04} tasks/module_selftest} 2
pass 6563205 2021-12-15 03:30:51 2021-12-15 03:31:25 2021-12-15 04:12:52 0:41:27 0:33:37 0:07:50 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 6563206 2021-12-15 03:30:52 2021-12-15 03:31:26 2021-12-15 03:56:15 0:24:49 0:11:38 0:13:11 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563207 2021-12-15 03:30:52 2021-12-15 03:31:26 2021-12-15 03:51:46 0:20:20 0:11:14 0:09:06 smithi master centos 8.3 rados/singleton/{all/mon-config msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6563208 2021-12-15 03:30:53 2021-12-15 03:31:27 2021-12-15 03:47:57 0:16:30 0:05:55 0:10:35 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm_repos} 1
pass 6563209 2021-12-15 03:30:54 2021-12-15 03:31:27 2021-12-15 04:00:42 0:29:15 0:18:53 0:10:22 smithi master rhel 8.3 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} 2
pass 6563210 2021-12-15 03:30:55 2021-12-15 03:31:27 2021-12-15 04:12:29 0:41:02 0:31:02 0:10:00 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
pass 6563211 2021-12-15 03:30:56 2021-12-15 03:31:27 2021-12-15 04:06:29 0:35:02 0:22:35 0:12:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
pass 6563212 2021-12-15 03:30:56 2021-12-15 03:31:28 2021-12-15 04:13:26 0:41:58 0:32:45 0:09:13 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6563213 2021-12-15 03:30:57 2021-12-15 03:31:28 2021-12-15 04:02:59 0:31:31 0:17:43 0:13:48 smithi master ubuntu 18.04 rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563214 2021-12-15 03:30:58 2021-12-15 03:31:28 2021-12-15 04:04:47 0:33:19 0:19:25 0:13:54 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_orch_cli} 1
pass 6563215 2021-12-15 03:30:58 2021-12-15 03:31:29 2021-12-15 04:18:00 0:46:31 0:36:13 0:10:18 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6563216 2021-12-15 03:30:59 2021-12-15 03:31:29 2021-12-15 04:01:55 0:30:26 0:21:10 0:09:16 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6563217 2021-12-15 03:31:00 2021-12-15 03:31:29 2021-12-15 03:53:14 0:21:45 0:09:23 0:12:22 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6563218 2021-12-15 03:31:01 2021-12-15 03:31:30 2021-12-15 04:13:03 0:41:33 0:28:48 0:12:45 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
pass 6563219 2021-12-15 03:31:02 2021-12-15 03:31:30 2021-12-15 04:04:00 0:32:30 0:20:32 0:11:58 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} 2
dead 6563220 2021-12-15 03:31:02 2021-12-15 03:31:30 2021-12-15 03:50:18 0:18:48 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

SSH connection to smithi092 was lost: 'uname -r'

pass 6563221 2021-12-15 03:31:03 2021-12-15 03:31:31 2021-12-15 04:09:58 0:38:27 0:30:52 0:07:35 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563222 2021-12-15 03:31:04 2021-12-15 03:31:31 2021-12-15 04:16:16 0:44:45 0:31:28 0:13:17 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 6563223 2021-12-15 03:31:05 2021-12-15 03:31:31 2021-12-15 05:00:17 1:28:46 1:18:29 0:10:17 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 6563224 2021-12-15 03:31:05 2021-12-15 03:31:32 2021-12-15 03:51:31 0:19:59 0:07:27 0:12:32 smithi master ubuntu 18.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_18.04}} 1
pass 6563225 2021-12-15 03:31:06 2021-12-15 03:31:32 2021-12-15 03:49:11 0:17:39 0:08:00 0:09:39 smithi master ubuntu 18.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_18.04}} 1
pass 6563226 2021-12-15 03:31:07 2021-12-15 03:31:32 2021-12-15 03:57:57 0:26:25 0:17:01 0:09:24 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} 1
pass 6563227 2021-12-15 03:31:07 2021-12-15 03:31:32 2021-12-15 03:57:59 0:26:27 0:20:10 0:06:17 smithi master rhel 8.3 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
dead 6563228 2021-12-15 03:31:08 2021-12-15 03:31:33 2021-12-15 03:51:50 0:20:17 smithi master ubuntu 18.04 rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04} 4
Failure Reason:

SSH connection to smithi040 was lost: 'uname -r'

pass 6563229 2021-12-15 03:31:09 2021-12-15 03:31:33 2021-12-15 04:04:00 0:32:27 0:20:49 0:11:38 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6563230 2021-12-15 03:31:10 2021-12-15 03:31:33 2021-12-15 04:06:33 0:35:00 0:21:46 0:13:14 smithi master centos 8.3 rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6563231 2021-12-15 03:31:10 2021-12-15 03:31:34 2021-12-15 04:07:26 0:35:52 0:20:39 0:15:13 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6563232 2021-12-15 03:31:11 2021-12-15 03:31:34 2021-12-15 04:09:33 0:37:59 0:28:51 0:09:08 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 2
dead 6563233 2021-12-15 03:31:12 2021-12-15 03:31:34 2021-12-15 03:50:57 0:19:23 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

SSH connection to smithi058 was lost: 'uname -r'

pass 6563234 2021-12-15 03:31:13 2021-12-15 03:31:35 2021-12-15 03:58:04 0:26:29 0:16:23 0:10:06 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
pass 6563235 2021-12-15 03:31:13 2021-12-15 03:31:35 2021-12-15 03:58:37 0:27:02 0:13:20 0:13:42 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} 2
pass 6563236 2021-12-15 03:31:14 2021-12-15 03:31:35 2021-12-15 03:53:16 0:21:41 0:11:08 0:10:33 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
pass 6563237 2021-12-15 03:31:15 2021-12-15 03:31:36 2021-12-15 04:17:40 0:46:04 0:35:16 0:10:48 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
fail 6563238 2021-12-15 03:31:16 2021-12-15 03:31:36 2021-12-15 03:54:02 0:22:26 0:10:34 0:11:52 smithi master centos 8.3 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
Failure Reason:

"2021-12-15T03:51:32.354729+0000 mon.a (mon.0) 21 : cluster [WRN] Health check failed: 1/21 mons down, quorum a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t (MON_DOWN)" in cluster log

pass 6563239 2021-12-15 03:31:16 2021-12-15 03:31:36 2021-12-15 04:02:32 0:30:56 0:22:30 0:08:26 smithi master rhel 8.3 rados/singleton/{all/osd-recovery msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6563240 2021-12-15 03:31:17 2021-12-15 03:31:37 2021-12-15 04:16:50 0:45:13 0:34:28 0:10:45 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6563241 2021-12-15 03:31:18 2021-12-15 03:31:37 2021-12-15 04:24:43 0:53:06 0:42:01 0:11:05 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
pass 6563242 2021-12-15 03:31:19 2021-12-15 03:31:37 2021-12-15 04:00:47 0:29:10 0:16:07 0:13:03 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_18.04} tasks/progress} 2
pass 6563243 2021-12-15 03:31:19 2021-12-15 03:31:38 2021-12-15 04:20:21 0:48:43 0:35:58 0:12:45 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} 2
pass 6563244 2021-12-15 03:31:20 2021-12-15 03:31:38 2021-12-15 03:56:20 0:24:42 0:11:18 0:13:24 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563245 2021-12-15 03:31:21 2021-12-15 03:31:38 2021-12-15 03:57:47 0:26:09 0:13:04 0:13:05 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6563246 2021-12-15 03:31:22 2021-12-15 03:31:39 2021-12-15 04:00:40 0:29:01 0:15:11 0:13:50 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 start} 2
pass 6563247 2021-12-15 03:31:22 2021-12-15 03:31:39 2021-12-15 04:15:40 0:44:01 0:34:37 0:09:24 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} 2
pass 6563248 2021-12-15 03:31:23 2021-12-15 04:17:21 2214 smithi master rhel 8.3 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} 2
pass 6563249 2021-12-15 03:31:24 2021-12-15 04:00:46 1068 smithi master rhel 8.3 rados/singleton/{all/peer msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6563250 2021-12-15 03:31:25 2021-12-15 03:31:40 2021-12-15 04:13:12 0:41:32 0:27:52 0:13:40 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} 2
pass 6563251 2021-12-15 03:31:26 2021-12-15 03:58:18 1172 smithi master rhel 8.3 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} 1
pass 6563252 2021-12-15 03:31:26 2021-12-15 03:55:31 665 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} 2
pass 6563253 2021-12-15 03:31:27 2021-12-15 03:58:59 838 smithi master centos 8.2 rados/cephadm/smoke-roleless/{distro/centos_8.2_container_tools_3.0 start} 2
pass 6563254 2021-12-15 03:31:28 2021-12-15 03:31:41 2021-12-15 03:57:12 0:25:31 0:12:43 0:12:48 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup_tier} 2
pass 6563255 2021-12-15 03:31:29 2021-12-15 03:31:41 2021-12-15 04:16:14 0:44:33 0:34:30 0:10:03 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6563256 2021-12-15 03:31:30 2021-12-15 03:31:42 2021-12-15 04:14:52 0:43:10 0:28:58 0:14:12 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6563257 2021-12-15 03:31:31 2021-12-15 03:31:42 2021-12-15 03:53:41 0:21:59 0:09:34 0:12:25 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 6563258 2021-12-15 03:31:32 2021-12-15 04:54:37 3370 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/rados_api_tests} 2
pass 6563259 2021-12-15 03:31:32 2021-12-15 03:48:06 2021-12-15 04:28:55 0:40:49 0:28:15 0:12:34 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6563260 2021-12-15 03:31:33 2021-12-15 03:49:46 2021-12-15 04:26:16 0:36:30 0:24:27 0:12:03 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6563261 2021-12-15 03:31:34 2021-12-15 04:06:21 368 smithi master centos 8.2 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} 2
Failure Reason:

Command failed on smithi058 with status 5: 'sudo systemctl stop ceph-47270daa-5d5c-11ec-8c31-001a4aab830c@mon.a'

pass 6563262 2021-12-15 03:31:35 2021-12-15 03:51:07 2021-12-15 04:52:06 1:00:59 0:50:54 0:10:05 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6563263 2021-12-15 03:31:36 2021-12-15 04:32:54 1894 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6563264 2021-12-15 03:31:37 2021-12-15 03:51:38 2021-12-15 04:13:44 0:22:06 0:11:11 0:10:55 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
dead 6563265 2021-12-15 03:31:38 2021-12-15 04:11:48 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

SSH connection to smithi040 was lost: 'uname -r'

pass 6563266 2021-12-15 03:31:39 2021-12-15 05:32:21 5375 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} 2
pass 6563267 2021-12-15 03:31:39 2021-12-15 04:18:49 1171 smithi master rhel 8.3 rados/singleton/{all/pg-autoscaler msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 2
pass 6563268 2021-12-15 03:31:40 2021-12-15 05:13:39 4138 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_18.04} tasks/dashboard} 2
pass 6563269 2021-12-15 03:31:41 2021-12-15 03:53:49 2021-12-15 04:21:35 0:27:46 0:21:43 0:06:03 smithi master rhel 8.3 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 6563270 2021-12-15 03:31:42 2021-12-15 03:54:10 2021-12-15 04:23:03 0:28:53 0:23:00 0:05:53 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 6563271 2021-12-15 03:31:43 2021-12-15 03:54:10 2021-12-15 04:14:01 0:19:51 0:08:28 0:11:23 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_adoption} 1
pass 6563272 2021-12-15 03:31:44 2021-12-15 03:54:20 2021-12-15 04:13:18 0:18:58 0:07:48 0:11:10 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563273 2021-12-15 03:31:44 2021-12-15 03:55:41 2021-12-15 04:13:03 0:17:22 0:06:03 0:11:19 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} tasks/mon_clock_with_skews} 2
pass 6563274 2021-12-15 03:31:45 2021-12-15 03:56:21 2021-12-15 04:27:48 0:31:27 0:22:17 0:09:10 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6563275 2021-12-15 03:31:46 2021-12-15 03:56:21 2021-12-15 04:21:34 0:25:13 0:16:13 0:09:00 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
pass 6563276 2021-12-15 03:31:47 2021-12-15 03:56:22 2021-12-15 04:40:04 0:43:42 0:36:39 0:07:03 smithi master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6563277 2021-12-15 03:31:47 2021-12-15 03:56:22 2021-12-15 04:22:29 0:26:07 0:15:22 0:10:45 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
pass 6563278 2021-12-15 03:31:48 2021-12-15 03:57:13 2021-12-15 04:18:59 0:21:46 0:12:10 0:09:36 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 6563279 2021-12-15 03:31:49 2021-12-15 03:57:13 2021-12-15 04:21:20 0:24:07 0:12:56 0:11:11 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6563280 2021-12-15 03:31:50 2021-12-15 03:57:53 2021-12-15 04:17:00 0:19:07 0:09:40 0:09:27 smithi master centos 8.3 rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6563281 2021-12-15 03:31:50 2021-12-15 03:58:04 2021-12-15 04:18:36 0:20:32 0:09:17 0:11:15 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563282 2021-12-15 03:31:51 2021-12-15 03:58:24 2021-12-15 04:24:05 0:25:41 0:14:23 0:11:18 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm} 1
pass 6563283 2021-12-15 03:31:52 2021-12-15 03:58:44 2021-12-15 04:19:27 0:20:43 0:10:27 0:10:16 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} 2
pass 6563284 2021-12-15 03:31:53 2021-12-15 03:58:45 2021-12-15 04:44:17 0:45:32 0:35:41 0:09:51 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 6563285 2021-12-15 03:31:53 2021-12-15 03:58:45 2021-12-15 04:28:18 0:29:33 0:23:36 0:05:57 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 6563286 2021-12-15 03:31:54 2021-12-15 03:59:05 2021-12-15 05:01:16 1:02:11 0:51:01 0:11:10 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/sync-many workloads/rados_mon_osdmap_prune} 2
pass 6563287 2021-12-15 03:31:55 2021-12-15 03:59:16 2021-12-15 04:33:59 0:34:43 0:22:57 0:11:46 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 6563288 2021-12-15 03:31:56 2021-12-15 04:00:46 2021-12-15 04:28:43 0:27:57 0:17:07 0:10:50 smithi master ubuntu 20.04 rados/singleton/{all/radostool msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563289 2021-12-15 03:31:56 2021-12-15 04:00:47 2021-12-15 04:34:58 0:34:11 0:22:54 0:11:17 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
pass 6563290 2021-12-15 03:31:57 2021-12-15 04:00:47 2021-12-15 04:20:54 0:20:07 0:08:57 0:11:10 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6563291 2021-12-15 03:31:58 2021-12-15 04:00:57 2021-12-15 04:39:24 0:38:27 0:30:25 0:08:02 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 6563292 2021-12-15 03:31:59 2021-12-15 04:01:58 2021-12-15 04:25:09 0:23:11 0:13:03 0:10:08 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/readwrite} 2
pass 6563293 2021-12-15 03:31:59 2021-12-15 04:01:58 2021-12-15 04:31:19 0:29:21 0:17:23 0:11:58 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 2
pass 6563294 2021-12-15 03:32:00 2021-12-15 04:03:09 2021-12-15 04:23:06 0:19:57 0:09:44 0:10:13 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} 1
pass 6563295 2021-12-15 03:32:01 2021-12-15 04:04:09 2021-12-15 04:24:50 0:20:41 0:09:24 0:11:17 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6563296 2021-12-15 03:32:02 2021-12-15 04:04:50 2021-12-15 04:41:53 0:37:03 0:25:48 0:11:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6563297 2021-12-15 03:32:02 2021-12-15 04:06:30 2021-12-15 04:34:43 0:28:13 0:18:16 0:09:57 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} 2
pass 6563298 2021-12-15 03:32:03 2021-12-15 04:06:31 2021-12-15 04:45:45 0:39:14 0:27:32 0:11:42 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563299 2021-12-15 03:32:04 2021-12-15 04:07:31 2021-12-15 04:38:14 0:30:43 0:18:47 0:11:56 smithi master ubuntu 20.04 rados/singleton/{all/random-eio msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 2
pass 6563300 2021-12-15 03:32:04 2021-12-15 04:08:01 2021-12-15 04:51:25 0:43:24 0:32:29 0:10:55 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
fail 6563301 2021-12-15 03:32:05 2021-12-15 04:09:42 2021-12-15 04:31:25 0:21:43 0:08:44 0:12:59 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi041 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 038328ce-5d5f-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi041:vg_nvme/lv_4'

pass 6563302 2021-12-15 03:32:06 2021-12-15 04:11:43 2021-12-15 04:53:14 0:41:31 0:31:47 0:09:44 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 6563303 2021-12-15 03:32:07 2021-12-15 04:11:53 2021-12-15 04:36:51 0:24:58 0:12:43 0:12:15 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6563304 2021-12-15 03:32:07 2021-12-15 04:12:03 2021-12-15 04:27:23 0:15:20 0:05:42 0:09:38 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm_repos} 1
pass 6563305 2021-12-15 03:32:08 2021-12-15 04:12:04 2021-12-15 04:51:34 0:39:30 0:32:22 0:07:08 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6563306 2021-12-15 03:32:09 2021-12-15 04:12:34 2021-12-15 04:36:22 0:23:48 0:13:06 0:10:42 smithi master ubuntu 20.04 rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563307 2021-12-15 03:32:10 2021-12-15 04:12:55 2021-12-15 04:34:51 0:21:56 0:11:14 0:10:42 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} tasks/mon_recovery} 2
pass 6563308 2021-12-15 03:32:10 2021-12-15 04:13:05 2021-12-15 05:30:48 1:17:43 1:08:23 0:09:20 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_18.04} tasks/dashboard} 2
pass 6563309 2021-12-15 03:32:11 2021-12-15 04:13:05 2021-12-15 04:31:14 0:18:09 0:06:44 0:11:25 smithi master ubuntu 20.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 6563310 2021-12-15 03:32:12 2021-12-15 04:13:06 2021-12-15 04:46:26 0:33:20 0:23:16 0:10:04 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6563311 2021-12-15 03:32:12 2021-12-15 04:13:16 2021-12-15 04:53:26 0:40:10 0:28:29 0:11:41 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 6563312 2021-12-15 03:32:13 2021-12-15 04:13:26 2021-12-15 04:33:24 0:19:58 0:09:57 0:10:01 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6563313 2021-12-15 03:32:14 2021-12-15 04:13:27 2021-12-15 04:51:20 0:37:53 0:27:26 0:10:27 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 6563314 2021-12-15 03:32:15 2021-12-15 04:14:07 2021-12-15 04:33:12 0:19:05 0:07:01 0:12:04 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 6563315 2021-12-15 03:32:15 2021-12-15 04:14:57 2021-12-15 04:30:59 0:16:02 0:05:51 0:10:11 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563316 2021-12-15 03:32:16 2021-12-15 04:15:18 2021-12-15 04:45:16 0:29:58 0:22:13 0:07:45 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 6563317 2021-12-15 03:32:17 2021-12-15 04:15:48 2021-12-15 04:43:51 0:28:03 0:18:12 0:09:51 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_orch_cli} 1
pass 6563318 2021-12-15 03:32:17 2021-12-15 04:15:49 2021-12-15 04:36:30 0:20:41 0:09:57 0:10:44 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563319 2021-12-15 03:32:18 2021-12-15 04:16:19 2021-12-15 04:54:27 0:38:08 0:31:09 0:06:59 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6563320 2021-12-15 03:32:19 2021-12-15 04:17:00 2021-12-15 04:45:53 0:28:53 0:19:13 0:09:40 smithi master centos 8.3 rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6563321 2021-12-15 03:32:20 2021-12-15 04:17:00 2021-12-15 05:01:15 0:44:15 0:33:07 0:11:08 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} 2
pass 6563322 2021-12-15 03:32:20 2021-12-15 04:17:31 2021-12-15 04:48:50 0:31:19 0:19:48 0:11:31 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 6563323 2021-12-15 03:32:21 2021-12-15 04:17:41 2021-12-15 04:45:14 0:27:33 0:17:33 0:10:00 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 6563324 2021-12-15 03:32:22 2021-12-15 04:18:01 2021-12-15 05:00:30 0:42:29 0:31:46 0:10:43 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 6563325 2021-12-15 03:32:22 2021-12-15 04:18:42 2021-12-15 04:57:11 0:38:29 0:26:26 0:12:03 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 6563326 2021-12-15 03:32:23 2021-12-15 04:18:42 2021-12-15 04:53:05 0:34:23 0:23:16 0:11:07 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6563327 2021-12-15 03:32:24 2021-12-15 04:18:53 2021-12-15 04:56:16 0:37:23 0:28:25 0:08:58 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 6563328 2021-12-15 03:32:25 2021-12-15 04:19:03 2021-12-15 04:44:45 0:25:42 0:14:40 0:11:02 smithi master centos 8.3 rados/singleton/{all/resolve_stuck_peering msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 6563329 2021-12-15 03:32:25 2021-12-15 04:19:33 2021-12-15 05:03:37 0:44:04 0:37:18 0:06:46 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6563330 2021-12-15 03:32:26 2021-12-15 04:20:24 2021-12-15 04:48:54 0:28:30 0:19:52 0:08:38 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} 2
pass 6563331 2021-12-15 03:32:27 2021-12-15 04:21:24 2021-12-15 04:47:16 0:25:52 0:15:28 0:10:24 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 start} 2
pass 6563332 2021-12-15 03:32:28 2021-12-15 04:21:35 2021-12-15 04:47:06 0:25:31 0:19:39 0:05:52 smithi master rhel 8.3 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 6563333 2021-12-15 03:32:28 2021-12-15 04:21:35 2021-12-15 04:49:46 0:28:11 0:20:17 0:07:54 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup_tier} 2
pass 6563334 2021-12-15 03:32:29 2021-12-15 04:22:36 2021-12-15 05:01:05 0:38:29 0:28:23 0:10:06 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563335 2021-12-15 03:32:30 2021-12-15 04:23:06 2021-12-15 04:43:03 0:19:57 0:09:04 0:10:53 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
fail 6563336 2021-12-15 03:32:31 2021-12-15 04:23:06 2021-12-15 04:44:53 0:21:47 0:08:32 0:13:15 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi133 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e103c324-5d60-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_4'

pass 6563337 2021-12-15 03:32:31 2021-12-15 04:24:47 2021-12-15 04:40:20 0:15:33 0:06:30 0:09:03 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563338 2021-12-15 03:32:32 2021-12-15 04:24:47 2021-12-15 05:08:41 0:43:54 0:32:53 0:11:01 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6563339 2021-12-15 03:32:33 2021-12-15 04:24:58 2021-12-15 04:50:39 0:25:41 0:18:58 0:06:43 smithi master rhel 8.3 rados/singleton/{all/test-crash msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6563340 2021-12-15 03:32:33 2021-12-15 04:24:58 2021-12-15 05:00:16 0:35:18 0:25:36 0:09:42 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 6563341 2021-12-15 03:32:34 2021-12-15 04:25:18 2021-12-15 04:50:21 0:25:03 0:13:53 0:11:10 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} 2
pass 6563342 2021-12-15 03:32:35 2021-12-15 04:26:19 2021-12-15 05:10:05 0:43:46 0:31:42 0:12:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6563343 2021-12-15 03:32:36 2021-12-15 04:27:49 2021-12-15 04:46:01 0:18:12 0:06:30 0:11:42 smithi master ubuntu 20.04 rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6563344 2021-12-15 03:32:36 2021-12-15 04:28:20 2021-12-15 05:46:46 1:18:26 1:05:57 0:12:29 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 6563345 2021-12-15 03:32:37 2021-12-15 04:29:00 2021-12-15 05:08:18 0:39:18 0:22:33 0:16:45 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6563346 2021-12-15 03:32:38 2021-12-15 04:31:01 2021-12-15 04:57:07 0:26:06 0:14:12 0:11:54 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} 2
pass 6563347 2021-12-15 03:32:39 2021-12-15 04:31:21 2021-12-15 05:11:35 0:40:14 0:28:23 0:11:51 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563348 2021-12-15 03:32:39 2021-12-15 04:31:22 2021-12-15 05:08:34 0:37:12 0:23:35 0:13:37 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
pass 6563349 2021-12-15 03:32:40 2021-12-15 04:31:32 2021-12-15 05:04:36 0:33:04 0:26:47 0:06:17 smithi master rhel 8.3 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6563350 2021-12-15 03:32:41 2021-12-15 04:31:32 2021-12-15 05:02:25 0:30:53 0:16:29 0:14:24 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect} 2
pass 6563351 2021-12-15 03:32:41 2021-12-15 04:33:13 2021-12-15 05:01:31 0:28:18 0:18:12 0:10:06 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} 2
pass 6563352 2021-12-15 03:32:42 2021-12-15 04:33:33 2021-12-15 05:55:24 1:21:51 1:09:36 0:12:15 smithi master centos 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 6563353 2021-12-15 03:32:43 2021-12-15 04:34:04 2021-12-15 06:58:50 2:24:46 2:14:00 0:10:46 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_18.04}} 1
pass 6563354 2021-12-15 03:32:44 2021-12-15 04:34:44 2021-12-15 05:06:11 0:31:27 0:21:09 0:10:18 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6563355 2021-12-15 03:32:44 2021-12-15 04:34:44 2021-12-15 04:57:03 0:22:19 0:10:41 0:11:38 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563356 2021-12-15 03:32:45 2021-12-15 04:35:05 2021-12-15 05:01:47 0:26:42 0:12:05 0:14:37 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 6563357 2021-12-15 03:32:46 2021-12-15 04:36:35 2021-12-15 05:04:02 0:27:27 0:21:43 0:05:44 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6563358 2021-12-15 03:32:47 2021-12-15 04:36:36 2021-12-15 05:02:07 0:25:31 0:15:31 0:10:00 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 6563359 2021-12-15 03:32:47 2021-12-15 04:36:56 2021-12-15 05:23:43 0:46:47 0:39:33 0:07:14 smithi master rhel 8.3 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} 2
pass 6563360 2021-12-15 03:32:48 2021-12-15 04:38:17 2021-12-15 04:57:47 0:19:30 0:09:02 0:10:28 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6563361 2021-12-15 03:32:49 2021-12-15 04:38:17 2021-12-15 05:02:54 0:24:37 0:16:50 0:07:47 smithi master rhel 8.3 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} 1
pass 6563362 2021-12-15 03:32:49 2021-12-15 04:39:27 2021-12-15 04:59:28 0:20:01 0:08:43 0:11:18 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_adoption} 1
pass 6563363 2021-12-15 03:32:50 2021-12-15 04:39:28 2021-12-15 05:07:49 0:28:21 0:21:18 0:07:03 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunk-promote-flush} 2
pass 6563364 2021-12-15 03:32:51 2021-12-15 04:40:08 2021-12-15 06:09:15 1:29:07 1:20:45 0:08:22 smithi master rhel 8.3 rados/singleton/{all/thrash-backfill-full msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 2
pass 6563365 2021-12-15 03:32:52 2021-12-15 04:41:59 2021-12-15 05:10:51 0:28:52 0:17:42 0:11:10 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 6563366 2021-12-15 03:32:52 2021-12-15 04:43:09 2021-12-15 05:17:48 0:34:39 0:22:42 0:11:57 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 6563367 2021-12-15 03:32:53 2021-12-15 04:44:20 2021-12-15 05:06:34 0:22:14 0:12:09 0:10:05 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6563368 2021-12-15 03:32:54 2021-12-15 04:45:01 2021-12-15 05:10:44 0:25:43 0:14:31 0:11:12 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm} 1
pass 6563369 2021-12-15 03:32:55 2021-12-15 04:45:01 2021-12-15 05:20:50 0:35:49 0:27:54 0:07:55 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 6563370 2021-12-15 03:32:55 2021-12-15 04:45:21 2021-12-15 05:38:34 0:53:13 0:47:29 0:05:44 smithi master rhel 8.3 rados/singleton/{all/thrash-eio msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
pass 6563371 2021-12-15 03:32:56 2021-12-15 04:45:22 2021-12-15 05:25:09 0:39:47 0:27:52 0:11:55 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6563372 2021-12-15 03:32:57 2021-12-15 04:45:52 2021-12-15 05:05:30 0:19:38 0:09:09 0:10:29 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d1bca3c4-5d63-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi040:vg_nvme/lv_4'

pass 6563373 2021-12-15 03:32:58 2021-12-15 04:46:03 2021-12-15 05:15:46 0:29:43 0:19:46 0:09:57 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 6563374 2021-12-15 03:32:58 2021-12-15 04:46:03 2021-12-15 05:24:15 0:38:12 0:27:54 0:10:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6563375 2021-12-15 03:32:59 2021-12-15 04:46:33 2021-12-15 05:21:39 0:35:06 0:22:48 0:12:18 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 6563376 2021-12-15 03:33:00 2021-12-15 04:47:24 2021-12-15 05:25:06 0:37:42 0:25:43 0:11:59 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6563377 2021-12-15 03:33:00 2021-12-15 04:48:54 2021-12-15 05:22:00 0:33:06 0:23:12 0:09:54 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6563378 2021-12-15 03:33:01 2021-12-15 04:48:55 2021-12-15 05:25:06 0:36:11 0:28:06 0:08:05 smithi master rhel 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 2
pass 6563379 2021-12-15 03:33:02 2021-12-15 04:49:55 2021-12-15 05:07:52 0:17:57 0:08:10 0:09:47 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563380 2021-12-15 03:33:03 2021-12-15 04:49:56 2021-12-15 05:20:04 0:30:08 0:20:26 0:09:42 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6563381 2021-12-15 03:33:03 2021-12-15 04:50:26 2021-12-15 05:24:59 0:34:33 0:23:39 0:10:54 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 6563382 2021-12-15 03:33:04 2021-12-15 04:50:46 2021-12-15 05:10:43 0:19:57 0:09:40 0:10:17 smithi master centos 8.3 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 6563383 2021-12-15 03:33:05 2021-12-15 04:51:27 2021-12-15 05:13:30 0:22:03 0:11:30 0:10:33 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 6563384 2021-12-15 03:33:06 2021-12-15 04:51:37 2021-12-15 05:31:05 0:39:28 0:32:19 0:07:09 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
pass 6563385 2021-12-15 03:33:06 2021-12-15 04:52:08 2021-12-15 05:24:47 0:32:39 0:22:10 0:10:29 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 6563386 2021-12-15 03:33:07 2021-12-15 04:53:08 2021-12-15 05:17:28 0:24:20 0:13:39 0:10:41 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6563387 2021-12-15 03:33:08 2021-12-15 04:53:18 2021-12-15 06:09:03 1:15:45 1:05:54 0:09:51 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
fail 6563388 2021-12-15 03:33:09 2021-12-15 04:53:29 2021-12-15 05:10:00 0:16:31 0:05:36 0:10:55 smithi master centos 8.2 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} 2
Failure Reason:

Command failed on smithi081 with status 5: 'sudo systemctl stop ceph-0d27d144-5d65-11ec-8c31-001a4aab830c@mon.a'

pass 6563389 2021-12-15 03:33:09 2021-12-15 04:54:29 2021-12-15 05:27:57 0:33:28 0:22:55 0:10:33 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 6563390 2021-12-15 03:33:10 2021-12-15 04:54:30 2021-12-15 05:16:19 0:21:49 0:10:02 0:11:47 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563391 2021-12-15 03:33:11 2021-12-15 04:56:20 2021-12-15 05:19:14 0:22:54 0:12:11 0:10:43 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6563392 2021-12-15 03:33:12 2021-12-15 04:57:11 2021-12-15 05:32:39 0:35:28 0:27:48 0:07:40 smithi master rhel 8.3 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 2
pass 6563393 2021-12-15 03:33:12 2021-12-15 04:57:11 2021-12-15 05:34:58 0:37:47 0:27:50 0:09:57 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 6563394 2021-12-15 03:33:13 2021-12-15 04:57:11 2021-12-15 06:22:50 1:25:39 1:19:14 0:06:25 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 6563395 2021-12-15 03:33:14 2021-12-15 04:57:22 2021-12-15 07:29:17 2:31:55 2:21:17 0:10:38 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_18.04}} 1
pass 6563396 2021-12-15 03:33:15 2021-12-15 04:57:52 2021-12-15 05:26:33 0:28:41 0:15:47 0:12:54 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} 2
pass 6563397 2021-12-15 03:33:15 2021-12-15 05:00:23 2021-12-15 05:19:50 0:19:27 0:10:29 0:08:58 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 6563398 2021-12-15 03:33:16 2021-12-15 05:00:23 2021-12-15 05:16:24 0:16:01 0:05:39 0:10:22 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm_repos} 1
pass 6563399 2021-12-15 03:33:17 2021-12-15 05:00:24 2021-12-15 05:34:14 0:33:50 0:24:20 0:09:30 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6563400 2021-12-15 03:33:18 2021-12-15 05:00:34 2021-12-15 05:24:26 0:23:52 0:16:40 0:07:12 smithi master rhel 8.3 rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6563401 2021-12-15 03:33:18 2021-12-15 05:01:14 2021-12-15 05:38:57 0:37:43 0:26:52 0:10:51 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 6563402 2021-12-15 03:33:19 2021-12-15 05:01:25 2021-12-15 05:20:14 0:18:49 0:09:48 0:09:01 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} 1
pass 6563403 2021-12-15 03:33:20 2021-12-15 05:01:25 2021-12-15 05:24:08 0:22:43 0:11:24 0:11:19 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6563404 2021-12-15 03:33:20 2021-12-15 05:01:25 2021-12-15 05:28:53 0:27:28 0:17:59 0:09:29 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_orch_cli} 1
pass 6563405 2021-12-15 03:33:21 2021-12-15 05:01:26 2021-12-15 05:34:52 0:33:26 0:22:56 0:10:30 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6563406 2021-12-15 03:33:22 2021-12-15 05:01:36 2021-12-15 05:36:00 0:34:24 0:23:36 0:10:48 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 6563407 2021-12-15 03:33:23 2021-12-15 05:02:16 2021-12-15 05:22:09 0:19:53 0:09:25 0:10:28 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi120 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ba02f02-5d66-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi120:vg_nvme/lv_4'

pass 6563408 2021-12-15 03:33:23 2021-12-15 05:02:27 2021-12-15 05:37:30 0:35:03 0:24:10 0:10:53 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563409 2021-12-15 03:33:24 2021-12-15 05:03:47 2021-12-15 05:37:00 0:33:13 0:27:20 0:05:53 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 6563410 2021-12-15 03:33:25 2021-12-15 05:03:48 2021-12-15 05:19:49 0:16:01 0:06:27 0:09:34 smithi master ubuntu 18.04 rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563411 2021-12-15 03:33:26 2021-12-15 05:04:08 2021-12-15 05:26:20 0:22:12 0:10:47 0:11:25 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 6563412 2021-12-15 03:33:26 2021-12-15 05:04:39 2021-12-15 05:46:44 0:42:05 0:31:18 0:10:47 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
pass 6563413 2021-12-15 03:33:27 2021-12-15 05:05:39 2021-12-15 08:45:04 3:39:25 3:27:40 0:11:45 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04} 4
pass 6563414 2021-12-15 03:33:28 2021-12-15 05:06:40 2021-12-15 05:31:20 0:24:40 0:11:03 0:13:37 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup_tier} 2
pass 6563415 2021-12-15 03:33:29 2021-12-15 05:07:50 2021-12-15 05:29:42 0:21:52 0:11:40 0:10:12 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} tasks/rados_cls_all} 2
pass 6563416 2021-12-15 03:33:29 2021-12-15 05:08:01 2021-12-15 05:44:03 0:36:02 0:24:51 0:11:11 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6563417 2021-12-15 03:33:30 2021-12-15 05:08:21 2021-12-15 05:31:53 0:23:32 0:14:17 0:09:15 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/insights} 2
pass 6563418 2021-12-15 03:33:31 2021-12-15 05:08:41 2021-12-15 05:28:09 0:19:28 0:09:17 0:10:11 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} tasks/mon_recovery} 2
pass 6563419 2021-12-15 03:33:32 2021-12-15 05:08:42 2021-12-15 05:41:23 0:32:41 0:20:49 0:11:52 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 6563420 2021-12-15 03:33:32 2021-12-15 05:10:02 2021-12-15 05:28:08 0:18:06 0:06:59 0:11:07 smithi master ubuntu 20.04 rados/singleton/{all/deduptool msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563421 2021-12-15 03:33:33 2021-12-15 05:10:12 2021-12-15 05:56:04 0:45:52 0:38:25 0:07:27 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6563422 2021-12-15 03:33:34 2021-12-15 05:10:53 2021-12-15 05:32:35 0:21:42 0:10:45 0:10:57 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
pass 6563423 2021-12-15 03:33:35 2021-12-15 05:10:53 2021-12-15 05:34:05 0:23:12 0:14:02 0:09:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 6563424 2021-12-15 03:33:35 2021-12-15 05:10:54 2021-12-15 05:57:42 0:46:48 0:36:39 0:10:09 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6563425 2021-12-15 03:33:36 2021-12-15 05:11:44 2021-12-15 05:33:31 0:21:47 0:10:15 0:11:32 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563426 2021-12-15 03:33:37 2021-12-15 05:13:45 2021-12-15 05:33:36 0:19:51 0:08:06 0:11:45 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563427 2021-12-15 03:33:37 2021-12-15 05:15:55 2021-12-15 05:35:22 0:19:27 0:09:12 0:10:15 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6563428 2021-12-15 03:33:38 2021-12-15 05:15:56 2021-12-15 06:00:24 0:44:28 0:33:16 0:11:12 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} 2
pass 6563429 2021-12-15 03:33:39 2021-12-15 05:16:26 2021-12-15 05:38:23 0:21:57 0:11:43 0:10:14 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 6563430 2021-12-15 03:33:40 2021-12-15 05:16:27 2021-12-15 05:54:57 0:38:30 0:28:48 0:09:42 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563431 2021-12-15 03:33:40 2021-12-15 05:16:27 2021-12-15 05:40:49 0:24:22 0:14:32 0:09:50 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 start} 2
pass 6563432 2021-12-15 03:33:41 2021-12-15 05:17:37 2021-12-15 05:35:54 0:18:17 0:07:36 0:10:41 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563433 2021-12-15 03:33:42 2021-12-15 05:17:58 2021-12-15 05:49:59 0:32:01 0:19:45 0:12:16 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6563434 2021-12-15 03:33:43 2021-12-15 05:19:18 2021-12-15 05:37:25 0:18:07 0:08:05 0:10:02 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/one workloads/rados_5925} 2
pass 6563435 2021-12-15 03:33:43 2021-12-15 05:19:59 2021-12-15 05:41:35 0:21:36 0:11:32 0:10:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 6563436 2021-12-15 03:33:44 2021-12-15 05:19:59 2021-12-15 06:38:05 1:18:06 1:07:55 0:10:11 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_18.04} tasks/dashboard} 2
pass 6563437 2021-12-15 03:33:45 2021-12-15 05:20:20 2021-12-15 05:36:45 0:16:25 0:05:54 0:10:31 smithi master ubuntu 18.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_18.04}} 1
pass 6563438 2021-12-15 03:33:45 2021-12-15 05:21:00 2021-12-15 05:50:52 0:29:52 0:23:03 0:06:49 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 6563439 2021-12-15 03:33:46 2021-12-15 05:21:40 2021-12-15 05:46:26 0:24:46 0:13:20 0:11:26 smithi master centos 8.2 rados/cephadm/smoke-roleless/{distro/centos_8.2_container_tools_3.0 start} 2
pass 6563440 2021-12-15 03:33:47 2021-12-15 06:31:31 2021-12-15 06:55:43 0:24:12 0:14:07 0:10:05 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/set-chunk-promote-flush} 2
pass 6563441 2021-12-15 03:33:48 2021-12-15 06:32:22 2021-12-15 07:27:21 0:54:59 0:45:17 0:09:42 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
fail 6563442 2021-12-15 03:33:48 2021-12-15 06:32:22 2021-12-15 06:52:58 0:20:36 0:09:05 0:11:31 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi026 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca0ed52a-5d72-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_4'

pass 6563443 2021-12-15 03:33:49 2021-12-15 06:33:13 2021-12-15 06:54:09 0:20:56 0:11:40 0:09:16 smithi master centos 8.3 rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6563444 2021-12-15 03:33:50 2021-12-15 06:33:13 2021-12-15 06:54:17 0:21:04 0:09:32 0:11:32 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6563445 2021-12-15 03:33:50 2021-12-15 06:34:44 2021-12-15 07:13:46 0:39:02 0:29:27 0:09:35 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563446 2021-12-15 03:33:51 2021-12-15 06:34:44 2021-12-15 07:03:29 0:28:45 0:14:30 0:14:15 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 6563447 2021-12-15 03:33:52 2021-12-15 06:37:15 2021-12-15 07:01:06 0:23:51 0:12:42 0:11:09 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} tasks/rados_python} 2
pass 6563448 2021-12-15 03:33:53 2021-12-15 06:37:25 2021-12-15 07:09:07 0:31:42 0:20:36 0:11:06 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6563449 2021-12-15 03:33:53 2021-12-15 06:37:25 2021-12-15 07:03:17 0:25:52 0:18:36 0:07:16 smithi master rhel 8.3 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_8}} 1
fail 6563450 2021-12-15 03:33:54 2021-12-15 06:38:06 2021-12-15 06:55:31 0:17:25 0:05:33 0:11:52 smithi master centos 8.2 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} 2
Failure Reason:

Command failed on smithi132 with status 5: 'sudo systemctl stop ceph-bddb2af0-5d73-11ec-8c31-001a4aab830c@mon.a'

pass 6563451 2021-12-15 03:33:55 2021-12-15 06:40:16 2021-12-15 07:14:04 0:33:48 0:21:33 0:12:15 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 6563452 2021-12-15 03:33:56 2021-12-15 06:42:53 2021-12-15 07:07:00 0:24:07 0:11:32 0:12:35 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6563453 2021-12-15 03:33:56 2021-12-15 06:45:18 2021-12-15 07:10:14 0:24:56 0:18:31 0:06:25 smithi master rhel 8.3 rados/singleton/{all/dump-stuck msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 6563454 2021-12-15 03:33:57 2021-12-15 06:45:18 2021-12-15 07:24:10 0:38:52 0:30:50 0:08:02 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 6563455 2021-12-15 03:33:58 2021-12-15 06:46:48 2021-12-15 07:26:25 0:39:37 0:26:50 0:12:47 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 6563456 2021-12-15 03:33:58 2021-12-15 06:48:29 2021-12-15 07:26:25 0:37:56 0:28:01 0:09:55 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6563457 2021-12-15 03:33:59 2021-12-15 06:49:19 2021-12-15 07:09:30 0:20:11 0:08:58 0:11:13 smithi master centos 8.3 rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 6563458 2021-12-15 03:34:00 2021-12-15 06:50:00 2021-12-15 07:09:45 0:19:45 0:08:30 0:11:15 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_adoption} 1
pass 6563459 2021-12-15 03:34:01 2021-12-15 06:50:00 2021-12-15 07:23:53 0:33:53 0:23:45 0:10:08 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6563460 2021-12-15 03:34:01 2021-12-15 06:50:10 2021-12-15 07:31:47 0:41:37 0:35:31 0:06:06 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6563461 2021-12-15 03:34:02 2021-12-15 06:50:21 2021-12-15 07:39:50 0:49:29 0:39:19 0:10:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 6563462 2021-12-15 03:34:03 2021-12-15 06:50:21 2021-12-15 07:12:35 0:22:14 0:10:14 0:12:00 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563463 2021-12-15 03:34:03 2021-12-15 06:53:02 2021-12-15 07:31:38 0:38:36 0:28:37 0:09:59 smithi master ubuntu 18.04 rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563464 2021-12-15 03:34:04 2021-12-15 06:53:52 2021-12-15 07:29:50 0:35:58 0:24:54 0:11:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 6563465 2021-12-15 03:34:05 2021-12-15 06:53:53 2021-12-15 07:16:08 0:22:15 0:11:25 0:10:50 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6563466 2021-12-15 03:34:06 2021-12-15 06:54:23 2021-12-15 07:19:50 0:25:27 0:14:51 0:10:36 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm} 1
pass 6563467 2021-12-15 03:34:06 2021-12-15 07:19:20 959 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_8}} 1
pass 6563468 2021-12-15 03:34:07 2021-12-15 06:54:23 2021-12-15 07:26:38 0:32:15 0:21:09 0:11:06 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6563469 2021-12-15 03:34:08 2021-12-15 06:55:34 2021-12-15 07:35:29 0:39:55 0:33:08 0:06:47 smithi master rhel 8.3 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} 2
pass 6563470 2021-12-15 03:34:09 2021-12-15 06:55:44 2021-12-15 07:27:42 0:31:58 0:20:54 0:11:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 6563471 2021-12-15 03:34:09 2021-12-15 06:55:45 2021-12-15 07:11:14 0:15:29 0:05:58 0:09:31 smithi master ubuntu 18.04 rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563472 2021-12-15 03:34:10 2021-12-15 06:55:45 2021-12-15 07:21:10 0:25:25 0:12:30 0:12:55 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6563473 2021-12-15 03:34:11 2021-12-15 06:56:55 2021-12-15 07:21:28 0:24:33 0:12:55 0:11:38 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6563474 2021-12-15 03:34:12 2021-12-15 06:57:46 2021-12-15 07:29:26 0:31:40 0:22:09 0:09:31 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root msgr/async start tasks/rados_python} 2
pass 6563475 2021-12-15 03:34:12 2021-12-15 06:57:56 2021-12-15 07:24:07 0:26:11 0:14:48 0:11:23 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} tasks/rados_stress_watch} 2
pass 6563476 2021-12-15 03:34:13 2021-12-15 06:57:57 2021-12-15 08:21:53 1:23:56 1:16:41 0:07:15 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 6563477 2021-12-15 03:34:14 2021-12-15 06:58:37 2021-12-15 07:21:49 0:23:12 0:17:12 0:06:00 smithi master rhel 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} 1
fail 6563478 2021-12-15 03:34:14 2021-12-15 06:58:37 2021-12-15 07:19:28 0:20:51 0:08:42 0:12:09 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi066 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e15cd0a-5d76-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi066:vg_nvme/lv_4'

pass 6563479 2021-12-15 03:34:15 2021-12-15 06:59:18 2021-12-15 07:30:10 0:30:52 0:18:49 0:12:03 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6563480 2021-12-15 03:34:16 2021-12-15 07:00:28 2021-12-15 07:46:22 0:45:54 0:38:39 0:07:15 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6563481 2021-12-15 03:34:17 2021-12-15 07:01:09 2021-12-15 07:36:32 0:35:23 0:24:24 0:10:59 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563482 2021-12-15 03:34:17 2021-12-15 07:03:19 2021-12-15 07:39:38 0:36:19 0:23:07 0:13:12 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6563483 2021-12-15 03:34:18 2021-12-15 07:04:30 2021-12-15 07:36:55 0:32:25 0:22:23 0:10:02 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6563484 2021-12-15 03:34:19 2021-12-15 07:04:40 2021-12-15 07:52:44 0:48:04 0:38:17 0:09:47 smithi master rhel 8.3 rados/singleton/{all/lost-unfound-delete msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6563485 2021-12-15 03:34:20 2021-12-15 07:07:01 2021-12-15 07:37:27 0:30:26 0:18:09 0:12:17 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} 2
pass 6563486 2021-12-15 03:34:20 2021-12-15 07:09:11 2021-12-15 07:52:36 0:43:25 0:34:03 0:09:22 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6563487 2021-12-15 03:34:21 2021-12-15 07:09:22 2021-12-15 07:37:46 0:28:24 0:17:42 0:10:42 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6563488 2021-12-15 03:34:22 2021-12-15 07:09:32 2021-12-15 07:42:04 0:32:32 0:20:49 0:11:43 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6563489 2021-12-15 03:34:22 2021-12-15 07:10:23 2021-12-15 07:36:52 0:26:29 0:14:53 0:11:36 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_18.04} tasks/progress} 2
pass 6563490 2021-12-15 03:34:23 2021-12-15 07:11:23 2021-12-15 07:47:54 0:36:31 0:29:15 0:07:16 smithi master rhel 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} 2
pass 6563491 2021-12-15 03:34:24 2021-12-15 07:12:44 2021-12-15 07:34:10 0:21:26 0:11:59 0:09:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/cache} 2
pass 6563492 2021-12-15 03:34:25 2021-12-15 07:12:44 2021-12-15 07:33:21 0:20:37 0:09:08 0:11:29 smithi master centos 8.3 rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 6563493 2021-12-15 03:34:25 2021-12-15 07:13:54 2021-12-15 07:51:47 0:37:53 0:27:41 0:10:12 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563494 2021-12-15 03:34:26 2021-12-15 07:14:05 2021-12-15 07:30:11 0:16:06 0:05:38 0:10:28 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm_repos} 1
pass 6563495 2021-12-15 03:34:27 2021-12-15 07:14:05 2021-12-15 10:17:38 3:03:33 2:52:14 0:11:19 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} 1
pass 6563496 2021-12-15 03:34:27 2021-12-15 08:44:54 2021-12-15 09:11:08 0:26:14 0:19:38 0:06:36 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup_tier} 2
pass 6563497 2021-12-15 03:34:28 2021-12-15 08:45:14 2021-12-15 09:04:55 0:19:41 0:08:51 0:10:50 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6563498 2021-12-15 03:34:29 2021-12-15 08:45:14 2021-12-15 09:21:03 0:35:49 0:22:47 0:13:02 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 6563499 2021-12-15 03:34:30 2021-12-15 08:47:25 2021-12-15 09:32:32 0:45:07 0:38:15 0:06:52 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6563500 2021-12-15 03:34:30 2021-12-15 08:47:25 2021-12-15 09:17:02 0:29:37 0:20:37 0:09:00 smithi master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563501 2021-12-15 03:34:31 2021-12-15 08:49:16 2021-12-15 09:31:40 0:42:24 0:30:28 0:11:56 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6563502 2021-12-15 03:34:32 2021-12-15 08:49:57 2021-12-15 09:29:25 0:39:28 0:32:27 0:07:01 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
pass 6563503 2021-12-15 03:34:32 2021-12-15 08:50:27 2021-12-15 09:20:40 0:30:13 0:17:57 0:12:16 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_orch_cli} 1
pass 6563504 2021-12-15 03:34:33 2021-12-15 08:50:28 2021-12-15 09:06:09 0:15:41 0:06:21 0:09:20 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563505 2021-12-15 03:34:34 2021-12-15 08:50:28 2021-12-15 09:30:15 0:39:47 0:31:49 0:07:58 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6563506 2021-12-15 03:34:35 2021-12-15 08:50:49 2021-12-15 09:58:26 1:07:37 1:00:09 0:07:28 smithi master rhel 8.3 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 6563507 2021-12-15 03:34:35 2021-12-15 08:50:59 2021-12-15 09:14:31 0:23:32 0:10:29 0:13:03 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_striper} 2
pass 6563508 2021-12-15 03:34:36 2021-12-15 08:53:20 2021-12-15 10:36:58 1:43:38 1:32:30 0:11:08 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 6563509 2021-12-15 03:34:37 2021-12-15 08:57:31 2021-12-15 09:25:36 0:28:05 0:20:58 0:07:07 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} 2
pass 6563510 2021-12-15 03:34:37 2021-12-15 08:58:22 2021-12-15 09:39:28 0:41:06 0:30:45 0:10:21 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} 2
fail 6563511 2021-12-15 03:34:38 2021-12-15 08:58:22 2021-12-15 09:20:32 0:22:10 0:08:42 0:13:28 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi116 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 680eeaf8-5d87-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi116:vg_nvme/lv_4'

pass 6563512 2021-12-15 03:34:39 2021-12-15 09:00:23 2021-12-15 09:28:09 0:27:46 0:16:49 0:10:57 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563513 2021-12-15 03:34:40 2021-12-15 09:00:23 2021-12-15 09:22:59 0:22:36 0:10:50 0:11:46 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563514 2021-12-15 03:34:40 2021-12-15 09:01:03 2021-12-15 09:22:45 0:21:42 0:11:35 0:10:07 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 6563515 2021-12-15 03:34:41 2021-12-15 09:01:04 2021-12-15 09:39:26 0:38:22 0:27:47 0:10:35 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563516 2021-12-15 03:34:42 2021-12-15 09:01:44 2021-12-15 09:47:27 0:45:43 0:38:36 0:07:07 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563517 2021-12-15 03:34:42 2021-12-15 09:02:25 2021-12-15 09:22:56 0:20:31 0:10:01 0:10:30 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6563518 2021-12-15 03:34:43 2021-12-15 09:03:15 2021-12-15 09:33:57 0:30:42 0:18:27 0:12:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 6563519 2021-12-15 03:34:44 2021-12-15 09:06:16 2021-12-15 10:25:42 1:19:26 1:08:03 0:11:23 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_18.04} tasks/dashboard} 2
pass 6563520 2021-12-15 03:34:45 2021-12-15 09:07:56 2021-12-15 09:48:01 0:40:05 0:28:12 0:11:53 smithi master ubuntu 20.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 6563521 2021-12-15 03:34:45 2021-12-15 09:07:57 2021-12-15 09:28:03 0:20:06 0:09:11 0:10:55 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6563522 2021-12-15 03:34:46 2021-12-15 09:08:37 2021-12-15 09:36:06 0:27:29 0:15:21 0:12:08 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 start} 2
pass 6563523 2021-12-15 03:34:47 2021-12-15 09:08:47 2021-12-15 09:31:53 0:23:06 0:12:36 0:10:30 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunk-promote-flush} 2
pass 6563524 2021-12-15 03:34:47 2021-12-15 09:08:48 2021-12-15 09:31:33 0:22:45 0:11:46 0:10:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 6563525 2021-12-15 03:34:48 2021-12-15 09:09:08 2021-12-15 09:31:51 0:22:43 0:10:38 0:12:05 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563526 2021-12-15 03:34:49 2021-12-15 09:10:19 2021-12-15 09:37:58 0:27:39 0:19:58 0:07:41 smithi master rhel 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 6563527 2021-12-15 03:34:50 2021-12-15 09:10:19 2021-12-15 09:42:55 0:32:36 0:21:24 0:11:12 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
pass 6563528 2021-12-15 03:34:50 2021-12-15 09:10:29 2021-12-15 09:36:12 0:25:43 0:13:38 0:12:05 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} 2
pass 6563529 2021-12-15 03:34:51 2021-12-15 09:11:10 2021-12-15 09:51:25 0:40:15 0:33:42 0:06:33 smithi master rhel 8.3 rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6563530 2021-12-15 03:34:52 2021-12-15 09:12:10 2021-12-15 09:47:38 0:35:28 0:24:28 0:11:00 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 6563531 2021-12-15 03:34:52 2021-12-15 09:14:31 2021-12-15 09:46:17 0:31:46 0:22:02 0:09:44 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/small-objects} 2
pass 6563532 2021-12-15 03:34:53 2021-12-15 09:14:31 2021-12-15 10:32:57 1:18:26 1:05:16 0:13:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
pass 6563533 2021-12-15 03:34:54 2021-12-15 09:17:12 2021-12-15 09:43:04 0:25:52 0:12:58 0:12:54 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563534 2021-12-15 03:34:55 2021-12-15 09:19:53 2021-12-15 09:38:21 0:18:28 0:08:11 0:10:17 smithi master ubuntu 18.04 rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563535 2021-12-15 03:34:55 2021-12-15 09:20:43 2021-12-15 10:10:26 0:49:43 0:39:52 0:09:51 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 6563536 2021-12-15 03:34:56 2021-12-15 09:20:44 2021-12-15 09:46:11 0:25:27 0:18:10 0:07:17 smithi master rhel 8.3 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{rhel_8}} 1
pass 6563537 2021-12-15 03:34:57 2021-12-15 09:20:44 2021-12-15 10:02:04 0:41:20 0:34:31 0:06:49 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6563538 2021-12-15 03:34:58 2021-12-15 09:20:44 2021-12-15 09:52:47 0:32:03 0:22:22 0:09:41 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6563539 2021-12-15 03:34:58 2021-12-15 09:21:05 2021-12-15 10:00:28 0:39:23 0:28:41 0:10:42 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} tasks/rados_workunit_loadgen_big} 2
pass 6563540 2021-12-15 03:34:59 2021-12-15 09:22:45 2021-12-15 09:50:42 0:27:57 0:17:46 0:10:11 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} 2
pass 6563541 2021-12-15 03:35:00 2021-12-15 09:22:46 2021-12-15 10:00:30 0:37:44 0:28:02 0:09:42 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6563542 2021-12-15 03:35:00 2021-12-15 09:23:06 2021-12-15 09:43:03 0:19:57 0:09:31 0:10:26 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6563543 2021-12-15 03:35:01 2021-12-15 09:23:06 2021-12-15 09:54:37 0:31:31 0:22:36 0:08:55 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 6563544 2021-12-15 03:35:02 2021-12-15 09:23:07 2021-12-15 09:59:11 0:36:04 0:25:56 0:10:08 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 6563545 2021-12-15 03:35:03 2021-12-15 09:23:37 2021-12-15 09:49:06 0:25:29 0:19:16 0:06:13 smithi master rhel 8.3 rados/singleton/{all/mon-config-key-caps msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 6563546 2021-12-15 03:35:03 2021-12-15 09:23:37 2021-12-15 09:46:35 0:22:58 0:12:07 0:10:51 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
fail 6563547 2021-12-15 03:35:04 2021-12-15 09:24:58 2021-12-15 09:47:53 0:22:55 0:08:56 0:13:59 smithi master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi026 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ce3aefec24fd9e170ead8d89207f0236d915f6f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42093792-5d8b-11ec-8c31-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_4'

pass 6563548 2021-12-15 03:35:05 2021-12-15 09:28:09 2021-12-15 09:48:00 0:19:51 0:08:33 0:11:18 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_adoption} 1
pass 6563549 2021-12-15 03:35:05 2021-12-15 09:28:19 2021-12-15 11:09:26 1:41:07 1:30:12 0:10:55 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 6563550 2021-12-15 03:35:06 2021-12-15 09:29:29 2021-12-15 09:58:02 0:28:33 0:17:06 0:11:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6563551 2021-12-15 03:35:07 2021-12-15 09:30:20 2021-12-15 10:13:16 0:42:56 0:35:44 0:07:12 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6563552 2021-12-15 03:35:08 2021-12-15 09:31:40 2021-12-15 09:57:45 0:26:05 0:16:05 0:10:00 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 6563553 2021-12-15 03:35:08 2021-12-15 09:31:41 2021-12-15 10:06:13 0:34:32 0:22:45 0:11:47 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6563554 2021-12-15 03:35:09 2021-12-15 09:32:01 2021-12-15 10:00:58 0:28:57 0:23:18 0:05:39 smithi master rhel 8.3 rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6563555 2021-12-15 03:35:10 2021-12-15 09:32:02 2021-12-15 10:05:38 0:33:36 0:26:04 0:07:32 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 6563556 2021-12-15 03:35:11 2021-12-15 09:32:12 2021-12-15 09:56:23 0:24:11 0:14:14 0:09:57 smithi master ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm} 1
pass 6563557 2021-12-15 03:35:11 2021-12-15 09:32:42 2021-12-15 10:10:06 0:37:24 0:27:33 0:09:51 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_18.04}} 1
pass 6563558 2021-12-15 03:35:12 2021-12-15 09:32:43 2021-12-15 10:07:45 0:35:02 0:23:54 0:11:08 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6563559 2021-12-15 03:35:13 2021-12-15 09:34:03 2021-12-15 10:51:45 1:17:42 1:07:13 0:10:29 smithi master centos 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 6563560 2021-12-15 03:35:14 2021-12-15 09:34:34 2021-12-15 14:19:16 4:44:42 4:13:27 0:31:15 smithi master ubuntu 18.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_18.04}} 1
pass 6563561 2021-12-15 03:35:14 2021-12-15 09:35:44 2021-12-15 09:54:29 0:18:45 0:07:01 0:11:44 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 6563562 2021-12-15 03:35:15 2021-12-15 09:36:04 2021-12-15 10:07:39 0:31:35 0:20:44 0:10:51 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 6563563 2021-12-15 03:35:16 2021-12-15 09:36:15 2021-12-15 09:55:32 0:19:17 0:07:43 0:11:34 smithi master ubuntu 20.04 rados/singleton/{all/mon-config msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6563564 2021-12-15 03:35:16 2021-12-15 09:36:15 2021-12-15 10:10:13 0:33:58 0:23:13 0:10:45 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} 2
pass 6563565 2021-12-15 03:35:17 2021-12-15 09:36:15 2021-12-15 09:59:43 0:23:28 0:11:06 0:12:22 smithi master ubuntu 20.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6563566 2021-12-15 03:35:18 2021-12-15 09:38:06 2021-12-15 10:12:56 0:34:50 0:22:44 0:12:06 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6563567 2021-12-15 03:35:19 2021-12-15 09:38:26 2021-12-15 09:55:46 0:17:20 0:06:11 0:11:09 smithi master ubuntu 20.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
pass 6563568 2021-12-15 03:35:19 2021-12-15 09:39:37 2021-12-15 10:15:20 0:35:43 0:24:16 0:11:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 6563569 2021-12-15 03:35:20 2021-12-15 09:41:37 2021-12-15 10:09:44 0:28:07 0:18:10 0:09:57 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} tasks/rados_workunit_loadgen_mix} 2
pass 6563570 2021-12-15 03:35:21 2021-12-15 09:41:48 2021-12-15 10:03:05 0:21:17 0:09:49 0:11:28 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6563571 2021-12-15 03:35:22 2021-12-15 09:43:08 2021-12-15 10:06:19 0:23:11 0:13:40 0:09:31 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 6563572 2021-12-15 03:35:22 2021-12-15 09:43:09 2021-12-15 10:21:31 0:38:22 0:29:38 0:08:44 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2