Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7903332 2024-09-13 09:38:17 2024-09-13 09:44:35 2024-09-13 10:10:52 0:26:17 0:10:54 0:15:23 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache} 4
pass 7903333 2024-09-13 09:38:18 2024-09-13 09:49:16 2024-09-13 10:11:57 0:22:41 0:14:32 0:08:09 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} 1
pass 7903334 2024-09-13 09:38:19 2024-09-13 09:49:17 2024-09-13 10:14:19 0:25:02 0:15:06 0:09:56 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{ubuntu_latest} thrashers/careful_host thrashosds-health workloads/dedup-io-mixed} 4
pass 7903335 2024-09-13 09:38:21 2024-09-13 09:50:37 2024-09-13 10:24:00 0:33:23 0:21:29 0:11:54 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7903336 2024-09-13 09:38:22 2024-09-13 09:51:08 2024-09-13 10:20:03 0:28:55 0:16:37 0:12:18 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} 4
pass 7903337 2024-09-13 09:38:23 2024-09-13 09:51:48 2024-09-13 10:14:25 0:22:37 0:10:24 0:12:13 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore/bluestore-bitmap} tasks/{1-install 2-ceph 3-mgrmodules 4-units/devicehealth}} 2
pass 7903338 2024-09-13 09:38:25 2024-09-13 09:53:09 2024-09-13 10:36:18 0:43:09 0:34:03 0:09:06 smithi main centos 9.stream rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest}} 2
pass 7903339 2024-09-13 09:38:26 2024-09-13 09:53:19 2024-09-13 10:33:31 0:40:12 0:28:55 0:11:17 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/default_host thrashosds-health workloads/pool-snaps-few-objects} 4
pass 7903340 2024-09-13 09:38:28 2024-09-13 09:54:10 2024-09-13 10:36:55 0:42:45 0:32:03 0:10:42 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 4
pass 7903341 2024-09-13 09:38:29 2024-09-13 09:54:30 2024-09-13 10:31:44 0:37:14 0:26:19 0:10:55 smithi main ubuntu 22.04 rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-lz4} rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap_host thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} 4
pass 7903342 2024-09-13 09:38:30 2024-09-13 09:56:01 2024-09-13 10:37:55 0:41:54 0:30:16 0:11:38 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap_host thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 4
pass 7903343 2024-09-13 09:38:31 2024-09-13 09:58:02 2024-09-13 11:02:15 1:04:13 0:54:10 0:10:03 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/mapgap_host thrashosds-health workloads/radosbench-high-concurrency} 4
pass 7903344 2024-09-13 09:38:33 2024-09-13 09:58:42 2024-09-13 10:59:44 1:01:02 0:52:21 0:08:41 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} 4
pass 7903345 2024-09-13 09:38:34 2024-09-13 09:58:43 2024-09-13 10:24:50 0:26:07 0:14:03 0:12:04 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 7903346 2024-09-13 09:38:35 2024-09-13 10:01:03 2024-09-13 10:23:49 0:22:46 0:09:06 0:13:40 smithi main centos 9.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7903347 2024-09-13 09:38:37 2024-09-13 10:04:34 2024-09-13 10:30:20 0:25:46 0:14:25 0:11:21 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect} 4
pass 7903348 2024-09-13 09:38:38 2024-09-13 10:05:15 2024-09-13 10:31:11 0:25:56 0:15:34 0:10:22 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 4
pass 7903349 2024-09-13 09:38:39 2024-09-13 10:05:35 2024-09-13 10:28:57 0:23:22 0:13:36 0:09:46 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7903350 2024-09-13 09:38:40 2024-09-13 10:05:36 2024-09-13 10:30:24 0:24:48 0:12:00 0:12:48 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest} thrashers/pggrow_host thrashosds-health workloads/redirect_set_object} 4
pass 7903351 2024-09-13 09:38:42 2024-09-13 10:09:27 2024-09-13 10:36:46 0:27:19 0:13:50 0:13:29 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} 4
fail 7903352 2024-09-13 09:38:43 2024-09-13 10:11:07 2024-09-13 10:40:16 0:29:09 0:18:53 0:10:16 smithi main centos 9.stream rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi173 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'"

pass 7903353 2024-09-13 09:38:44 2024-09-13 10:11:18 2024-09-13 10:42:16 0:30:58 0:20:37 0:10:21 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/careful_host thrashosds-health workloads/small-objects-balanced} 4
pass 7903354 2024-09-13 09:38:46 2024-09-13 10:13:18 2024-09-13 10:42:08 0:28:50 0:19:18 0:09:32 smithi main centos 9.stream rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest}} 2
pass 7903355 2024-09-13 09:38:47 2024-09-13 10:13:19 2024-09-13 10:45:51 0:32:32 0:20:23 0:12:09 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-localized} 4
pass 7903356 2024-09-13 09:38:48 2024-09-13 10:14:39 2024-09-13 10:41:40 0:27:01 0:18:15 0:08:46 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete} 2
pass 7903357 2024-09-13 09:38:49 2024-09-13 10:14:40 2024-09-13 10:36:14 0:21:34 0:10:35 0:10:59 smithi main ubuntu 22.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-bitmap} rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
fail 7903358 2024-09-13 09:38:51 2024-09-13 10:15:50 2024-09-13 11:02:01 0:46:11 0:34:56 0:11:15 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-bitmap} rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 3
Failure Reason:

Command failed on smithi099 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 7903359 2024-09-13 09:38:52 2024-09-13 10:16:41 2024-09-13 10:41:41 0:25:00 0:15:06 0:09:54 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
dead 7903360 2024-09-13 09:38:54 2024-09-13 10:16:41 2024-09-13 11:16:57 1:00:16 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

Error reimaging machines: reached maximum tries (240) after waiting for 3600 seconds

pass 7903361 2024-09-13 09:38:55 2024-09-13 10:16:42 2024-09-13 10:50:30 0:33:48 0:20:22 0:13:26 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/default_host thrashosds-health workloads/small-objects} 4
pass 7903362 2024-09-13 09:38:56 2024-09-13 10:18:42 2024-09-13 10:53:55 0:35:13 0:26:12 0:09:01 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 4
pass 7903363 2024-09-13 09:38:58 2024-09-13 10:18:54 2024-09-13 10:54:43 0:35:49 0:24:15 0:11:34 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 4
pass 7903364 2024-09-13 09:38:59 2024-09-13 10:20:24 2024-09-13 11:00:26 0:40:02 0:28:35 0:11:27 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{centos_latest} thrashers/mapgap_host thrashosds-health workloads/snaps-few-objects-localized} 4
pass 7903365 2024-09-13 09:39:00 2024-09-13 10:21:25 2024-09-13 10:59:21 0:37:56 0:28:45 0:09:11 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 4
pass 7903366 2024-09-13 09:39:01 2024-09-13 10:21:45 2024-09-13 10:44:43 0:22:58 0:13:15 0:09:43 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
pass 7903367 2024-09-13 09:39:03 2024-09-13 10:21:46 2024-09-13 10:45:01 0:23:15 0:13:38 0:09:37 smithi main centos 9.stream rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7903368 2024-09-13 09:39:04 2024-09-13 10:21:46 2024-09-13 10:45:26 0:23:40 0:12:42 0:10:58 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 4
pass 7903369 2024-09-13 09:39:05 2024-09-13 10:22:16 2024-09-13 10:57:07 0:34:51 0:21:37 0:13:14 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 4
pass 7903370 2024-09-13 09:39:06 2024-09-13 10:24:17 2024-09-13 10:47:41 0:23:24 0:14:34 0:08:50 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7903371 2024-09-13 09:39:08 2024-09-13 10:24:18 2024-09-13 11:19:04 0:54:46 0:44:33 0:10:13 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 4
pass 7903372 2024-09-13 09:39:09 2024-09-13 10:25:28 2024-09-13 11:34:11 1:08:43 0:54:28 0:14:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/pggrow_host thrashosds-health workloads/cache-agent-big} 4
pass 7903373 2024-09-13 09:39:10 2024-09-13 10:29:09 2024-09-13 10:51:39 0:22:30 0:11:58 0:10:32 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} 4
pass 7903374 2024-09-13 09:39:12 2024-09-13 10:30:30 2024-09-13 10:59:41 0:29:11 0:18:25 0:10:46 smithi main centos 9.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{centos_latest}} 2
pass 7903375 2024-09-13 09:39:13 2024-09-13 10:30:40 2024-09-13 11:02:16 0:31:36 0:22:03 0:09:33 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/careful_host thrashosds-health workloads/cache-pool-snaps-readproxy} 4
pass 7903376 2024-09-13 09:39:14 2024-09-13 10:31:21 2024-09-13 11:01:02 0:29:41 0:20:13 0:09:28 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 4
pass 7903377 2024-09-13 09:39:15 2024-09-13 10:32:01 2024-09-13 11:13:35 0:41:34 0:29:11 0:12:23 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/default_host thrashosds-health workloads/cache-snaps} 4
fail 7903378 2024-09-13 09:39:17 2024-09-13 10:33:42 2024-09-13 11:13:39 0:39:57 0:29:15 0:10:42 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/deploy-raw} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7903379 2024-09-13 09:39:18 2024-09-13 10:33:53 2024-09-13 11:01:38 0:27:45 0:15:51 0:11:54 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} 4
dead 7903380 2024-09-13 09:39:19 2024-09-13 10:36:33 2024-09-13 10:42:25 0:05:52 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest} thrashers/mapgap_host thrashosds-health workloads/dedup-io-mixed} 4
Failure Reason:

Error reimaging machines: Expected smithi059's OS to be centos 9.stream but found ubuntu 22.04

pass 7903381 2024-09-13 09:39:21 2024-09-13 10:37:04 2024-09-13 11:09:22 0:32:18 0:21:03 0:11:15 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 2
pass 7903382 2024-09-13 09:39:22 2024-09-13 10:37:04 2024-09-13 11:03:18 0:26:14 0:15:50 0:10:24 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} 4
pass 7903383 2024-09-13 09:39:23 2024-09-13 10:37:15 2024-09-13 11:00:30 0:23:15 0:10:27 0:12:48 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-low-osd-mem-target} rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7903384 2024-09-13 09:39:24 2024-09-13 10:38:15 2024-09-13 11:18:17 0:40:02 0:28:37 0:11:25 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 4
pass 7903385 2024-09-13 09:39:26 2024-09-13 10:40:36 2024-09-13 11:19:24 0:38:48 0:27:11 0:11:37 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 4
pass 7903386 2024-09-13 09:39:27 2024-09-13 10:42:27 2024-09-13 11:37:24 0:54:57 0:43:48 0:11:09 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/pggrow_host thrashosds-health workloads/radosbench-high-concurrency} 4
pass 7903387 2024-09-13 09:39:28 2024-09-13 10:42:27 2024-09-13 11:09:18 0:26:51 0:15:45 0:11:06 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore/bluestore-bitmap} tasks/{1-install 2-ceph 3-mgrmodules 4-units/failover}} 2
pass 7903388 2024-09-13 09:39:29 2024-09-13 10:43:48 2024-09-13 11:00:56 0:17:08 0:07:29 0:09:39 smithi main centos 9.stream rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest}} 1
pass 7903389 2024-09-13 09:39:31 2024-09-13 10:43:48 2024-09-13 11:37:35 0:53:47 0:41:45 0:12:02 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} 4
fail 7903390 2024-09-13 09:39:32 2024-09-13 10:45:39 2024-09-13 11:05:17 0:19:38 0:09:22 0:10:16 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d58f73069a8157a9ace12a0247ee3e8497707ea9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7903391 2024-09-13 09:39:33 2024-09-13 10:45:39 2024-09-13 11:18:59 0:33:20 0:22:25 0:10:55 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/careful_host thrashosds-health workloads/redirect} 4
pass 7903392 2024-09-13 09:39:35 2024-09-13 10:46:09 2024-09-13 11:12:10 0:26:01 0:14:00 0:12:01 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} 4
pass 7903393 2024-09-13 09:39:36 2024-09-13 10:47:00 2024-09-13 11:14:20 0:27:20 0:16:06 0:11:14 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{ubuntu_latest} thrashers/default_host thrashosds-health workloads/redirect_set_object} 4
pass 7903394 2024-09-13 09:39:37 2024-09-13 10:48:01 2024-09-13 11:19:16 0:31:15 0:16:44 0:14:31 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
pass 7903395 2024-09-13 09:39:39 2024-09-13 10:50:42 2024-09-13 11:21:33 0:30:51 0:19:59 0:10:52 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 4
pass 7903396 2024-09-13 09:39:40 2024-09-13 10:51:53 2024-09-13 11:30:05 0:38:12 0:23:39 0:14:33 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-bitmap} rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap_host thrashosds-health workloads/small-objects-balanced} 4
pass 7903397 2024-09-13 09:39:41 2024-09-13 10:52:23 2024-09-13 11:24:26 0:32:03 0:21:11 0:10:52 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7903398 2024-09-13 09:39:43 2024-09-13 10:52:54 2024-09-13 11:25:09 0:32:15 0:19:45 0:12:30 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 4
pass 7903399 2024-09-13 09:39:44 2024-09-13 10:54:14 2024-09-13 11:27:22 0:33:08 0:22:38 0:10:30 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 4
pass 7903400 2024-09-13 09:39:45 2024-09-13 10:55:05 2024-09-13 11:16:15 0:21:10 0:11:24 0:09:46 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7903401 2024-09-13 09:39:47 2024-09-13 10:55:15 2024-09-13 11:54:57 0:59:42 0:49:33 0:10:09 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} 1
Failure Reason:

Command failed (workunit test misc/test-ceph-helpers.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d58f73069a8157a9ace12a0247ee3e8497707ea9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh'

pass 7903402 2024-09-13 09:39:48 2024-09-13 10:55:16 2024-09-13 11:29:30 0:34:14 0:20:11 0:14:03 smithi main centos 9.stream rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-snappy} rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=2-crush} 4
pass 7903403 2024-09-13 09:39:49 2024-09-13 10:57:27 2024-09-13 11:37:14 0:39:47 0:27:55 0:11:52 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 4
pass 7903404 2024-09-13 09:39:51 2024-09-13 10:59:38 2024-09-13 11:41:34 0:41:56 0:31:03 0:10:53 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 4
pass 7903405 2024-09-13 09:39:52 2024-09-13 10:59:58 2024-09-13 11:25:57 0:25:59 0:15:52 0:10:07 smithi main centos 9.stream rados/singleton/{all/3-az-stretch-cluster-netsplit mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest}} 4
pass 7903406 2024-09-13 09:39:54 2024-09-13 11:00:39 2024-09-13 11:42:25 0:41:46 0:30:43 0:11:03 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow_host thrashosds-health workloads/snaps-few-objects-localized} 4
pass 7903407 2024-09-13 09:39:55 2024-09-13 11:00:39 2024-09-13 11:36:24 0:35:45 0:24:14 0:11:31 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} 4
pass 7903408 2024-09-13 09:39:56 2024-09-13 11:01:09 2024-09-13 11:24:21 0:23:12 0:13:58 0:09:14 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest} thrashers/careful_host thrashosds-health workloads/write_fadvise_dontneed} 4
pass 7903409 2024-09-13 09:39:58 2024-09-13 11:01:20 2024-09-13 11:33:47 0:32:27 0:22:10 0:10:17 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 4
pass 7903410 2024-09-13 09:39:59 2024-09-13 11:02:01 2024-09-13 11:57:34 0:55:33 0:45:08 0:10:25 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/default_host thrashosds-health workloads/cache-agent-big} 4
pass 7903411 2024-09-13 09:40:00 2024-09-13 11:02:31 2024-09-13 11:24:06 0:21:35 0:12:40 0:08:55 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 7903412 2024-09-13 09:40:02 2024-09-13 11:02:31 2024-09-13 11:32:51 0:30:20 0:19:10 0:11:10 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 4
pass 7903413 2024-09-13 09:40:03 2024-09-13 11:02:32 2024-09-13 11:23:51 0:21:19 0:12:05 0:09:14 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7903414 2024-09-13 09:40:04 2024-09-13 11:02:32 2024-09-13 11:25:10 0:22:38 0:11:44 0:10:54 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7903415 2024-09-13 09:40:06 2024-09-13 11:03:03 2024-09-13 11:38:53 0:35:50 0:24:07 0:11:43 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/mapgap_host thrashosds-health workloads/cache-pool-snaps-readproxy} 4
pass 7903416 2024-09-13 09:40:07 2024-09-13 11:03:33 2024-09-13 11:40:41 0:37:08 0:20:42 0:16:26 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 4
pass 7903417 2024-09-13 09:40:08 2024-09-13 11:08:54 2024-09-13 12:03:42 0:54:48 0:40:05 0:14:43 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps} 4
pass 7903418 2024-09-13 09:40:10 2024-09-13 11:12:25 2024-09-13 11:59:49 0:47:24 0:38:58 0:08:26 smithi main ubuntu 22.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 7903419 2024-09-13 09:40:11 2024-09-13 11:12:26 2024-09-13 11:34:51 0:22:25 0:11:29 0:10:56 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-hybrid} rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache} 4
pass 7903420 2024-09-13 09:40:12 2024-09-13 11:13:47 2024-09-13 11:30:50 0:17:03 0:06:56 0:10:07 smithi main centos 9.stream rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest}} 1
pass 7903421 2024-09-13 09:40:14 2024-09-13 11:13:57 2024-09-13 11:36:12 0:22:15 0:11:29 0:10:46 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{centos_latest} thrashers/pggrow_host thrashosds-health workloads/dedup-io-mixed} 4
pass 7903422 2024-09-13 09:40:15 2024-09-13 11:14:37 2024-09-13 11:42:13 0:27:36 0:16:09 0:11:27 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-stupid} rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 4
pass 7903423 2024-09-13 09:40:16 2024-09-13 11:16:28 2024-09-13 11:53:45 0:37:17 0:24:06 0:13:11 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-hybrid} rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 4
pass 7903424 2024-09-13 09:40:17 2024-09-13 11:18:29 2024-09-13 12:00:40 0:42:11 0:30:56 0:11:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/careful_host thrashosds-health workloads/pool-snaps-few-objects} 4
pass 7903425 2024-09-13 09:40:19 2024-09-13 11:19:09 2024-09-13 11:54:51 0:35:42 0:26:03 0:09:39 smithi main ubuntu 22.04 rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7903426 2024-09-13 09:40:20 2024-09-13 11:19:20 2024-09-13 11:58:20 0:39:00 0:26:46 0:12:14 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rados_api_tests} 4
pass 7903427 2024-09-13 09:40:21 2024-09-13 11:19:20 2024-09-13 12:31:07 1:11:47 1:02:25 0:09:22 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{ubuntu_latest} thrashers/default_host thrashosds-health workloads/radosbench-high-concurrency} 4
pass 7903428 2024-09-13 09:40:23 2024-09-13 11:19:20 2024-09-13 11:43:58 0:24:38 0:13:00 0:11:38 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 7903429 2024-09-13 09:40:24 2024-09-13 11:19:21 2024-09-13 11:41:31 0:22:10 0:10:28 0:11:42 smithi main ubuntu 22.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 7903430 2024-09-13 09:40:25 2024-09-13 11:21:52 2024-09-13 11:55:53 0:34:01 0:23:44 0:10:17 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-lz4} rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 7903431 2024-09-13 09:40:26 2024-09-13 11:22:42 2024-09-13 12:24:18 1:01:36 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} 4
Failure Reason:

Error reimaging machines: reached maximum tries (240) after waiting for 3600 seconds