Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7487526 2023-12-11 23:28:44 2023-12-11 23:29:29 2023-12-11 23:54:53 0:25:24 0:13:33 0:11:51 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 7487527 2023-12-11 23:28:45 2023-12-11 23:29:29 2023-12-12 00:25:58 0:56:29 0:45:57 0:10:32 smithi main ubuntu 22.04 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487528 2023-12-11 23:28:45 2023-12-11 23:29:30 2023-12-12 00:09:23 0:39:53 0:30:04 0:09:49 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 7487529 2023-12-11 23:28:46 2023-12-11 23:29:30 2023-12-11 23:52:15 0:22:45 0:13:01 0:09:44 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} 2
pass 7487530 2023-12-11 23:28:47 2023-12-11 23:29:30 2023-12-11 23:48:06 0:18:36 0:09:33 0:09:03 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487531 2023-12-11 23:28:48 2023-12-11 23:29:31 2023-12-12 00:02:40 0:33:09 0:21:10 0:11:59 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} 2
fail 7487532 2023-12-11 23:28:49 2023-12-11 23:29:31 2023-12-12 00:21:41 0:52:10 0:17:29 0:34:41 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi018 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:21b8309530d48c7266e1db5c3ccbe10963f99737 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ff64b4c-9883-11ee-95a3-87774f69a715 -- ceph rgw realm bootstrap -i -'

pass 7487533 2023-12-11 23:28:49 2023-12-11 23:29:31 2023-12-12 00:04:09 0:34:38 0:23:47 0:10:51 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7487534 2023-12-11 23:28:50 2023-12-11 23:29:32 2023-12-12 00:04:03 0:34:31 0:23:37 0:10:54 smithi main ubuntu 22.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487535 2023-12-11 23:28:51 2023-12-11 23:29:32 2023-12-11 23:55:08 0:25:36 0:15:58 0:09:38 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7487536 2023-12-11 23:28:52 2023-12-11 23:29:32 2023-12-12 00:20:45 0:51:13 0:16:31 0:34:42 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7487537 2023-12-11 23:28:53 2023-12-11 23:29:33 2023-12-12 00:03:26 0:33:53 0:24:11 0:09:42 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487538 2023-12-11 23:28:53 2023-12-11 23:29:33 2023-12-11 23:50:45 0:21:12 0:12:33 0:08:39 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487539 2023-12-11 23:28:54 2023-12-11 23:29:33 2023-12-11 23:56:11 0:26:38 0:16:26 0:10:12 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 7487540 2023-12-11 23:28:55 2023-12-11 23:29:34 2023-12-11 23:59:31 0:29:57 0:19:32 0:10:25 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
fail 7487541 2023-12-11 23:28:56 2023-12-11 23:29:34 2023-12-12 00:22:53 0:53:19 0:42:22 0:10:57 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

pass 7487542 2023-12-11 23:28:57 2023-12-11 23:29:35 2023-12-11 23:55:38 0:26:03 0:18:40 0:07:23 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7487543 2023-12-11 23:28:58 2023-12-11 23:29:35 2023-12-12 00:05:56 0:36:21 0:22:51 0:13:30 smithi main ubuntu 22.04 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487544 2023-12-11 23:28:58 2023-12-11 23:32:26 2023-12-12 00:00:09 0:27:43 0:18:29 0:09:14 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7487545 2023-12-11 23:28:59 2023-12-11 23:32:26 2023-12-12 00:03:21 0:30:55 0:14:54 0:16:01 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487546 2023-12-11 23:29:00 2023-12-11 23:37:17 2023-12-12 00:29:43 0:52:26 0:24:29 0:27:57 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 7487547 2023-12-11 23:29:01 2023-12-11 23:40:38 2023-12-11 23:59:26 0:18:48 0:09:43 0:09:05 smithi main centos 9.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487548 2023-12-11 23:29:02 2023-12-11 23:40:38 2023-12-12 00:06:24 0:25:46 0:15:14 0:10:32 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 7487549 2023-12-11 23:29:03 2023-12-11 23:40:39 2023-12-12 00:26:03 0:45:24 0:20:24 0:25:00 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7487550 2023-12-11 23:29:03 2023-12-11 23:42:39 2023-12-12 00:06:05 0:23:26 0:11:20 0:12:06 smithi main ubuntu 22.04 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487551 2023-12-11 23:29:04 2023-12-11 23:44:30 2023-12-12 02:21:36 2:37:06 2:27:46 0:09:20 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} 1
pass 7487552 2023-12-11 23:29:05 2023-12-11 23:44:30 2023-12-12 00:22:55 0:38:25 0:27:05 0:11:20 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_api_tests} 2
pass 7487553 2023-12-11 23:29:06 2023-12-11 23:45:21 2023-12-12 00:08:35 0:23:14 0:16:20 0:06:54 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} 1
pass 7487554 2023-12-11 23:29:07 2023-12-11 23:45:21 2023-12-12 00:28:07 0:42:46 0:29:28 0:13:18 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 7487555 2023-12-11 23:29:08 2023-12-11 23:48:12 2023-12-12 00:11:10 0:22:58 0:11:21 0:11:37 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487556 2023-12-11 23:29:08 2023-12-11 23:49:42 2023-12-12 00:09:30 0:19:48 0:08:15 0:11:33 smithi main centos 9.stream rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} 1
pass 7487557 2023-12-11 23:29:09 2023-12-11 23:49:43 2023-12-12 00:09:06 0:19:23 0:09:42 0:09:41 smithi main centos 9.stream rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 2
pass 7487558 2023-12-11 23:29:10 2023-12-11 23:49:43 2023-12-12 00:12:59 0:23:16 0:12:45 0:10:31 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7487559 2023-12-11 23:29:11 2023-12-11 23:49:54 2023-12-12 00:24:29 0:34:35 0:24:51 0:09:44 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 7487560 2023-12-11 23:29:11 2023-12-11 23:50:54 2023-12-12 00:10:40 0:19:46 0:08:57 0:10:49 smithi main centos 9.stream rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
pass 7487561 2023-12-11 23:29:12 2023-12-11 23:51:35 2023-12-12 00:19:12 0:27:37 0:17:04 0:10:33 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7487562 2023-12-11 23:29:13 2023-12-11 23:51:55 2023-12-12 00:19:34 0:27:39 0:16:48 0:10:51 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/repair_test} 2
pass 7487563 2023-12-11 23:29:14 2023-12-11 23:52:25 2023-12-12 00:15:54 0:23:29 0:13:28 0:10:01 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 7487564 2023-12-11 23:29:15 2023-12-11 23:52:46 2023-12-12 00:14:27 0:21:41 0:10:46 0:10:55 smithi main centos 9.stream rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487565 2023-12-11 23:29:15 2023-12-11 23:52:46 2023-12-12 00:38:15 0:45:29 0:35:38 0:09:51 smithi main ubuntu 22.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487566 2023-12-11 23:29:16 2023-12-11 23:52:46 2023-12-12 00:21:51 0:29:05 0:17:57 0:11:08 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7487567 2023-12-11 23:29:17 2023-12-11 23:55:17 2023-12-12 00:20:11 0:24:54 0:16:40 0:08:14 smithi main centos 9.stream rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
fail 7487568 2023-12-11 23:29:18 2023-12-11 23:55:18 2023-12-12 00:34:56 0:39:38 0:29:51 0:09:47 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b8309530d48c7266e1db5c3ccbe10963f99737 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7487569 2023-12-11 23:29:18 2023-12-11 23:55:48 2023-12-12 00:29:38 0:33:50 0:21:43 0:12:07 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 7487570 2023-12-11 23:29:19 2023-12-11 23:55:48 2023-12-12 00:21:27 0:25:39 0:15:28 0:10:11 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 7487571 2023-12-11 23:29:20 2023-12-11 23:55:49 2023-12-12 00:21:03 0:25:14 0:18:54 0:06:20 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7487572 2023-12-11 23:29:21 2023-12-11 23:56:19 2023-12-12 00:19:28 0:23:09 0:11:38 0:11:31 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487573 2023-12-11 23:29:22 2023-12-11 23:58:00 2023-12-12 00:32:24 0:34:24 0:24:23 0:10:01 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487574 2023-12-11 23:29:22 2023-12-11 23:59:30 2023-12-12 00:33:59 0:34:29 0:23:10 0:11:19 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7487575 2023-12-11 23:29:23 2023-12-12 00:00:11 2023-12-12 00:38:47 0:38:36 0:27:29 0:11:07 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 7487576 2023-12-11 23:29:24 2023-12-12 00:01:01 2023-12-12 00:22:21 0:21:20 0:11:37 0:09:43 smithi main centos 9.stream rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} 1
pass 7487577 2023-12-11 23:29:25 2023-12-12 00:01:32 2023-12-12 00:30:51 0:29:19 0:18:53 0:10:26 smithi main ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 7487578 2023-12-11 23:29:26 2023-12-12 00:02:42 2023-12-12 00:39:50 0:37:08 0:27:52 0:09:16 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
fail 7487579 2023-12-11 23:29:26 2023-12-12 00:02:43 2023-12-12 00:21:38 0:18:55 0:09:55 0:09:00 smithi main centos 9.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

pass 7487580 2023-12-11 23:29:27 2023-12-12 00:02:43 2023-12-12 00:26:43 0:24:00 0:12:43 0:11:17 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487581 2023-12-11 23:29:28 2023-12-12 00:03:24 2023-12-12 00:37:12 0:33:48 0:23:49 0:09:59 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 7487582 2023-12-11 23:29:29 2023-12-12 00:03:34 2023-12-12 00:33:39 0:30:05 0:19:00 0:11:05 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} 1
pass 7487583 2023-12-11 23:29:29 2023-12-12 00:03:34 2023-12-12 02:43:24 2:39:50 2:30:20 0:09:30 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} 1
pass 7487584 2023-12-11 23:29:30 2023-12-12 00:04:05 2023-12-12 00:23:08 0:19:03 0:10:16 0:08:47 smithi main centos 9.stream rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
pass 7487585 2023-12-11 23:29:31 2023-12-12 00:04:05 2023-12-12 00:31:08 0:27:03 0:15:05 0:11:58 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 7487586 2023-12-11 23:29:32 2023-12-12 00:04:16 2023-12-12 00:34:58 0:30:42 0:20:22 0:10:20 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7487587 2023-12-11 23:29:33 2023-12-12 00:06:06 2023-12-12 00:29:45 0:23:39 0:13:50 0:09:49 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
pass 7487588 2023-12-11 23:29:34 2023-12-12 00:06:07 2023-12-12 00:58:03 0:51:56 0:42:12 0:09:44 smithi main centos 9.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 7487589 2023-12-11 23:29:34 2023-12-12 00:30:36 791 smithi main centos 9.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7487590 2023-12-11 23:29:35 2023-12-12 00:08:08 2023-12-12 00:45:26 0:37:18 0:27:07 0:10:11 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 7487591 2023-12-11 23:29:36 2023-12-12 00:08:08 2023-12-12 00:32:17 0:24:09 0:14:05 0:10:04 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7487592 2023-12-11 23:29:37 2023-12-12 00:08:39 2023-12-12 00:54:52 0:46:13 0:36:13 0:10:00 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
pass 7487593 2023-12-11 23:29:38 2023-12-12 00:09:29 2023-12-12 00:30:37 0:21:08 0:11:06 0:10:02 smithi main centos 9.stream rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} 1
pass 7487594 2023-12-11 23:29:38 2023-12-12 00:09:30 2023-12-12 00:34:46 0:25:16 0:16:42 0:08:34 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7487595 2023-12-11 23:29:39 2023-12-12 00:10:40 2023-12-12 00:36:18 0:25:38 0:15:44 0:09:54 smithi main ubuntu 22.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 7487596 2023-12-11 23:29:40 2023-12-12 00:10:41 2023-12-12 00:48:48 0:38:07 0:27:11 0:10:56 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 3
pass 7487597 2023-12-11 23:29:41 2023-12-12 00:11:11 2023-12-12 00:44:34 0:33:23 0:21:12 0:12:11 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487598 2023-12-11 23:29:42 2023-12-12 00:12:31 2023-12-12 00:31:24 0:18:53 0:10:28 0:08:25 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7487599 2023-12-11 23:29:42 2023-12-12 00:12:32 2023-12-12 00:44:07 0:31:35 0:20:51 0:10:44 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 7487600 2023-12-11 23:29:43 2023-12-12 00:13:02 2023-12-12 00:31:56 0:18:54 0:10:36 0:08:18 smithi main centos 9.stream rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 1
pass 7487601 2023-12-11 23:29:44 2023-12-12 00:13:03 2023-12-12 00:32:27 0:19:24 0:10:33 0:08:51 smithi main ubuntu 22.04 rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} 1
pass 7487602 2023-12-11 23:29:45 2023-12-12 00:13:03 2023-12-12 00:44:06 0:31:03 0:20:41 0:10:22 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 7487603 2023-12-11 23:29:45 2023-12-12 00:13:03 2023-12-12 00:43:12 0:30:09 0:17:00 0:13:09 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features} 2
pass 7487604 2023-12-11 23:29:46 2023-12-12 00:16:04 2023-12-12 00:46:45 0:30:41 0:19:24 0:11:17 smithi main centos 9.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}} 2
pass 7487605 2023-12-11 23:29:47 2023-12-12 00:19:15 2023-12-12 00:57:15 0:38:00 0:28:33 0:09:27 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487606 2023-12-11 23:29:48 2023-12-12 00:19:35 2023-12-12 00:41:20 0:21:45 0:11:23 0:10:22 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache} 2
pass 7487607 2023-12-11 23:29:48 2023-12-12 00:20:16 2023-12-12 00:45:15 0:24:59 0:16:15 0:08:44 smithi main centos 9.stream rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7487608 2023-12-11 23:29:49 2023-12-12 00:20:46 2023-12-12 00:46:00 0:25:14 0:18:58 0:06:16 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7487609 2023-12-11 23:29:50 2023-12-12 00:21:07 2023-12-12 00:44:44 0:23:37 0:13:16 0:10:21 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} 2
fail 7487610 2023-12-11 23:29:51 2023-12-12 00:21:37 2023-12-12 02:24:52 2:03:15 1:52:45 0:10:30 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

pass 7487611 2023-12-11 23:29:51 2023-12-12 00:21:48 2023-12-12 00:52:29 0:30:41 0:14:40 0:16:01 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7487612 2023-12-11 23:29:52 2023-12-12 00:21:48 2023-12-12 00:53:15 0:31:27 0:21:18 0:10:09 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487613 2023-12-11 23:29:53 2023-12-12 00:21:48 2023-12-12 00:47:26 0:25:38 0:12:53 0:12:45 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487614 2023-12-11 23:29:54 2023-12-12 00:22:59 2023-12-12 03:24:58 3:01:59 2:50:50 0:11:09 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 7487615 2023-12-11 23:29:55 2023-12-12 00:22:59 2023-12-12 00:52:42 0:29:43 0:19:45 0:09:58 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7487616 2023-12-11 23:29:55 2023-12-12 00:23:00 2023-12-12 00:44:58 0:21:58 0:12:10 0:09:48 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 7487617 2023-12-11 23:29:56 2023-12-12 00:23:10 2023-12-12 01:11:10 0:48:00 0:37:54 0:10:06 smithi main centos 9.stream rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
pass 7487618 2023-12-11 23:29:57 2023-12-12 00:24:31 2023-12-12 00:49:19 0:24:48 0:13:12 0:11:36 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 7487619 2023-12-11 23:29:58 2023-12-12 00:26:01 2023-12-12 01:02:09 0:36:08 0:26:28 0:09:40 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7487620 2023-12-11 23:29:58 2023-12-12 00:26:12 2023-12-12 00:55:51 0:29:39 0:23:17 0:06:22 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_host_drain} 3
pass 7487621 2023-12-11 23:29:59 2023-12-12 00:26:42 2023-12-12 00:48:13 0:21:31 0:11:40 0:09:51 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487622 2023-12-11 23:30:00 2023-12-12 00:26:53 2023-12-12 01:08:39 0:41:46 0:32:33 0:09:13 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
pass 7487623 2023-12-11 23:30:01 2023-12-12 00:26:53 2023-12-12 00:46:35 0:19:42 0:10:36 0:09:06 smithi main ubuntu 22.04 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
dead 7487624 2023-12-11 23:30:01 2023-12-12 00:26:53 2023-12-12 00:42:10 0:15:17 0:05:56 0:09:21 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
Failure Reason:

['<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Enabling a Copr repository. Please note that this repository is not part', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 500 - HTTP Error 500: INTERNAL SERVER ERROR', 'Please do not file bug reports about these packages in Fedora', 'The Fedora Project does not exercise any power over the contents of', 'and packages are not held to any quality or security level.', 'of the main distribution, and quality may vary.', 'this repository beyond the rules outlined in the Copr FAQ at']

pass 7487625 2023-12-11 23:30:02 2023-12-12 00:26:54 2023-12-12 00:54:57 0:28:03 0:18:18 0:09:45 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 2
pass 7487626 2023-12-11 23:30:03 2023-12-12 00:26:54 2023-12-12 00:51:15 0:24:21 0:11:18 0:13:03 smithi main ubuntu 22.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 7487627 2023-12-11 23:30:04 2023-12-12 00:29:45 2023-12-12 01:06:55 0:37:10 0:27:29 0:09:41 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7487628 2023-12-11 23:30:05 2023-12-12 00:29:45 2023-12-12 01:09:28 0:39:43 0:28:35 0:11:08 smithi main centos 9.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487629 2023-12-11 23:30:06 2023-12-12 00:29:46 2023-12-12 01:03:49 0:34:03 0:24:46 0:09:17 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7487630 2023-12-11 23:30:07 2023-12-12 00:29:46 2023-12-12 01:15:14 0:45:28 0:33:23 0:12:05 smithi main ubuntu 22.04 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487631 2023-12-11 23:30:07 2023-12-12 00:30:37 2023-12-12 00:54:34 0:23:57 0:14:21 0:09:36 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7487632 2023-12-11 23:30:08 2023-12-12 00:30:47 2023-12-12 01:08:18 0:37:31 0:27:11 0:10:20 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} 2
pass 7487633 2023-12-11 23:30:09 2023-12-12 00:31:17 2023-12-12 01:12:18 0:41:01 0:28:54 0:12:07 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7487634 2023-12-11 23:30:10 2023-12-12 00:31:28 2023-12-12 01:05:20 0:33:52 0:22:05 0:11:47 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 7487635 2023-12-11 23:30:10 2023-12-12 00:32:18 2023-12-12 01:06:39 0:34:21 0:24:30 0:09:51 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_monitoring_stack_basic} 3
pass 7487636 2023-12-11 23:30:11 2023-12-12 00:32:29 2023-12-12 01:10:49 0:38:20 0:27:24 0:10:56 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7487637 2023-12-11 23:30:12 2023-12-12 00:33:09 2023-12-12 00:59:26 0:26:17 0:14:54 0:11:23 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487638 2023-12-11 23:30:13 2023-12-12 00:33:40 2023-12-12 01:14:55 0:41:15 0:32:09 0:09:06 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
pass 7487639 2023-12-11 23:30:14 2023-12-12 00:34:00 2023-12-12 01:10:44 0:36:44 0:25:19 0:11:25 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487640 2023-12-11 23:30:14 2023-12-12 00:34:51 2023-12-12 01:11:51 0:37:00 0:27:55 0:09:05 smithi main centos 9.stream rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} 1
pass 7487641 2023-12-11 23:30:15 2023-12-12 00:34:51 2023-12-12 01:00:10 0:25:19 0:15:03 0:10:16 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7487642 2023-12-11 23:30:16 2023-12-12 00:35:02 2023-12-12 01:09:43 0:34:41 0:26:14 0:08:27 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 7487643 2023-12-11 23:30:17 2023-12-12 00:35:02 2023-12-12 02:07:32 1:32:30 1:22:41 0:09:49 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
pass 7487644 2023-12-11 23:30:17 2023-12-12 00:36:23 2023-12-12 01:00:50 0:24:27 0:13:49 0:10:38 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 7487645 2023-12-11 23:30:18 2023-12-12 00:37:13 2023-12-12 01:25:18 0:48:05 0:38:22 0:09:43 smithi main centos 9.stream rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} 1
pass 7487646 2023-12-11 23:30:19 2023-12-12 00:38:24 2023-12-12 01:01:52 0:23:28 0:13:07 0:10:21 smithi main centos 9.stream rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} 1
dead 7487647 2023-12-11 23:30:20 2023-12-12 00:38:54 2023-12-12 12:48:34 12:09:40 smithi main centos 9.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

hit max job timeout

pass 7487648 2023-12-11 23:30:21 2023-12-12 00:38:54 2023-12-12 01:05:42 0:26:48 0:15:59 0:10:49 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
dead 7487649 2023-12-11 23:30:21 2023-12-12 00:39:55 2023-12-12 00:56:32 0:16:37 0:05:48 0:10:49 smithi main centos 8.stream rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

['<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Enabling a Copr repository. Please note that this repository is not part', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 500 - HTTP Error 500: INTERNAL SERVER ERROR', 'Please do not file bug reports about these packages in Fedora', 'The Fedora Project does not exercise any power over the contents of', 'and packages are not held to any quality or security level.', 'of the main distribution, and quality may vary.', 'this repository beyond the rules outlined in the Copr FAQ at']

pass 7487650 2023-12-11 23:30:22 2023-12-12 00:41:25 2023-12-12 01:08:32 0:27:07 0:17:38 0:09:29 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 7487651 2023-12-11 23:30:23 2023-12-12 00:41:26 2023-12-12 01:06:02 0:24:36 0:13:11 0:11:25 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 7487652 2023-12-11 23:30:24 2023-12-12 01:10:20 1014 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} 1
pass 7487653 2023-12-11 23:30:25 2023-12-12 00:43:07 2023-12-12 01:09:56 0:26:49 0:15:01 0:11:48 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487654 2023-12-11 23:30:25 2023-12-12 00:44:07 2023-12-12 01:02:51 0:18:44 0:09:24 0:09:20 smithi main centos 9.stream rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
pass 7487655 2023-12-11 23:30:26 2023-12-12 00:44:08 2023-12-12 01:09:55 0:25:47 0:15:38 0:10:09 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7487656 2023-12-11 23:30:27 2023-12-12 00:44:38 2023-12-12 01:30:34 0:45:56 0:36:51 0:09:05 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7487657 2023-12-11 23:30:28 2023-12-12 00:44:48 2023-12-12 01:06:35 0:21:47 0:12:20 0:09:27 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487658 2023-12-11 23:30:29 2023-12-12 00:44:59 2023-12-12 01:08:55 0:23:56 0:14:46 0:09:10 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 7487659 2023-12-11 23:30:29 2023-12-12 00:44:59 2023-12-12 01:33:10 0:48:11 0:37:42 0:10:29 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 7487660 2023-12-11 23:30:30 2023-12-12 00:45:30 2023-12-12 01:08:51 0:23:21 0:13:05 0:10:16 smithi main centos 9.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} 1
pass 7487661 2023-12-11 23:30:31 2023-12-12 00:45:30 2023-12-12 01:13:19 0:27:49 0:16:59 0:10:50 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} 2
pass 7487662 2023-12-11 23:30:32 2023-12-12 00:46:11 2023-12-12 01:09:19 0:23:08 0:16:24 0:06:44 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 7487663 2023-12-11 23:30:33 2023-12-12 00:46:41 2023-12-12 01:07:55 0:21:14 0:09:09 0:12:05 smithi main centos 9.stream rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 3
pass 7487664 2023-12-11 23:30:33 2023-12-12 00:47:32 2023-12-12 01:09:08 0:21:36 0:11:50 0:09:46 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7487665 2023-12-11 23:30:34 2023-12-12 00:47:32 2023-12-12 01:09:01 0:21:29 0:12:04 0:09:25 smithi main centos 9.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487666 2023-12-11 23:30:35 2023-12-12 00:48:22 2023-12-12 01:23:56 0:35:34 0:25:38 0:09:56 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench} 2
pass 7487667 2023-12-11 23:30:36 2023-12-12 00:48:53 2023-12-12 01:20:38 0:31:45 0:21:03 0:10:42 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7487668 2023-12-11 23:30:36 2023-12-12 00:49:23 2023-12-12 01:26:58 0:37:35 0:25:30 0:12:05 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} 5
pass 7487669 2023-12-11 23:30:37 2023-12-12 00:51:24 2023-12-12 01:17:38 0:26:14 0:15:07 0:11:07 smithi main ubuntu 22.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487670 2023-12-11 23:30:38 2023-12-12 00:51:24 2023-12-12 01:18:17 0:26:53 0:15:32 0:11:21 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7487671 2023-12-11 23:30:38 2023-12-12 00:52:45 2023-12-12 01:11:28 0:18:43 0:10:20 0:08:23 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7487672 2023-12-11 23:30:39 2023-12-12 00:52:45 2023-12-12 01:20:24 0:27:39 0:15:33 0:12:06 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 7487673 2023-12-11 23:30:40 2023-12-12 00:54:36 2023-12-12 01:32:33 0:37:57 0:27:04 0:10:53 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7487674 2023-12-11 23:30:41 2023-12-12 00:54:56 2023-12-12 01:19:44 0:24:48 0:14:05 0:10:43 smithi main ubuntu 22.04 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487675 2023-12-11 23:30:42 2023-12-12 00:54:57 2023-12-12 01:30:31 0:35:34 0:24:52 0:10:42 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487676 2023-12-11 23:30:42 2023-12-12 00:55:07 2023-12-12 01:20:51 0:25:44 0:14:51 0:10:53 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/failover} 2
fail 7487677 2023-12-11 23:30:43 2023-12-12 00:55:17 2023-12-12 01:23:07 0:27:50 0:20:29 0:07:21 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi145 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:21b8309530d48c7266e1db5c3ccbe10963f99737 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06bd6f76-988c-11ee-95a3-87774f69a715 -- ceph rgw realm bootstrap -i -'

pass 7487678 2023-12-11 23:30:44 2023-12-12 00:55:58 2023-12-12 01:26:52 0:30:54 0:21:10 0:09:44 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} 1
pass 7487679 2023-12-11 23:30:45 2023-12-12 00:55:59 2023-12-12 01:20:14 0:24:15 0:14:23 0:09:52 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
fail 7487680 2023-12-11 23:30:45 2023-12-12 00:56:39 2023-12-12 01:15:33 0:18:54 0:09:26 0:09:28 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed (workunit test post-file.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b8309530d48c7266e1db5c3ccbe10963f99737 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'

pass 7487681 2023-12-11 23:30:46 2023-12-12 00:56:39 2023-12-12 01:22:58 0:26:19 0:15:56 0:10:23 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
dead 7487682 2023-12-11 23:30:47 2023-12-12 00:57:20 2023-12-12 01:14:56 0:17:36 0:06:08 0:11:28 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

['<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Enabling a Copr repository. Please note that this repository is not part', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 500 - HTTP Error 500: INTERNAL SERVER ERROR', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 500 - HTTP Error 500: Internal Server Error', 'Please do not file bug reports about these packages in Fedora', 'The Fedora Project does not exercise any power over the contents of', 'and packages are not held to any quality or security level.', 'of the main distribution, and quality may vary.', 'this repository beyond the rules outlined in the Copr FAQ at']

fail 7487683 2023-12-11 23:30:48 2023-12-12 00:59:31 2023-12-12 01:59:20 0:59:49 0:49:55 0:09:54 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

pass 7487684 2023-12-11 23:30:48 2023-12-12 01:00:11 2023-12-12 01:25:44 0:25:33 0:16:19 0:09:14 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7487685 2023-12-11 23:30:49 2023-12-12 01:00:52 2023-12-12 01:27:25 0:26:33 0:15:21 0:11:12 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} 2
pass 7487686 2023-12-11 23:30:50 2023-12-12 01:02:12 2023-12-12 01:25:54 0:23:42 0:13:45 0:09:57 smithi main ubuntu 22.04 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487687 2023-12-11 23:30:51 2023-12-12 01:02:13 2023-12-12 01:26:18 0:24:05 0:13:18 0:10:47 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487688 2023-12-11 23:30:51 2023-12-12 01:03:13 2023-12-12 01:36:33 0:33:20 0:24:19 0:09:01 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7487689 2023-12-11 23:30:52 2023-12-12 01:05:24 2023-12-12 01:27:03 0:21:39 0:11:29 0:10:10 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487690 2023-12-11 23:30:53 2023-12-12 01:05:24 2023-12-12 01:28:41 0:23:17 0:14:26 0:08:51 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 7487691 2023-12-11 23:30:54 2023-12-12 01:05:35 2023-12-12 01:30:44 0:25:09 0:15:11 0:09:58 smithi main centos 9.stream rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
pass 7487692 2023-12-11 23:30:55 2023-12-12 01:05:35 2023-12-12 01:24:39 0:19:04 0:08:49 0:10:15 smithi main centos 9.stream rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}} 1
pass 7487693 2023-12-11 23:30:56 2023-12-12 01:05:45 2023-12-12 01:32:50 0:27:05 0:20:07 0:06:58 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7487694 2023-12-11 23:30:56 2023-12-12 01:06:06 2023-12-12 01:36:29 0:30:23 0:20:23 0:10:00 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} 2
pass 7487695 2023-12-11 23:30:57 2023-12-12 01:06:46 2023-12-12 01:25:43 0:18:57 0:10:13 0:08:44 smithi main centos 9.stream rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487696 2023-12-11 23:30:58 2023-12-12 01:06:47 2023-12-12 01:42:46 0:35:59 0:26:06 0:09:53 smithi main ubuntu 22.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 7487697 2023-12-11 23:30:59 2023-12-12 01:06:57 2023-12-12 01:46:24 0:39:27 0:27:11 0:12:16 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 3
pass 7487698 2023-12-11 23:30:59 2023-12-12 01:07:58 2023-12-12 01:29:51 0:21:53 0:12:08 0:09:45 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} 1
pass 7487699 2023-12-11 23:31:00 2023-12-12 01:07:58 2023-12-12 01:31:40 0:23:42 0:13:24 0:10:18 smithi main centos 9.stream rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
pass 7487700 2023-12-11 23:31:01 2023-12-12 01:07:58 2023-12-12 01:35:06 0:27:08 0:18:03 0:09:05 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 7487701 2023-12-11 23:31:02 2023-12-12 01:07:59 2023-12-12 01:33:58 0:25:59 0:15:21 0:10:38 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 7487702 2023-12-11 23:31:02 2023-12-12 01:08:19 2023-12-12 01:35:24 0:27:05 0:21:12 0:05:53 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7487703 2023-12-11 23:31:03 2023-12-12 01:08:39 2023-12-12 01:27:42 0:19:03 0:09:48 0:09:15 smithi main centos 9.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7487704 2023-12-11 23:31:04 2023-12-12 01:08:40 2023-12-12 01:32:18 0:23:38 0:13:13 0:10:25 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/insights} 2
pass 7487705 2023-12-11 23:31:05 2023-12-12 05:17:03 2023-12-12 05:48:43 0:31:40 0:22:14 0:09:26 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
pass 7487706 2023-12-11 23:31:05 2023-12-12 05:17:03 2023-12-12 05:57:10 0:40:07 0:26:44 0:13:23 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 7487707 2023-12-11 23:31:06 2023-12-12 05:19:24 2023-12-12 05:50:48 0:31:24 0:20:53 0:10:31 smithi main ubuntu 22.04 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487708 2023-12-11 23:31:07 2023-12-12 05:19:24 2023-12-12 05:51:21 0:31:57 0:21:50 0:10:07 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 7487709 2023-12-11 23:31:08 2023-12-12 05:20:15 2023-12-12 05:54:46 0:34:31 0:22:43 0:11:48 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 7487710 2023-12-11 23:31:08 2023-12-12 05:20:45 2023-12-12 06:54:30 1:33:45 1:22:42 0:11:03 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} 1
pass 7487711 2023-12-11 23:31:09 2023-12-12 05:20:46 2023-12-12 05:47:00 0:26:14 0:15:12 0:11:02 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7487712 2023-12-11 23:31:10 2023-12-12 05:21:46 2023-12-12 05:57:48 0:36:02 0:26:33 0:09:29 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487713 2023-12-11 23:31:10 2023-12-12 05:21:47 2023-12-12 05:47:19 0:25:32 0:11:34 0:13:58 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487714 2023-12-11 23:31:11 2023-12-12 05:25:38 2023-12-12 05:52:27 0:26:49 0:17:33 0:09:16 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7487715 2023-12-11 23:31:12 2023-12-12 05:27:48 2023-12-12 06:08:49 0:41:01 0:31:57 0:09:04 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7487716 2023-12-11 23:31:13 2023-12-12 05:27:49 2023-12-12 05:59:12 0:31:23 0:22:55 0:08:28 smithi main ubuntu 22.04 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487717 2023-12-11 23:31:13 2023-12-12 05:27:49 2023-12-12 05:54:49 0:27:00 0:18:03 0:08:57 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 7487718 2023-12-11 23:31:14 2023-12-12 05:27:49 2023-12-12 05:57:30 0:29:41 0:19:33 0:10:08 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 7487719 2023-12-11 23:31:15 2023-12-12 05:28:20 2023-12-12 05:52:57 0:24:37 0:12:14 0:12:23 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487720 2023-12-11 23:31:16 2023-12-12 05:31:51 2023-12-12 06:00:26 0:28:35 0:17:01 0:11:34 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} 1
pass 7487721 2023-12-11 23:31:16 2023-12-12 05:33:21 2023-12-12 05:56:37 0:23:16 0:12:37 0:10:39 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487722 2023-12-11 23:31:17 2023-12-12 05:35:02 2023-12-12 06:01:33 0:26:31 0:15:04 0:11:27 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 7487723 2023-12-11 23:31:18 2023-12-12 05:35:42 2023-12-12 06:01:25 0:25:43 0:15:31 0:10:12 smithi main ubuntu 22.04 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
fail 7487724 2023-12-11 23:31:19 2023-12-12 05:35:43 2023-12-12 06:15:33 0:39:50 0:29:19 0:10:31 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b8309530d48c7266e1db5c3ccbe10963f99737 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7487725 2023-12-11 23:31:19 2023-12-12 05:35:53 2023-12-12 07:27:53 1:52:00 1:42:52 0:09:08 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 7487726 2023-12-11 23:31:20 2023-12-12 05:36:44 2023-12-12 06:01:25 0:24:41 0:18:20 0:06:21 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7487727 2023-12-11 23:31:21 2023-12-12 05:36:44 2023-12-12 06:08:30 0:31:46 0:22:51 0:08:55 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 7487728 2023-12-11 23:31:21 2023-12-12 05:36:44 2023-12-12 06:01:40 0:24:56 0:13:17 0:11:39 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} 2
pass 7487729 2023-12-11 23:31:22 2023-12-12 05:38:05 2023-12-12 05:56:59 0:18:54 0:09:49 0:09:05 smithi main centos 9.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487730 2023-12-11 23:31:23 2023-12-12 05:38:05 2023-12-12 05:58:43 0:20:38 0:09:01 0:11:37 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper} 2
pass 7487731 2023-12-11 23:31:24 2023-12-12 05:39:26 2023-12-12 06:06:07 0:26:41 0:13:34 0:13:07 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} 1
pass 7487732 2023-12-11 23:31:24 2023-12-12 05:43:06 2023-12-12 06:04:20 0:21:14 0:11:30 0:09:44 smithi main ubuntu 22.04 rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487733 2023-12-11 23:31:25 2023-12-12 05:43:07 2023-12-12 06:04:52 0:21:45 0:10:55 0:10:50 smithi main ubuntu 22.04 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
pass 7487734 2023-12-11 23:31:26 2023-12-12 05:43:17 2023-12-12 06:18:34 0:35:17 0:25:25 0:09:52 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7487735 2023-12-11 23:31:27 2023-12-12 05:43:18 2023-12-12 06:17:27 0:34:09 0:24:34 0:09:35 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/module_selftest} 2
pass 7487736 2023-12-11 23:31:27 2023-12-12 05:44:18 2023-12-12 06:25:51 0:41:33 0:29:39 0:11:54 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7487737 2023-12-11 23:31:28 2023-12-12 05:44:49 2023-12-12 06:13:06 0:28:17 0:17:58 0:10:19 smithi main ubuntu 22.04 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} 1
pass 7487738 2023-12-11 23:31:29 2023-12-12 05:45:09 2023-12-12 06:06:14 0:21:05 0:12:08 0:08:57 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} 1
fail 7487739 2023-12-11 23:31:30 2023-12-12 05:47:10 2023-12-12 06:06:11 0:19:01 0:09:30 0:09:31 smithi main centos 9.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

pass 7487740 2023-12-11 23:31:30 2023-12-12 05:47:10 2023-12-12 06:15:03 0:27:53 0:18:16 0:09:37 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
pass 7487741 2023-12-11 23:31:31 2023-12-12 05:47:20 2023-12-12 06:18:36 0:31:16 0:19:24 0:11:52 smithi main ubuntu 22.04 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487742 2023-12-11 23:31:32 2023-12-12 05:48:51 2023-12-12 07:27:03 1:38:12 1:25:40 0:12:32 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 7487743 2023-12-11 23:31:32 2023-12-12 05:51:22 2023-12-12 06:14:56 0:23:34 0:17:16 0:06:18 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7487744 2023-12-11 23:31:33 2023-12-12 05:52:02 2023-12-12 06:16:41 0:24:39 0:13:13 0:11:26 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 7487745 2023-12-11 23:31:34 2023-12-12 05:52:02 2023-12-12 06:30:59 0:38:57 0:27:02 0:11:55 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487746 2023-12-11 23:31:35 2023-12-12 05:52:13 2023-12-12 06:29:25 0:37:12 0:26:57 0:10:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 7487747 2023-12-11 23:31:35 2023-12-12 05:52:13 2023-12-12 06:18:29 0:26:16 0:15:40 0:10:36 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487748 2023-12-11 23:31:36 2023-12-12 05:52:34 2023-12-12 06:20:49 0:28:15 0:20:02 0:08:13 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_extra_daemon_features} 2
pass 7487749 2023-12-11 23:31:37 2023-12-12 05:53:04 2023-12-12 06:22:40 0:29:36 0:19:18 0:10:18 smithi main ubuntu 22.04 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 7487750 2023-12-11 23:31:38 2023-12-12 05:53:04 2023-12-12 06:24:14 0:31:10 0:22:09 0:09:01 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

fail 7487751 2023-12-11 23:31:38 2023-12-12 05:53:05 2023-12-12 06:35:42 0:42:37 0:32:02 0:10:35 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

pass 7487752 2023-12-11 23:31:39 2023-12-12 05:54:45 2023-12-12 06:40:12 0:45:27 0:35:01 0:10:26 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7487753 2023-12-11 23:31:40 2023-12-12 05:54:56 2023-12-12 06:20:10 0:25:14 0:12:20 0:12:54 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487754 2023-12-11 23:31:40 2023-12-12 05:57:06 2023-12-12 06:22:22 0:25:16 0:16:41 0:08:35 smithi main centos 9.stream rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7487755 2023-12-11 23:31:41 2023-12-12 05:57:17 2023-12-12 06:33:53 0:36:36 0:24:46 0:11:50 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7487756 2023-12-11 23:31:42 2023-12-12 05:57:37 2023-12-12 06:37:35 0:39:58 0:30:10 0:09:48 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 7487757 2023-12-11 23:31:43 2023-12-12 05:57:58 2023-12-12 06:40:08 0:42:10 0:30:53 0:11:17 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} 2
pass 7487758 2023-12-11 23:31:43 2023-12-12 05:58:38 2023-12-12 06:21:01 0:22:23 0:11:42 0:10:41 smithi main ubuntu 22.04 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487759 2023-12-11 23:31:44 2023-12-12 05:58:38 2023-12-12 06:33:05 0:34:27 0:23:03 0:11:24 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_host_drain} 3
pass 7487760 2023-12-11 23:31:45 2023-12-12 05:58:49 2023-12-12 06:28:53 0:30:04 0:20:03 0:10:01 smithi main centos 9.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}} 2
pass 7487761 2023-12-11 23:31:46 2023-12-12 05:59:19 2023-12-12 06:36:21 0:37:02 0:28:11 0:08:51 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 7487762 2023-12-11 23:31:46 2023-12-12 05:59:20 2023-12-12 06:27:18 0:27:58 0:17:12 0:10:46 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7487763 2023-12-11 23:31:47 2023-12-12 05:59:40 2023-12-12 06:23:20 0:23:40 0:12:04 0:11:36 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} 2
pass 7487764 2023-12-11 23:31:48 2023-12-12 06:01:31 2023-12-12 06:31:37 0:30:06 0:19:39 0:10:27 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7487765 2023-12-11 23:31:49 2023-12-12 06:01:31 2023-12-12 06:35:32 0:34:01 0:23:54 0:10:07 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 7487766 2023-12-11 23:31:49 2023-12-12 06:01:41 2023-12-12 06:30:36 0:28:55 0:18:31 0:10:24 smithi main centos 9.stream rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
pass 7487767 2023-12-11 23:31:50 2023-12-12 06:01:42 2023-12-12 06:23:22 0:21:40 0:08:46 0:12:54 smithi main centos 9.stream rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 2
pass 7487768 2023-12-11 23:31:51 2023-12-12 06:04:23 2023-12-12 06:28:45 0:24:22 0:13:58 0:10:24 smithi main ubuntu 22.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7487769 2023-12-11 23:31:52 2023-12-12 06:05:03 2023-12-12 06:33:54 0:28:51 0:19:30 0:09:21 smithi main centos 9.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7487770 2023-12-11 23:31:52 2023-12-12 06:32:27 995 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7487771 2023-12-11 23:31:53 2023-12-12 06:05:04 2023-12-12 06:37:36 0:32:32 0:21:47 0:10:45 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 7487772 2023-12-11 23:31:54 2023-12-12 06:06:24 2023-12-12 07:22:13 1:15:49 1:05:12 0:10:37 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} 1
pass 7487773 2023-12-11 23:31:54 2023-12-12 06:07:25 2023-12-12 06:35:22 0:27:57 0:17:44 0:10:13 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7487774 2023-12-11 23:31:55 2023-12-12 06:07:25 2023-12-12 06:51:54 0:44:29 0:34:00 0:10:29 smithi main ubuntu 22.04 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487775 2023-12-11 23:31:56 2023-12-12 06:08:06 2023-12-12 06:37:02 0:28:56 0:16:07 0:12:49 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7487776 2023-12-11 23:31:57 2023-12-12 06:08:36 2023-12-12 06:42:07 0:33:31 0:23:43 0:09:48 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 7487777 2023-12-11 23:31:57 2023-12-12 06:08:36 2023-12-12 06:43:43 0:35:07 0:25:14 0:09:53 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487778 2023-12-11 23:31:58 2023-12-12 06:08:37 2023-12-12 06:30:41 0:22:04 0:12:15 0:09:49 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487779 2023-12-11 23:31:59 2023-12-12 06:08:57 2023-12-12 06:48:31 0:39:34 0:24:06 0:15:28 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} 2
pass 7487780 2023-12-11 23:32:00 2023-12-12 06:15:46 2023-12-12 07:03:51 0:48:05 0:38:50 0:09:15 smithi main ubuntu 22.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 7487781 2023-12-11 23:32:00 2023-12-12 06:15:47 2023-12-12 06:43:08 0:27:21 0:16:56 0:10:25 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 7487782 2023-12-11 23:32:01 2023-12-12 06:15:57 2023-12-12 06:47:54 0:31:57 0:22:00 0:09:57 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_monitoring_stack_basic} 3
pass 7487783 2023-12-11 23:32:02 2023-12-12 06:16:17 2023-12-12 06:38:53 0:22:36 0:13:59 0:08:37 smithi main centos 9.stream rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
pass 7487784 2023-12-11 23:32:03 2023-12-12 06:16:18 2023-12-12 06:53:26 0:37:08 0:25:40 0:11:28 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 7487785 2023-12-11 23:32:03 2023-12-12 06:17:28 2023-12-12 06:44:27 0:26:59 0:14:54 0:12:05 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7487786 2023-12-11 23:32:04 2023-12-12 06:18:40 2023-12-12 06:58:11 0:39:31 0:28:20 0:11:11 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487787 2023-12-11 23:32:05 2023-12-12 06:18:40 2023-12-12 06:44:43 0:26:03 0:15:25 0:10:38 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7487788 2023-12-11 23:32:05 2023-12-12 06:18:40 2023-12-12 06:44:43 0:26:03 0:15:19 0:10:44 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7487789 2023-12-11 23:32:06 2023-12-12 06:19:31 2023-12-12 06:51:05 0:31:34 0:21:25 0:10:09 smithi main ubuntu 22.04 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487790 2023-12-11 23:32:07 2023-12-12 06:19:31 2023-12-12 06:45:51 0:26:20 0:14:54 0:11:26 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 7487791 2023-12-11 23:32:08 2023-12-12 06:20:11 2023-12-12 07:05:43 0:45:32 0:35:24 0:10:08 smithi main ubuntu 22.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487792 2023-12-11 23:32:08 2023-12-12 06:20:12 2023-12-12 06:47:37 0:27:25 0:20:07 0:07:18 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} 1
pass 7487793 2023-12-11 23:32:09 2023-12-12 06:20:12 2023-12-12 06:52:07 0:31:55 0:22:19 0:09:36 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/progress} 2
pass 7487794 2023-12-11 23:32:10 2023-12-12 06:20:53 2023-12-12 06:42:53 0:22:00 0:11:54 0:10:06 smithi main centos 9.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487795 2023-12-11 23:32:11 2023-12-12 06:21:03 2023-12-12 06:53:46 0:32:43 0:20:37 0:12:06 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7487796 2023-12-11 23:32:11 2023-12-12 06:22:44 2023-12-12 07:31:06 1:08:22 0:57:09 0:11:13 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 7487797 2023-12-11 23:32:12 2023-12-12 06:23:24 2023-12-12 06:42:31 0:19:07 0:09:59 0:09:08 smithi main centos 9.stream rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 2
pass 7487798 2023-12-11 23:32:13 2023-12-12 06:23:24 2023-12-12 06:51:07 0:27:43 0:15:27 0:12:16 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7487799 2023-12-11 23:32:14 2023-12-12 06:25:55 2023-12-12 07:07:00 0:41:05 0:29:36 0:11:29 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7487800 2023-12-11 23:32:14 2023-12-12 06:27:26 2023-12-12 06:56:35 0:29:09 0:17:37 0:11:32 smithi main ubuntu 22.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 7487801 2023-12-11 23:32:15 2023-12-12 06:28:46 2023-12-12 07:07:18 0:38:32 0:28:14 0:10:18 smithi main ubuntu 22.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 3
pass 7487802 2023-12-11 23:32:16 2023-12-12 06:28:57 2023-12-12 07:04:46 0:35:49 0:25:52 0:09:57 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 7487803 2023-12-11 23:32:17 2023-12-12 06:29:27 2023-12-12 08:03:54 1:34:27 1:23:07 0:11:20 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} 2
dead 7487804 2023-12-11 23:32:17 2023-12-12 06:30:48 2023-12-12 18:42:56 12:12:08 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

hit max job timeout

pass 7487805 2023-12-11 23:32:18 2023-12-12 06:31:08 2023-12-12 07:04:04 0:32:56 0:23:52 0:09:04 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} 1
dead 7487806 2023-12-11 23:32:19 2023-12-12 06:31:09 2023-12-12 18:42:31 12:11:22 smithi main rhel 8.6 rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

hit max job timeout

pass 7487807 2023-12-11 23:32:20 2023-12-12 06:31:39 2023-12-12 07:10:20 0:38:41 0:31:11 0:07:30 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli_mon} 5
pass 7487808 2023-12-11 23:32:20 2023-12-12 06:33:10 2023-12-12 06:54:27 0:21:17 0:10:56 0:10:21 smithi main centos 9.stream rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7487809 2023-12-11 23:32:21 2023-12-12 06:33:10 2023-12-12 07:09:02 0:35:52 0:25:19 0:10:33 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 7487810 2023-12-11 23:32:22 2023-12-12 06:34:01 2023-12-12 06:57:24 0:23:23 0:13:15 0:10:08 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 7487811 2023-12-11 23:32:22 2023-12-12 06:34:01 2023-12-12 06:55:13 0:21:12 0:12:48 0:08:24 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7487812 2023-12-11 23:32:23 2023-12-12 06:34:01 2023-12-12 06:56:39 0:22:38 0:11:05 0:11:33 smithi main centos 9.stream rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7487813 2023-12-11 23:32:24 2023-12-12 06:35:32 2023-12-12 07:09:30 0:33:58 0:23:17 0:10:41 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7487814 2023-12-11 23:32:25 2023-12-12 06:35:32 2023-12-12 07:13:13 0:37:41 0:27:45 0:09:56 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7487815 2023-12-11 23:32:26 2023-12-12 06:35:43 2023-12-12 06:58:01 0:22:18 0:11:50 0:10:28 smithi main ubuntu 22.04 rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 7487816 2023-12-11 23:32:26 2023-12-12 06:36:23 2023-12-12 07:08:29 0:32:06 0:18:46 0:13:20 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi066 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:21b8309530d48c7266e1db5c3ccbe10963f99737 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdf3172-98bb-11ee-95a3-87774f69a715 -- ceph rgw realm bootstrap -i -'

pass 7487817 2023-12-11 23:32:27 2023-12-12 06:37:04 2023-12-12 07:24:55 0:47:51 0:36:56 0:10:55 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 7487818 2023-12-11 23:32:28 2023-12-12 06:37:44 2023-12-12 07:08:53 0:31:09 0:21:35 0:09:34 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 7487819 2023-12-11 23:32:29 2023-12-12 06:37:45 2023-12-12 07:02:13 0:24:28 0:14:00 0:10:28 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487820 2023-12-11 23:32:29 2023-12-12 06:38:55 2023-12-12 07:07:41 0:28:46 0:16:14 0:12:32 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7487821 2023-12-11 23:32:30 2023-12-12 06:40:16 2023-12-12 07:12:13 0:31:57 0:14:53 0:17:04 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7487822 2023-12-11 23:32:31 2023-12-12 06:41:16 2023-12-12 08:49:13 2:07:57 1:56:37 0:11:20 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate

pass 7487823 2023-12-11 23:32:32 2023-12-12 06:42:17 2023-12-12 07:03:45 0:21:28 0:12:13 0:09:15 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/prometheus} 2
pass 7487824 2023-12-11 23:32:32 2023-12-12 06:42:37 2023-12-12 08:55:32 2:12:55 2:00:32 0:12:23 smithi main ubuntu 22.04 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487825 2023-12-11 23:32:33 2023-12-12 06:42:58 2023-12-12 09:22:31 2:39:33 2:09:46 0:29:47 smithi main centos 9.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}} 1
pass 7487826 2023-12-11 23:32:34 2023-12-12 06:43:18 2023-12-12 07:10:57 0:27:39 0:20:12 0:07:27 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7487827 2023-12-11 23:32:35 2023-12-12 06:43:49 2023-12-12 07:13:23 0:29:34 0:19:46 0:09:48 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 7487828 2023-12-11 23:32:35 2023-12-12 06:44:29 2023-12-12 07:10:16 0:25:47 0:16:19 0:09:28 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 7487829 2023-12-11 23:32:36 2023-12-12 06:44:30 2023-12-12 07:06:06 0:21:36 0:12:44 0:08:52 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7487830 2023-12-11 23:32:37 2023-12-12 06:44:30 2023-12-12 07:10:35 0:26:05 0:16:11 0:09:54 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 7487831 2023-12-11 23:32:38 2023-12-12 06:44:50 2023-12-12 07:34:45 0:49:55 0:38:28 0:11:27 smithi main ubuntu 22.04 rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
pass 7487832 2023-12-11 23:32:39 2023-12-12 06:44:51 2023-12-12 07:15:20 0:30:29 0:19:34 0:10:55 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7487833 2023-12-11 23:32:39 2023-12-12 06:46:11 2023-12-12 07:27:15 0:41:04 0:31:58 0:09:06 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 7487834 2023-12-11 23:32:40 2023-12-12 06:46:12 2023-12-12 08:02:37 1:16:25 1:05:27 0:10:58 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} 1
pass 7487835 2023-12-11 23:32:41 2023-12-12 06:47:42 2023-12-12 07:09:14 0:21:32 0:12:37 0:08:55 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
fail 7487836 2023-12-11 23:32:42 2023-12-12 06:48:03 2023-12-12 07:09:31 0:21:28 0:11:00 0:10:28 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed (workunit test post-file.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b8309530d48c7266e1db5c3ccbe10963f99737 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'

pass 7487837 2023-12-11 23:32:42 2023-12-12 06:48:03 2023-12-12 07:12:06 0:24:03 0:11:30 0:12:33 smithi main ubuntu 22.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 7487838 2023-12-11 23:32:43 2023-12-12 06:50:14 2023-12-12 07:29:03 0:38:49 0:27:33 0:11:16 smithi main ubuntu 22.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3