ID
Status
Ceph Branch
Suite Branch
Teuthology Branch
Machine
OS
Nodes
Description
Failure Reason
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
Error reimaging machines: Expected smithi152's OS to be ubuntu 22.04 but found centos 9.stream
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi028 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key}
"2024-06-21T02:33:53.807745+0000 mon.a (mon.0) 350 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_latest} tasks/workunits}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests}
Command failed (workunit test rados/test.sh) on smithi017 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
Command failed (workunit test cephtool/test.sh) on smithi042 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}}
hit max job timeout
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
"2024-06-21T02:58:37.134492+0000 mon.a (mon.0) 682 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-localized}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/failover}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps}
"2024-06-21T03:40:00.000164+0000 mon.a (mon.0) 1579 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down; Reduced data availability: 22 pgs inactive; Degraded data redundancy: 51/1440 objects degraded (3.542%), 3 pgs degraded, 22 pgs undersized" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/insights}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
Command failed (workunit test cephtool/test.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
"2024-06-21T03:52:46.157932+0000 mon.smithi079 (mon.0) 821 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e}
"2024-06-21T04:09:26.993614+0000 mon.a (mon.0) 707 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench}
"2024-06-21T04:30:00.000126+0000 mon.a (mon.0) 1782 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain}
"2024-06-21T04:09:13.570404+0000 mon.a (mon.0) 701 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_latest} tasks/module_selftest}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
reached maximum tries (801) after waiting for 4800 seconds
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
"2024-06-21T04:15:29.346095+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic}
"2024-06-21T04:54:34.966405+0000 mon.a (mon.0) 526 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
Command failed (workunit test rados/test.sh) on smithi064 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
Command failed (workunit test cephtool/test.sh) on smithi193 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/progress}
Test failure: test_default_progress_test (tasks.mgr.test_progress.TestProgress)
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
hit max job timeout
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
"2024-06-21T05:12:08.171723+0000 mon.a (mon.0) 662 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
"2024-06-21T05:40:00.000153+0000 mon.a (mon.0) 1391 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/prometheus}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon}
Command failed (workunit test mon/osd-erasure-code-profile.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6591 (apt-get)']
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations}
"2024-06-21T06:04:16.518803+0000 mon.a (mon.0) 446 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/workunits}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
Command failed (workunit test cephtool/test.sh) on smithi053 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=961a5ccb260829af2bdb3e96f377ce07199bcdae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/scrub_test}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e}
"2024-06-21T06:48:33.431568+0000 mon.a (mon.0) 871 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/crash}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
"2024-06-21T06:47:18.610141+0000 mon.a (mon.0) 417 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 20.04
rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
"2024-06-21T07:20:00.000162+0000 mon.a (mon.0) 1959 : cluster [WRN] Health detail: HEALTH_WARN noscrub,nodeep-scrub flag(s) set" in cluster log
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
centos 9.stream
rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/failover}
wip-yuri10-testing-2024-06-19-1225
wip-yuri10-testing-2024-06-19-1225
main
smithi
ubuntu 22.04
rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps}