Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7234110 2023-04-06 15:24:40 2023-04-07 20:09:37 2023-04-07 20:43:10 0:33:33 0:22:58 0:10:35 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
Failure Reason:

"1680899749.7570362 mon.a (mon.0) 507 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7234111 2023-04-06 15:24:41 2023-04-07 20:09:37 2023-04-07 20:49:41 0:40:04 0:28:51 0:11:13 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7234112 2023-04-06 15:24:42 2023-04-07 20:09:37 2023-04-07 20:47:51 0:38:14 0:28:14 0:10:00 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7234113 2023-04-06 15:24:43 2023-04-07 20:09:38 2023-04-07 21:48:52 1:39:14 1:10:12 0:29:02 smithi main centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7234114 2023-04-06 15:24:44 2023-04-07 20:09:38 2023-04-07 20:29:43 0:20:05 0:08:49 0:11:16 smithi main ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} 1
fail 7234115 2023-04-06 15:24:45 2023-04-07 20:09:38 2023-04-07 21:12:26 1:02:48 0:32:38 0:30:10 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

fail 7234116 2023-04-06 15:24:46 2023-04-07 20:11:09 2023-04-07 20:28:05 0:16:56 0:06:13 0:10:43 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi170 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7234117 2023-04-06 15:24:48 2023-04-07 20:12:09 2023-04-07 20:34:33 0:22:24 0:11:58 0:10:26 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 7234118 2023-04-06 15:24:49 2023-04-07 20:12:10 2023-04-07 20:42:11 0:30:01 0:22:57 0:07:04 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 7234119 2023-04-06 15:24:50 2023-04-07 20:12:50 2023-04-07 22:20:11 2:07:21 1:37:31 0:29:50 smithi main centos 8.stream rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
fail 7234120 2023-04-06 15:24:51 2023-04-07 20:13:21 2023-04-07 20:41:14 0:27:53 0:19:06 0:08:47 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234121 2023-04-06 15:24:52 2023-04-07 20:15:42 2023-04-07 20:47:15 0:31:33 0:22:41 0:08:52 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
fail 7234122 2023-04-06 15:24:53 2023-04-07 20:15:42 2023-04-07 22:07:49 1:52:07 1:21:00 0:31:07 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234123 2023-04-06 15:24:54 2023-04-07 20:16:43 2023-04-07 20:36:26 0:19:43 0:09:19 0:10:24 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} 1
pass 7234124 2023-04-06 15:24:55 2023-04-07 20:16:43 2023-04-07 22:06:39 1:49:56 1:14:08 0:35:48 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7234125 2023-04-06 15:24:56 2023-04-07 20:19:54 2023-04-07 20:57:33 0:37:39 0:27:38 0:10:01 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 7234126 2023-04-06 15:24:58 2023-04-07 20:20:04 2023-04-07 20:56:34 0:36:30 0:24:39 0:11:51 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
fail 7234127 2023-04-06 15:24:59 2023-04-07 20:22:45 2023-04-07 20:49:14 0:26:29 0:19:16 0:07:13 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234128 2023-04-06 15:25:00 2023-04-07 20:23:35 2023-04-07 22:05:38 1:42:03 1:12:11 0:29:52 smithi main centos 8.stream rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 7234129 2023-04-06 15:25:01 2023-04-07 20:24:36 2023-04-07 20:44:45 0:20:09 0:10:42 0:09:27 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

pass 7234130 2023-04-06 15:25:02 2023-04-07 20:25:06 2023-04-07 23:52:51 3:27:45 3:18:39 0:09:06 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 7234131 2023-04-06 15:25:03 2023-04-07 20:25:07 2023-04-07 20:51:53 0:26:46 0:19:32 0:07:14 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} 2
pass 7234132 2023-04-06 15:25:04 2023-04-07 20:26:47 2023-04-07 20:50:42 0:23:55 0:15:56 0:07:59 smithi main rhel 8.6 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 7234133 2023-04-06 15:25:05 2023-04-07 20:27:28 2023-04-07 20:52:07 0:24:39 0:10:17 0:14:22 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/many workloads/rados_5925} 2
pass 7234134 2023-04-06 15:25:07 2023-04-07 20:28:18 2023-04-07 21:01:49 0:33:31 0:22:28 0:11:03 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7234135 2023-04-06 15:25:08 2023-04-07 20:29:49 2023-04-07 20:55:58 0:26:09 0:13:16 0:12:53 smithi main ubuntu 22.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7234136 2023-04-06 15:25:09 2023-04-07 20:32:19 2023-04-07 21:01:52 0:29:33 0:15:33 0:14:00 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/rados_python} 2
fail 7234137 2023-04-06 15:25:10 2023-04-07 20:34:40 2023-04-07 22:24:40 1:50:00 1:19:09 0:30:51 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234138 2023-04-06 15:25:11 2023-04-07 20:34:40 2023-04-07 22:18:40 1:44:00 1:11:54 0:32:06 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} 2
pass 7234139 2023-04-06 15:25:12 2023-04-07 20:37:41 2023-04-07 20:59:08 0:21:27 0:12:12 0:09:15 smithi main ubuntu 22.04 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7234140 2023-04-06 15:25:13 2023-04-07 20:37:42 2023-04-07 21:00:09 0:22:27 0:12:28 0:09:59 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7234141 2023-04-06 15:25:14 2023-04-07 20:38:42 2023-04-07 20:59:14 0:20:32 0:12:25 0:08:07 smithi main rhel 8.6 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 7234142 2023-04-06 15:25:15 2023-04-07 20:40:13 2023-04-07 21:01:45 0:21:32 0:12:32 0:09:00 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} 1
pass 7234143 2023-04-06 15:25:17 2023-04-07 20:40:13 2023-04-07 21:05:26 0:25:13 0:13:20 0:11:53 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} 2
fail 7234144 2023-04-06 15:25:18 2023-04-07 20:41:23 2023-04-07 21:11:32 0:30:09 0:22:12 0:07:57 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234145 2023-04-06 15:25:19 2023-04-07 20:42:14 2023-04-07 21:16:56 0:34:42 0:24:43 0:09:59 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7234146 2023-04-06 15:25:20 2023-04-07 20:43:14 2023-04-07 21:06:20 0:23:06 0:11:36 0:11:30 smithi main ubuntu 22.04 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7234147 2023-04-06 15:25:21 2023-04-07 20:44:55 2023-04-07 22:30:31 1:45:36 1:14:38 0:30:58 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 7234148 2023-04-06 15:25:22 2023-04-07 20:47:26 2023-04-07 21:24:14 0:36:48 0:25:51 0:10:57 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 7234149 2023-04-06 15:25:23 2023-04-07 20:47:57 2023-04-07 22:29:40 1:41:43 1:09:29 0:32:14 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} 3
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234150 2023-04-06 15:25:24 2023-04-07 21:08:33 2023-04-07 21:36:29 0:27:56 0:19:05 0:08:51 smithi main rhel 8.6 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 7234151 2023-04-06 15:25:25 2023-04-07 21:11:34 2023-04-07 21:37:33 0:25:59 0:19:14 0:06:45 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

fail 7234152 2023-04-06 15:25:26 2023-04-07 21:12:35 2023-04-07 22:37:47 1:25:12 1:13:12 0:12:00 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi073 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=13b01c260c039abb2058ebe35d51581ccd3358c6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7234153 2023-04-06 15:25:28 2023-04-07 21:13:25 2023-04-07 21:34:34 0:21:09 0:14:35 0:06:34 smithi main rhel 8.6 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7234154 2023-04-06 15:25:29 2023-04-07 21:13:26 2023-04-07 22:02:27 0:49:01 0:36:49 0:12:12 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} 2
fail 7234155 2023-04-06 15:25:30 2023-04-07 21:16:57 2023-04-07 23:22:44 2:05:47 1:27:26 0:38:21 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234156 2023-04-06 15:25:31 2023-04-07 21:22:32 2023-04-07 21:41:36 0:19:04 0:12:08 0:06:56 smithi main rhel 8.6 rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{rhel_8}} 1
pass 7234157 2023-04-06 15:25:32 2023-04-07 21:22:33 2023-04-07 21:53:42 0:31:09 0:24:55 0:06:14 smithi main rhel 8.6 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} 2
pass 7234158 2023-04-06 15:25:33 2023-04-07 21:22:33 2023-04-07 22:22:36 1:00:03 0:47:36 0:12:27 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/radosbench} 2
pass 7234159 2023-04-06 15:25:34 2023-04-07 21:24:24 2023-04-07 21:56:32 0:32:08 0:21:47 0:10:21 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
pass 7234160 2023-04-06 15:25:35 2023-04-07 21:24:54 2023-04-07 21:49:22 0:24:28 0:12:26 0:12:02 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7234161 2023-04-06 15:25:36 2023-04-07 21:27:55 2023-04-07 22:25:11 0:57:16 0:44:45 0:12:31 smithi main ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} 1
pass 7234162 2023-04-06 15:25:37 2023-04-07 21:27:55 2023-04-07 21:57:05 0:29:10 0:16:12 0:12:58 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7234163 2023-04-06 15:25:38 2023-04-07 21:33:46 2023-04-07 22:01:07 0:27:21 0:20:53 0:06:28 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234164 2023-04-06 15:25:40 2023-04-07 21:34:07 2023-04-07 22:00:56 0:26:49 0:15:01 0:11:48 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} 2
pass 7234165 2023-04-06 15:25:41 2023-04-07 21:35:17 2023-04-07 21:55:38 0:20:21 0:09:51 0:10:30 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_20.04} tasks/workunits} 2
pass 7234166 2023-04-06 15:25:42 2023-04-07 21:35:18 2023-04-07 23:25:57 1:50:39 1:20:33 0:30:06 smithi main centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7234167 2023-04-06 15:25:43 2023-04-07 21:36:39 2023-04-08 00:37:22 3:00:43 2:50:06 0:10:37 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 7234168 2023-04-06 15:25:44 2023-04-07 21:37:40 2023-04-07 22:23:17 0:45:37 0:35:32 0:10:05 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} 2
pass 7234169 2023-04-06 15:25:45 2023-04-07 21:37:50 2023-04-07 22:08:17 0:30:27 0:17:58 0:12:29 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 7234170 2023-04-06 15:25:46 2023-04-07 21:40:22 2023-04-07 22:19:23 0:39:01 0:23:42 0:15:19 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 7234171 2023-04-06 15:25:47 2023-04-07 21:45:53 2023-04-07 23:53:09 2:07:16 1:36:38 0:30:38 smithi main centos 8.stream rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 7234172 2023-04-06 15:25:48 2023-04-07 21:45:53 2023-04-07 22:28:53 0:43:00 0:25:33 0:17:27 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7234173 2023-04-06 15:25:49 2023-04-07 21:52:35 2023-04-07 22:12:56 0:20:21 0:14:38 0:05:43 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 7234174 2023-04-06 15:25:50 2023-04-07 21:52:35 2023-04-07 23:48:21 1:55:46 1:23:19 0:32:27 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7234175 2023-04-06 15:25:51 2023-04-07 21:53:45 2023-04-07 22:19:11 0:25:26 0:16:01 0:09:25 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} 2
pass 7234176 2023-04-06 15:25:52 2023-04-07 21:55:46 2023-04-07 22:15:51 0:20:05 0:12:19 0:07:46 smithi main rhel 8.6 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 7234177 2023-04-06 15:25:53 2023-04-07 21:56:37 2023-04-07 22:16:02 0:19:25 0:13:04 0:06:21 smithi main rhel 8.6 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 7234178 2023-04-06 15:25:54 2023-04-07 21:56:37 2023-04-07 22:41:26 0:44:49 0:32:24 0:12:25 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234179 2023-04-06 15:25:55 2023-04-07 21:57:07 2023-04-07 23:32:30 1:35:23 1:05:36 0:29:47 smithi main centos 8.stream rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 7234180 2023-04-06 15:25:57 2023-04-07 21:57:08 2023-04-07 23:42:16 1:45:08 1:14:49 0:30:19 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 7234181 2023-04-06 15:25:58 2023-04-07 21:57:08 2023-04-08 00:14:15 2:17:07 1:44:04 0:33:03 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
pass 7234182 2023-04-06 15:25:59 2023-04-07 22:00:59 2023-04-07 23:56:12 1:55:13 1:26:01 0:29:12 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7234183 2023-04-06 15:26:00 2023-04-07 22:01:09 2023-04-07 22:32:33 0:31:24 0:20:41 0:10:43 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 7234184 2023-04-06 15:26:01 2023-04-07 22:02:30 2023-04-07 22:27:07 0:24:37 0:12:22 0:12:15 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7234185 2023-04-06 15:26:02 2023-04-07 22:05:41 2023-04-07 22:48:38 0:42:57 0:37:14 0:05:43 smithi main rhel 8.6 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
fail 7234186 2023-04-06 15:26:03 2023-04-07 22:05:51 2023-04-07 22:58:26 0:52:35 0:37:46 0:14:49 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

pass 7234187 2023-04-06 15:26:04 2023-04-07 22:06:41 2023-04-07 22:28:19 0:21:38 0:11:33 0:10:05 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
fail 7234188 2023-04-06 15:26:05 2023-04-07 22:06:42 2023-04-07 22:51:45 0:45:03 0:34:34 0:10:29 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"1680907596.433268 osd.0 (osd.0) 18 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log

pass 7234189 2023-04-06 15:26:07 2023-04-07 22:06:42 2023-04-07 22:55:15 0:48:33 0:37:12 0:11:21 smithi main ubuntu 22.04 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1