Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7212105 2023-03-17 23:39:25 2023-03-18 23:49:03 2023-03-19 01:35:42 1:46:39 1:25:46 0:20:53 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7212106 2023-03-17 23:39:26 2023-03-18 23:55:21 2023-03-19 05:20:46 5:25:25 5:07:35 0:17:50 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs} 1
pass 7212107 2023-03-17 23:39:26 2023-03-18 23:58:25 2023-03-19 01:40:20 1:41:55 1:24:49 0:17:06 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7212108 2023-03-17 23:39:27 2023-03-18 23:58:41 2023-03-19 00:33:46 0:35:05 0:18:32 0:16:33 smithi main ubuntu 20.04 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212109 2023-03-17 23:39:28 2023-03-19 00:01:12 2023-03-19 01:39:37 1:38:25 1:22:48 0:15:37 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 7212110 2023-03-17 23:39:28 2023-03-19 00:01:20 2023-03-19 00:43:03 0:41:43 0:31:08 0:10:35 smithi main rhel 8.6 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212111 2023-03-17 23:39:29 2023-03-19 00:03:26 2023-03-19 04:42:33 4:39:07 4:26:16 0:12:51 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 7212112 2023-03-17 23:39:30 2023-03-19 00:03:37 2023-03-19 02:25:07 2:21:30 2:03:47 0:17:43 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
dead 7212113 2023-03-17 23:39:31 2023-03-19 00:07:26 2023-03-19 12:48:13 12:40:47 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
Failure Reason:

hit max job timeout

pass 7212114 2023-03-17 23:39:31 2023-03-19 00:07:36 2023-03-19 00:48:17 0:40:41 0:27:39 0:13:02 smithi main ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 7212115 2023-03-17 23:39:32 2023-03-19 00:07:45 2023-03-19 01:32:16 1:24:31 1:09:00 0:15:31 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212116 2023-03-17 23:39:33 2023-03-19 00:07:52 2023-03-19 02:01:46 1:53:54 1:20:11 0:33:43 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 7212117 2023-03-17 23:39:34 2023-03-19 00:26:38 2023-03-19 01:02:31 0:35:53 0:26:19 0:09:34 smithi main rhel 8.6 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 7212118 2023-03-17 23:39:34 2023-03-19 00:26:54 2023-03-19 01:05:06 0:38:12 0:23:47 0:14:25 smithi main centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212119 2023-03-17 23:39:35 2023-03-19 00:27:08 2023-03-19 04:06:09 3:39:01 3:26:48 0:12:13 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7212120 2023-03-17 23:39:36 2023-03-19 00:27:40 2023-03-19 01:14:40 0:47:00 0:33:51 0:13:09 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
fail 7212121 2023-03-17 23:39:36 2023-03-19 00:30:46 2023-03-19 05:57:40 5:26:54 5:11:33 0:15:21 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi193 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh'

pass 7212122 2023-03-17 23:39:37 2023-03-19 00:31:26 2023-03-19 02:38:56 2:07:30 1:55:58 0:11:32 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 7212123 2023-03-17 23:39:38 2023-03-19 00:32:39 2023-03-19 01:09:36 0:36:57 0:22:15 0:14:42 smithi main ubuntu 20.04 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212124 2023-03-17 23:39:39 2023-03-19 00:32:55 2023-03-19 01:04:53 0:31:58 0:16:36 0:15:22 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
fail 7212125 2023-03-17 23:39:39 2023-03-19 00:34:24 2023-03-19 13:59:29 13:25:05 12:27:11 0:57:54 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

hit max job timeout

pass 7212126 2023-03-17 23:39:40 2023-03-19 00:40:28 2023-03-19 01:30:46 0:50:18 0:30:00 0:20:18 smithi main centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 7212127 2023-03-17 23:39:41 2023-03-19 00:46:27 2023-03-19 01:24:13 0:37:46 0:25:16 0:12:30 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7212128 2023-03-17 23:39:42 2023-03-19 00:46:31 2023-03-19 02:12:16 1:25:45 1:11:40 0:14:05 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212129 2023-03-17 23:39:42 2023-03-19 00:47:35 2023-03-19 01:20:31 0:32:56 0:22:42 0:10:14 smithi main rhel 8.6 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7212130 2023-03-17 23:39:43 2023-03-19 00:47:49 2023-03-19 02:35:30 1:47:41 1:32:53 0:14:48 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 7212131 2023-03-17 23:39:44 2023-03-19 00:48:35 2023-03-19 02:18:03 1:29:28 1:14:13 0:15:15 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7212132 2023-03-17 23:39:45 2023-03-19 00:50:37 2023-03-19 01:20:24 0:29:47 0:16:48 0:12:59 smithi main centos 8.stream rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_8}} 1
pass 7212133 2023-03-17 23:39:45 2023-03-19 00:50:48 2023-03-19 01:52:41 1:01:53 0:44:59 0:16:54 smithi main centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} 2
pass 7212134 2023-03-17 23:39:46 2023-03-19 00:54:34 2023-03-19 02:37:19 1:42:45 1:28:30 0:14:15 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 7212135 2023-03-17 23:39:47 2023-03-19 00:54:43 2023-03-19 02:43:48 1:49:05 1:38:22 0:10:43 smithi main rhel 8.6 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 7212136 2023-03-17 23:39:47 2023-03-19 00:55:54 2023-03-19 02:28:26 1:32:32 1:18:40 0:13:52 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212137 2023-03-17 23:39:48 2023-03-19 00:56:09 2023-03-19 06:37:52 5:41:43 5:23:31 0:18:12 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7212138 2023-03-17 23:39:49 2023-03-19 01:05:14 2023-03-19 02:43:47 1:38:33 1:19:39 0:18:54 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} 2
pass 7212139 2023-03-17 23:39:50 2023-03-19 01:09:53 2023-03-19 02:39:47 1:29:54 1:06:13 0:23:41 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7212140 2023-03-17 23:39:50 2023-03-19 01:20:47 2023-03-19 02:14:21 0:53:34 0:40:19 0:13:15 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 7212141 2023-03-17 23:39:51 2023-03-19 01:24:35 2023-03-19 02:05:57 0:41:22 0:30:26 0:10:56 smithi main rhel 8.6 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212142 2023-03-17 23:39:52 2023-03-19 01:24:48 2023-03-19 06:13:32 4:48:44 4:28:35 0:20:09 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
pass 7212143 2023-03-17 23:39:52 2023-03-19 01:31:04 2023-03-19 04:26:25 2:55:21 2:38:46 0:16:35 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
pass 7212144 2023-03-17 23:39:53 2023-03-19 01:32:38 2023-03-19 02:24:10 0:51:32 0:36:03 0:15:29 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 7212145 2023-03-17 23:39:54 2023-03-19 01:32:56 2023-03-19 02:05:43 0:32:47 0:18:23 0:14:24 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
dead 7212146 2023-03-17 23:39:55 2023-03-19 01:33:09 2023-03-19 13:51:34 12:18:25 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

hit max job timeout

pass 7212147 2023-03-17 23:39:55 2023-03-19 01:40:44 2023-03-19 04:41:23 3:00:39 2:50:12 0:10:27 smithi main rhel 8.6 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 7212148 2023-03-17 23:39:56 2023-03-19 01:40:57 2023-03-19 03:34:56 1:53:59 1:16:27 0:37:32 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212149 2023-03-17 23:39:57 2023-03-19 02:01:59 2023-03-19 03:16:45 1:14:46 0:56:26 0:18:20 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 7212150 2023-03-17 23:39:57 2023-03-19 02:06:06 2023-03-19 03:47:10 1:41:04 1:18:05 0:22:59 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7212151 2023-03-17 23:39:58 2023-03-19 02:12:27 2023-03-19 02:43:17 0:30:50 0:14:42 0:16:08 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212152 2023-03-17 23:39:59 2023-03-19 02:14:41 2023-03-19 02:58:49 0:44:08 0:26:12 0:17:56 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7212153 2023-03-17 23:39:59 2023-03-19 02:18:12 2023-03-19 02:48:18 0:30:06 0:14:32 0:15:34 smithi main rhel 8.6 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
fail 7212154 2023-03-17 23:40:00 2023-03-19 02:24:31 2023-03-19 10:03:02 7:38:31 7:20:59 0:17:32 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
Failure Reason:

Timeout opening channel.

pass 7212155 2023-03-17 23:40:01 2023-03-19 02:25:30 2023-03-19 03:54:42 1:29:12 1:14:58 0:14:14 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 2
pass 7212156 2023-03-17 23:40:02 2023-03-19 02:28:47 2023-03-19 02:55:45 0:26:58 0:18:34 0:08:24 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 7212157 2023-03-17 23:40:02 2023-03-19 02:28:56 2023-03-19 03:12:06 0:43:10 0:28:41 0:14:29 smithi main rhel 8.6 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
pass 7212158 2023-03-17 23:40:03 2023-03-19 02:31:55 2023-03-19 03:33:27 1:01:32 0:52:46 0:08:46 smithi main rhel 8.6 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212159 2023-03-17 23:40:04 2023-03-19 02:32:09 2023-03-19 03:28:01 0:55:52 0:43:12 0:12:40 smithi main centos 8.stream rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 7212160 2023-03-17 23:40:04 2023-03-19 02:32:21 2023-03-19 05:58:33 3:26:12 3:09:57 0:16:15 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7212161 2023-03-17 23:40:05 2023-03-19 02:33:28 2023-03-19 03:04:02 0:30:34 0:17:09 0:13:25 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7212162 2023-03-17 23:40:06 2023-03-19 02:33:43 2023-03-19 03:47:53 1:14:10 0:57:35 0:16:35 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
pass 7212163 2023-03-17 23:40:07 2023-03-19 02:36:00 2023-03-19 04:22:57 1:46:57 1:36:13 0:10:44 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7212164 2023-03-17 23:40:07 2023-03-19 02:37:33 2023-03-19 13:13:26 10:35:53 10:17:25 0:18:28 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 7212165 2023-03-17 23:40:08 2023-03-19 02:40:06 2023-03-19 03:33:45 0:53:39 0:45:32 0:08:07 smithi main rhel 8.6 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 7212166 2023-03-17 23:40:09 2023-03-19 02:40:17 2023-03-19 03:19:19 0:39:02 0:27:07 0:11:55 smithi main centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212167 2023-03-17 23:40:09 2023-03-19 02:40:28 2023-03-19 04:23:53 1:43:25 1:28:48 0:14:37 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7212168 2023-03-17 23:40:10 2023-03-19 02:44:03 2023-03-19 04:01:58 1:17:55 1:03:23 0:14:32 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 7212169 2023-03-17 23:40:11 2023-03-19 02:44:13 2023-03-19 04:23:08 1:38:55 1:20:49 0:18:06 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212170 2023-03-17 23:40:12 2023-03-19 02:48:49 2023-03-19 03:37:07 0:48:18 0:27:43 0:20:35 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7212171 2023-03-17 23:40:12 2023-03-19 02:55:08 2023-03-19 05:01:37 2:06:29 1:49:33 0:16:56 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7212172 2023-03-17 23:40:13 2023-03-19 02:59:16 2023-03-19 04:56:08 1:56:52 1:40:34 0:16:18 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 7212173 2023-03-17 23:40:14 2023-03-19 03:04:28 2023-03-19 03:44:11 0:39:43 0:19:27 0:20:16 smithi main centos 8.stream rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
dead 7212174 2023-03-17 23:40:14 2023-03-19 03:12:31 2023-03-19 16:19:43 13:07:12 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
Failure Reason:

hit max job timeout

pass 7212175 2023-03-17 23:40:15 2023-03-19 03:12:44 2023-03-19 15:08:52 11:56:08 11:36:50 0:19:18 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 7212176 2023-03-17 23:40:16 2023-03-19 03:17:13 2023-03-19 07:00:52 3:43:39 3:28:49 0:14:50 smithi main centos 8.stream rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} 1
pass 7212177 2023-03-17 23:40:16 2023-03-19 03:19:54 2023-03-19 04:19:38 0:59:44 0:43:26 0:16:18 smithi main rhel 8.6 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
fail 7212178 2023-03-17 23:40:17 2023-03-19 03:27:00 2023-03-19 03:47:23 0:20:23 0:06:57 0:13:26 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi139 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7212179 2023-03-17 23:40:18 2023-03-19 03:27:16 2023-03-19 04:10:54 0:43:38 0:32:28 0:11:10 smithi main centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212180 2023-03-17 23:40:19 2023-03-19 03:27:28 2023-03-19 03:55:28 0:28:00 0:18:05 0:09:55 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} 1
dead 7212181 2023-03-17 23:40:19 2023-03-19 03:27:47 2023-03-19 16:41:08 13:13:21 smithi main centos 8.stream rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

hit max job timeout

pass 7212182 2023-03-17 23:40:20 2023-03-19 03:33:40 2023-03-19 04:17:32 0:43:52 0:32:04 0:11:48 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 7212183 2023-03-17 23:40:21 2023-03-19 03:33:53 2023-03-19 04:55:55 1:22:02 1:07:46 0:14:16 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
fail 7212184 2023-03-17 23:40:21 2023-03-19 03:34:07 2023-03-19 04:05:27 0:31:20 0:22:42 0:08:38 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: ['type=AVC msg=audit(1679198508.680:19826): avc: denied { ioctl } for pid=109514 comm="iptables" path="/var/lib/containers/storage/overlay/39edf9328336b455ef9006c03b64ed46d41c81c9ee2181709eb11f5158b4a32f/merged" dev="overlay" ino=3278938 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7212185 2023-03-17 23:40:22 2023-03-19 03:34:20 2023-03-19 04:55:57 1:21:37 1:03:59 0:17:38 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212186 2023-03-17 23:40:23 2023-03-19 03:35:21 2023-03-19 04:23:03 0:47:42 0:33:40 0:14:02 smithi main centos 8.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 7212187 2023-03-17 23:40:24 2023-03-19 03:37:23 2023-03-19 05:30:47 1:53:24 1:35:25 0:17:59 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7212188 2023-03-17 23:40:24 2023-03-19 03:41:06 2023-03-19 06:29:07 2:48:01 2:34:07 0:13:54 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7212189 2023-03-17 23:40:25 2023-03-19 03:41:20 2023-03-19 04:16:07 0:34:47 0:22:15 0:12:32 smithi main rhel 8.6 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212190 2023-03-17 23:40:26 2023-03-19 03:44:34 2023-03-19 04:16:14 0:31:40 0:15:33 0:16:07 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 7212191 2023-03-17 23:40:26 2023-03-19 03:47:25 2023-03-19 05:49:49 2:02:24 1:46:19 0:16:05 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} 2
pass 7212192 2023-03-17 23:40:27 2023-03-19 03:47:50 2023-03-19 04:51:26 1:03:36 0:47:28 0:16:08 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 7212193 2023-03-17 23:40:28 2023-03-19 03:48:18 2023-03-19 04:35:02 0:46:44 0:26:48 0:19:56 smithi main ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212194 2023-03-17 23:40:29 2023-03-19 03:55:09 2023-03-19 04:27:41 0:32:32 0:17:48 0:14:44 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7212195 2023-03-17 23:40:29 2023-03-19 03:55:23 2023-03-19 04:46:23 0:51:00 0:24:36 0:26:24 smithi main centos 8.stream rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 7212196 2023-03-17 23:40:30 2023-03-19 04:06:00 2023-03-19 04:59:56 0:53:56 0:38:13 0:15:43 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} 2
pass 7212197 2023-03-17 23:40:31 2023-03-19 04:06:37 2023-03-19 06:16:03 2:09:26 1:50:05 0:19:21 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7212198 2023-03-17 23:40:31 2023-03-19 04:16:26 2023-03-19 05:06:15 0:49:49 0:37:24 0:12:25 smithi main centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212199 2023-03-17 23:40:32 2023-03-19 04:16:41 2023-03-19 05:00:36 0:43:55 0:25:20 0:18:35 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7212200 2023-03-17 23:40:33 2023-03-19 04:19:59 2023-03-19 04:54:32 0:34:33 0:22:22 0:12:11 smithi main ubuntu 20.04 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212201 2023-03-17 23:40:34 2023-03-19 04:20:32 2023-03-19 06:14:44 1:54:12 1:39:58 0:14:14 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 7212202 2023-03-17 23:40:34 2023-03-19 04:20:41 2023-03-19 04:56:30 0:35:49 0:21:39 0:14:10 smithi main centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7212203 2023-03-17 23:40:35 2023-03-19 04:23:05 2023-03-19 05:56:05 1:33:00 1:17:31 0:15:29 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7212204 2023-03-17 23:40:36 2023-03-19 04:23:17 2023-03-19 04:44:02 0:20:45 0:07:46 0:12:59 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7212205 2023-03-17 23:40:36 2023-03-19 04:23:26 2023-03-19 05:54:54 1:31:28 1:15:26 0:16:02 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212206 2023-03-17 23:40:37 2023-03-19 04:24:08 2023-03-19 05:07:43 0:43:35 0:30:21 0:13:14 smithi main centos 8.stream rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 7212207 2023-03-17 23:40:38 2023-03-19 04:24:18 2023-03-19 05:41:45 1:17:27 0:56:47 0:20:40 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7212208 2023-03-17 23:40:39 2023-03-19 04:28:05 2023-03-19 05:03:10 0:35:05 0:14:46 0:20:19 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
dead 7212209 2023-03-17 23:40:39 2023-03-19 04:35:22 2023-03-19 17:15:55 12:40:33 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/failover} 2
Failure Reason:

hit max job timeout

pass 7212210 2023-03-17 23:40:40 2023-03-19 04:37:32 2023-03-19 05:03:44 0:26:12 0:09:13 0:16:59 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212211 2023-03-17 23:40:41 2023-03-19 04:41:39 2023-03-19 05:21:57 0:40:18 0:29:44 0:10:34 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
pass 7212212 2023-03-17 23:40:42 2023-03-19 04:41:53 2023-03-19 06:52:58 2:11:05 1:58:58 0:12:07 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
dead 7212213 2023-03-17 23:40:42 2023-03-19 04:42:49 2023-03-19 17:10:31 12:27:42 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

hit max job timeout

pass 7212214 2023-03-17 23:40:43 2023-03-19 04:46:45 2023-03-19 06:39:43 1:52:58 1:34:18 0:18:40 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
pass 7212215 2023-03-17 23:40:44 2023-03-19 04:51:51 2023-03-19 08:06:33 3:14:42 2:58:33 0:16:09 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7212216 2023-03-17 23:40:44 2023-03-19 04:54:52 2023-03-19 05:35:53 0:41:01 0:30:07 0:10:54 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
pass 7212217 2023-03-17 23:40:45 2023-03-19 04:56:08 2023-03-19 06:21:10 1:25:02 1:09:14 0:15:48 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212218 2023-03-17 23:40:46 2023-03-19 04:56:27 2023-03-19 05:32:33 0:36:06 0:26:52 0:09:14 smithi main rhel 8.6 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 7212219 2023-03-17 23:40:47 2023-03-19 04:56:39 2023-03-19 05:34:05 0:37:26 0:25:50 0:11:36 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 7212220 2023-03-17 23:40:47 2023-03-19 04:56:53 2023-03-19 05:27:26 0:30:33 0:17:32 0:13:01 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212221 2023-03-17 23:40:48 2023-03-19 04:57:05 2023-03-19 06:51:25 1:54:20 1:36:07 0:18:13 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 7212222 2023-03-17 23:40:49 2023-03-19 05:00:18 2023-03-19 05:28:08 0:27:50 0:14:40 0:13:10 smithi main centos 8.stream rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} 1
pass 7212223 2023-03-17 23:40:49 2023-03-19 05:00:53 2023-03-19 05:34:44 0:33:51 0:19:16 0:14:35 smithi main ubuntu 20.04 rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212224 2023-03-17 23:40:50 2023-03-19 05:01:08 2023-03-19 10:15:55 5:14:47 4:59:37 0:15:10 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} 2
pass 7212225 2023-03-17 23:40:51 2023-03-19 05:01:55 2023-03-19 05:40:29 0:38:34 0:28:36 0:09:58 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7212226 2023-03-17 23:40:51 2023-03-19 05:03:30 2023-03-19 06:32:14 1:28:44 1:12:22 0:16:22 smithi main rhel 8.6 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 7212227 2023-03-17 23:40:52 2023-03-19 05:08:04 2023-03-19 05:51:10 0:43:06 0:20:35 0:22:31 smithi main rhel 8.6 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212228 2023-03-17 23:40:53 2023-03-19 05:21:05 2023-03-19 07:49:53 2:28:48 2:11:47 0:17:01 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 7212229 2023-03-17 23:40:54 2023-03-19 05:27:47 2023-03-19 05:56:43 0:28:56 0:15:30 0:13:26 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 7212230 2023-03-17 23:40:54 2023-03-19 05:28:25 2023-03-19 06:40:51 1:12:26 0:56:30 0:15:56 smithi main centos 8.stream rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 7212231 2023-03-17 23:40:55 2023-03-19 05:31:11 2023-03-19 08:22:27 2:51:16 2:39:45 0:11:31 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7212232 2023-03-17 23:40:56 2023-03-19 05:32:55 2023-03-19 06:43:52 1:10:57 0:57:28 0:13:29 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 7212233 2023-03-17 23:40:56 2023-03-19 05:35:04 2023-03-19 06:04:48 0:29:44 0:15:09 0:14:35 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212234 2023-03-17 23:40:57 2023-03-19 05:36:19 2023-03-19 07:04:18 1:27:59 1:14:37 0:13:22 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 7212235 2023-03-17 23:40:58 2023-03-19 05:40:37 2023-03-19 07:37:40 1:57:03 1:45:44 0:11:19 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 7212236 2023-03-17 23:40:58 2023-03-19 05:41:59 2023-03-19 06:43:23 1:01:24 0:48:37 0:12:47 smithi main centos 8.stream rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 7212237 2023-03-17 23:40:59 2023-03-19 05:42:16 2023-03-19 07:18:32 1:36:16 1:26:08 0:10:08 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 7212238 2023-03-17 23:41:00 2023-03-19 05:42:33 2023-03-19 10:42:30 4:59:57 4:47:27 0:12:30 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
pass 7212239 2023-03-17 23:41:01 2023-03-19 05:42:46 2023-03-19 07:20:22 1:37:36 1:22:47 0:14:49 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212240 2023-03-17 23:41:01 2023-03-19 05:44:39 2023-03-19 07:30:05 1:45:26 1:21:55 0:23:31 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 7212241 2023-03-17 23:41:02 2023-03-19 05:50:47 2023-03-19 20:42:38 14:51:51 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/insights} 2
Failure Reason:

hit max job timeout

pass 7212242 2023-03-17 23:41:03 2023-03-19 05:55:17 2023-03-19 07:03:15 1:07:58 0:54:59 0:12:59 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 7212243 2023-03-17 23:41:03 2023-03-19 05:55:31 2023-03-19 06:39:27 0:43:56 0:33:33 0:10:23 smithi main rhel 8.6 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 7212244 2023-03-17 23:41:04 2023-03-19 05:56:16 2023-03-19 06:34:34 0:38:18 0:27:46 0:10:32 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7212245 2023-03-17 23:41:05 2023-03-19 05:57:07 2023-03-19 06:33:32 0:36:25 0:23:55 0:12:30 smithi main centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212246 2023-03-17 23:41:05 2023-03-19 05:58:04 2023-03-19 07:51:52 1:53:48 1:45:36 0:08:12 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} 1
pass 7212247 2023-03-17 23:41:06 2023-03-19 05:58:15 2023-03-19 07:36:52 1:38:37 1:24:07 0:14:30 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 7212248 2023-03-17 23:41:07 2023-03-19 05:59:02 2023-03-19 07:45:44 1:46:42 1:27:24 0:19:18 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 7212249 2023-03-17 23:41:07 2023-03-19 06:03:48 2023-03-19 07:17:36 1:13:48 0:52:51 0:20:57 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212250 2023-03-17 23:41:08 2023-03-19 06:08:23 2023-03-19 06:44:01 0:35:38 0:15:09 0:20:29 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 7212251 2023-03-17 23:41:09 2023-03-19 06:13:51 2023-03-19 08:33:24 2:19:33 2:08:12 0:11:21 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7212252 2023-03-17 23:41:10 2023-03-19 06:15:01 2023-03-19 06:49:38 0:34:37 0:24:14 0:10:23 smithi main rhel 8.6 rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7212253 2023-03-17 23:41:10 2023-03-19 06:16:19 2023-03-19 07:14:27 0:58:08 0:41:13 0:16:55 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} 2
fail 7212254 2023-03-17 23:41:11 2023-03-19 06:18:52 2023-03-19 06:47:14 0:28:22 0:08:34 0:19:48 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi044 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7212255 2023-03-17 23:41:12 2023-03-19 06:21:32 2023-03-19 06:57:21 0:35:49 0:19:32 0:16:17 smithi main centos 8.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
dead 7212256 2023-03-17 23:41:12 2023-03-19 06:21:42 2023-03-19 21:14:25 14:52:43 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
Failure Reason:

hit max job timeout

pass 7212257 2023-03-17 23:41:13 2023-03-19 06:29:24 2023-03-19 08:04:09 1:34:45 1:16:12 0:18:33 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 7212258 2023-03-17 23:41:14 2023-03-19 06:32:41 2023-03-19 07:41:37 1:08:56 0:57:35 0:11:21 smithi main rhel 8.6 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} 2
pass 7212259 2023-03-17 23:41:15 2023-03-19 06:33:00 2023-03-19 07:47:39 1:14:39 1:05:57 0:08:42 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7212260 2023-03-17 23:41:15 2023-03-19 06:33:49 2023-03-19 07:11:35 0:37:46 0:21:23 0:16:23 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
pass 7212261 2023-03-17 23:41:16 2023-03-19 06:38:20 2023-03-19 07:25:31 0:47:11 0:32:36 0:14:35 smithi main centos 8.stream rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 2
pass 7212262 2023-03-17 23:41:17 2023-03-19 06:39:43 2023-03-19 07:10:07 0:30:24 0:20:34 0:09:50 smithi main rhel 8.6 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 7212263 2023-03-17 23:41:17 2023-03-19 06:40:08 2023-03-19 07:20:36 0:40:28 0:27:12 0:13:16 smithi main centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7212264 2023-03-17 23:41:18 2023-03-19 06:41:17 2023-03-19 08:22:55 1:41:38 1:27:47 0:13:51 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7212265 2023-03-17 23:41:19 2023-03-19 06:44:15 2023-03-19 07:12:45 0:28:30 0:19:25 0:09:05 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 7212266 2023-03-17 23:41:19 2023-03-19 06:44:28 2023-03-19 08:23:28 1:39:00 1:30:39 0:08:21 smithi main rhel 8.6 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} 1
pass 7212267 2023-03-17 23:41:20 2023-03-19 06:44:37 2023-03-19 07:21:41 0:37:04 0:21:42 0:15:22 smithi main ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212268 2023-03-17 23:41:21 2023-03-19 06:47:38 2023-03-19 07:21:17 0:33:39 0:25:21 0:08:18 smithi main rhel 8.6 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212269 2023-03-17 23:41:22 2023-03-19 06:47:49 2023-03-19 09:34:19 2:46:30 2:29:21 0:17:09 smithi main centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 7212270 2023-03-17 23:41:22 2023-03-19 06:50:01 2023-03-19 07:27:57 0:37:56 0:24:53 0:13:03 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7212271 2023-03-17 23:41:23 2023-03-19 06:51:50 2023-03-19 07:22:15 0:30:25 0:15:02 0:15:23 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 7212272 2023-03-17 23:41:24 2023-03-19 06:53:21 2023-03-19 08:15:42 1:22:21 1:02:35 0:19:46 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212273 2023-03-17 23:41:24 2023-03-19 06:57:42 2023-03-19 08:29:28 1:31:46 1:15:47 0:15:59 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 7212274 2023-03-17 23:41:25 2023-03-19 07:03:35 2023-03-19 07:35:48 0:32:13 0:19:37 0:12:36 smithi main centos 8.stream rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
dead 7212275 2023-03-17 23:41:26 2023-03-19 07:04:36 2023-03-19 21:41:19 14:36:43 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/module_selftest} 2
Failure Reason:

hit max job timeout

pass 7212276 2023-03-17 23:41:26 2023-03-19 07:10:30 2023-03-19 08:09:18 0:58:48 0:41:23 0:17:25 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
dead 7212277 2023-03-17 23:41:27 2023-03-19 07:11:56 2023-03-19 19:59:44 12:47:48 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

hit max job timeout

pass 7212278 2023-03-17 23:41:28 2023-03-19 07:13:12 2023-03-19 08:31:36 1:18:24 1:09:06 0:09:18 smithi main rhel 8.6 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212279 2023-03-17 23:41:29 2023-03-19 07:14:45 2023-03-19 07:45:19 0:30:34 0:16:52 0:13:42 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
pass 7212280 2023-03-17 23:41:29 2023-03-19 07:14:59 2023-03-19 08:01:20 0:46:21 0:31:45 0:14:36 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 7212281 2023-03-17 23:41:30 2023-03-19 07:17:54 2023-03-19 08:22:00 1:04:06 0:50:25 0:13:41 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 7212282 2023-03-17 23:41:31 2023-03-19 07:18:05 2023-03-19 08:48:45 1:30:40 1:18:57 0:11:43 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7212283 2023-03-17 23:41:31 2023-03-19 07:18:50 2023-03-19 08:35:24 1:16:34 1:01:29 0:15:05 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212284 2023-03-17 23:41:32 2023-03-19 07:20:58 2023-03-19 09:01:42 1:40:44 1:25:34 0:15:10 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 7212285 2023-03-17 23:41:33 2023-03-19 07:21:55 2023-03-19 08:07:50 0:45:55 0:36:01 0:09:54 smithi main rhel 8.6 rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 7212286 2023-03-17 23:41:33 2023-03-19 07:22:31 2023-03-19 08:39:28 1:16:57 0:58:38 0:18:19 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} 2
pass 7212287 2023-03-17 23:41:34 2023-03-19 07:23:09 2023-03-19 10:56:02 3:32:53 3:17:45 0:15:08 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7212288 2023-03-17 23:41:35 2023-03-19 07:23:17 2023-03-19 08:13:37 0:50:20 0:37:36 0:12:44 smithi main rhel 8.6 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} 2
pass 7212289 2023-03-17 23:41:36 2023-03-19 07:25:56 2023-03-19 19:35:06 12:09:10 11:53:50 0:15:20 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 7212290 2023-03-17 23:41:36 2023-03-19 07:28:24 2023-03-19 08:26:56 0:58:32 0:42:55 0:15:37 smithi main centos 8.stream rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 7212291 2023-03-17 23:41:37 2023-03-19 07:30:41 2023-03-19 09:42:49 2:12:08 2:00:48 0:11:20 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7212292 2023-03-17 23:41:38 2023-03-19 07:30:59 2023-03-19 07:59:55 0:28:56 0:11:50 0:17:06 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} 1
pass 7212293 2023-03-17 23:41:38 2023-03-19 07:36:10 2023-03-19 08:19:50 0:43:40 0:29:12 0:14:28 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 7212294 2023-03-17 23:41:39 2023-03-19 07:37:20 2023-03-19 08:06:27 0:29:07 0:14:23 0:14:44 smithi main ubuntu 20.04 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 7212295 2023-03-17 23:41:40 2023-03-19 07:37:55 2023-03-19 08:16:23 0:38:28 0:24:33 0:13:55 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212296 2023-03-17 23:41:40 2023-03-19 07:38:02 2023-03-19 08:25:46 0:47:44 0:26:55 0:20:49 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7212297 2023-03-17 23:41:41 2023-03-19 07:41:55 2023-03-19 08:22:55 0:41:00 0:29:15 0:11:45 smithi main rhel 8.6 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 7212298 2023-03-17 23:41:42 2023-03-19 07:45:39 2023-03-19 18:10:45 10:25:06 10:08:36 0:16:30 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 7212299 2023-03-17 23:41:42 2023-03-19 07:47:58 2023-03-19 08:32:54 0:44:56 0:32:17 0:12:39 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7212300 2023-03-17 23:41:43 2023-03-19 07:50:22 2023-03-19 11:40:17 3:49:55 3:27:07 0:22:48 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7212301 2023-03-17 23:41:44 2023-03-19 08:01:49 2023-03-19 08:32:13 0:30:24 0:18:40 0:11:44 smithi main rhel 8.6 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212302 2023-03-17 23:41:45 2023-03-19 08:04:41 2023-03-19 09:52:54 1:48:13 1:35:00 0:13:13 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 7212303 2023-03-17 23:41:45 2023-03-19 08:06:45 2023-03-19 09:51:12 1:44:27 1:33:59 0:10:28 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212304 2023-03-17 23:41:46 2023-03-19 08:07:03 2023-03-19 09:41:04 1:34:01 1:20:39 0:13:22 smithi main centos 8.stream rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 7212305 2023-03-17 23:41:47 2023-03-19 08:07:20 2023-03-19 09:43:52 1:36:32 1:23:35 0:12:57 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 2
pass 7212306 2023-03-17 23:41:47 2023-03-19 08:09:38 2023-03-19 16:06:19 7:56:41 7:43:05 0:13:36 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/progress} 2
pass 7212307 2023-03-17 23:41:48 2023-03-19 08:09:53 2023-03-19 09:02:28 0:52:35 0:35:35 0:17:00 smithi main ubuntu 20.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 7212308 2023-03-17 23:41:49 2023-03-19 08:13:58 2023-03-19 12:00:11 3:46:13 3:30:58 0:15:15 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 7212309 2023-03-17 23:41:50 2023-03-19 08:15:56 2023-03-19 10:20:29 2:04:33 1:47:06 0:17:27 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7212310 2023-03-17 23:41:50 2023-03-19 08:20:12 2023-03-19 08:58:00 0:37:48 0:22:31 0:15:17 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} 1
pass 7212311 2023-03-17 23:41:51 2023-03-19 08:22:29 2023-03-19 09:26:08 1:03:39 0:54:46 0:08:53 smithi main rhel 8.6 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212312 2023-03-17 23:41:52 2023-03-19 08:22:42 2023-03-19 10:18:08 1:55:26 1:43:23 0:12:03 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 7212313 2023-03-17 23:41:52 2023-03-19 08:22:52 2023-03-19 10:55:47 2:32:55 2:16:40 0:16:15 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 7212314 2023-03-17 23:41:53 2023-03-19 08:23:12 2023-03-19 09:06:10 0:42:58 0:29:23 0:13:35 smithi main ubuntu 20.04 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
pass 7212315 2023-03-17 23:41:54 2023-03-19 08:23:22 2023-03-19 09:58:17 1:34:55 1:18:51 0:16:04 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212316 2023-03-17 23:41:54 2023-03-19 08:27:07 2023-03-19 08:59:24 0:32:17 0:19:31 0:12:46 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7212317 2023-03-17 23:41:55 2023-03-19 08:27:16 2023-03-19 09:15:42 0:48:26 0:31:48 0:16:38 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7212318 2023-03-17 23:41:56 2023-03-19 08:29:47 2023-03-19 10:36:13 2:06:26 1:53:39 0:12:47 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 7212319 2023-03-17 23:41:57 2023-03-19 08:32:31 2023-03-19 09:52:06 1:19:35 1:06:40 0:12:55 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 7212320 2023-03-17 23:41:57 2023-03-19 08:32:37 2023-03-19 09:10:35 0:37:58 0:21:31 0:16:27 smithi main ubuntu 20.04 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212321 2023-03-17 23:41:58 2023-03-19 08:33:12 2023-03-19 09:13:55 0:40:43 0:27:26 0:13:17 smithi main centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7212322 2023-03-17 23:41:59 2023-03-19 08:33:22 2023-03-19 10:42:01 2:08:39 1:52:41 0:15:58 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7212323 2023-03-17 23:41:59 2023-03-19 08:33:49 2023-03-19 11:32:21 2:58:32 2:44:05 0:14:27 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7212324 2023-03-17 23:42:00 2023-03-19 08:34:03 2023-03-19 13:59:16 5:25:13 5:09:41 0:15:32 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi089 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh'

pass 7212325 2023-03-17 23:42:01 2023-03-19 08:35:10 2023-03-19 10:25:43 1:50:33 1:38:33 0:12:00 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7212326 2023-03-17 23:42:01 2023-03-19 08:35:40 2023-03-19 09:08:50 0:33:10 0:24:55 0:08:15 smithi main rhel 8.6 rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 7212327 2023-03-17 23:42:02 2023-03-19 08:35:54 2023-03-19 09:40:36 1:04:42 0:41:14 0:23:28 smithi main ubuntu 20.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 7212328 2023-03-17 23:42:03 2023-03-19 08:39:41 2023-03-19 10:27:44 1:48:03 1:22:38 0:25:25 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
dead 7212329 2023-03-17 23:42:04 2023-03-19 08:50:50 2023-03-19 23:48:02 14:57:12 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} 2
Failure Reason:

hit max job timeout

fail 7212330 2023-03-17 23:42:04 2023-03-19 08:53:38 2023-03-19 09:16:29 0:22:51 0:07:16 0:15:35 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

Command failed on smithi110 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7212331 2023-03-17 23:42:05 2023-03-19 08:54:04 2023-03-19 09:42:30 0:48:26 0:37:54 0:10:32 smithi main rhel 8.6 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 7212332 2023-03-17 23:42:06 2023-03-19 08:54:23 2023-03-19 20:57:45 12:03:22 11:43:46 0:19:36 smithi main centos 8.stream rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

failed to complete snap trimming before timeout

pass 7212333 2023-03-17 23:42:06 2023-03-19 08:58:26 2023-03-19 09:25:42 0:27:16 0:11:40 0:15:36 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7212334 2023-03-17 23:42:07 2023-03-19 08:59:48 2023-03-19 10:59:25 1:59:37 1:40:50 0:18:47 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 7212335 2023-03-17 23:42:08 2023-03-19 09:02:17 2023-03-19 09:35:43 0:33:26 0:18:17 0:15:09 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 7212336 2023-03-17 23:42:09 2023-03-19 09:03:06 2023-03-19 09:42:10 0:39:04 0:24:33 0:14:31 smithi main rhel 8.6 rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

pass 7212337 2023-03-17 23:42:09 2023-03-19 09:06:44 2023-03-19 09:39:21 0:32:37 0:22:17 0:10:20 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 7212338 2023-03-17 23:42:10 2023-03-19 09:07:02 2023-03-19 09:42:51 0:35:49 0:24:23 0:11:26 smithi main rhel 8.6 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212339 2023-03-17 23:42:11 2023-03-19 09:09:15 2023-03-19 10:51:00 1:41:45 1:24:15 0:17:30 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7212340 2023-03-17 23:42:11 2023-03-19 09:14:11 2023-03-19 10:40:40 1:26:29 1:13:37 0:12:52 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212341 2023-03-17 23:42:12 2023-03-19 09:16:20 2023-03-19 21:05:54 11:49:34 11:24:09 0:25:25 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
dead 7212342 2023-03-17 23:42:13 2023-03-19 09:26:15 2023-03-19 22:08:02 12:41:47 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

hit max job timeout

pass 7212343 2023-03-17 23:42:14 2023-03-19 09:34:41 2023-03-19 10:56:10 1:21:29 0:59:55 0:21:34 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7212344 2023-03-17 23:42:14 2023-03-19 09:39:43 2023-03-19 11:09:36 1:29:53 1:10:42 0:19:11 smithi main ubuntu 20.04 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 2
pass 7212345 2023-03-17 23:42:15 2023-03-19 09:41:08 2023-03-19 10:21:16 0:40:08 0:26:43 0:13:25 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7212346 2023-03-17 23:42:16 2023-03-19 09:41:21 2023-03-19 11:33:39 1:52:18 1:39:25 0:12:53 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 7212347 2023-03-17 23:42:16 2023-03-19 09:42:57 2023-03-19 10:55:23 1:12:26 0:50:49 0:21:37 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212348 2023-03-17 23:42:17 2023-03-19 09:44:06 2023-03-19 10:30:40 0:46:34 0:32:29 0:14:05 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
fail 7212349 2023-03-17 23:42:18 2023-03-19 09:44:19 2023-03-19 11:17:21 1:33:02 1:12:30 0:20:32 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
Failure Reason:

Command failed (workunit test mon/mon-last-epoch-clean.sh) on smithi196 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh'

pass 7212350 2023-03-17 23:42:19 2023-03-19 09:51:47 2023-03-19 12:32:21 2:40:34 2:25:58 0:14:36 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
pass 7212351 2023-03-17 23:42:19 2023-03-19 09:52:30 2023-03-19 11:57:06 2:04:36 1:54:07 0:10:29 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7212352 2023-03-17 23:42:20 2023-03-19 09:53:15 2023-03-19 11:19:17 1:26:02 1:06:20 0:19:42 smithi main centos 8.stream rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 7212353 2023-03-17 23:42:21 2023-03-19 09:58:52 2023-03-19 12:40:48 2:41:56 2:17:20 0:24:36 smithi main centos 8.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} 1
pass 7212354 2023-03-17 23:42:22 2023-03-19 09:59:14 2023-03-19 11:24:31 1:25:17 1:05:00 0:20:17 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 7212355 2023-03-17 23:42:22 2023-03-19 10:03:28 2023-03-19 11:39:22 1:35:54 1:18:34 0:17:20 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite} 2
pass 7212356 2023-03-17 23:42:23 2023-03-19 10:04:37 2023-03-19 10:35:45 0:31:08 0:21:21 0:09:47 smithi main rhel 8.6 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212357 2023-03-17 23:42:24 2023-03-19 10:04:49 2023-03-19 10:35:29 0:30:40 0:16:40 0:14:00 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
fail 7212358 2023-03-17 23:42:24 2023-03-19 10:05:00 2023-03-19 10:35:18 0:30:18 0:07:59 0:22:19 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
Failure Reason:

Command failed on smithi176 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

fail 7212359 2023-03-17 23:42:25 2023-03-19 10:16:07 2023-03-19 17:13:40 6:57:33 6:40:52 0:16:41 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} 2
Failure Reason:

Command failed (workunit test mon/caps.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

pass 7212360 2023-03-17 23:42:26 2023-03-19 10:18:27 2023-03-19 11:32:25 1:13:58 0:57:38 0:16:20 smithi main centos 8.stream rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 2
pass 7212361 2023-03-17 23:42:27 2023-03-19 10:20:45 2023-03-19 12:00:15 1:39:30 1:24:37 0:14:53 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 7212362 2023-03-17 23:42:27 2023-03-19 10:21:33 2023-03-19 11:10:01 0:48:28 0:28:23 0:20:05 smithi main centos 8.stream rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 7212363 2023-03-17 23:42:28 2023-03-19 10:25:39 2023-03-19 15:07:06 4:41:27 4:33:30 0:07:57 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} 1
pass 7212364 2023-03-17 23:42:29 2023-03-19 10:25:55 2023-03-19 10:48:33 0:22:38 0:10:04 0:12:34 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212365 2023-03-17 23:42:30 2023-03-19 10:26:04 2023-03-19 12:20:08 1:54:04 1:41:29 0:12:35 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 7212366 2023-03-17 23:42:30 2023-03-19 10:26:12 2023-03-19 15:02:28 4:36:16 4:23:16 0:13:00 smithi main centos 8.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 7212367 2023-03-17 23:42:31 2023-03-19 10:26:24 2023-03-19 11:02:20 0:35:56 0:23:10 0:12:46 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7212368 2023-03-17 23:42:32 2023-03-19 10:26:33 2023-03-19 11:40:34 1:14:01 1:04:38 0:09:23 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} 2
pass 7212369 2023-03-17 23:42:32 2023-03-19 10:26:44 2023-03-19 11:56:43 1:29:59 1:14:02 0:15:57 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7212370 2023-03-17 23:42:33 2023-03-19 10:28:03 2023-03-19 12:37:43 2:09:40 1:52:23 0:17:17 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 7212371 2023-03-17 23:42:34 2023-03-19 10:35:40 2023-03-19 11:07:09 0:31:29 0:22:58 0:08:31 smithi main rhel 8.6 rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7212372 2023-03-17 23:42:35 2023-03-19 10:36:00 2023-03-19 11:25:18 0:49:18 0:33:00 0:16:18 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 7212373 2023-03-17 23:42:36 2023-03-19 10:36:31 2023-03-19 11:09:41 0:33:10 0:23:33 0:09:37 smithi main rhel 8.6 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7212374 2023-03-17 23:42:36 2023-03-19 10:36:38 2023-03-19 11:42:36 1:05:58 0:50:56 0:15:02 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 7212375 2023-03-17 23:42:37 2023-03-19 10:40:58 2023-03-19 12:46:59 2:06:01 1:54:22 0:11:39 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7212376 2023-03-17 23:42:38 2023-03-19 10:42:37 2023-03-19 12:22:47 1:40:10 1:22:42 0:17:28 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7212377 2023-03-17 23:42:39 2023-03-19 10:46:40 2023-03-19 11:17:17 0:30:37 0:16:52 0:13:45 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 7212378 2023-03-17 23:42:39 2023-03-19 10:46:52 2023-03-19 12:07:15 1:20:23 1:06:16 0:14:07 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} 2
pass 7212379 2023-03-17 23:42:40 2023-03-19 10:51:16 2023-03-19 12:19:13 1:27:57 1:05:20 0:22:37 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7212380 2023-03-17 23:42:41 2023-03-19 10:55:48 2023-03-19 11:27:01 0:31:13 0:20:35 0:10:38 smithi main rhel 8.6 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212381 2023-03-17 23:42:41 2023-03-19 10:56:00 2023-03-19 15:01:37 4:05:37 3:52:35 0:13:02 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} 1
pass 7212382 2023-03-17 23:42:42 2023-03-19 10:56:13 2023-03-19 11:41:05 0:44:52 0:31:30 0:13:22 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 7212383 2023-03-17 23:42:43 2023-03-19 10:56:25 2023-03-19 12:14:38 1:18:13 1:04:04 0:14:09 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
fail 7212384 2023-03-17 23:42:44 2023-03-19 10:56:35 2023-03-19 11:26:59 0:30:24 0:16:12 0:14:12 smithi main ubuntu 20.04 rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi037 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6dd66830c12498d02f3894e352dd8b49a7bab4c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

pass 7212385 2023-03-17 23:42:44 2023-03-19 10:56:52 2023-03-19 12:15:43 1:18:51 1:04:44 0:14:07 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} 1
dead 7212386 2023-03-17 23:42:45 2023-03-19 10:57:05 2023-03-19 23:20:39 12:23:34 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

hit max job timeout

pass 7212387 2023-03-17 23:42:46 2023-03-19 10:59:43 2023-03-19 12:42:49 1:43:06 1:29:28 0:13:38 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7212388 2023-03-17 23:42:47 2023-03-19 11:02:54 2023-03-19 12:35:19 1:32:25 1:19:34 0:12:51 smithi main rhel 8.6 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 7212389 2023-03-17 23:42:47 2023-03-19 11:07:28 2023-03-19 11:41:56 0:34:28 0:15:18 0:19:10 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7212390 2023-03-17 23:42:48 2023-03-19 11:09:59 2023-03-19 12:49:13 1:39:14 1:24:24 0:14:50 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7212391 2023-03-17 23:42:49 2023-03-19 11:10:16 2023-03-19 12:18:16 1:08:00 0:53:57 0:14:03 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 7212392 2023-03-17 23:42:49 2023-03-19 11:10:33 2023-03-19 12:31:12 1:20:39 1:07:28 0:13:11 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} 2
pass 7212393 2023-03-17 23:42:50 2023-03-19 11:10:50 2023-03-19 11:41:17 0:30:27 0:13:50 0:16:37 smithi main rhel 8.6 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} 1
pass 7212394 2023-03-17 23:42:51 2023-03-19 11:17:36 2023-03-19 11:55:35 0:37:59 0:24:57 0:13:02 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7212395 2023-03-17 23:42:52 2023-03-19 11:19:34 2023-03-19 11:55:05 0:35:31 0:18:45 0:16:46 smithi main rhel 8.6 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 7212396 2023-03-17 23:42:52 2023-03-19 11:25:06 2023-03-19 13:01:42 1:36:36 1:26:19 0:10:17 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
pass 7212397 2023-03-17 23:42:53 2023-03-19 11:25:42 2023-03-19 12:09:13 0:43:31 0:35:30 0:08:01 smithi main rhel 8.6 rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 7212398 2023-03-17 23:42:54 2023-03-19 11:25:57 2023-03-19 11:59:55 0:33:58 0:24:31 0:09:27 smithi main rhel 8.6 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7212399 2023-03-17 23:42:55 2023-03-19 11:27:23 2023-03-19 12:00:13 0:32:50 0:17:02 0:15:48 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7212400 2023-03-17 23:42:55 2023-03-19 11:27:36 2023-03-19 12:20:49 0:53:13 0:34:05 0:19:08 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
dead 7212401 2023-03-17 23:42:56 2023-03-19 11:32:57 2023-03-20 02:04:57 14:32:00 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

hit max job timeout

fail 7212402 2023-03-17 23:42:57 2023-03-19 11:39:41 2023-03-19 12:03:39 0:23:58 0:08:16 0:15:42 smithi main ubuntu 20.04 rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

No module named 'tasks.ceph'

pass 7212403 2023-03-17 23:42:57 2023-03-19 11:39:53 2023-03-19 12:34:33 0:54:40 0:43:31 0:11:09 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7212404 2023-03-17 23:42:58 2023-03-19 11:40:45 2023-03-19 13:06:47 1:26:02 1:13:07 0:12:55 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 7212405 2023-03-17 23:42:59 2023-03-19 11:40:53 2023-03-19 12:05:06 0:24:13 0:06:59 0:17:14 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

Command failed on smithi039 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-2743-ga6dd6683-1focal ceph-mds=18.0.0-2743-ga6dd6683-1focal ceph-common=18.0.0-2743-ga6dd6683-1focal ceph-fuse=18.0.0-2743-ga6dd6683-1focal ceph-test=18.0.0-2743-ga6dd6683-1focal radosgw=18.0.0-2743-ga6dd6683-1focal python-ceph=18.0.0-2743-ga6dd6683-1focal libcephfs1=18.0.0-2743-ga6dd6683-1focal libcephfs-java=18.0.0-2743-ga6dd6683-1focal libcephfs-jni=18.0.0-2743-ga6dd6683-1focal librados2=18.0.0-2743-ga6dd6683-1focal librbd1=18.0.0-2743-ga6dd6683-1focal rbd-fuse=18.0.0-2743-ga6dd6683-1focal'

pass 7212406 2023-03-17 23:43:00 2023-03-19 11:41:39 2023-03-19 12:42:13 1:00:34 0:42:30 0:18:04 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} 2
fail 7212407 2023-03-17 23:43:00 2023-03-19 11:43:00 2023-03-19 12:25:30 0:42:30 0:14:21 0:28:09 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/crash} 2
Failure Reason:

No module named 'tasks'

fail 7212408 2023-03-17 23:43:01 2023-03-19 11:55:26 2023-03-19 12:21:12 0:25:46 0:08:30 0:17:16 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi045 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7212409 2023-03-17 23:43:02 2023-03-19 11:55:44 2023-03-19 12:26:33 0:30:49 0:18:03 0:12:46 smithi main centos 8.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1