Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 6978840 2022-08-18 17:38:04 2022-08-18 17:39:08 2022-08-19 05:48:01 12:08:53 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

hit max job timeout

fail 6978841 2022-08-18 17:38:05 2022-08-18 17:39:38 2022-08-18 17:58:15 0:18:37 0:06:38 0:11:59 smithi main rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6978842 2022-08-18 17:38:06 2022-08-18 17:40:09 2022-08-18 18:02:36 0:22:27 0:13:48 0:08:39 smithi main rhel 8.6 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} 2
pass 6978843 2022-08-18 17:38:08 2022-08-18 17:41:19 2022-08-18 18:51:48 1:10:29 1:02:32 0:07:57 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} 2
pass 6978844 2022-08-18 17:38:09 2022-08-18 17:42:30 2022-08-18 17:59:50 0:17:20 0:10:56 0:06:24 smithi main ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978845 2022-08-18 17:38:10 2022-08-18 17:42:30 2022-08-18 18:00:31 0:18:01 0:09:47 0:08:14 smithi main centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6978846 2022-08-18 17:38:11 2022-08-18 17:43:21 2022-08-18 18:16:32 0:33:11 0:26:09 0:07:02 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6978847 2022-08-18 17:38:13 2022-08-18 17:43:21 2022-08-18 18:07:03 0:23:42 0:13:53 0:09:49 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 6978848 2022-08-18 17:38:14 2022-08-18 17:45:32 2022-08-18 20:14:44 2:29:12 2:08:46 0:20:26 smithi main centos 8.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} 1
pass 6978849 2022-08-18 17:38:15 2022-08-18 17:45:32 2022-08-18 18:10:41 0:25:09 0:16:14 0:08:55 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6978850 2022-08-18 17:38:16 2022-08-18 17:47:43 2022-08-18 18:28:28 0:40:45 0:32:02 0:08:43 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6978851 2022-08-18 17:38:18 2022-08-18 17:48:13 2022-08-18 18:31:49 0:43:36 0:36:49 0:06:47 smithi main rhel 8.6 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6978852 2022-08-18 17:38:19 2022-08-18 17:48:54 2022-08-18 18:10:14 0:21:20 0:14:22 0:06:58 smithi main rhel 8.6 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6978853 2022-08-18 17:38:20 2022-08-18 17:48:54 2022-08-18 18:14:57 0:26:03 0:16:46 0:09:17 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 6978854 2022-08-18 17:38:21 2022-08-18 17:52:05 2022-08-18 18:19:19 0:27:14 0:20:05 0:07:09 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

fail 6978855 2022-08-18 17:38:23 2022-08-18 17:52:25 2022-08-18 18:21:45 0:29:20 0:19:39 0:09:41 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

'wait for operator' reached maximum tries (90) after waiting for 900 seconds

pass 6978856 2022-08-18 17:38:24 2022-08-18 17:52:26 2022-08-18 18:12:09 0:19:43 0:13:07 0:06:36 smithi main rhel 8.6 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6978857 2022-08-18 17:38:25 2022-08-18 17:53:16 2022-08-18 18:23:37 0:30:21 0:22:44 0:07:37 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 6978858 2022-08-18 17:38:26 2022-08-18 17:54:37 2022-08-18 18:32:06 0:37:29 0:29:00 0:08:29 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6978859 2022-08-18 17:38:28 2022-08-18 17:58:04 2022-08-18 18:14:06 0:16:02 0:08:24 0:07:38 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6978860 2022-08-18 17:38:29 2022-08-18 17:58:05 2022-08-18 18:15:48 0:17:43 0:10:25 0:07:18 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 6978861 2022-08-18 17:38:30 2022-08-18 17:58:15 2022-08-18 18:19:24 0:21:09 0:15:03 0:06:06 smithi main rhel 8.6 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6978862 2022-08-18 17:38:31 2022-08-18 17:58:15 2022-08-18 18:21:20 0:23:05 0:16:33 0:06:32 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
fail 6978863 2022-08-18 17:38:33 2022-08-18 17:58:26 2022-08-18 18:41:32 0:43:06 0:36:04 0:07:02 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Command failed on smithi017 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 6978864 2022-08-18 17:38:34 2022-08-18 17:58:26 2022-08-18 18:32:15 0:33:49 0:26:12 0:07:37 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6978865 2022-08-18 17:38:35 2022-08-18 17:59:07 2022-08-18 18:16:17 0:17:10 0:09:49 0:07:21 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 6978866 2022-08-18 17:38:36 2022-08-18 18:00:37 2022-08-18 18:23:33 0:22:56 0:14:22 0:08:34 smithi main rhel 8.6 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6978867 2022-08-18 17:38:37 2022-08-18 18:02:28 2022-08-18 21:39:47 3:37:19 3:30:17 0:07:02 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} 1
pass 6978868 2022-08-18 17:38:39 2022-08-18 18:02:28 2022-08-18 18:21:57 0:19:29 0:12:04 0:07:25 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6978869 2022-08-18 17:38:40 2022-08-18 18:02:39 2022-08-18 18:28:07 0:25:28 0:18:16 0:07:12 smithi main rhel 8.6 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
fail 6978870 2022-08-18 17:38:41 2022-08-18 18:02:49 2022-08-18 18:18:34 0:15:45 0:05:44 0:10:01 smithi main rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 6978871 2022-08-18 17:38:42 2022-08-18 18:02:49 2022-08-18 18:18:29 0:15:40 0:07:49 0:07:51 smithi main centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 2
pass 6978872 2022-08-18 17:38:44 2022-08-18 18:03:00 2022-08-18 18:29:32 0:26:32 0:16:26 0:10:06 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} 2
fail 6978873 2022-08-18 17:38:45 2022-08-18 18:06:21 2022-08-18 18:29:24 0:23:03 0:15:48 0:07:15 smithi main rhel 8.6 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (workunit test rados/test_librados_build.sh) on smithi105 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_librados_build.sh'

pass 6978874 2022-08-18 17:38:46 2022-08-18 18:06:31 2022-08-18 18:41:10 0:34:39 0:26:11 0:08:28 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} 2
pass 6978875 2022-08-18 17:38:47 2022-08-18 18:07:12 2022-08-18 18:32:26 0:25:14 0:18:59 0:06:15 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 6978876 2022-08-18 17:38:49 2022-08-18 18:07:32 2022-08-18 18:32:13 0:24:41 0:16:09 0:08:32 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} 2
pass 6978877 2022-08-18 17:38:50 2022-08-18 18:08:12 2022-08-18 18:27:21 0:19:09 0:13:47 0:05:22 smithi main rhel 8.6 rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6978878 2022-08-18 17:38:51 2022-08-18 18:08:13 2022-08-18 20:52:13 2:44:00 2:17:08 0:26:52 smithi main centos 8.stream rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} 1
pass 6978879 2022-08-18 17:38:53 2022-08-18 18:08:43 2022-08-18 18:24:03 0:15:20 0:07:57 0:07:23 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6978880 2022-08-18 17:38:54 2022-08-18 18:08:44 2022-08-18 18:33:51 0:25:07 0:16:13 0:08:54 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6978881 2022-08-18 17:38:55 2022-08-18 18:10:44 2022-08-18 18:49:47 0:39:03 0:31:03 0:08:00 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
fail 6978882 2022-08-18 17:38:56 2022-08-18 18:12:45 2022-08-18 18:38:53 0:26:08 0:18:27 0:07:41 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} 2
Failure Reason:

Command failed on smithi057 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 6978883 2022-08-18 17:38:58 2022-08-18 18:13:26 2022-08-18 18:30:36 0:17:10 0:09:03 0:08:07 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6978884 2022-08-18 17:38:59 2022-08-18 18:14:26 2022-08-18 18:40:00 0:25:34 0:19:18 0:06:16 smithi main rhel 8.6 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6978885 2022-08-18 17:39:00 2022-08-18 18:15:07 2022-08-18 18:43:22 0:28:15 0:20:03 0:08:12 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 6978886 2022-08-18 17:39:01 2022-08-18 18:15:57 2022-08-18 18:39:16 0:23:19 0:15:57 0:07:22 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6978887 2022-08-18 17:39:03 2022-08-18 18:15:58 2022-08-18 19:18:52 1:02:54 0:57:49 0:05:05 smithi main rhel 8.6 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6978888 2022-08-18 17:39:04 2022-08-18 18:15:58 2022-08-18 18:45:34 0:29:36 0:21:45 0:07:51 smithi main centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 6978889 2022-08-18 17:39:05 2022-08-18 18:16:18 2022-08-18 18:53:20 0:37:02 0:29:59 0:07:03 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6978890 2022-08-18 17:39:06 2022-08-18 18:16:19 2022-08-18 18:35:41 0:19:22 0:12:40 0:06:42 smithi main centos 8.stream rados/cephadm/workunits/{agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 6978891 2022-08-18 17:39:08 2022-08-18 18:16:39 2022-08-18 18:50:05 0:33:26 0:25:48 0:07:38 smithi main rhel 8.6 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} 2
pass 6978892 2022-08-18 17:39:09 2022-08-18 18:17:00 2022-08-18 19:05:35 0:48:35 0:40:36 0:07:59 smithi main centos 8.stream rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6978893 2022-08-18 17:39:10 2022-08-18 18:18:30 2022-08-18 18:56:15 0:37:45 0:30:50 0:06:55 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6978894 2022-08-18 17:39:11 2022-08-18 18:18:41 2022-08-18 21:46:25 3:27:44 3:20:46 0:06:58 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi059 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6978895 2022-08-18 17:39:12 2022-08-18 18:19:21 2022-08-18 18:44:25 0:25:04 0:19:30 0:05:34 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 6978896 2022-08-18 17:39:14 2022-08-18 18:19:22 2022-08-18 18:44:40 0:25:18 0:18:40 0:06:38 smithi main centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6978897 2022-08-18 17:39:15 2022-08-18 18:19:32 2022-08-18 21:17:13 2:57:41 2:50:44 0:06:57 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} 1
pass 6978898 2022-08-18 17:39:16 2022-08-18 18:20:02 2022-08-18 18:48:09 0:28:07 0:19:44 0:08:23 smithi main rhel 8.6 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6978899 2022-08-18 17:39:17 2022-08-18 18:21:13 2022-08-18 18:38:17 0:17:04 0:09:49 0:07:15 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/workunits} 2
pass 6978900 2022-08-18 17:39:18 2022-08-18 18:21:23 2022-08-18 18:37:05 0:15:42 0:08:28 0:07:14 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6978901 2022-08-18 17:39:19 2022-08-18 18:21:54 2022-08-18 18:53:23 0:31:29 0:25:28 0:06:01 smithi main rhel 8.6 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
fail 6978902 2022-08-18 17:39:21 2022-08-18 18:22:04 2022-08-18 19:11:54 0:49:50 0:39:45 0:10:05 smithi main rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_export_create_with_non_existing_fsname (tasks.cephfs.test_nfs.TestNFS)

pass 6978903 2022-08-18 17:39:22 2022-08-18 18:22:04 2022-08-18 18:51:34 0:29:30 0:21:11 0:08:19 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6978904 2022-08-18 17:39:23 2022-08-18 18:23:45 2022-08-18 18:59:07 0:35:22 0:28:17 0:07:05 smithi main ubuntu 20.04 rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} 1
pass 6978905 2022-08-18 17:39:24 2022-08-18 18:23:46 2022-08-18 19:09:15 0:45:29 0:39:00 0:06:29 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 6978906 2022-08-18 17:39:25 2022-08-18 18:23:46 2022-08-18 19:06:33 0:42:47 0:32:35 0:10:12 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
pass 6978907 2022-08-18 17:39:26 2022-08-18 18:27:27 2022-08-18 19:04:10 0:36:43 0:29:18 0:07:25 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} 2
pass 6978908 2022-08-18 17:39:28 2022-08-18 18:28:38 2022-08-18 18:58:18 0:29:40 0:22:24 0:07:16 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6978909 2022-08-18 17:39:29 2022-08-18 18:28:38 2022-08-18 18:42:11 0:13:33 0:07:16 0:06:17 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978910 2022-08-18 17:39:30 2022-08-18 18:28:49 2022-08-18 18:42:05 0:13:16 0:06:20 0:06:56 smithi main ubuntu 20.04 rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978911 2022-08-18 17:39:31 2022-08-18 18:28:49 2022-08-18 18:48:08 0:19:19 0:09:59 0:09:20 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6978912 2022-08-18 17:39:32 2022-08-18 18:30:30 2022-08-18 18:55:48 0:25:18 0:15:01 0:10:17 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6978913 2022-08-18 17:39:34 2022-08-18 18:30:31 2022-08-18 19:41:48 1:11:17 1:04:05 0:07:12 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 6978914 2022-08-18 17:39:35 2022-08-18 18:30:41 2022-08-18 19:09:23 0:38:42 0:30:28 0:08:14 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6978915 2022-08-18 17:39:36 2022-08-18 18:31:42 2022-08-18 19:06:40 0:34:58 0:29:30 0:05:28 smithi main rhel 8.6 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6978916 2022-08-18 17:39:37 2022-08-18 18:31:53 2022-08-18 19:03:59 0:32:06 0:21:38 0:10:28 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 6978917 2022-08-18 17:39:38 2022-08-18 18:32:13 2022-08-18 18:57:48 0:25:35 0:18:52 0:06:43 smithi main rhel 8.6 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 2
pass 6978918 2022-08-18 17:39:40 2022-08-18 18:32:14 2022-08-18 19:17:42 0:45:28 0:38:25 0:07:03 smithi main centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6978919 2022-08-18 17:39:41 2022-08-18 18:32:24 2022-08-18 18:55:36 0:23:12 0:17:35 0:05:37 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} 2
pass 6978920 2022-08-18 17:39:42 2022-08-18 18:32:35 2022-08-18 18:49:11 0:16:36 0:08:20 0:08:16 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6978921 2022-08-18 17:39:43 2022-08-18 18:33:45 2022-08-18 19:01:19 0:27:34 0:18:37 0:08:57 smithi main rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} 1
pass 6978922 2022-08-18 17:39:44 2022-08-18 18:33:45 2022-08-18 18:59:03 0:25:18 0:18:54 0:06:24 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 6978923 2022-08-18 17:39:46 2022-08-18 18:33:56 2022-08-18 18:54:21 0:20:25 0:13:44 0:06:41 smithi main centos 8.stream rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6978924 2022-08-18 17:39:47 2022-08-18 18:33:56 2022-08-18 19:03:49 0:29:53 0:22:00 0:07:53 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6978925 2022-08-18 17:39:48 2022-08-18 18:34:27 2022-08-18 18:56:11 0:21:44 0:15:37 0:06:07 smithi main rhel 8.6 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6978926 2022-08-18 17:39:49 2022-08-18 18:34:57 2022-08-18 19:13:53 0:38:56 0:32:45 0:06:11 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6978927 2022-08-18 17:39:50 2022-08-18 18:34:57 2022-08-18 19:01:17 0:26:20 0:17:50 0:08:30 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 6978928 2022-08-18 17:39:52 2022-08-18 18:36:08 2022-08-18 19:02:39 0:26:31 0:19:17 0:07:14 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
pass 6978929 2022-08-18 17:39:53 2022-08-18 18:37:08 2022-08-18 18:57:13 0:20:05 0:11:29 0:08:36 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6978930 2022-08-18 17:39:54 2022-08-18 18:38:19 2022-08-18 19:14:20 0:36:01 0:28:13 0:07:48 smithi main rhel 8.6 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6978931 2022-08-18 17:39:55 2022-08-18 18:39:00 2022-08-18 18:52:10 0:13:10 0:06:04 0:07:06 smithi main ubuntu 20.04 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
fail 6978932 2022-08-18 17:39:56 2022-08-18 18:39:00 2022-08-18 19:24:33 0:45:33 0:37:59 0:07:34 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} 2
Failure Reason:

Test failure: test_add_indiv_flag (tasks.mgr.dashboard.test_osd.OsdFlagsTest)

pass 6978933 2022-08-18 17:39:57 2022-08-18 18:39:20 2022-08-18 18:57:12 0:17:52 0:09:20 0:08:32 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 6978934 2022-08-18 17:39:59 2022-08-18 18:42:58 2022-08-18 18:57:04 0:14:06 0:06:36 0:07:30 smithi main ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 6978935 2022-08-18 17:40:00 2022-08-18 18:43:29 2022-08-18 19:03:02 0:19:33 0:12:45 0:06:48 smithi main centos 8.stream rados/rest/{mgr-restful supported-random-distro$/{centos_8}} 1
fail 6978936 2022-08-18 17:40:01 2022-08-18 18:43:29 2022-08-18 19:13:56 0:30:27 0:19:31 0:10:56 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

'wait for operator' reached maximum tries (90) after waiting for 900 seconds

pass 6978937 2022-08-18 17:40:02 2022-08-18 18:44:30 2022-08-18 19:13:24 0:28:54 0:22:17 0:06:37 smithi main rhel 8.6 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6978938 2022-08-18 17:40:04 2022-08-18 18:44:30 2022-08-18 19:02:11 0:17:41 0:10:38 0:07:03 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
fail 6978939 2022-08-18 17:40:05 2022-08-18 18:44:41 2022-08-18 19:35:24 0:50:43 0:39:47 0:10:56 smithi main ubuntu 20.04 rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Command failed (workunit test cls/test_cls_rgw.sh) on smithi085 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh'

fail 6978940 2022-08-18 17:40:06 2022-08-18 18:45:41 2022-08-18 19:11:56 0:26:15 0:19:13 0:07:02 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
Failure Reason:

expected valgrind issues and found none

pass 6978941 2022-08-18 17:40:07 2022-08-18 18:47:02 2022-08-18 19:17:10 0:30:08 0:23:07 0:07:01 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 6978942 2022-08-18 17:40:08 2022-08-18 18:48:12 2022-08-18 19:09:07 0:20:55 0:13:48 0:07:07 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6978943 2022-08-18 17:40:10 2022-08-18 18:48:12 2022-08-18 19:25:23 0:37:11 0:30:50 0:06:21 smithi main rhel 8.6 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 6978944 2022-08-18 17:40:11 2022-08-18 18:48:13 2022-08-18 19:18:17 0:30:04 0:23:27 0:06:37 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 6978945 2022-08-18 17:40:12 2022-08-18 18:49:13 2022-08-18 19:09:56 0:20:43 0:11:56 0:08:47 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6978946 2022-08-18 17:40:13 2022-08-18 18:50:14 2022-08-18 19:17:34 0:27:20 0:20:46 0:06:34 smithi main ubuntu 20.04 rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978947 2022-08-18 17:40:14 2022-08-18 18:50:14 2022-08-18 19:10:34 0:20:20 0:13:38 0:06:42 smithi main rhel 8.6 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6978948 2022-08-18 17:40:16 2022-08-18 18:51:35 2022-08-18 19:10:44 0:19:09 0:11:34 0:07:35 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6978949 2022-08-18 17:40:17 2022-08-18 18:51:35 2022-08-18 19:05:34 0:13:59 0:06:05 0:07:54 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6978950 2022-08-18 17:40:18 2022-08-18 18:51:56 2022-08-18 19:15:22 0:23:26 0:14:18 0:09:08 smithi main ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 6978951 2022-08-18 17:40:19 2022-08-18 18:51:56 2022-08-18 19:18:45 0:26:49 0:18:47 0:08:02 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 6978952 2022-08-18 17:40:20 2022-08-18 18:53:27 2022-08-18 19:18:48 0:25:21 0:18:22 0:06:59 smithi main ubuntu 20.04 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
pass 6978953 2022-08-18 17:40:21 2022-08-18 18:53:27 2022-08-18 19:26:50 0:33:23 0:24:45 0:08:38 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
fail 6978954 2022-08-18 17:40:23 2022-08-18 18:55:28 2022-08-18 19:12:39 0:17:11 0:06:43 0:10:28 smithi main rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6978955 2022-08-18 17:40:24 2022-08-18 18:55:28 2022-08-18 19:30:40 0:35:12 0:28:13 0:06:59 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6978956 2022-08-18 17:40:25 2022-08-18 18:55:39 2022-08-18 19:18:38 0:22:59 0:17:11 0:05:48 smithi main rhel 8.6 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6978957 2022-08-18 17:40:26 2022-08-18 18:55:49 2022-08-18 19:25:53 0:30:04 0:23:15 0:06:49 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6978958 2022-08-18 17:40:27 2022-08-18 18:56:20 2022-08-18 19:15:53 0:19:33 0:12:53 0:06:40 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
pass 6978959 2022-08-18 17:40:29 2022-08-18 18:56:20 2022-08-18 19:30:20 0:34:00 0:27:34 0:06:26 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6978960 2022-08-18 17:40:30 2022-08-18 18:57:00 2022-08-18 19:16:45 0:19:45 0:13:12 0:06:33 smithi main ubuntu 20.04 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978961 2022-08-18 17:40:31 2022-08-18 18:57:11 2022-08-18 19:14:15 0:17:04 0:10:55 0:06:09 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6978962 2022-08-18 17:40:32 2022-08-18 18:57:21 2022-08-18 19:12:14 0:14:53 0:08:44 0:06:09 smithi main centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6978963 2022-08-18 17:40:34 2022-08-18 18:57:21 2022-08-18 19:25:35 0:28:14 0:19:38 0:08:36 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 6978964 2022-08-18 17:40:35 2022-08-18 18:57:52 2022-08-18 19:21:21 0:23:29 0:17:43 0:05:46 smithi main rhel 8.6 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 6978965 2022-08-18 17:40:36 2022-08-18 18:57:52 2022-08-18 19:17:46 0:19:54 0:12:09 0:07:45 smithi main rhel 8.6 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
fail 6978966 2022-08-18 17:40:37 2022-08-18 18:58:23 2022-08-18 19:14:17 0:15:54 0:04:56 0:10:58 smithi main rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6978967 2022-08-18 17:40:38 2022-08-18 18:58:33 2022-08-18 19:58:02 0:59:29 0:52:14 0:07:15 smithi main centos 8.stream rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6978968 2022-08-18 17:40:40 2022-08-18 18:59:03 2022-08-18 19:12:34 0:13:31 0:06:08 0:07:23 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6978969 2022-08-18 17:40:41 2022-08-18 18:59:04 2022-08-18 19:18:23 0:19:19 0:13:13 0:06:06 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/failover} 2
pass 6978970 2022-08-18 17:40:43 2022-08-18 18:59:14 2022-08-18 19:36:35 0:37:21 0:28:48 0:08:33 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
pass 6978971 2022-08-18 17:40:44 2022-08-18 19:01:25 2022-08-18 19:12:45 0:11:20 0:05:09 0:06:11 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978972 2022-08-18 17:40:45 2022-08-18 19:01:25 2022-08-18 19:30:53 0:29:28 0:21:58 0:07:30 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} 1
pass 6978973 2022-08-18 17:40:46 2022-08-18 19:01:56 2022-08-18 19:29:34 0:27:38 0:20:03 0:07:35 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 6978974 2022-08-18 17:40:48 2022-08-18 19:02:16 2022-08-18 19:38:47 0:36:31 0:28:39 0:07:52 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
fail 6978975 2022-08-18 17:40:49 2022-08-18 19:03:07 2022-08-19 01:38:58 6:35:51 6:27:21 0:08:30 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi152 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6978976 2022-08-18 17:40:50 2022-08-18 19:03:57 2022-08-18 19:27:49 0:23:52 0:16:00 0:07:52 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6978977 2022-08-18 17:40:52 2022-08-18 19:06:41 2022-08-18 19:30:05 0:23:24 0:13:40 0:09:44 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6978978 2022-08-18 17:40:53 2022-08-18 19:09:11 2022-08-18 19:22:51 0:13:40 0:06:58 0:06:42 smithi main ubuntu 20.04 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 6978979 2022-08-18 17:40:54 2022-08-18 19:09:22 2022-08-18 19:47:12 0:37:50 0:29:51 0:07:59 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6978980 2022-08-18 17:40:55 2022-08-18 19:09:32 2022-08-19 07:18:51 12:09:19 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
Failure Reason:

hit max job timeout

pass 6978981 2022-08-18 17:40:56 2022-08-18 19:10:03 2022-08-18 19:25:12 0:15:09 0:08:49 0:06:20 smithi main centos 8.stream rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6978982 2022-08-18 17:40:58 2022-08-18 19:10:03 2022-08-18 19:35:13 0:25:10 0:18:59 0:06:11 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 6978983 2022-08-18 17:40:59 2022-08-18 19:10:04 2022-08-18 19:35:56 0:25:52 0:18:55 0:06:57 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 6978984 2022-08-18 17:41:00 2022-08-18 19:10:54 2022-08-18 19:24:03 0:13:09 0:07:48 0:05:21 smithi main ubuntu 20.04 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
dead 6978985 2022-08-18 17:41:01 2022-08-18 19:10:54 2022-08-19 07:20:46 12:09:52 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
Failure Reason:

hit max job timeout

pass 6978986 2022-08-18 17:41:02 2022-08-18 19:12:05 2022-08-18 19:47:21 0:35:16 0:27:55 0:07:21 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
fail 6978987 2022-08-18 17:41:04 2022-08-18 19:12:15 2022-08-18 19:28:19 0:16:04 0:05:41 0:10:23 smithi main rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 6978988 2022-08-18 17:41:05 2022-08-18 19:12:36 2022-08-18 19:31:52 0:19:16 0:12:47 0:06:29 smithi main rhel 8.6 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6978989 2022-08-18 17:41:06 2022-08-18 19:12:46 2022-08-18 19:25:21 0:12:35 0:06:22 0:06:13 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6978990 2022-08-18 17:41:07 2022-08-18 19:12:47 2022-08-18 19:49:53 0:37:06 0:31:09 0:05:57 smithi main rhel 8.6 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6978991 2022-08-18 17:41:09 2022-08-18 19:12:57 2022-08-18 19:26:40 0:13:43 0:06:22 0:07:21 smithi main ubuntu 20.04 rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6978992 2022-08-18 17:41:10 2022-08-18 19:13:27 2022-08-18 19:32:40 0:19:13 0:12:43 0:06:30 smithi main rhel 8.6 rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} 1
pass 6978993 2022-08-18 17:41:11 2022-08-18 19:13:58 2022-08-18 19:39:19 0:25:21 0:19:25 0:05:56 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
dead 6978994 2022-08-18 17:41:12 2022-08-18 19:14:18 2022-08-19 07:23:54 12:09:36 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

hit max job timeout

pass 6978995 2022-08-18 17:41:13 2022-08-18 19:14:19 2022-08-18 19:33:47 0:19:28 0:12:07 0:07:21 smithi main rhel 8.6 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6978996 2022-08-18 17:41:15 2022-08-18 19:14:29 2022-08-18 19:29:23 0:14:54 0:08:40 0:06:14 smithi main centos 8.stream rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6978997 2022-08-18 17:41:16 2022-08-18 19:14:29 2022-08-18 19:49:20 0:34:51 0:26:21 0:08:30 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6978998 2022-08-18 17:41:17 2022-08-18 19:16:00 2022-08-18 19:38:55 0:22:55 0:15:45 0:07:10 smithi main centos 8.stream rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6978999 2022-08-18 17:41:19 2022-08-18 19:16:00 2022-08-18 19:35:55 0:19:55 0:12:41 0:07:14 smithi main centos 8.stream rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 6979000 2022-08-18 17:41:20 2022-08-18 19:16:51 2022-08-18 19:40:05 0:23:14 0:16:09 0:07:05 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 6979001 2022-08-18 17:41:21 2022-08-18 19:17:12 2022-08-18 19:57:17 0:40:05 0:33:26 0:06:39 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} 2
pass 6979002 2022-08-18 17:41:23 2022-08-18 19:17:52 2022-08-18 19:37:11 0:19:19 0:13:18 0:06:01 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6979003 2022-08-18 17:41:24 2022-08-18 19:17:53 2022-08-18 19:39:29 0:21:36 0:14:31 0:07:05 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/insights} 2
pass 6979004 2022-08-18 17:41:25 2022-08-18 19:18:23 2022-08-18 19:41:46 0:23:23 0:15:53 0:07:30 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6979005 2022-08-18 17:41:26 2022-08-18 19:18:44 2022-08-18 19:33:48 0:15:04 0:07:57 0:07:07 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_striper} 2
pass 6979006 2022-08-18 17:41:28 2022-08-18 19:18:54 2022-08-18 19:57:54 0:39:00 0:31:45 0:07:15 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6979007 2022-08-18 17:41:29 2022-08-18 19:18:55 2022-08-18 19:36:02 0:17:07 0:09:42 0:07:25 smithi main centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6979008 2022-08-18 17:41:30 2022-08-18 19:18:55 2022-08-18 21:00:48 1:41:53 1:34:26 0:07:27 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 6979009 2022-08-18 17:41:31 2022-08-18 19:18:55 2022-08-18 20:40:04 1:21:09 1:10:38 0:10:31 smithi main centos 8.stream rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 6979010 2022-08-18 17:41:32 2022-08-18 19:22:56 2022-08-18 19:47:40 0:24:44 0:16:44 0:08:00 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6979011 2022-08-18 17:41:34 2022-08-18 19:24:07 2022-08-18 19:46:27 0:22:20 0:15:29 0:06:51 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6979012 2022-08-18 17:41:35 2022-08-18 19:25:18 2022-08-18 20:13:09 0:47:51 0:40:10 0:07:41 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6979013 2022-08-18 17:41:36 2022-08-18 19:25:28 2022-08-18 19:38:31 0:13:03 0:06:16 0:06:47 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
fail 6979014 2022-08-18 17:41:38 2022-08-18 19:25:28 2022-08-18 19:53:12 0:27:44 0:19:36 0:08:08 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

fail 6979015 2022-08-18 17:41:39 2022-08-18 19:25:39 2022-08-18 20:02:51 0:37:12 0:24:42 0:12:30 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

'check osd count' reached maximum tries (90) after waiting for 900 seconds

pass 6979016 2022-08-18 17:41:40 2022-08-18 19:26:51 2022-08-18 19:42:39 0:15:48 0:08:36 0:07:12 smithi main centos 8.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6979017 2022-08-18 17:41:41 2022-08-18 19:27:52 2022-08-18 20:43:54 1:16:02 1:08:19 0:07:43 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 6979018 2022-08-18 17:41:42 2022-08-18 19:27:52 2022-08-18 19:53:31 0:25:39 0:19:37 0:06:02 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6979019 2022-08-18 17:41:44 2022-08-18 19:28:22 2022-08-18 20:17:03 0:48:41 0:40:37 0:08:04 smithi main rhel 8.6 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6979020 2022-08-18 17:41:45 2022-08-18 19:29:43 2022-08-18 20:55:10 1:25:27 1:19:07 0:06:20 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 6979021 2022-08-18 17:41:46 2022-08-18 19:30:13 2022-08-18 19:57:33 0:27:20 0:19:49 0:07:31 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 6979022 2022-08-18 17:41:47 2022-08-18 19:30:24 2022-08-18 20:06:13 0:35:49 0:29:44 0:06:05 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6979023 2022-08-18 17:41:49 2022-08-18 19:30:44 2022-08-18 19:51:48 0:21:04 0:15:41 0:05:23 smithi main rhel 8.6 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 6979024 2022-08-18 17:41:50 2022-08-18 19:30:55 2022-08-18 22:01:37 2:30:42 2:22:40 0:08:02 smithi main ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} 1
pass 6979025 2022-08-18 17:41:51 2022-08-18 19:31:55 2022-08-18 19:57:17 0:25:22 0:17:40 0:07:42 smithi main ubuntu 20.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
pass 6979026 2022-08-18 17:41:52 2022-08-18 19:33:56 2022-08-18 19:50:50 0:16:54 0:10:22 0:06:32 smithi main centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6979027 2022-08-18 17:41:53 2022-08-18 19:33:56 2022-08-18 20:00:45 0:26:49 0:18:37 0:08:12 smithi main rhel 8.6 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6979028 2022-08-18 17:41:55 2022-08-18 19:35:17 2022-08-18 19:58:43 0:23:26 0:17:31 0:05:55 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6979029 2022-08-18 17:41:56 2022-08-18 19:35:27 2022-08-18 20:15:06 0:39:39 0:32:53 0:06:46 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
fail 6979030 2022-08-18 17:41:57 2022-08-18 19:35:58 2022-08-18 19:53:54 0:17:56 0:06:44 0:11:12 smithi main rados/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6979031 2022-08-18 17:41:58 2022-08-18 19:35:58 2022-08-18 20:03:16 0:27:18 0:20:42 0:06:36 smithi main centos 8.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
fail 6979032 2022-08-18 17:41:59 2022-08-18 19:36:09 2022-08-18 19:51:32 0:15:23 0:08:56 0:06:27 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test rados/test_librados_build.sh) on smithi179 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_librados_build.sh'

pass 6979033 2022-08-18 17:42:01 2022-08-18 19:36:19 2022-08-18 20:11:51 0:35:32 0:28:18 0:07:14 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 6979034 2022-08-18 17:42:02 2022-08-18 19:36:40 2022-08-18 19:49:52 0:13:12 0:06:19 0:06:53 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6979035 2022-08-18 17:42:03 2022-08-18 19:36:40 2022-08-18 19:58:59 0:22:19 0:14:58 0:07:21 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} 2
pass 6979036 2022-08-18 17:42:04 2022-08-18 19:37:21 2022-08-18 19:55:07 0:17:46 0:09:47 0:07:59 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6979037 2022-08-18 17:42:05 2022-08-18 19:38:51 2022-08-18 20:02:18 0:23:27 0:16:28 0:06:59 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6979038 2022-08-18 17:42:07 2022-08-18 19:39:22 2022-08-18 20:10:36 0:31:14 0:24:53 0:06:21 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6979039 2022-08-18 17:42:08 2022-08-18 19:39:32 2022-08-18 20:13:35 0:34:03 0:27:29 0:06:34 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 6979040 2022-08-18 17:42:09 2022-08-18 19:40:13 2022-08-18 19:53:33 0:13:20 0:06:44 0:06:36 smithi main ubuntu 20.04 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
fail 6979041 2022-08-18 17:42:10 2022-08-18 19:40:13 2022-08-18 20:17:18 0:37:05 0:28:22 0:08:43 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

"2022-08-18T20:11:02.317298+0000 osd.0 (osd.0) 281 : cluster [ERR] 3.fs0 deep-scrub : stat mismatch, got 9/8 objects, 5/4 clones, 9/8 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 1/1 whiteouts, 16039936/14139392 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes." in cluster log

pass 6979042 2022-08-18 17:42:11 2022-08-18 19:41:54 2022-08-18 20:05:14 0:23:20 0:15:53 0:07:27 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979043 2022-08-18 17:42:13 2022-08-18 19:41:54 2022-08-18 20:06:48 0:24:54 0:19:26 0:05:28 smithi main rhel 8.6 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 6979044 2022-08-18 17:42:14 2022-08-18 19:41:54 2022-08-18 20:08:49 0:26:55 0:19:43 0:07:12 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6979045 2022-08-18 17:42:15 2022-08-18 19:41:55 2022-08-18 20:23:55 0:42:00 0:30:18 0:11:42 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6979046 2022-08-18 17:42:16 2022-08-18 19:46:36 2022-08-18 20:17:59 0:31:23 0:22:09 0:09:14 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6979047 2022-08-18 17:42:17 2022-08-18 19:46:36 2022-08-18 20:20:18 0:33:42 0:26:53 0:06:49 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6979048 2022-08-18 17:42:19 2022-08-18 19:47:17 2022-08-18 20:18:38 0:31:21 0:24:41 0:06:40 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6979049 2022-08-18 17:42:20 2022-08-18 19:47:27 2022-08-18 20:07:03 0:19:36 0:12:35 0:07:01 smithi main rhel 8.6 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
fail 6979050 2022-08-18 17:42:21 2022-08-18 19:47:28 2022-08-18 20:06:13 0:18:45 0:06:34 0:12:11 smithi main rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6979051 2022-08-18 17:42:22 2022-08-18 19:47:48 2022-08-18 20:20:48 0:33:00 0:24:21 0:08:39 smithi main rhel 8.6 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} 2
pass 6979052 2022-08-18 17:42:23 2022-08-18 19:49:29 2022-08-18 22:32:40 2:43:11 2:37:37 0:05:34 smithi main ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} 1
pass 6979053 2022-08-18 17:42:24 2022-08-18 19:49:29 2022-08-18 20:15:00 0:25:31 0:18:28 0:07:03 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6979054 2022-08-18 17:42:26 2022-08-18 19:50:00 2022-08-18 20:29:46 0:39:46 0:33:10 0:06:36 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6979055 2022-08-18 17:42:27 2022-08-18 19:50:50 2022-08-18 20:16:48 0:25:58 0:18:53 0:07:05 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
pass 6979056 2022-08-18 17:42:28 2022-08-18 19:51:51 2022-08-18 20:21:15 0:29:24 0:21:15 0:08:09 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6979057 2022-08-18 17:42:29 2022-08-18 19:53:21 2022-08-18 20:24:02 0:30:41 0:23:31 0:07:10 smithi main centos 8.stream rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6979058 2022-08-18 17:42:30 2022-08-18 19:53:22 2022-08-18 20:19:04 0:25:42 0:16:03 0:09:39 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6979059 2022-08-18 17:42:32 2022-08-18 19:53:32 2022-08-18 20:16:59 0:23:27 0:16:09 0:07:18 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979060 2022-08-18 17:42:33 2022-08-18 19:53:42 2022-08-18 20:09:29 0:15:47 0:05:59 0:09:48 smithi main ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6979061 2022-08-18 17:42:34 2022-08-18 19:55:13 2022-08-18 20:24:12 0:28:59 0:22:51 0:06:08 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6979062 2022-08-18 17:42:36 2022-08-18 19:55:14 2022-08-18 20:22:34 0:27:20 0:19:10 0:08:10 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 6979063 2022-08-18 17:42:37 2022-08-18 19:57:24 2022-08-18 20:18:47 0:21:23 0:13:48 0:07:35 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6979064 2022-08-18 17:42:38 2022-08-18 19:57:35 2022-08-18 20:10:56 0:13:21 0:07:51 0:05:30 smithi main ubuntu 20.04 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979065 2022-08-18 17:42:39 2022-08-18 19:57:35 2022-08-18 20:29:12 0:31:37 0:24:06 0:07:31 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 6979066 2022-08-18 17:42:40 2022-08-18 19:58:06 2022-08-18 20:14:44 0:16:38 0:09:47 0:06:51 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6979067 2022-08-18 17:42:42 2022-08-18 19:59:06 2022-08-18 20:18:16 0:19:10 0:10:35 0:08:35 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} 2
pass 6979068 2022-08-18 17:42:43 2022-08-18 20:00:47 2022-08-18 20:15:55 0:15:08 0:08:58 0:06:10 smithi main centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6979069 2022-08-18 17:42:44 2022-08-18 20:00:47 2022-08-18 20:29:23 0:28:36 0:20:25 0:08:11 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} 2
pass 6979070 2022-08-18 17:42:45 2022-08-18 20:02:28 2022-08-18 20:20:27 0:17:59 0:09:10 0:08:49 smithi main rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} 1
pass 6979071 2022-08-18 17:42:46 2022-08-18 20:02:58 2022-08-18 20:32:22 0:29:24 0:23:05 0:06:19 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/progress} 2
pass 6979072 2022-08-18 17:42:48 2022-08-18 20:02:59 2022-08-18 20:20:46 0:17:47 0:08:43 0:09:04 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6979073 2022-08-18 17:42:49 2022-08-18 20:05:19 2022-08-18 20:21:42 0:16:23 0:09:11 0:07:12 smithi main centos 8.stream rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6979074 2022-08-18 17:42:50 2022-08-18 20:06:20 2022-08-18 20:39:21 0:33:01 0:26:38 0:06:23 smithi main centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6979075 2022-08-18 17:42:51 2022-08-18 20:06:20 2022-08-18 21:19:30 1:13:10 1:06:23 0:06:47 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 6979076 2022-08-18 17:42:52 2022-08-18 20:06:21 2022-08-18 20:30:58 0:24:37 0:16:10 0:08:27 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 6979077 2022-08-18 17:42:53 2022-08-18 20:07:11 2022-08-18 20:45:15 0:38:04 0:28:38 0:09:26 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
fail 6979078 2022-08-18 17:42:55 2022-08-18 20:09:32 2022-08-18 20:26:21 0:16:49 0:05:02 0:11:47 smithi main rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6979079 2022-08-18 17:42:56 2022-08-18 20:09:32 2022-08-18 20:22:54 0:13:22 0:07:51 0:05:31 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6979080 2022-08-18 17:42:57 2022-08-18 20:09:33 2022-08-18 20:38:08 0:28:35 0:19:57 0:08:38 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6979081 2022-08-18 17:42:58 2022-08-18 20:10:43 2022-08-18 20:22:21 0:11:38 0:05:19 0:06:19 smithi main ubuntu 20.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 6979082 2022-08-18 17:42:59 2022-08-18 20:11:04 2022-08-18 20:29:03 0:17:59 0:09:36 0:08:23 smithi main centos 8.stream rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6979083 2022-08-18 17:43:01 2022-08-18 20:11:54 2022-08-18 20:47:20 0:35:26 0:29:33 0:05:53 smithi main ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 6979084 2022-08-18 17:43:02 2022-08-18 20:11:54 2022-08-18 20:26:24 0:14:30 0:07:08 0:07:22 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi172 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:9a61d24e26c1e6b0d28ad5d43fff516833b21e89 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8b656a04-1f33-11ed-8431-001a4aab830c -- ceph mon dump -f json'

dead 6979085 2022-08-18 17:43:03 2022-08-18 20:13:15 2022-08-19 08:22:18 12:09:03 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

pass 6979086 2022-08-18 17:43:04 2022-08-18 20:13:45 2022-08-18 20:34:00 0:20:15 0:13:26 0:06:49 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 6979087 2022-08-18 17:43:06 2022-08-18 20:14:46 2022-08-18 20:35:56 0:21:10 0:15:13 0:05:57 smithi main rhel 8.6 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6979088 2022-08-18 17:43:07 2022-08-18 20:14:47 2022-08-18 20:47:57 0:33:10 0:26:57 0:06:13 smithi main rhel 8.6 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6979089 2022-08-18 17:43:08 2022-08-18 20:14:47 2022-08-18 20:28:25 0:13:38 0:07:46 0:05:52 smithi main ubuntu 20.04 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979090 2022-08-18 17:43:09 2022-08-18 20:15:07 2022-08-18 20:27:08 0:12:01 0:05:38 0:06:23 smithi main ubuntu 20.04 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 6979091 2022-08-18 17:43:10 2022-08-18 20:15:08 2022-08-18 20:37:07 0:21:59 0:14:14 0:07:45 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 6979092 2022-08-18 17:43:12 2022-08-18 20:15:58 2022-08-18 21:03:54 0:47:56 0:39:36 0:08:20 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

Command failed on smithi175 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

fail 6979093 2022-08-18 17:43:13 2022-08-18 20:16:49 2022-08-18 20:48:28 0:31:39 0:24:39 0:07:00 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/dashboard} 2
Failure Reason:

Test failure: test_create (tasks.mgr.dashboard.test_erasure_code_profile.ECPTest)

fail 6979094 2022-08-18 17:43:14 2022-08-18 20:17:09 2022-08-18 20:46:33 0:29:24 0:19:33 0:09:51 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

'wait for operator' reached maximum tries (90) after waiting for 900 seconds

pass 6979095 2022-08-18 17:43:15 2022-08-18 20:17:09 2022-08-18 20:38:35 0:21:26 0:15:51 0:05:35 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
fail 6979096 2022-08-18 17:43:17 2022-08-18 20:17:20 2022-08-18 21:04:10 0:46:50 0:39:43 0:07:07 smithi main rhel 8.6 rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Command failed (workunit test cls/test_cls_rgw.sh) on smithi131 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh'

pass 6979097 2022-08-18 17:43:18 2022-08-18 20:17:20 2022-08-18 22:07:28 1:50:08 1:42:49 0:07:19 smithi main ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
fail 6979098 2022-08-18 17:43:19 2022-08-18 20:18:01 2022-08-19 00:52:00 4:33:59 4:26:57 0:07:02 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

Command failed (workunit test cls/test_cls_rgw.sh) on smithi088 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh'

pass 6979099 2022-08-18 17:43:20 2022-08-18 20:18:21 2022-08-18 20:42:01 0:23:40 0:16:18 0:07:22 smithi main rhel 8.6 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6979100 2022-08-18 17:43:22 2022-08-18 20:18:52 2022-08-18 20:50:46 0:31:54 0:23:59 0:07:55 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 6979101 2022-08-18 17:43:23 2022-08-18 20:19:12 2022-08-18 20:36:05 0:16:53 0:09:32 0:07:21 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 6979102 2022-08-18 17:43:24 2022-08-18 20:19:12 2022-08-18 20:33:44 0:14:32 0:06:13 0:08:19 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6979103 2022-08-18 17:43:25 2022-08-18 20:20:23 2022-08-18 21:01:32 0:41:09 0:34:23 0:06:46 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 6979104 2022-08-18 17:43:27 2022-08-18 20:20:33 2022-08-18 20:38:27 0:17:54 0:10:15 0:07:39 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 6979105 2022-08-18 17:43:28 2022-08-18 20:20:54 2022-08-18 20:34:16 0:13:22 0:07:17 0:06:05 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979106 2022-08-18 17:43:29 2022-08-18 20:20:54 2022-08-18 20:55:07 0:34:13 0:27:10 0:07:03 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6979107 2022-08-18 17:43:30 2022-08-18 20:21:24 2022-08-18 21:27:50 1:06:26 0:59:18 0:07:08 smithi main ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
fail 6979108 2022-08-18 17:43:32 2022-08-18 20:21:45 2022-08-18 20:38:02 0:16:17 0:05:43 0:10:34 smithi main rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi086 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9a61d24e26c1e6b0d28ad5d43fff516833b21e89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 6979109 2022-08-18 17:43:33 2022-08-18 20:22:25 2022-08-18 20:41:45 0:19:20 0:12:09 0:07:11 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6979110 2022-08-18 17:43:34 2022-08-18 20:22:36 2022-08-18 21:03:16 0:40:40 0:33:27 0:07:13 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 6979111 2022-08-18 17:43:35 2022-08-18 20:23:56 2022-08-18 20:42:50 0:18:54 0:13:07 0:05:47 smithi main centos 8.stream rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 6979112 2022-08-18 17:43:37 2022-08-18 20:23:57 2022-08-18 21:09:32 0:45:35 0:38:51 0:06:44 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6979113 2022-08-18 17:43:38 2022-08-18 20:24:17 2022-08-18 21:01:30 0:37:13 0:28:24 0:08:49 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6979114 2022-08-18 17:43:39 2022-08-18 20:26:28 2022-08-18 20:44:36 0:18:08 0:11:14 0:06:54 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979115 2022-08-18 17:43:40 2022-08-18 20:26:28 2022-08-18 21:41:53 1:15:25 1:09:23 0:06:02 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} 1
pass 6979116 2022-08-18 17:43:41 2022-08-18 20:26:29 2022-08-18 20:46:09 0:19:40 0:12:20 0:07:20 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 6979117 2022-08-18 17:43:42 2022-08-18 20:27:09 2022-08-18 20:41:23 0:14:14 0:07:23 0:06:51 smithi main centos 8.stream rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6979118 2022-08-18 17:43:44 2022-08-18 20:28:30 2022-08-18 21:00:49 0:32:19 0:24:29 0:07:50 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6979119 2022-08-18 17:43:45 2022-08-18 20:29:20 2022-08-18 22:08:31 1:39:11 1:31:25 0:07:46 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 6979120 2022-08-18 17:43:46 2022-08-18 20:29:31 2022-08-18 20:56:50 0:27:19 0:19:55 0:07:24 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6979121 2022-08-18 17:43:47 2022-08-18 20:29:51 2022-08-18 21:57:51 1:28:00 1:20:57 0:07:03 smithi main rhel 8.6 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 6979122 2022-08-18 17:43:49 2022-08-18 20:29:52 2022-08-18 20:49:55 0:20:03 0:12:59 0:07:04 smithi main rhel 8.6 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6979123 2022-08-18 17:43:50 2022-08-18 20:31:02 2022-08-18 20:47:03 0:16:01 0:07:59 0:08:02 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6979124 2022-08-18 17:43:51 2022-08-18 20:31:03 2022-08-18 20:52:05 0:21:02 0:11:48 0:09:14 smithi main centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 6979125 2022-08-18 17:43:52 2022-08-18 20:32:23 2022-08-18 20:55:22 0:22:59 0:15:26 0:07:33 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 6979126 2022-08-18 17:43:53 2022-08-18 20:34:04 2022-08-18 20:55:22 0:21:18 0:14:21 0:06:57 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 6979127 2022-08-18 17:43:55 2022-08-18 20:34:24 2022-08-18 20:55:13 0:20:49 0:12:22 0:08:27 smithi main centos 8.stream rados/cephadm/workunits/{agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 6979128 2022-08-18 17:43:56 2022-08-18 20:36:05 2022-08-18 20:55:19 0:19:14 0:11:14 0:08:00 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6979129 2022-08-18 17:43:57 2022-08-18 20:38:06 2022-08-18 20:55:17 0:17:11 0:10:39 0:06:32 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 6979130 2022-08-18 17:43:58 2022-08-18 20:38:16 2022-08-18 21:50:06 1:11:50 1:04:49 0:07:01 smithi main ubuntu 20.04 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979131 2022-08-18 17:44:00 2022-08-18 20:38:37 2022-08-18 21:39:49 1:01:12 0:54:10 0:07:02 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 6979132 2022-08-18 17:44:01 2022-08-18 20:38:37 2022-08-18 20:50:41 0:12:04 0:05:12 0:06:52 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979133 2022-08-18 17:44:02 2022-08-18 20:39:27 2022-08-18 21:11:39 0:32:12 0:24:31 0:07:41 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6979134 2022-08-18 17:44:03 2022-08-18 20:40:08 2022-08-18 20:59:06 0:18:58 0:10:39 0:08:19 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6979135 2022-08-18 17:44:05 2022-08-18 20:41:49 2022-08-18 21:05:06 0:23:17 0:16:46 0:06:31 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 6979136 2022-08-18 17:44:06 2022-08-18 20:42:09 2022-08-18 20:59:28 0:17:19 0:10:58 0:06:21 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6979137 2022-08-18 17:44:07 2022-08-18 20:42:10 2022-08-18 20:56:18 0:14:08 0:06:20 0:07:48 smithi main ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979138 2022-08-18 17:44:08 2022-08-18 20:43:00 2022-08-18 21:19:24 0:36:24 0:27:58 0:08:26 smithi main rhel 8.6 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6979139 2022-08-18 17:44:10 2022-08-18 20:44:01 2022-08-18 20:59:32 0:15:31 0:08:45 0:06:46 smithi main centos 8.stream rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6979140 2022-08-18 17:44:11 2022-08-18 20:44:01 2022-08-18 20:59:26 0:15:25 0:06:49 0:08:36 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 6979141 2022-08-18 17:44:12 2022-08-18 20:45:22 2022-08-18 21:11:21 0:25:59 0:19:26 0:06:33 smithi main rhel 8.6 rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6979142 2022-08-18 17:44:13 2022-08-18 20:46:12 2022-08-18 21:22:08 0:35:56 0:28:13 0:07:43 smithi main rhel 8.6 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 6979143 2022-08-18 17:44:15 2022-08-18 20:46:42 2022-08-18 21:11:05 0:24:23 0:17:18 0:07:05 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 6979144 2022-08-18 17:44:16 2022-08-18 20:47:23 2022-08-18 21:03:22 0:15:59 0:07:58 0:08:01 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6979145 2022-08-18 17:44:17 2022-08-18 20:48:04 2022-08-18 21:06:57 0:18:53 0:11:31 0:07:22 smithi main centos 8.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
fail 6979146 2022-08-18 17:44:18 2022-08-18 20:48:04 2022-08-18 21:04:25 0:16:21 0:04:46 0:11:35 smithi main rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9a61d24e26c1e6b0d28ad5d43fff516833b21e89

pass 6979147 2022-08-18 17:44:19 2022-08-18 20:48:34 2022-08-18 21:07:29 0:18:55 0:12:36 0:06:19 smithi main rhel 8.6 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6979148 2022-08-18 17:44:21 2022-08-18 20:48:35 2022-08-19 01:31:48 4:43:13 4:34:49 0:08:24 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} 1
fail 6979149 2022-08-18 17:44:22 2022-08-18 20:50:05 2022-08-18 21:15:36 0:25:31 0:18:26 0:07:05 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
Failure Reason:

expected valgrind issues and found none

pass 6979150 2022-08-18 17:44:23 2022-08-18 20:50:46 2022-08-18 21:20:29 0:29:43 0:21:58 0:07:45 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6979151 2022-08-18 17:44:24 2022-08-18 20:50:56 2022-08-18 21:13:38 0:22:42 0:14:34 0:08:08 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
pass 6979152 2022-08-18 17:44:25 2022-08-18 20:52:07 2022-08-18 21:14:20 0:22:13 0:13:14 0:08:59 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 6979153 2022-08-18 17:44:27 2022-08-18 20:56:04 2022-08-18 21:19:22 0:23:18 0:16:38 0:06:40 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
pass 6979154 2022-08-18 17:44:28 2022-08-18 20:56:05 2022-08-18 21:15:05 0:19:00 0:12:07 0:06:53 smithi main centos 8.stream rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6979155 2022-08-18 17:44:29 2022-08-18 20:56:05 2022-08-18 21:29:42 0:33:37 0:24:17 0:09:20 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6979156 2022-08-18 17:44:30 2022-08-18 20:56:05 2022-08-18 21:11:06 0:15:01 0:08:03 0:06:58 smithi main centos 8.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 6979157 2022-08-18 17:44:31 2022-08-18 20:56:06 2022-08-18 21:09:06 0:13:00 0:06:16 0:06:44 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6979158 2022-08-18 17:44:33 2022-08-18 20:56:06 2022-08-18 21:13:41 0:17:35 0:11:22 0:06:13 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4