Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6243921 2021-06-29 21:27:32 2021-06-29 22:58:44 2021-06-29 23:49:52 0:51:08 0:40:41 0:10:27 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 6243922 2021-06-29 21:27:33 2021-06-29 22:58:44 2021-06-29 23:29:14 0:30:30 0:16:42 0:13:48 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6243923 2021-06-29 21:27:34 2021-06-29 22:58:45 2021-06-29 23:53:49 0:55:04 0:48:14 0:06:50 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} 2
pass 6243924 2021-06-29 21:27:35 2021-06-29 22:58:45 2021-06-29 23:38:22 0:39:37 0:27:23 0:12:14 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6243925 2021-06-29 21:27:36 2021-06-29 22:58:45 2021-06-29 23:44:02 0:45:17 0:30:36 0:14:41 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 6243926 2021-06-29 21:27:37 2021-06-29 22:58:45 2021-06-29 23:39:22 0:40:37 0:29:58 0:10:39 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/cache-snaps-balanced} 2
pass 6243927 2021-06-29 21:27:39 2021-06-29 22:58:46 2021-06-30 02:00:06 3:01:20 2:52:16 0:09:04 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 6243928 2021-06-29 21:27:40 2021-06-29 22:58:47 2021-06-29 23:29:32 0:30:45 0:24:32 0:06:13 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} 2
fail 6243929 2021-06-29 21:27:41 2021-06-29 22:58:47 2021-06-29 23:42:34 0:43:47 0:34:29 0:09:18 smithi master rhel 8.4 rados/dashboard/{debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi084 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ca793ee05bdda4c7cabcaf14102c9c219338779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6243930 2021-06-29 21:27:43 2021-06-29 22:58:48 2021-06-29 23:40:05 0:41:17 0:28:15 0:13:02 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-snaps} 2
pass 6243931 2021-06-29 21:27:44 2021-06-29 22:58:48 2021-06-29 23:30:18 0:31:30 0:21:06 0:10:24 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} 2
pass 6243932 2021-06-29 21:27:46 2021-06-29 22:58:48 2021-06-29 23:27:56 0:29:08 0:14:58 0:14:10 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} 2
fail 6243933 2021-06-29 21:27:47 2021-06-29 22:58:50 2021-06-29 23:33:05 0:34:15 0:21:21 0:12:54 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi124 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6243934 2021-06-29 21:27:48 2021-06-29 22:58:50 2021-06-29 23:29:55 0:31:05 0:17:30 0:13:35 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6243935 2021-06-29 21:27:49 2021-06-29 22:58:50 2021-06-29 23:26:00 0:27:10 0:12:57 0:14:13 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6243936 2021-06-29 21:27:50 2021-06-29 22:58:50 2021-06-29 23:24:56 0:26:06 0:15:40 0:10:26 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} 2
pass 6243937 2021-06-29 21:27:51 2021-06-29 22:58:51 2021-06-29 23:31:41 0:32:50 0:17:37 0:15:13 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6243938 2021-06-29 21:27:53 2021-06-29 22:58:51 2021-06-29 23:28:09 0:29:18 0:17:41 0:11:37 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} 2
pass 6243939 2021-06-29 21:27:54 2021-06-29 22:58:51 2021-06-29 23:43:06 0:44:15 0:34:01 0:10:14 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6243940 2021-06-29 21:27:55 2021-06-29 22:58:52 2021-06-30 01:01:40 2:02:48 1:52:37 0:10:11 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 6243941 2021-06-29 21:27:56 2021-06-29 22:58:52 2021-06-29 23:39:27 0:40:35 0:29:21 0:11:14 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} 1
pass 6243942 2021-06-29 21:27:57 2021-06-29 22:58:52 2021-06-29 23:43:52 0:45:00 0:30:15 0:14:45 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6243943 2021-06-29 21:27:59 2021-06-29 22:58:52 2021-06-29 23:27:28 0:28:36 0:15:28 0:13:08 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 6243944 2021-06-29 21:28:00 2021-06-29 22:58:53 2021-06-29 23:53:28 0:54:35 0:39:19 0:15:16 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 6243945 2021-06-29 21:28:01 2021-06-29 22:58:53 2021-06-29 23:50:24 0:51:31 0:39:27 0:12:04 smithi master centos 8.3 rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6243946 2021-06-29 21:28:02 2021-06-29 22:58:53 2021-06-29 23:54:28 0:55:35 0:42:51 0:12:44 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6243947 2021-06-29 21:28:03 2021-06-29 22:58:55 2021-06-29 23:39:35 0:40:40 0:29:10 0:11:30 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6243948 2021-06-29 21:28:04 2021-06-29 22:58:55 2021-06-29 23:20:50 0:21:55 0:10:18 0:11:37 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6243949 2021-06-29 21:28:06 2021-06-29 22:58:55 2021-06-29 23:43:23 0:44:28 0:31:59 0:12:29 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6243950 2021-06-29 21:28:07 2021-06-29 22:58:55 2021-06-30 00:29:59 1:31:04 1:17:26 0:13:38 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 6243951 2021-06-29 21:28:08 2021-06-29 22:58:56 2021-06-29 23:25:18 0:26:22 0:13:24 0:12:58 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
pass 6243952 2021-06-29 21:28:09 2021-06-29 22:58:57 2021-06-29 23:24:30 0:25:33 0:13:45 0:11:48 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6243953 2021-06-29 21:28:10 2021-06-29 22:58:57 2021-06-29 23:33:36 0:34:39 0:23:59 0:10:40 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect} 2
pass 6243954 2021-06-29 21:28:11 2021-06-29 22:58:59 2021-06-29 23:43:07 0:44:08 0:32:20 0:11:48 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6243955 2021-06-29 21:28:12 2021-06-29 22:59:00 2021-06-29 23:24:00 0:25:00 0:09:20 0:15:40 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} 3
Failure Reason:

ceph version 14.2.21-369.g22c2801c was not installed, found 14.2.22-0.el8.

pass 6243956 2021-06-29 21:28:13 2021-06-29 22:59:00 2021-06-29 23:32:10 0:33:10 0:19:53 0:13:17 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6243957 2021-06-29 21:28:14 2021-06-29 22:59:00 2021-06-29 23:50:57 0:51:57 0:41:15 0:10:42 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 6243958 2021-06-29 21:28:15 2021-06-29 22:59:01 2021-06-29 23:28:09 0:29:08 0:19:44 0:09:24 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 3
pass 6243959 2021-06-29 21:28:17 2021-06-29 22:59:01 2021-06-29 23:27:42 0:28:41 0:14:41 0:14:00 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6243960 2021-06-29 21:28:18 2021-06-29 22:59:02 2021-06-29 23:24:31 0:25:29 0:11:00 0:14:29 smithi master ubuntu 20.04 rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
pass 6243961 2021-06-29 21:28:19 2021-06-29 22:59:03 2021-06-29 23:33:37 0:34:34 0:27:49 0:06:45 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 6243962 2021-06-29 21:28:20 2021-06-29 22:59:04 2021-06-30 02:07:36 3:08:32 2:24:02 0:44:30 smithi master rhel 8.4 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} 1
pass 6243963 2021-06-29 21:28:21 2021-06-29 22:59:04 2021-06-29 23:38:54 0:39:50 0:29:56 0:09:54 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} 2
pass 6243964 2021-06-29 21:28:22 2021-06-29 22:59:04 2021-06-29 23:27:27 0:28:23 0:17:35 0:10:48 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/basic 3-final} 2
pass 6243965 2021-06-29 21:28:23 2021-06-29 22:59:05 2021-06-29 23:33:21 0:34:16 0:20:30 0:13:46 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 6243966 2021-06-29 21:28:24 2021-06-29 22:59:05 2021-06-29 23:28:01 0:28:56 0:19:47 0:09:09 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6243967 2021-06-29 21:28:26 2021-06-29 22:59:06 2021-06-29 23:40:52 0:41:46 0:32:47 0:08:59 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 6243968 2021-06-29 21:28:27 2021-06-29 22:59:08 2021-06-29 23:53:55 0:54:47 0:40:36 0:14:11 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6243969 2021-06-29 21:28:28 2021-06-29 22:59:09 2021-06-29 23:34:17 0:35:08 0:23:33 0:11:35 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6243970 2021-06-29 21:28:29 2021-06-29 22:59:09 2021-06-29 23:38:13 0:39:04 0:24:20 0:14:44 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 6243971 2021-06-29 21:28:30 2021-06-29 22:59:10 2021-06-29 23:51:11 0:52:01 0:42:19 0:09:42 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} 2
pass 6243972 2021-06-29 21:28:32 2021-06-29 22:59:10 2021-06-29 23:20:21 0:21:11 0:12:19 0:08:52 smithi master centos 8.stream rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 1
pass 6243973 2021-06-29 21:28:33 2021-06-29 22:59:10 2021-06-29 23:34:39 0:35:29 0:23:10 0:12:19 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/small-objects} 2
pass 6243974 2021-06-29 21:28:34 2021-06-29 22:59:10 2021-06-29 23:43:06 0:43:56 0:34:44 0:09:12 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6243975 2021-06-29 21:28:35 2021-06-29 22:59:11 2021-06-29 23:26:58 0:27:47 0:21:26 0:06:21 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/client-keyring 3-final} 2
pass 6243976 2021-06-29 21:28:36 2021-06-29 22:59:11 2021-06-29 23:43:09 0:43:58 0:32:51 0:11:07 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6243977 2021-06-29 21:28:38 2021-06-29 22:59:12 2021-06-29 23:43:26 0:44:14 0:32:30 0:11:44 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6243978 2021-06-29 21:28:39 2021-06-29 22:59:14 2021-06-29 23:26:57 0:27:43 0:14:55 0:12:48 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 6243979 2021-06-29 21:28:40 2021-06-29 22:59:14 2021-06-29 23:29:56 0:30:42 0:19:47 0:10:55 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
pass 6243980 2021-06-29 21:28:41 2021-06-29 22:59:14 2021-06-29 23:47:34 0:48:20 0:34:38 0:13:42 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6243981 2021-06-29 21:28:42 2021-06-29 22:59:14 2021-06-29 23:37:22 0:38:08 0:28:08 0:10:00 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6243982 2021-06-29 21:28:43 2021-06-29 22:59:18 2021-06-29 23:44:22 0:45:04 0:33:17 0:11:47 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 6243983 2021-06-29 21:28:44 2021-06-29 22:59:18 2021-06-29 23:29:17 0:29:59 0:21:21 0:08:38 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6243984 2021-06-29 21:28:45 2021-06-29 22:59:18 2021-06-29 23:31:27 0:32:09 0:21:10 0:10:59 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
fail 6243985 2021-06-29 21:28:46 2021-06-29 22:59:29 2021-06-29 23:22:31 0:23:02 0:12:31 0:10:31 smithi master centos 8.3 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi132 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ca793ee05bdda4c7cabcaf14102c9c219338779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

pass 6243986 2021-06-29 21:28:47 2021-06-29 22:59:29 2021-06-29 23:25:41 0:26:12 0:16:52 0:09:20 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6243987 2021-06-29 21:28:48 2021-06-29 22:59:39 2021-06-29 23:59:56 1:00:17 0:48:15 0:12:02 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6243988 2021-06-29 21:28:49 2021-06-29 22:59:40 2021-06-29 23:32:43 0:33:03 0:20:19 0:12:44 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} 2
pass 6243989 2021-06-29 21:28:50 2021-06-29 22:59:40 2021-06-29 23:48:31 0:48:51 0:36:38 0:12:13 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6243990 2021-06-29 21:28:51 2021-06-29 22:59:40 2021-06-29 23:50:57 0:51:17 0:24:02 0:27:15 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 6243991 2021-06-29 21:28:52 2021-06-29 23:20:01 2021-06-29 23:46:45 0:26:44 0:18:43 0:08:01 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6243992 2021-06-29 21:28:53 2021-06-29 23:20:01 2021-06-29 23:48:49 0:28:48 0:22:06 0:06:42 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
fail 6243993 2021-06-29 21:28:55 2021-06-29 23:20:02 2021-06-29 23:40:49 0:20:47 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

Could not reconnect to ubuntu@smithi072.front.sepia.ceph.com

pass 6243994 2021-06-29 21:28:55 2021-06-29 23:20:02 2021-06-30 01:16:56 1:56:54 1:49:22 0:07:32 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/scrub} 1
pass 6243995 2021-06-29 21:28:56 2021-06-29 23:20:02 2021-06-29 23:58:51 0:38:49 0:29:55 0:08:54 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6243996 2021-06-29 21:28:57 2021-06-29 23:20:03 2021-06-30 00:51:11 1:31:08 1:21:28 0:09:40 smithi master centos 8.3 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 2
pass 6243997 2021-06-29 21:28:58 2021-06-29 23:20:03 2021-06-29 23:59:13 0:39:10 0:29:24 0:09:46 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6243998 2021-06-29 21:29:00 2021-06-29 23:20:03 2021-06-29 23:53:18 0:33:15 0:22:07 0:11:08 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 6243999 2021-06-29 21:29:01 2021-06-29 23:20:04 2021-06-29 23:55:04 0:35:00 0:25:07 0:09:53 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244000 2021-06-29 21:29:02 2021-06-29 23:20:04 2021-06-30 00:17:36 0:57:32 0:46:17 0:11:15 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244001 2021-06-29 21:29:03 2021-06-29 23:20:05 2021-06-29 23:57:27 0:37:22 0:28:07 0:09:15 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} 1
pass 6244002 2021-06-29 21:29:04 2021-06-29 23:20:05 2021-06-29 23:36:18 0:16:13 0:07:45 0:08:28 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
pass 6244003 2021-06-29 21:29:05 2021-06-29 23:20:06 2021-06-29 23:37:28 0:17:22 0:07:34 0:09:48 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244004 2021-06-29 21:29:06 2021-06-29 23:20:06 2021-06-29 23:39:46 0:19:40 0:10:00 0:09:40 smithi master ubuntu 20.04 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 6244005 2021-06-29 21:29:07 2021-06-29 23:20:16 2021-06-30 00:04:25 0:44:09 0:32:02 0:12:07 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6244006 2021-06-29 21:29:08 2021-06-29 23:20:57 2021-06-30 00:03:45 0:42:48 0:35:02 0:07:46 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 6244007 2021-06-29 21:29:09 2021-06-29 23:21:47 2021-06-30 01:59:42 2:37:55 2:27:59 0:09:56 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} 2
pass 6244008 2021-06-29 21:29:10 2021-06-29 23:22:37 2021-06-29 23:49:19 0:26:42 0:14:52 0:11:50 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} 2
pass 6244009 2021-06-29 21:29:11 2021-06-29 23:24:08 2021-06-29 23:57:43 0:33:35 0:24:02 0:09:33 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 6244010 2021-06-29 21:29:12 2021-06-29 23:24:38 2021-06-30 00:09:41 0:45:03 0:35:09 0:09:54 smithi master centos 8.3 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 2
pass 6244011 2021-06-29 21:29:13 2021-06-29 23:24:39 2021-06-29 23:46:03 0:21:24 0:12:09 0:09:15 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 6244012 2021-06-29 21:29:14 2021-06-29 23:24:59 2021-06-29 23:51:17 0:26:18 0:18:43 0:07:35 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 6244013 2021-06-29 21:29:16 2021-06-29 23:25:49 2021-06-29 23:52:05 0:26:16 0:15:23 0:10:53 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/mirror 3-final} 2
pass 6244014 2021-06-29 21:29:17 2021-06-29 23:27:00 2021-06-29 23:53:15 0:26:15 0:12:54 0:13:21 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244015 2021-06-29 21:29:18 2021-06-29 23:27:30 2021-06-29 23:51:47 0:24:17 0:13:16 0:11:01 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 2
pass 6244016 2021-06-29 21:29:19 2021-06-29 23:27:31 2021-06-29 23:55:25 0:27:54 0:16:19 0:11:35 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} 2
pass 6244017 2021-06-29 21:29:20 2021-06-29 23:27:51 2021-06-30 00:15:01 0:47:10 0:36:04 0:11:06 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6244018 2021-06-29 21:29:22 2021-06-29 23:28:01 2021-06-30 00:05:07 0:37:06 0:31:05 0:06:01 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6244019 2021-06-29 21:29:23 2021-06-29 23:28:02 2021-06-29 23:47:50 0:19:48 0:10:21 0:09:27 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6244020 2021-06-29 21:29:24 2021-06-29 23:28:12 2021-06-30 00:19:20 0:51:08 0:41:38 0:09:30 smithi master centos 8.3 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6244021 2021-06-29 21:29:25 2021-06-29 23:28:12 2021-06-29 23:57:53 0:29:41 0:17:44 0:11:57 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} 3
pass 6244022 2021-06-29 21:29:26 2021-06-29 23:28:13 2021-06-29 23:58:29 0:30:16 0:22:17 0:07:59 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs-ingress 3-final} 2
pass 6244023 2021-06-29 21:29:27 2021-06-29 23:29:23 2021-06-30 00:18:31 0:49:08 0:40:18 0:08:50 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 6244024 2021-06-29 21:29:28 2021-06-29 23:29:24 2021-06-30 00:20:38 0:51:14 0:45:26 0:05:48 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6244025 2021-06-29 21:29:29 2021-06-29 23:29:25 2021-06-30 00:00:23 0:30:58 0:20:45 0:10:13 smithi master centos 8.stream rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} 2
pass 6244026 2021-06-29 21:29:30 2021-06-29 23:29:36 2021-06-29 23:57:22 0:27:46 0:16:52 0:10:54 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6244027 2021-06-29 21:29:31 2021-06-29 23:29:57 2021-06-30 00:15:32 0:45:35 0:35:05 0:10:30 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/module_selftest} 2
pass 6244028 2021-06-29 21:29:32 2021-06-29 23:30:28 2021-06-30 01:21:01 1:50:33 1:38:21 0:12:12 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/radosbench} 2
pass 6244029 2021-06-29 21:29:33 2021-06-29 23:31:29 2021-06-30 00:06:38 0:35:09 0:24:50 0:10:19 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
pass 6244030 2021-06-29 21:29:34 2021-06-29 23:31:30 2021-06-29 23:57:03 0:25:33 0:14:23 0:11:10 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 6244031 2021-06-29 21:29:36 2021-06-29 23:31:51 2021-06-29 23:51:06 0:19:15 0:10:44 0:08:31 smithi master centos 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244032 2021-06-29 21:29:37 2021-06-29 23:32:11 2021-06-30 00:00:07 0:27:56 0:17:34 0:10:22 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 6244033 2021-06-29 21:29:38 2021-06-29 23:32:52 2021-06-30 00:02:55 0:30:03 0:19:18 0:10:45 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final} 2
pass 6244034 2021-06-29 21:29:39 2021-06-29 23:33:12 2021-06-30 00:00:18 0:27:06 0:16:42 0:10:24 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 6244035 2021-06-29 21:29:40 2021-06-29 23:33:23 2021-06-30 00:02:47 0:29:24 0:18:48 0:10:36 smithi master ubuntu 20.04 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 2
pass 6244036 2021-06-29 21:29:41 2021-06-29 23:33:43 2021-06-30 00:04:39 0:30:56 0:24:05 0:06:51 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 6244037 2021-06-29 21:29:42 2021-06-29 23:33:44 2021-06-30 00:15:29 0:41:45 0:31:42 0:10:03 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6244038 2021-06-29 21:29:43 2021-06-29 23:34:25 2021-06-30 00:07:59 0:33:34 0:23:19 0:10:15 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 6244039 2021-06-29 21:29:44 2021-06-29 23:34:25 2021-06-30 00:00:26 0:26:01 0:15:00 0:11:01 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/nfs 3-final} 2
pass 6244040 2021-06-29 21:29:45 2021-06-29 23:34:45 2021-06-30 00:09:44 0:34:59 0:27:58 0:07:01 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 6244041 2021-06-29 21:29:46 2021-06-29 23:34:46 2021-06-30 01:12:54 1:38:08 1:29:44 0:08:24 smithi master rhel 8.4 rados/dashboard/{debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/dashboard} 2
fail 6244042 2021-06-29 21:29:47 2021-06-29 23:37:26 2021-06-29 23:54:19 0:16:53 0:08:11 0:08:42 smithi master ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2021-06-29T23:51:20.796483+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6244043 2021-06-29 21:29:48 2021-06-29 23:37:27 2021-06-30 00:00:43 0:23:16 0:17:26 0:05:50 smithi master rhel 8.4 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
pass 6244044 2021-06-29 21:29:49 2021-06-29 23:37:37 2021-06-30 00:03:20 0:25:43 0:16:42 0:09:01 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6244045 2021-06-29 21:29:50 2021-06-29 23:38:18 2021-06-30 00:00:49 0:22:31 0:14:50 0:07:41 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/c2c} 1
pass 6244046 2021-06-29 21:29:51 2021-06-29 23:38:18 2021-06-30 01:16:05 1:37:47 1:26:00 0:11:47 smithi master ubuntu 20.04 rados/upgrade/parallel/{0-start 1-tasks distro1$/{ubuntu_20.04} mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6244047 2021-06-29 21:29:52 2021-06-29 23:38:29 2021-06-30 00:08:04 0:29:35 0:21:08 0:08:27 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6244048 2021-06-29 21:29:53 2021-06-29 23:38:59 2021-06-30 00:14:27 0:35:28 0:24:14 0:11:14 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 6244049 2021-06-29 21:29:54 2021-06-29 23:39:30 2021-06-30 00:18:49 0:39:19 0:28:18 0:11:01 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244050 2021-06-29 21:29:55 2021-06-29 23:39:30 2021-06-30 00:00:34 0:21:04 0:11:17 0:09:47 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/scrub_test} 2
pass 6244051 2021-06-29 21:29:56 2021-06-29 23:39:41 2021-06-30 00:06:57 0:27:16 0:17:31 0:09:45 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_kubic_stable} 2-node-mgr orchestrator_cli} 2
pass 6244052 2021-06-29 21:29:57 2021-06-29 23:39:53 2021-06-30 00:02:38 0:22:45 0:16:09 0:06:36 smithi master rhel 8.4 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6244053 2021-06-29 21:29:58 2021-06-29 23:39:53 2021-06-29 23:59:08 0:19:15 0:10:12 0:09:03 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6244054 2021-06-29 21:29:59 2021-06-29 23:39:54 2021-06-30 00:25:28 0:45:34 0:34:21 0:11:13 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6244055 2021-06-29 21:30:00 2021-06-29 23:40:15 2021-06-30 00:03:50 0:23:35 0:16:28 0:07:07 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 6244056 2021-06-29 21:30:01 2021-06-29 23:40:55 2021-06-30 00:12:58 0:32:03 0:13:12 0:18:51 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6244057 2021-06-29 21:30:02 2021-06-29 23:42:36 2021-06-30 00:22:23 0:39:47 0:29:01 0:10:46 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6244058 2021-06-29 21:30:03 2021-06-29 23:43:07 2021-06-30 00:04:17 0:21:10 0:11:32 0:09:38 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} 2
pass 6244059 2021-06-29 21:30:04 2021-06-29 23:43:08 2021-06-30 00:08:53 0:25:45 0:15:40 0:10:05 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/classic start} 2
pass 6244060 2021-06-29 21:30:05 2021-06-29 23:43:09 2021-06-30 00:16:27 0:33:18 0:23:51 0:09:27 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6244061 2021-06-29 21:30:08 2021-06-29 23:43:20 2021-06-30 00:29:08 0:45:48 0:39:07 0:06:41 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 6244062 2021-06-29 21:30:09 2021-06-29 23:43:30 2021-06-30 00:11:34 0:28:04 0:15:16 0:12:48 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} 3
pass 6244063 2021-06-29 21:30:10 2021-06-29 23:44:01 2021-06-30 00:11:42 0:27:41 0:20:44 0:06:57 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244064 2021-06-29 21:30:11 2021-06-29 23:44:31 2021-06-30 00:06:10 0:21:39 0:11:56 0:09:43 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 6244065 2021-06-29 21:30:12 2021-06-29 23:44:32 2021-06-30 00:13:23 0:28:51 0:16:53 0:11:58 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6244066 2021-06-29 21:30:13 2021-06-29 23:46:12 2021-06-30 00:03:37 0:17:25 0:08:51 0:08:34 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244067 2021-06-29 21:30:14 2021-06-29 23:46:13 2021-06-30 00:08:32 0:22:19 0:11:46 0:10:33 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/force-sync-many workloads/rados_5925} 2
pass 6244068 2021-06-29 21:30:15 2021-06-29 23:47:43 2021-06-30 00:05:09 0:17:26 0:07:14 0:10:12 smithi master ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244069 2021-06-29 21:30:16 2021-06-29 23:47:44 2021-06-30 00:19:57 0:32:13 0:21:47 0:10:26 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6244070 2021-06-29 21:30:17 2021-06-29 23:48:34 2021-06-30 00:23:52 0:35:18 0:25:08 0:10:10 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6244071 2021-06-29 21:30:18 2021-06-29 23:48:55 2021-06-30 00:30:18 0:41:23 0:31:18 0:10:05 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
pass 6244072 2021-06-29 21:30:19 2021-06-29 23:48:55 2021-06-30 00:31:13 0:42:18 0:30:29 0:11:49 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6244073 2021-06-29 21:30:20 2021-06-29 23:49:27 2021-06-30 00:31:03 0:41:36 0:35:10 0:06:26 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 6244074 2021-06-29 21:30:21 2021-06-29 23:49:57 2021-06-30 00:19:46 0:29:49 0:18:35 0:11:14 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 6244075 2021-06-29 21:30:22 2021-06-29 23:50:58 2021-06-30 00:24:07 0:33:09 0:23:59 0:09:10 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} 2
pass 6244076 2021-06-29 21:30:23 2021-06-29 23:50:59 2021-06-30 00:09:56 0:18:57 0:10:43 0:08:14 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
pass 6244077 2021-06-29 21:30:24 2021-06-29 23:51:00 2021-06-30 00:26:45 0:35:45 0:26:18 0:09:27 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6244078 2021-06-29 21:30:25 2021-06-29 23:51:20 2021-06-30 00:08:22 0:17:02 0:08:12 0:08:50 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244079 2021-06-29 21:30:26 2021-06-29 23:51:21 2021-06-30 00:24:00 0:32:39 0:24:19 0:08:20 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 6244080 2021-06-29 21:30:27 2021-06-29 23:51:21 2021-06-30 00:39:45 0:48:24 0:36:23 0:12:01 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6244081 2021-06-29 21:30:28 2021-06-29 23:51:51 2021-06-30 00:11:20 0:19:29 0:09:54 0:09:35 smithi master centos 8.3 rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6244082 2021-06-29 21:30:29 2021-06-29 23:52:12 2021-06-30 00:26:27 0:34:15 0:22:16 0:11:59 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244083 2021-06-29 21:30:30 2021-06-29 23:53:22 2021-06-30 00:20:26 0:27:04 0:19:54 0:07:10 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs2 3-final} 2
pass 6244084 2021-06-29 21:30:32 2021-06-29 23:53:23 2021-06-30 00:31:06 0:37:43 0:30:26 0:07:17 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 6244085 2021-06-29 21:30:33 2021-06-29 23:53:23 2021-06-30 00:44:55 0:51:32 0:40:15 0:11:17 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 3
pass 6244086 2021-06-29 21:30:34 2021-06-29 23:53:33 2021-06-30 00:13:07 0:19:34 0:11:05 0:08:29 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6244087 2021-06-29 21:30:35 2021-06-29 23:53:55 2021-06-30 00:17:20 0:23:25 0:12:11 0:11:14 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 6244088 2021-06-29 21:30:36 2021-06-29 23:54:05 2021-06-30 00:21:37 0:27:32 0:17:30 0:10:02 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
pass 6244089 2021-06-29 21:30:37 2021-06-29 23:54:26 2021-06-30 00:44:58 0:50:32 0:38:55 0:11:37 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6244090 2021-06-29 21:30:38 2021-06-29 23:54:36 2021-06-30 00:24:01 0:29:25 0:22:13 0:07:12 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} 2
pass 6244091 2021-06-29 21:30:39 2021-06-29 23:55:06 2021-06-30 00:14:37 0:19:31 0:09:32 0:09:59 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244092 2021-06-29 21:30:40 2021-06-29 23:55:27 2021-06-30 00:12:53 0:17:26 0:08:51 0:08:35 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244093 2021-06-29 21:30:42 2021-06-29 23:55:27 2021-06-30 00:20:40 0:25:13 0:14:55 0:10:18 smithi master ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
pass 6244094 2021-06-29 21:30:43 2021-06-29 23:57:07 2021-06-30 00:22:50 0:25:43 0:14:32 0:11:11 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} 2
pass 6244095 2021-06-29 21:30:44 2021-06-29 23:57:29 2021-06-30 00:31:01 0:33:32 0:23:46 0:09:46 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} 2
pass 6244096 2021-06-29 21:30:45 2021-06-29 23:57:29 2021-06-30 00:41:05 0:43:36 0:36:58 0:06:38 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6244097 2021-06-29 21:30:46 2021-06-29 23:57:50 2021-06-30 00:25:44 0:27:54 0:16:41 0:11:13 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6244098 2021-06-29 21:30:47 2021-06-29 23:58:00 2021-06-30 00:41:11 0:43:11 0:37:33 0:05:38 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244099 2021-06-29 21:30:48 2021-06-29 23:58:01 2021-06-30 00:37:39 0:39:38 0:28:19 0:11:19 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
pass 6244100 2021-06-29 21:30:49 2021-06-29 23:58:31 2021-06-30 00:18:36 0:20:05 0:07:38 0:12:27 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 6244101 2021-06-29 21:30:50 2021-06-29 23:59:12 2021-06-30 00:49:12 0:50:00 0:37:36 0:12:24 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6244102 2021-06-29 21:30:51 2021-06-30 00:00:02 2021-06-30 00:23:05 0:23:03 0:13:56 0:09:07 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} 1
pass 6244103 2021-06-29 21:30:52 2021-06-30 00:00:03 2021-06-30 01:13:48 1:13:45 1:04:13 0:09:32 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6244104 2021-06-29 21:30:53 2021-06-30 00:00:13 2021-06-30 00:41:17 0:41:04 0:31:02 0:10:02 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} 2
pass 6244105 2021-06-29 21:30:54 2021-06-30 00:00:24 2021-06-30 00:27:25 0:27:01 0:17:54 0:09:07 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/rgw 3-final} 2
pass 6244106 2021-06-29 21:30:55 2021-06-30 00:00:24 2021-06-30 00:19:32 0:19:08 0:09:56 0:09:12 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6244107 2021-06-29 21:30:56 2021-06-30 00:00:35 2021-06-30 00:21:08 0:20:33 0:11:48 0:08:45 smithi master centos 8.3 rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6244108 2021-06-29 21:30:57 2021-06-30 00:00:35 2021-06-30 01:52:20 1:51:45 1:40:12 0:11:33 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 6244109 2021-06-29 21:30:59 2021-06-30 00:00:37 2021-06-30 00:32:10 0:31:33 0:20:47 0:10:46 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect} 2
pass 6244110 2021-06-29 21:31:00 2021-06-30 00:00:57 2021-06-30 00:28:22 0:27:25 0:13:28 0:13:57 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244111 2021-06-29 21:31:01 2021-06-30 00:02:59 2021-06-30 00:30:35 0:27:36 0:20:53 0:06:43 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6244112 2021-06-29 21:31:02 2021-06-30 00:03:29 2021-06-30 00:45:27 0:41:58 0:31:42 0:10:16 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} 2
pass 6244113 2021-06-29 21:31:03 2021-06-30 00:03:50 2021-06-30 00:28:59 0:25:09 0:16:03 0:09:06 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 6244114 2021-06-29 21:31:04 2021-06-30 00:04:01 2021-06-30 00:35:51 0:31:50 0:20:34 0:11:16 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 6244115 2021-06-29 21:31:05 2021-06-30 00:04:22 2021-06-30 00:31:47 0:27:25 0:19:49 0:07:36 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/basic 3-final} 2
pass 6244116 2021-06-29 21:31:06 2021-06-30 00:04:33 2021-06-30 00:29:40 0:25:07 0:15:36 0:09:31 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 6244117 2021-06-29 21:31:07 2021-06-30 00:04:34 2021-06-30 00:33:55 0:29:21 0:22:03 0:07:18 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 6244118 2021-06-29 21:31:08 2021-06-30 00:04:44 2021-06-30 00:32:22 0:27:38 0:17:47 0:09:51 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 6244119 2021-06-29 21:31:09 2021-06-30 00:05:15 2021-06-30 00:25:38 0:20:23 0:11:03 0:09:20 smithi master centos 8.3 rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6244120 2021-06-29 21:31:10 2021-06-30 00:05:15 2021-06-30 00:25:34 0:20:19 0:09:12 0:11:07 smithi master centos 8.3 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244121 2021-06-29 21:31:11 2021-06-30 00:06:16 2021-06-30 00:28:13 0:21:57 0:12:45 0:09:12 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6244122 2021-06-29 21:31:12 2021-06-30 00:06:46 2021-06-30 00:54:29 0:47:43 0:36:37 0:11:06 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6244123 2021-06-29 21:31:13 2021-06-30 00:07:17 2021-06-30 00:39:15 0:31:58 0:20:24 0:11:34 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6244124 2021-06-29 21:31:14 2021-06-30 00:08:07 2021-06-30 00:41:59 0:33:52 0:23:49 0:10:03 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 6244125 2021-06-29 21:31:15 2021-06-30 00:08:37 2021-06-30 00:58:17 0:49:40 0:38:15 0:11:25 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6244126 2021-06-29 21:31:16 2021-06-30 00:08:38 2021-06-30 00:46:30 0:37:52 0:27:18 0:10:34 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
pass 6244127 2021-06-29 21:31:17 2021-06-30 00:08:58 2021-06-30 00:45:02 0:36:04 0:24:15 0:11:49 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6244128 2021-06-29 21:31:18 2021-06-30 00:09:49 2021-06-30 00:43:08 0:33:19 0:24:03 0:09:16 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 6244129 2021-06-29 21:31:19 2021-06-30 00:09:49 2021-06-30 00:27:03 0:17:14 0:07:42 0:09:32 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
pass 6244130 2021-06-29 21:31:20 2021-06-30 00:10:00 2021-06-30 00:54:44 0:44:44 0:37:20 0:07:24 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6244131 2021-06-29 21:31:21 2021-06-30 00:11:40 2021-06-30 01:16:49 1:05:09 0:55:53 0:09:16 smithi master centos 8.3 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6244132 2021-06-29 21:31:22 2021-06-30 00:11:41 2021-06-30 00:30:44 0:19:03 0:09:41 0:09:22 smithi master centos 8.3 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6244133 2021-06-29 21:31:23 2021-06-30 00:11:41 2021-06-30 00:53:18 0:41:37 0:35:36 0:06:01 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6244134 2021-06-29 21:31:24 2021-06-30 00:11:53 2021-06-30 00:52:39 0:40:46 0:35:18 0:05:28 smithi master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6244135 2021-06-29 21:31:26 2021-06-30 00:11:54 2021-06-30 00:30:18 0:18:24 0:07:16 0:11:08 smithi master ubuntu 20.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 6244136 2021-06-29 21:31:27 2021-06-30 00:12:54 2021-06-30 00:48:37 0:35:43 0:25:03 0:10:40 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 6244137 2021-06-29 21:31:28 2021-06-30 00:13:04 2021-06-30 00:45:20 0:32:16 0:15:55 0:16:21 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6244138 2021-06-29 21:31:29 2021-06-30 00:13:15 2021-06-30 00:40:51 0:27:36 0:16:32 0:11:04 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/client-keyring 3-final} 2
pass 6244139 2021-06-29 21:31:30 2021-06-30 00:13:25 2021-06-30 00:59:32 0:46:07 0:36:08 0:09:59 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6244140 2021-06-29 21:31:31 2021-06-30 00:14:36 2021-06-30 00:36:02 0:21:26 0:15:32 0:05:54 smithi master rhel 8.4 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6244141 2021-06-29 21:31:32 2021-06-30 00:14:37 2021-06-30 01:25:42 1:11:05 1:03:40 0:07:25 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 6244142 2021-06-29 21:31:33 2021-06-30 00:14:37 2021-06-30 00:42:35 0:27:58 0:17:38 0:10:20 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6244143 2021-06-29 21:31:34 2021-06-30 00:15:08 2021-06-30 00:50:51 0:35:43 0:24:28 0:11:15 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244144 2021-06-29 21:31:35 2021-06-30 00:15:38 2021-06-30 00:34:48 0:19:10 0:10:20 0:08:50 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244145 2021-06-29 21:31:36 2021-06-30 00:15:40 2021-06-30 00:47:29 0:31:49 0:20:07 0:11:42 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} 3
pass 6244146 2021-06-29 21:31:37 2021-06-30 00:16:30 2021-06-30 00:52:48 0:36:18 0:23:10 0:13:08 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6244147 2021-06-29 21:31:38 2021-06-30 00:17:21 2021-06-30 00:41:47 0:24:26 0:12:02 0:12:24 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6244148 2021-06-29 21:31:39 2021-06-30 00:18:42 2021-06-30 00:47:47 0:29:05 0:22:01 0:07:04 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6244149 2021-06-29 21:31:41 2021-06-30 00:18:43 2021-06-30 00:54:07 0:35:24 0:25:00 0:10:24 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} 2
pass 6244150 2021-06-29 21:31:42 2021-06-30 00:18:44 2021-06-30 00:46:17 0:27:33 0:16:44 0:10:49 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/iscsi 3-final} 2
pass 6244151 2021-06-29 21:31:43 2021-06-30 00:18:55 2021-06-30 00:54:38 0:35:43 0:25:00 0:10:43 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6244152 2021-06-29 21:31:44 2021-06-30 00:19:36 2021-06-30 00:41:07 0:21:31 0:11:45 0:09:46 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6244153 2021-06-29 21:31:46 2021-06-30 00:19:56 2021-06-30 00:57:08 0:37:12 0:31:09 0:06:03 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6244154 2021-06-29 21:31:47 2021-06-30 00:20:07 2021-06-30 01:11:11 0:51:04 0:42:28 0:08:36 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 6244155 2021-06-29 21:31:48 2021-06-30 00:20:07 2021-06-30 00:43:57 0:23:50 0:12:24 0:11:26 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244156 2021-06-29 21:31:49 2021-06-30 00:20:48 2021-06-30 00:53:55 0:33:07 0:23:49 0:09:18 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
fail 6244157 2021-06-29 21:31:50 2021-06-30 00:20:48 2021-06-30 01:34:43 1:13:55 1:03:10 0:10:45 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2021-06-30T01:27:54.534029+0000 mon.a (mon.0) 5251 : cluster [ERR] Health check failed: mon a is very low on available space (MON_DISK_CRIT)" in cluster log

pass 6244158 2021-06-29 21:31:51 2021-06-30 00:21:38 2021-06-30 01:00:19 0:38:41 0:30:21 0:08:20 smithi master centos 8.stream rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6244159 2021-06-29 21:31:52 2021-06-30 00:21:39 2021-06-30 00:53:38 0:31:59 0:21:38 0:10:21 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244160 2021-06-29 21:31:53 2021-06-30 00:22:29 2021-06-30 01:02:07 0:39:38 0:28:39 0:10:59 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6244161 2021-06-29 21:31:54 2021-06-30 00:23:00 2021-06-30 00:56:58 0:33:58 0:23:21 0:10:37 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6244162 2021-06-29 21:31:55 2021-06-30 00:24:00 2021-06-30 00:42:55 0:18:55 0:09:43 0:09:12 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6244163 2021-06-29 21:31:56 2021-06-30 00:24:01 2021-06-30 01:29:08 1:05:07 0:54:55 0:10:12 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6244164 2021-06-29 21:31:57 2021-06-30 00:24:01 2021-06-30 00:49:21 0:25:20 0:14:39 0:10:41 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
pass 6244165 2021-06-29 21:31:58 2021-06-30 00:24:11 2021-06-30 00:49:12 0:25:01 0:18:09 0:06:52 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 6244166 2021-06-29 21:31:59 2021-06-30 00:24:12 2021-06-30 00:48:43 0:24:31 0:14:08 0:10:23 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} 2
pass 6244167 2021-06-29 21:32:00 2021-06-30 00:25:32 2021-06-30 00:52:57 0:27:25 0:19:56 0:07:29 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/mirror 3-final} 2
pass 6244168 2021-06-29 21:32:01 2021-06-30 00:25:43 2021-06-30 00:50:04 0:24:21 0:12:21 0:12:00 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 6244169 2021-06-29 21:32:02 2021-06-30 00:26:34 2021-06-30 01:00:23 0:33:49 0:22:36 0:11:13 smithi master centos 8.3 rados/dashboard/{debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/e2e} 2
pass 6244170 2021-06-29 21:32:03 2021-06-30 00:26:54 2021-06-30 00:55:07 0:28:13 0:16:02 0:12:11 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 6244171 2021-06-29 21:32:04 2021-06-30 00:27:15 2021-06-30 01:46:28 1:19:13 1:09:22 0:09:51 smithi master centos 8.stream rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
pass 6244172 2021-06-29 21:32:05 2021-06-30 00:27:35 2021-06-30 00:57:45 0:30:10 0:19:39 0:10:31 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} 2
pass 6244173 2021-06-29 21:32:06 2021-06-30 00:28:17 2021-06-30 01:08:10 0:39:53 0:29:52 0:10:01 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6244174 2021-06-29 21:32:07 2021-06-30 00:28:27 2021-06-30 00:46:43 0:18:16 0:10:37 0:07:39 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6244175 2021-06-29 21:32:08 2021-06-30 00:28:27 2021-06-30 01:07:49 0:39:22 0:33:08 0:06:14 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 6244176 2021-06-29 21:32:09 2021-06-30 00:29:08 2021-06-30 00:54:47 0:25:39 0:15:37 0:10:02 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6244177 2021-06-29 21:32:10 2021-06-30 00:29:18 2021-06-30 03:02:21 2:33:03 2:25:10 0:07:53 smithi master ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} 1
pass 6244178 2021-06-29 21:32:12 2021-06-30 00:29:19 2021-06-30 01:31:25 1:02:06 0:51:36 0:10:30 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6244179 2021-06-29 21:32:13 2021-06-30 00:29:49 2021-06-30 01:12:04 0:42:15 0:30:55 0:11:20 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} 3
pass 6244180 2021-06-29 21:32:14 2021-06-30 00:30:20 2021-06-30 01:11:26 0:41:06 0:32:28 0:08:38 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6244181 2021-06-29 21:32:15 2021-06-30 00:30:20 2021-06-30 00:54:00 0:23:40 0:13:15 0:10:25 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 6244182 2021-06-29 21:32:16 2021-06-30 00:30:41 2021-06-30 01:14:03 0:43:22 0:33:13 0:10:09 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 6244183 2021-06-29 21:32:17 2021-06-30 00:30:51 2021-06-30 00:49:20 0:18:29 0:07:30 0:10:59 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244184 2021-06-29 21:32:18 2021-06-30 00:31:11 2021-06-30 00:52:07 0:20:56 0:11:53 0:09:03 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6244185 2021-06-29 21:32:19 2021-06-30 00:31:12 2021-06-30 00:58:16 0:27:04 0:20:19 0:06:45 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 6244186 2021-06-29 21:32:20 2021-06-30 00:31:12 2021-06-30 01:12:40 0:41:28 0:29:46 0:11:42 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6244187 2021-06-29 21:32:21 2021-06-30 00:31:12 2021-06-30 00:54:50 0:23:38 0:12:39 0:10:59 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 6244188 2021-06-29 21:32:22 2021-06-30 00:31:23 2021-06-30 00:51:03 0:19:40 0:10:47 0:08:53 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6244189 2021-06-29 21:32:23 2021-06-30 00:31:53 2021-06-30 00:57:18 0:25:25 0:15:51 0:09:34 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 6244190 2021-06-29 21:32:24 2021-06-30 00:32:13 2021-06-30 01:07:33 0:35:20 0:25:28 0:09:52 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6244191 2021-06-29 21:32:25 2021-06-30 00:32:24 2021-06-30 00:51:00 0:18:36 0:10:56 0:07:40 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
pass 6244192 2021-06-29 21:32:26 2021-06-30 00:32:25 2021-06-30 01:15:03 0:42:38 0:35:17 0:07:21 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244193 2021-06-29 21:32:27 2021-06-30 00:34:06 2021-06-30 01:01:05 0:26:59 0:14:36 0:12:23 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 6244194 2021-06-29 21:32:28 2021-06-30 00:35:56 2021-06-30 00:59:50 0:23:54 0:16:15 0:07:39 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
fail 6244195 2021-06-29 21:32:29 2021-06-30 00:36:07 2021-06-30 01:28:38 0:52:31 0:41:36 0:10:55 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

Command failed on smithi028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 6244196 2021-06-29 21:32:30 2021-06-30 00:39:38 2021-06-30 01:02:29 0:22:51 0:13:06 0:09:45 smithi master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6244197 2021-06-29 21:32:31 2021-06-30 00:39:38 2021-06-30 01:30:10 0:50:32 0:38:16 0:12:16 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6244198 2021-06-29 21:32:32 2021-06-30 00:39:48 2021-06-30 03:18:27 2:38:39 2:27:21 0:11:18 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} 2
pass 6244199 2021-06-29 21:32:33 2021-06-30 00:41:09 2021-06-30 01:14:26 0:33:17 0:22:55 0:10:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
pass 6244200 2021-06-29 21:32:34 2021-06-30 00:41:10 2021-06-30 01:04:10 0:23:00 0:14:25 0:08:35 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/rados_python} 2
pass 6244201 2021-06-29 21:32:35 2021-06-30 00:41:21 2021-06-30 01:12:32 0:31:11 0:21:40 0:09:31 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 6244202 2021-06-29 21:32:36 2021-06-30 00:41:22 2021-06-30 01:07:00 0:25:38 0:12:35 0:13:03 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244203 2021-06-29 21:32:37 2021-06-30 00:41:53 2021-06-30 01:09:05 0:27:12 0:17:27 0:09:45 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/nfs-ingress2 3-final} 2
pass 6244204 2021-06-29 21:32:38 2021-06-30 00:42:03 2021-06-30 01:05:52 0:23:49 0:14:41 0:09:08 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244205 2021-06-29 21:32:39 2021-06-30 00:42:44 2021-06-30 01:23:57 0:41:13 0:34:42 0:06:31 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} 2
pass 6244206 2021-06-29 21:32:40 2021-06-30 00:43:05 2021-06-30 01:20:40 0:37:35 0:25:34 0:12:01 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} 2
pass 6244207 2021-06-29 21:32:41 2021-06-30 00:43:15 2021-06-30 01:25:26 0:42:11 0:31:44 0:10:27 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6244208 2021-06-29 21:32:42 2021-06-30 00:44:05 2021-06-30 01:25:26 0:41:21 0:30:04 0:11:17 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6244209 2021-06-29 21:32:43 2021-06-30 00:44:06 2021-06-30 01:10:03 0:25:57 0:19:35 0:06:22 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 6244210 2021-06-29 21:32:44 2021-06-30 00:44:56 2021-06-30 01:18:01 0:33:05 0:22:55 0:10:10 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6244211 2021-06-29 21:32:46 2021-06-30 00:44:57 2021-06-30 01:28:20 0:43:23 0:31:48 0:11:35 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6244212 2021-06-29 21:32:47 2021-06-30 00:45:07 2021-06-30 01:08:46 0:23:39 0:13:44 0:09:55 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} 2
pass 6244213 2021-06-29 21:32:48 2021-06-30 00:45:08 2021-06-30 01:23:03 0:37:55 0:26:02 0:11:53 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6244214 2021-06-29 21:32:49 2021-06-30 00:45:28 2021-06-30 01:08:32 0:23:04 0:13:29 0:09:35 smithi master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
fail 6244215 2021-06-29 21:32:50 2021-06-30 00:45:28 2021-06-30 01:16:01 0:30:33 0:15:04 0:15:29 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:1ca793ee05bdda4c7cabcaf14102c9c219338779 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14db2d9a-d940-11eb-8c1c-001a4aab830c -- ceph mon dump -f json'

pass 6244216 2021-06-29 21:32:51 2021-06-30 00:46:19 2021-06-30 01:25:48 0:39:29 0:32:29 0:07:00 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 6244217 2021-06-29 21:32:52 2021-06-30 00:46:49 2021-06-30 01:14:38 0:27:49 0:20:12 0:07:37 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs 3-final} 2
pass 6244218 2021-06-29 21:32:53 2021-06-30 00:46:50 2021-06-30 01:11:01 0:24:11 0:13:26 0:10:45 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6244219 2021-06-29 21:32:54 2021-06-30 00:47:30 2021-06-30 01:26:57 0:39:27 0:33:10 0:06:17 smithi master rhel 8.4 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} 2
pass 6244220 2021-06-29 21:32:55 2021-06-30 00:47:50 2021-06-30 01:07:02 0:19:12 0:10:54 0:08:18 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6244221 2021-06-29 21:32:56 2021-06-30 00:47:51 2021-06-30 01:13:36 0:25:45 0:16:53 0:08:52 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
pass 6244222 2021-06-29 21:32:57 2021-06-30 00:48:41 2021-06-30 01:23:57 0:35:16 0:27:59 0:07:17 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6244223 2021-06-29 21:32:58 2021-06-30 00:48:51 2021-06-30 01:24:18 0:35:27 0:24:57 0:10:30 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 6244224 2021-06-29 21:32:59 2021-06-30 00:49:22 2021-06-30 03:29:41 2:40:19 2:30:23 0:09:56 smithi master ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} 1
pass 6244225 2021-06-29 21:33:00 2021-06-30 00:49:22 2021-06-30 01:16:33 0:27:11 0:20:25 0:06:46 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6244226 2021-06-29 21:33:01 2021-06-30 00:49:23 2021-06-30 01:08:13 0:18:50 0:10:52 0:07:58 smithi master centos 8.stream rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 1
pass 6244227 2021-06-29 21:33:02 2021-06-30 00:49:24 2021-06-30 01:16:47 0:27:23 0:15:55 0:11:28 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 6244228 2021-06-29 21:33:03 2021-06-30 00:49:26 2021-06-30 01:35:17 0:45:51 0:38:20 0:07:31 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6244229 2021-06-29 21:33:04 2021-06-30 00:50:06 2021-06-30 01:18:25 0:28:19 0:16:40 0:11:39 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} 2
pass 6244230 2021-06-29 21:33:05 2021-06-30 00:50:56 2021-06-30 01:20:04 0:29:08 0:19:08 0:10:00 smithi master centos 8.3 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244231 2021-06-29 21:33:06 2021-06-30 00:50:58 2021-06-30 01:30:14 0:39:16 0:33:09 0:06:07 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 6244232 2021-06-29 21:33:07 2021-06-30 00:51:08 2021-06-30 01:42:25 0:51:17 0:40:47 0:10:30 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6244233 2021-06-29 21:33:08 2021-06-30 00:51:19 2021-06-30 01:17:44 0:26:25 0:17:43 0:08:42 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 6244234 2021-06-29 21:33:09 2021-06-30 00:52:49 2021-06-30 01:27:17 0:34:28 0:24:24 0:10:04 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244235 2021-06-29 21:33:10 2021-06-30 00:52:50 2021-06-30 01:11:50 0:19:00 0:09:18 0:09:42 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244236 2021-06-29 21:33:12 2021-06-30 00:52:50 2021-06-30 01:32:21 0:39:31 0:33:26 0:06:05 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 6244237 2021-06-29 21:33:13 2021-06-30 00:53:00 2021-06-30 01:33:02 0:40:02 0:28:41 0:11:21 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6244238 2021-06-29 21:33:14 2021-06-30 00:53:21 2021-06-30 01:16:45 0:23:24 0:13:14 0:10:10 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/cache} 2
pass 6244239 2021-06-29 21:33:15 2021-06-30 00:53:41 2021-06-30 01:33:14 0:39:33 0:29:35 0:09:58 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244240 2021-06-29 21:33:16 2021-06-30 00:54:03 2021-06-30 01:17:30 0:23:27 0:16:12 0:07:15 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6244241 2021-06-29 21:33:17 2021-06-30 00:54:14 2021-06-30 01:17:35 0:23:21 0:12:15 0:11:06 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6244242 2021-06-29 21:33:18 2021-06-30 00:54:34 2021-06-30 01:16:17 0:21:43 0:11:40 0:10:03 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} 2
pass 6244243 2021-06-29 21:33:19 2021-06-30 00:54:45 2021-06-30 01:11:43 0:16:58 0:07:35 0:09:23 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
pass 6244244 2021-06-29 21:33:20 2021-06-30 00:54:46 2021-06-30 01:16:09 0:21:23 0:12:13 0:09:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} 2
pass 6244245 2021-06-29 21:33:21 2021-06-30 00:54:56 2021-06-30 01:14:20 0:19:24 0:09:46 0:09:38 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6244246 2021-06-29 21:33:22 2021-06-30 00:54:57 2021-06-30 01:29:52 0:34:55 0:28:52 0:06:03 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} 2
pass 6244247 2021-06-29 21:33:23 2021-06-30 00:54:57 2021-06-30 01:21:17 0:26:20 0:11:05 0:15:15 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244248 2021-06-29 21:33:24 2021-06-30 00:57:08 2021-06-30 01:32:43 0:35:35 0:25:34 0:10:01 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6244249 2021-06-29 21:33:25 2021-06-30 00:57:19 2021-06-30 01:38:44 0:41:25 0:30:07 0:11:18 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} 2
pass 6244250 2021-06-29 21:33:26 2021-06-30 00:57:19 2021-06-30 01:21:10 0:23:51 0:13:23 0:10:28 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244251 2021-06-29 21:33:27 2021-06-30 00:57:50 2021-06-30 01:34:08 0:36:18 0:24:56 0:11:22 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6244252 2021-06-29 21:33:28 2021-06-30 00:58:20 2021-06-30 01:39:36 0:41:16 0:30:57 0:10:19 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6244253 2021-06-29 21:33:29 2021-06-30 00:58:21 2021-06-30 01:17:14 0:18:53 0:09:55 0:08:58 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6244254 2021-06-29 21:33:30 2021-06-30 00:58:21 2021-06-30 01:38:53 0:40:32 0:28:54 0:11:38 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 2
pass 6244255 2021-06-29 21:33:31 2021-06-30 00:59:42 2021-06-30 01:25:34 0:25:52 0:14:38 0:11:14 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6244256 2021-06-29 21:33:33 2021-06-30 00:59:52 2021-06-30 01:29:48 0:29:56 0:18:56 0:11:00 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/rgw-ingress 3-final} 2
pass 6244257 2021-06-29 21:33:34 2021-06-30 01:00:32 2021-06-30 01:42:26 0:41:54 0:30:18 0:11:36 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6244258 2021-06-29 21:33:35 2021-06-30 01:01:13 2021-06-30 02:00:52 0:59:39 0:48:44 0:10:55 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6244259 2021-06-29 21:33:36 2021-06-30 01:01:43 2021-06-30 02:25:16 1:23:33 1:17:40 0:05:53 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} 2
fail 6244260 2021-06-29 21:33:37 2021-06-30 01:02:14 2021-06-30 02:01:33 0:59:19 0:52:11 0:07:08 smithi master rhel 8.4 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2021-06-30T01:23:41.292504+0000 mon.a (mon.0) 10 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 6244261 2021-06-29 21:33:38 2021-06-30 01:02:34 2021-06-30 01:31:02 0:28:28 0:21:30 0:06:58 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw 3-final} 2
pass 6244262 2021-06-29 21:33:39 2021-06-30 01:04:15 2021-06-30 01:46:57 0:42:42 0:31:47 0:10:55 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 6244263 2021-06-29 21:33:40 2021-06-30 01:05:56 2021-06-30 01:28:38 0:22:42 0:11:33 0:11:09 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} 2
pass 6244264 2021-06-29 21:33:41 2021-06-30 01:07:06 2021-06-30 01:26:09 0:19:03 0:09:57 0:09:06 smithi master centos 8.3 rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 6244265 2021-06-29 21:33:42 2021-06-30 01:07:08 2021-06-30 01:34:36 0:27:28 0:17:10 0:10:18 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6244266 2021-06-29 21:33:43 2021-06-30 01:07:09 2021-06-30 01:36:55 0:29:46 0:22:23 0:07:23 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6244267 2021-06-29 21:33:44 2021-06-30 01:07:39 2021-06-30 01:28:45 0:21:06 0:15:24 0:05:42 smithi master rhel 8.4 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
pass 6244268 2021-06-29 21:33:45 2021-06-30 01:07:50 2021-06-30 01:32:48 0:24:58 0:13:44 0:11:14 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} 2
pass 6244269 2021-06-29 21:33:46 2021-06-30 01:08:20 2021-06-30 01:41:26 0:33:06 0:24:31 0:08:35 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
pass 6244270 2021-06-29 21:33:47 2021-06-30 01:08:21 2021-06-30 01:27:46 0:19:25 0:08:56 0:10:29 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/rados_striper} 2
pass 6244271 2021-06-29 21:33:48 2021-06-30 01:08:41 2021-06-30 01:36:44 0:28:03 0:15:41 0:12:22 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 6244272 2021-06-29 21:33:49 2021-06-30 01:08:52 2021-06-30 01:26:33 0:17:41 0:08:41 0:09:00 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244273 2021-06-29 21:33:50 2021-06-30 01:09:12 2021-06-30 03:18:31 2:09:19 1:55:55 0:13:24 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} 3
pass 6244274 2021-06-29 21:33:51 2021-06-30 01:11:04 2021-06-30 01:40:16 0:29:12 0:19:37 0:09:35 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 6244275 2021-06-29 21:33:52 2021-06-30 01:11:14 2021-06-30 01:39:12 0:27:58 0:16:10 0:11:48 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} 2
pass 6244276 2021-06-29 21:33:53 2021-06-30 01:11:45 2021-06-30 01:38:34 0:26:49 0:17:51 0:08:58 smithi master centos 8.stream rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6244277 2021-06-29 21:33:54 2021-06-30 01:11:55 2021-06-30 01:45:21 0:33:26 0:22:53 0:10:33 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 6244278 2021-06-29 21:33:56 2021-06-30 01:12:05 2021-06-30 01:59:39 0:47:34 0:36:54 0:10:40 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6244279 2021-06-29 21:33:57 2021-06-30 01:12:36 2021-06-30 01:44:05 0:31:29 0:20:17 0:11:12 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 6244280 2021-06-29 21:33:58 2021-06-30 01:12:46 2021-06-30 01:56:18 0:43:32 0:37:09 0:06:23 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6244281 2021-06-29 21:33:59 2021-06-30 01:12:57 2021-06-30 01:54:16 0:41:19 0:31:16 0:10:03 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6244282 2021-06-29 21:34:00 2021-06-30 01:12:57 2021-06-30 01:39:16 0:26:19 0:15:17 0:11:02 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/client-keyring 3-final} 2
pass 6244283 2021-06-29 21:34:01 2021-06-30 01:13:58 2021-06-30 01:50:10 0:36:12 0:24:04 0:12:08 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6244284 2021-06-29 21:34:02 2021-06-30 01:14:08 2021-06-30 02:47:21 1:33:13 1:24:00 0:09:13 smithi master centos 8.3 rados/dashboard/{debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 6244285 2021-06-29 21:34:03 2021-06-30 01:14:29 2021-06-30 01:43:54 0:29:25 0:22:38 0:06:47 smithi master rhel 8.4 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6244286 2021-06-29 21:34:04 2021-06-30 01:14:29 2021-06-30 02:52:52 1:38:23 1:26:14 0:12:09 smithi master ubuntu 20.04 rados/upgrade/parallel/{0-start 1-tasks distro1$/{ubuntu_20.04} mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6244287 2021-06-29 21:34:05 2021-06-30 01:14:39 2021-06-30 01:54:02 0:39:23 0:28:43 0:10:40 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244288 2021-06-29 21:34:06 2021-06-30 01:15:10 2021-06-30 02:06:07 0:50:57 0:41:31 0:09:26 smithi master centos 8.3 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6244289 2021-06-29 21:34:07 2021-06-30 01:15:10 2021-06-30 01:55:24 0:40:14 0:29:32 0:10:42 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
pass 6244290 2021-06-29 21:34:08 2021-06-30 01:16:10 2021-06-30 01:45:18 0:29:08 0:22:15 0:06:53 smithi master rhel 8.4 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6244291 2021-06-29 21:34:09 2021-06-30 01:16:11 2021-06-30 02:10:25 0:54:14 0:39:15 0:14:59 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6244292 2021-06-29 21:34:10 2021-06-30 01:16:21 2021-06-30 01:42:08 0:25:47 0:15:16 0:10:31 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} 2
pass 6244293 2021-06-29 21:34:11 2021-06-30 01:16:42 2021-06-30 02:23:50 1:07:08 0:56:58 0:10:10 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/valgrind} 2
pass 6244294 2021-06-29 21:34:12 2021-06-30 01:16:52 2021-06-30 01:43:38 0:26:46 0:17:35 0:09:11 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6244295 2021-06-29 21:34:13 2021-06-30 01:16:52 2021-06-30 01:42:59 0:26:07 0:11:37 0:14:30 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244296 2021-06-29 21:34:14 2021-06-30 01:17:23 2021-06-30 01:44:55 0:27:32 0:17:13 0:10:19 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/force-sync-many workloads/pool-create-delete} 2
pass 6244297 2021-06-29 21:34:15 2021-06-30 01:17:33 2021-06-30 02:30:52 1:13:19 1:07:30 0:05:49 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6244298 2021-06-29 21:34:16 2021-06-30 01:17:44 2021-06-30 03:27:17 2:09:33 1:59:17 0:10:16 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 6244299 2021-06-29 21:34:17 2021-06-30 01:17:54 2021-06-30 01:44:57 0:27:03 0:15:58 0:11:05 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/classic start} 2
pass 6244300 2021-06-29 21:34:18 2021-06-30 01:18:04 2021-06-30 01:59:44 0:41:40 0:30:56 0:10:44 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 1
pass 6244301 2021-06-29 21:34:19 2021-06-30 01:18:35 2021-06-30 02:07:15 0:48:40 0:38:02 0:10:38 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
fail 6244302 2021-06-29 21:34:20 2021-06-30 01:20:05 2021-06-30 01:51:54 0:31:49 0:23:34 0:08:15 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/insights} 2
Failure Reason:

Test failure: test_health_history (tasks.mgr.test_insights.TestInsights)

pass 6244303 2021-06-29 21:34:21 2021-06-30 01:20:46 2021-06-30 01:42:44 0:21:58 0:12:31 0:09:27 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
pass 6244304 2021-06-29 21:34:22 2021-06-30 01:21:06 2021-06-30 01:42:06 0:21:00 0:12:16 0:08:44 smithi master centos 8.2 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_kubic_stable} 1-start 2-services/basic 3-final} 1
pass 6244305 2021-06-29 21:34:23 2021-06-30 01:21:06 2021-06-30 01:40:21 0:19:15 0:09:59 0:09:16 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6244306 2021-06-29 21:34:24 2021-06-30 01:21:17 2021-06-30 01:51:04 0:29:47 0:22:03 0:07:44 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
pass 6244307 2021-06-29 21:34:25 2021-06-30 01:21:27 2021-06-30 02:04:42 0:43:15 0:34:26 0:08:49 smithi master ubuntu 20.04 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6244308 2021-06-29 21:34:26 2021-06-30 01:21:27 2021-06-30 01:56:42 0:35:15 0:22:37 0:12:38 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6244309 2021-06-29 21:34:27 2021-06-30 01:23:08 2021-06-30 02:17:05 0:53:57 0:42:52 0:11:05 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} 2
pass 6244310 2021-06-29 21:34:28 2021-06-30 01:23:59 2021-06-30 02:02:57 0:38:58 0:33:01 0:05:57 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
pass 6244311 2021-06-29 21:34:30 2021-06-30 01:23:59 2021-06-30 02:03:34 0:39:35 0:30:17 0:09:18 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6244312 2021-06-29 21:34:31 2021-06-30 01:24:20 2021-06-30 01:47:17 0:22:57 0:14:52 0:08:05 smithi master ubuntu 20.04 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} 1
pass 6244313 2021-06-29 21:34:32 2021-06-30 01:24:20 2021-06-30 02:00:51 0:36:31 0:25:03 0:11:28 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244314 2021-06-29 21:34:33 2021-06-30 01:25:32 2021-06-30 01:44:30 0:18:58 0:10:50 0:08:08 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
pass 6244315 2021-06-29 21:34:34 2021-06-30 01:25:32 2021-06-30 02:25:15 0:59:43 0:49:13 0:10:30 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} 1
pass 6244316 2021-06-29 21:34:35 2021-06-30 01:25:33 2021-06-30 02:06:44 0:41:11 0:33:43 0:07:28 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} 2
pass 6244317 2021-06-29 21:34:36 2021-06-30 01:25:44 2021-06-30 01:44:58 0:19:14 0:09:46 0:09:28 smithi master centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6244318 2021-06-29 21:34:37 2021-06-30 01:25:45 2021-06-30 01:45:40 0:19:55 0:09:15 0:10:40 smithi master centos 8.3 rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6244319 2021-06-29 21:34:38 2021-06-30 01:25:47 2021-06-30 02:12:32 0:46:45 0:37:19 0:09:26 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6244320 2021-06-29 21:34:39 2021-06-30 01:25:57 2021-06-30 01:51:37 0:25:40 0:15:27 0:10:13 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6244321 2021-06-29 21:34:40 2021-06-30 01:26:18 2021-06-30 01:54:18 0:28:00 0:17:06 0:10:54 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} 2
pass 6244322 2021-06-29 21:34:41 2021-06-30 01:26:59 2021-06-30 01:54:00 0:27:01 0:20:12 0:06:49 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 6244323 2021-06-29 21:34:42 2021-06-30 01:27:19 2021-06-30 01:54:39 0:27:20 0:20:07 0:07:13 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/iscsi 3-final} 2
pass 6244324 2021-06-29 21:34:43 2021-06-30 01:27:50 2021-06-30 01:50:02 0:22:12 0:10:54 0:11:18 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} 2
pass 6244325 2021-06-29 21:34:44 2021-06-30 01:28:31 2021-06-30 02:01:59 0:33:28 0:22:10 0:11:18 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6244326 2021-06-29 21:34:45 2021-06-30 01:28:41 2021-06-30 02:07:47 0:39:06 0:29:54 0:09:12 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6244327 2021-06-29 21:34:46 2021-06-30 01:28:42 2021-06-30 02:31:35 1:02:53 0:53:46 0:09:07 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6244328 2021-06-29 21:34:47 2021-06-30 01:28:42 2021-06-30 01:52:09 0:23:27 0:11:56 0:11:31 smithi master centos 8.stream rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 2
pass 6244329 2021-06-29 21:34:48 2021-06-30 01:29:13 2021-06-30 01:52:08 0:22:55 0:16:54 0:06:01 smithi master rhel 8.4 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 6244330 2021-06-29 21:34:49 2021-06-30 01:29:13 2021-06-30 02:34:59 1:05:46 0:54:58 0:10:48 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ca793ee05bdda4c7cabcaf14102c9c219338779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6244331 2021-06-29 21:34:50 2021-06-30 01:29:54 2021-06-30 01:57:42 0:27:48 0:17:15 0:10:33 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} 2
pass 6244332 2021-06-29 21:34:51 2021-06-30 01:29:54 2021-06-30 02:53:46 1:23:52 1:12:12 0:11:40 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6244333 2021-06-29 21:34:52 2021-06-30 01:30:15 2021-06-30 02:50:11 1:19:56 1:08:39 0:11:17 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/radosbench} 2
pass 6244334 2021-06-29 21:34:54 2021-06-30 01:30:15 2021-06-30 02:07:53 0:37:38 0:26:48 0:10:50 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244335 2021-06-29 21:34:55 2021-06-30 01:31:06 2021-06-30 02:04:01 0:32:55 0:21:15 0:11:40 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 6244336 2021-06-29 21:34:56 2021-06-30 01:32:26 2021-06-30 01:52:21 0:19:55 0:07:57 0:11:58 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6244337 2021-06-29 21:34:57 2021-06-30 01:32:47 2021-06-30 02:00:28 0:27:41 0:19:43 0:07:58 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6244338 2021-06-29 21:34:58 2021-06-30 01:33:07 2021-06-30 01:57:58 0:24:51 0:16:33 0:08:18 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6244339 2021-06-29 21:34:59 2021-06-30 01:33:08 2021-06-30 02:00:22 0:27:14 0:16:57 0:10:17 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/lockdep} 2
pass 6244340 2021-06-29 21:35:00 2021-06-30 01:33:19 2021-06-30 01:59:54 0:26:35 0:15:40 0:10:55 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 6244341 2021-06-29 21:35:01 2021-06-30 01:34:09 2021-06-30 02:01:55 0:27:46 0:20:47 0:06:59 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244342 2021-06-29 21:35:02 2021-06-30 01:34:50 2021-06-30 01:56:28 0:21:38 0:11:01 0:10:37 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/rados_5925} 2
pass 6244343 2021-06-29 21:35:03 2021-06-30 01:35:20 2021-06-30 02:02:44 0:27:24 0:18:00 0:09:24 smithi master rhel 8.4 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 2
pass 6244344 2021-06-29 21:35:04 2021-06-30 01:36:51 2021-06-30 02:08:40 0:31:49 0:23:48 0:08:01 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
pass 6244345 2021-06-29 21:35:05 2021-06-30 01:37:02 2021-06-30 02:11:59 0:34:57 0:22:27 0:12:30 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6244346 2021-06-29 21:35:06 2021-06-30 01:38:53 2021-06-30 02:05:56 0:27:03 0:18:08 0:08:55 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/nfs-ingress 3-final} 2
pass 6244347 2021-06-29 21:35:07 2021-06-30 01:38:53 2021-06-30 01:55:31 0:16:38 0:08:32 0:08:06 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6244348 2021-06-29 21:35:08 2021-06-30 01:38:54 2021-06-30 02:10:10 0:31:16 0:21:08 0:10:08 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} 2
pass 6244349 2021-06-29 21:35:09 2021-06-30 01:39:14 2021-06-30 02:26:40 0:47:26 0:36:05 0:11:21 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8.stream} tasks/module_selftest} 2
pass 6244350 2021-06-29 21:35:10 2021-06-30 01:39:26 2021-06-30 02:05:04 0:25:38 0:14:40 0:10:58 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 6244351 2021-06-29 21:35:11 2021-06-30 01:39:47 2021-06-30 02:07:04 0:27:17 0:20:32 0:06:45 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6244352 2021-06-29 21:35:13 2021-06-30 01:40:18 2021-06-30 02:07:19 0:27:01 0:14:19 0:12:42 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} 2
pass 6244353 2021-06-29 21:35:14 2021-06-30 01:41:29 2021-06-30 02:01:37 0:20:08 0:10:42 0:09:26 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6244354 2021-06-29 21:35:15 2021-06-30 01:42:10 2021-06-30 02:19:47 0:37:37 0:27:49 0:09:48 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 6244355 2021-06-29 21:35:16 2021-06-30 01:42:10 2021-06-30 02:19:40 0:37:30 0:31:49 0:05:41 smithi master rhel 8.4 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6244356 2021-06-29 21:35:17 2021-06-30 01:42:31 2021-06-30 02:11:39 0:29:08 0:21:44 0:07:24 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs-ingress2 3-final} 2
pass 6244357 2021-06-29 21:35:18 2021-06-30 01:42:31 2021-06-30 02:12:34 0:30:03 0:19:32 0:10:31 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
pass 6244358 2021-06-29 21:35:19 2021-06-30 01:42:52 2021-06-30 02:06:03 0:23:11 0:16:34 0:06:37 smithi master rhel 8.4 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 6244359 2021-06-29 21:35:20 2021-06-30 01:43:02 2021-06-30 02:16:24 0:33:22 0:22:26 0:10:56 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
pass 6244360 2021-06-29 21:35:21 2021-06-30 01:43:03 2021-06-30 02:05:49 0:22:46 0:17:10 0:05:36 smithi master rhel 8.4 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6244361 2021-06-29 21:35:22 2021-06-30 01:43:05 2021-06-30 02:27:28 0:44:23 0:33:32 0:10:51 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6244362 2021-06-29 21:35:24 2021-06-30 01:43:45 2021-06-30 02:19:15 0:35:30 0:24:35 0:10:55 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6244363 2021-06-29 21:35:25 2021-06-30 01:44:16 2021-06-30 02:22:39 0:38:23 0:27:44 0:10:39 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6244364 2021-06-29 21:35:26 2021-06-30 01:44:37 2021-06-30 02:24:41 0:40:04 0:29:29 0:10:35 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6244365 2021-06-29 21:35:27 2021-06-30 01:44:57 2021-06-30 02:26:40 0:41:43 0:31:07 0:10:36 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
pass 6244366 2021-06-29 21:35:28 2021-06-30 01:44:59 2021-06-30 03:37:42 1:52:43 1:44:53 0:07:50 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/osd-backfill} 1
pass 6244367 2021-06-29 21:35:29 2021-06-30 01:45:00 2021-06-30 02:14:12 0:29:12 0:20:48 0:08:24 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6244368 2021-06-29 21:35:30 2021-06-30 01:45:20 2021-06-30 02:08:27 0:23:07 0:14:00 0:09:07 smithi master centos 8.3 rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6244369 2021-06-29 21:35:31 2021-06-30 01:45:21 2021-06-30 02:01:52 0:16:31 0:07:49 0:08:42 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
pass 6244370 2021-06-29 21:35:33 2021-06-30 01:45:21 2021-06-30 02:12:35 0:27:14 0:16:03 0:11:11 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6244371 2021-06-29 21:35:34 2021-06-30 01:45:32 2021-06-30 02:05:35 0:20:03 0:09:01 0:11:02 smithi master centos 8.stream rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6244372 2021-06-29 21:35:35 2021-06-30 01:45:42 2021-06-30 02:20:16 0:34:34 0:27:31 0:07:03 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6244373 2021-06-29 21:35:36 2021-06-30 01:47:04 2021-06-30 02:29:15 0:42:11 0:33:37 0:08:34 smithi master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6244374 2021-06-29 21:35:37 2021-06-30 01:50:06 2021-06-30 02:21:28 0:31:22 0:22:00 0:09:22 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
pass 6244375 2021-06-29 21:35:38 2021-06-30 01:50:16 2021-06-30 02:16:50 0:26:34 0:15:19 0:11:15 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} 2
pass 6244376 2021-06-29 21:35:39 2021-06-30 01:51:07 2021-06-30 02:19:06 0:27:59 0:16:16 0:11:43 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} 2
pass 6244377 2021-06-29 21:35:40 2021-06-30 01:51:47 2021-06-30 02:31:35 0:39:48 0:30:01 0:09:47 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6244378 2021-06-29 21:35:41 2021-06-30 01:51:58 2021-06-30 02:27:28 0:35:30 0:23:05 0:12:25 smithi master ubuntu 20.04 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 2
pass 6244379 2021-06-29 21:35:42 2021-06-30 01:52:21 2021-06-30 02:27:53 0:35:32 0:24:12 0:11:20 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6244380 2021-06-29 21:35:43 2021-06-30 01:52:22 2021-06-30 02:13:49 0:21:27 0:12:39 0:08:48 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6244381 2021-06-29 21:35:44 2021-06-30 01:52:22 2021-06-30 02:38:58 0:46:36 0:39:46 0:06:50 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6244382 2021-06-29 21:35:45 2021-06-30 01:52:23 2021-06-30 02:21:22 0:28:59 0:16:50 0:12:09 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6244383 2021-06-29 21:35:46 2021-06-30 01:54:04 2021-06-30 02:16:53 0:22:49 0:16:39 0:06:10 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6244384 2021-06-29 21:35:47 2021-06-30 01:54:05 2021-06-30 02:31:41 0:37:36 0:26:41 0:10:55 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6244385 2021-06-29 21:35:48 2021-06-30 01:54:26 2021-06-30 02:31:44 0:37:18 0:30:58 0:06:20 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} 2
pass 6244386 2021-06-29 21:35:49 2021-06-30 01:54:47 2021-06-30 02:34:59 0:40:12 0:29:25 0:10:47 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} 2
pass 6244387 2021-06-29 21:35:50 2021-06-30 01:55:27 2021-06-30 02:14:08 0:18:41 0:10:31 0:08:10 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6244388 2021-06-29 21:35:51 2021-06-30 01:55:27 2021-06-30 02:19:56 0:24:29 0:12:13 0:12:16 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6244389 2021-06-29 21:35:52 2021-06-30 01:56:38 2021-06-30 02:38:01 0:41:23 0:30:37 0:10:46 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/rados_api_tests} 2
pass 6244390 2021-06-29 21:35:53 2021-06-30 01:56:49 2021-06-30 02:34:32 0:37:43 0:30:56 0:06:47 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} 2
pass 6244391 2021-06-29 21:35:55 2021-06-30 01:57:29 2021-06-30 02:33:14 0:35:45 0:28:49 0:06:56 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6244392 2021-06-29 21:35:56 2021-06-30 01:57:50 2021-06-30 02:22:48 0:24:58 0:15:27 0:09:31 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/nfs2 3-final} 2
pass 6244393 2021-06-29 21:35:57 2021-06-30 01:58:01 2021-06-30 02:29:13 0:31:12 0:19:58 0:11:14 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6244394 2021-06-29 21:35:58 2021-06-30 01:59:41 2021-06-30 02:45:04 0:45:23 0:39:03 0:06:20 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} 2
pass 6244395 2021-06-29 21:35:59 2021-06-30 01:59:52 2021-06-30 02:35:50 0:35:58 0:24:49 0:11:09 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6244396 2021-06-29 21:36:00 2021-06-30 02:00:02 2021-06-30 02:23:32 0:23:30 0:12:17 0:11:13 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} 2
fail 6244397 2021-06-29 21:36:01 2021-06-30 02:00:13 2021-06-30 02:21:34 0:21:21 0:11:06 0:10:15 smithi master ubuntu 20.04 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

'wait for quorum size 3' reached maximum tries (10) after waiting for 30 seconds

pass 6244398 2021-06-29 21:36:02 2021-06-30 02:00:13 2021-06-30 02:33:19 0:33:06 0:24:28 0:08:38 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
pass 6244399 2021-06-29 21:36:03 2021-06-30 02:00:23 2021-06-30 04:29:47 2:29:24 2:01:16 0:28:08 smithi master centos 8.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8.stream}} 1
pass 6244400 2021-06-29 21:36:04 2021-06-30 02:00:24 2021-06-30 02:21:54 0:21:30 0:11:03 0:10:27 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/dedup-io-mixed} 2