Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6300862 2021-07-29 08:07:06 2021-07-29 08:08:33 2021-07-29 08:29:03 0:20:30 0:12:43 0:07:47 smithi master centos 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_kubic_stable} 1-start 2-services/basic 3-final} 1
pass 6300863 2021-07-29 08:07:07 2021-07-29 08:08:33 2021-07-29 08:33:08 0:24:35 0:14:16 0:10:19 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6300864 2021-07-29 08:07:08 2021-07-29 08:09:43 2021-07-29 09:03:09 0:53:26 0:44:53 0:08:33 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} 1
pass 6300865 2021-07-29 08:07:09 2021-07-29 08:09:44 2021-07-29 08:50:07 0:40:23 0:28:33 0:11:50 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6300866 2021-07-29 08:07:10 2021-07-29 08:10:35 2021-07-29 08:27:39 0:17:04 0:08:58 0:08:06 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300867 2021-07-29 08:07:10 2021-07-29 08:10:35 2021-07-29 08:42:09 0:31:34 0:18:10 0:13:24 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6300868 2021-07-29 08:07:11 2021-07-29 08:12:46 2021-07-29 08:36:08 0:23:22 0:17:23 0:05:59 smithi master rhel 8.4 rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6300869 2021-07-29 08:07:12 2021-07-29 08:13:06 2021-07-29 08:31:49 0:18:43 0:10:49 0:07:54 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
pass 6300870 2021-07-29 08:07:13 2021-07-29 08:13:06 2021-07-29 08:42:35 0:29:29 0:19:11 0:10:18 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
dead 6300871 2021-07-29 08:07:14 2021-07-29 08:13:07 2021-07-29 16:35:48 8:22:41 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6300872 2021-07-29 08:07:15 2021-07-29 08:14:07 2021-07-29 08:45:57 0:31:50 0:20:56 0:10:54 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} 2
fail 6300873 2021-07-29 08:07:16 2021-07-29 08:14:37 2021-07-29 08:51:32 0:36:55 0:27:45 0:09:10 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi143 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 6300874 2021-07-29 08:07:17 2021-07-29 08:14:38 2021-07-29 08:41:47 0:27:09 0:17:26 0:09:43 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/rgw 3-final} 2
pass 6300875 2021-07-29 08:07:18 2021-07-29 08:15:08 2021-07-29 08:35:24 0:20:16 0:10:10 0:10:06 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6300876 2021-07-29 08:07:19 2021-07-29 08:16:28 2021-07-29 08:49:39 0:33:11 0:24:23 0:08:48 smithi master ubuntu 20.04 rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
dead 6300877 2021-07-29 08:07:20 2021-07-29 08:16:29 2021-07-29 16:35:40 8:19:11 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6300878 2021-07-29 08:07:21 2021-07-29 08:18:09 2021-07-29 08:44:32 0:26:23 0:17:21 0:09:02 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6300879 2021-07-29 08:07:22 2021-07-29 08:18:09 2021-07-29 08:59:16 0:41:07 0:29:34 0:11:33 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/sync-many workloads/rados_mon_workunits} 2
pass 6300880 2021-07-29 08:07:22 2021-07-29 08:20:20 2021-07-29 08:52:38 0:32:18 0:24:29 0:07:49 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 6300881 2021-07-29 08:07:23 2021-07-29 08:21:20 2021-07-29 09:05:02 0:43:42 0:31:17 0:12:25 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6300882 2021-07-29 08:07:24 2021-07-29 08:23:41 2021-07-29 08:49:04 0:25:23 0:19:17 0:06:06 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/basic 3-final} 2
pass 6300883 2021-07-29 08:07:25 2021-07-29 08:24:01 2021-07-29 09:03:46 0:39:45 0:29:22 0:10:23 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 6300884 2021-07-29 08:07:26 2021-07-29 08:24:51 2021-07-29 08:48:22 0:23:31 0:12:42 0:10:49 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 6300885 2021-07-29 08:07:27 2021-07-29 08:25:02 2021-07-29 09:13:13 0:48:11 0:36:55 0:11:16 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6300886 2021-07-29 08:07:28 2021-07-29 08:25:02 2021-07-29 09:08:28 0:43:26 0:34:10 0:09:16 smithi master centos 8.stream rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} 1
pass 6300887 2021-07-29 08:07:29 2021-07-29 08:25:32 2021-07-29 08:42:02 0:16:30 0:08:23 0:08:07 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
dead 6300888 2021-07-29 08:07:30 2021-07-29 08:25:33 2021-07-29 16:36:22 8:10:49 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6300889 2021-07-29 08:07:31 2021-07-29 08:26:03 2021-07-29 16:34:58 8:08:55 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6300890 2021-07-29 08:07:32 2021-07-29 08:26:03 2021-07-29 08:45:38 0:19:35 0:10:46 0:08:49 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6300891 2021-07-29 08:07:33 2021-07-29 08:26:03 2021-07-29 09:03:34 0:37:31 0:27:01 0:10:30 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/rados_api_tests} 2
pass 6300892 2021-07-29 08:07:34 2021-07-29 08:26:24 2021-07-29 08:52:14 0:25:50 0:19:12 0:06:38 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6300893 2021-07-29 08:07:35 2021-07-29 08:27:14 2021-07-29 08:57:01 0:29:47 0:18:26 0:11:21 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6300894 2021-07-29 08:07:36 2021-07-29 08:27:44 2021-07-29 09:18:56 0:51:12 0:45:36 0:05:36 smithi master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 6300895 2021-07-29 08:07:37 2021-07-29 08:27:45 2021-07-29 09:05:16 0:37:31 0:31:37 0:05:54 smithi master rhel 8.4 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6300896 2021-07-29 08:07:38 2021-07-29 08:28:05 2021-07-29 08:56:08 0:28:03 0:17:05 0:10:58 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/client-keyring 3-final} 2
pass 6300897 2021-07-29 08:07:39 2021-07-29 08:28:35 2021-07-29 08:49:34 0:20:59 0:12:31 0:08:28 smithi master ubuntu 20.04 rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300898 2021-07-29 08:07:40 2021-07-29 08:28:35 2021-07-29 08:44:15 0:15:40 0:06:40 0:09:00 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300899 2021-07-29 08:07:41 2021-07-29 08:28:36 2021-07-29 09:12:10 0:43:34 0:33:18 0:10:16 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
pass 6300900 2021-07-29 08:07:42 2021-07-29 08:29:06 2021-07-29 09:15:01 0:45:55 0:31:38 0:14:17 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 6300901 2021-07-29 08:07:42 2021-07-29 08:31:57 2021-07-29 09:10:01 0:38:04 0:26:53 0:11:11 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6300902 2021-07-29 08:07:43 2021-07-29 08:32:57 2021-07-29 08:52:21 0:19:24 0:08:57 0:10:27 smithi master centos 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 6300903 2021-07-29 08:07:44 2021-07-29 08:33:07 2021-07-29 08:50:04 0:16:57 0:07:39 0:09:18 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
pass 6300904 2021-07-29 08:07:45 2021-07-29 08:33:07 2021-07-29 09:03:30 0:30:23 0:22:04 0:08:19 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
fail 6300905 2021-07-29 08:07:46 2021-07-29 08:33:08 2021-07-29 09:24:17 0:51:09 0:40:58 0:10:11 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/osd-backfill} 1
Failure Reason:

Command failed (workunit test osd-backfill/osd-backfill-space.sh) on smithi061 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh'

pass 6300906 2021-07-29 08:07:47 2021-07-29 08:33:08 2021-07-29 09:03:58 0:30:50 0:21:09 0:09:41 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
fail 6300907 2021-07-29 08:07:48 2021-07-29 08:33:08 2021-07-29 09:07:38 0:34:30 0:25:10 0:09:20 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Command failed on smithi001 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 6300908 2021-07-29 08:07:49 2021-07-29 08:34:19 2021-07-29 08:57:37 0:23:18 0:16:36 0:06:42 smithi master rhel 8.4 rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6300909 2021-07-29 08:07:50 2021-07-29 08:34:19 2021-07-29 09:01:15 0:26:56 0:15:22 0:11:34 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/iscsi 3-final} 2
pass 6300910 2021-07-29 08:07:51 2021-07-29 08:36:09 2021-07-29 08:54:34 0:18:25 0:07:24 0:11:01 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300911 2021-07-29 08:07:52 2021-07-29 08:37:10 2021-07-29 09:38:07 1:00:57 0:51:21 0:09:36 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6300912 2021-07-29 08:07:53 2021-07-29 08:37:10 2021-07-29 09:00:32 0:23:22 0:13:31 0:09:51 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
fail 6300913 2021-07-29 08:07:54 2021-07-29 08:37:10 2021-07-29 10:58:29 2:21:19 2:06:09 0:15:10 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 6300914 2021-07-29 08:07:55 2021-07-29 08:41:51 2021-07-29 09:09:05 0:27:14 0:19:42 0:07:32 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/mirror 3-final} 2
pass 6300915 2021-07-29 08:07:56 2021-07-29 08:42:12 2021-07-29 09:09:06 0:26:54 0:17:32 0:09:22 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 6300916 2021-07-29 08:07:57 2021-07-29 08:42:12 2021-07-29 09:22:39 0:40:27 0:28:55 0:11:32 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} 2
dead 6300917 2021-07-29 08:07:58 2021-07-29 08:42:42 2021-07-29 16:34:47 7:52:05 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 6300918 2021-07-29 08:07:59 2021-07-29 08:43:13 2021-07-29 09:09:43 0:26:30 0:18:13 0:08:17 smithi master rhel 8.4 rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 6300919 2021-07-29 08:08:00 2021-07-29 08:44:23 2021-07-29 09:25:02 0:40:39 0:29:39 0:11:00 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
pass 6300920 2021-07-29 08:08:01 2021-07-29 08:45:43 2021-07-29 09:23:02 0:37:19 0:27:25 0:09:54 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6300921 2021-07-29 08:08:02 2021-07-29 08:46:04 2021-07-29 09:05:27 0:19:23 0:08:29 0:10:54 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300922 2021-07-29 08:08:03 2021-07-29 08:48:04 2021-07-29 09:31:29 0:43:25 0:37:36 0:05:49 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/module_selftest} 2
pass 6300923 2021-07-29 08:08:04 2021-07-29 08:48:24 2021-07-29 09:16:44 0:28:20 0:17:24 0:10:56 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6300924 2021-07-29 08:08:05 2021-07-29 08:49:15 2021-07-29 09:11:13 0:21:58 0:10:27 0:11:31 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
dead 6300925 2021-07-29 08:08:06 2021-07-29 08:49:45 2021-07-29 16:35:38 7:45:53 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6300926 2021-07-29 08:08:07 2021-07-29 08:50:15 2021-07-29 09:20:50 0:30:35 0:19:07 0:11:28 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} 2
fail 6300927 2021-07-29 08:08:08 2021-07-29 08:51:36 2021-07-29 09:25:28 0:33:52 0:12:13 0:21:39 smithi master centos 8.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8.stream}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*/2:-*SyntheticMatrixC* --gtest_catch_exceptions=0\''

pass 6300928 2021-07-29 08:08:09 2021-07-29 08:52:16 2021-07-29 09:17:38 0:25:22 0:17:53 0:07:29 smithi master rhel 8.4 rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6300929 2021-07-29 08:08:10 2021-07-29 08:52:27 2021-07-29 09:34:04 0:41:37 0:35:21 0:06:16 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6300930 2021-07-29 08:08:11 2021-07-29 08:52:47 2021-07-29 09:25:42 0:32:55 0:24:35 0:08:20 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
pass 6300931 2021-07-29 08:08:12 2021-07-29 08:52:47 2021-07-29 09:12:00 0:19:13 0:07:33 0:11:40 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300932 2021-07-29 08:08:12 2021-07-29 08:54:38 2021-07-29 09:31:41 0:37:03 0:30:18 0:06:45 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6300933 2021-07-29 08:08:13 2021-07-29 08:54:38 2021-07-29 09:33:52 0:39:14 0:26:15 0:12:59 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
fail 6300934 2021-07-29 08:08:14 2021-07-29 08:56:18 2021-07-29 09:27:36 0:31:18 0:19:42 0:11:36 smithi master centos 8.2 rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6300935 2021-07-29 08:08:15 2021-07-29 08:56:38 2021-07-29 09:26:03 0:29:25 0:18:19 0:11:06 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs-ingress 3-final} 2
pass 6300936 2021-07-29 08:08:16 2021-07-29 08:57:09 2021-07-29 09:20:03 0:22:54 0:16:19 0:06:35 smithi master rhel 8.4 rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6300937 2021-07-29 08:08:17 2021-07-29 08:57:09 2021-07-29 09:20:41 0:23:32 0:13:34 0:09:58 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6300938 2021-07-29 08:08:18 2021-07-29 08:57:29 2021-07-29 09:17:37 0:20:08 0:08:41 0:11:27 smithi master centos 8.3 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 2
dead 6300939 2021-07-29 08:08:19 2021-07-29 08:57:40 2021-07-29 16:36:25 7:38:45 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6300940 2021-07-29 08:08:20 2021-07-29 08:59:20 2021-07-29 09:42:30 0:43:10 0:31:50 0:11:20 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6300941 2021-07-29 08:08:21 2021-07-29 09:01:21 2021-07-29 09:20:08 0:18:47 0:09:55 0:08:52 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
dead 6300942 2021-07-29 08:08:22 2021-07-29 09:01:21 2021-07-29 16:35:16 7:33:55 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6300943 2021-07-29 08:08:23 2021-07-29 09:03:41 2021-07-29 09:27:00 0:23:19 0:16:29 0:06:50 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
pass 6300944 2021-07-29 08:08:24 2021-07-29 09:03:52 2021-07-29 09:31:06 0:27:14 0:21:13 0:06:01 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs-ingress2 3-final} 2
fail 6300945 2021-07-29 08:08:25 2021-07-29 09:04:02 2021-07-29 11:02:03 1:58:01 1:50:27 0:07:34 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} 1
Failure Reason:

Command failed (workunit test osd/pg-split-merge.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/pg-split-merge.sh'

pass 6300946 2021-07-29 08:08:26 2021-07-29 09:05:02 2021-07-29 09:30:25 0:25:23 0:15:24 0:09:59 smithi master centos 8.3 rados/cephadm/smoke/{distro/centos_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6300947 2021-07-29 08:08:27 2021-07-29 09:05:23 2021-07-29 09:27:02 0:21:39 0:12:10 0:09:29 smithi master ubuntu 20.04 rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
dead 6300948 2021-07-29 08:08:28 2021-07-29 09:05:33 2021-07-29 16:35:31 7:29:58 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6300949 2021-07-29 08:08:29 2021-07-29 09:07:43 2021-07-29 10:49:58 1:42:15 1:29:36 0:12:39 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 6300950 2021-07-29 08:08:30 2021-07-29 09:08:14 2021-07-29 09:30:45 0:22:31 0:13:23 0:09:08 smithi master centos 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_kubic_stable} 1-start 2-services/rgw 3-final} 1
pass 6300951 2021-07-29 08:08:31 2021-07-29 09:08:14 2021-07-29 09:27:32 0:19:18 0:10:28 0:08:50 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
dead 6300952 2021-07-29 08:08:32 2021-07-29 09:08:34 2021-07-29 16:34:37 7:26:03 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 6300953 2021-07-29 08:08:33 2021-07-29 09:09:15 2021-07-29 09:34:21 0:25:06 0:15:20 0:09:46 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} 2
pass 6300954 2021-07-29 08:08:34 2021-07-29 09:09:15 2021-07-29 09:39:38 0:30:23 0:18:36 0:11:47 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6300955 2021-07-29 08:08:35 2021-07-29 09:09:45 2021-07-29 11:11:04 2:01:19 1:51:17 0:10:02 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
pass 6300956 2021-07-29 08:08:36 2021-07-29 09:10:06 2021-07-29 09:50:49 0:40:43 0:29:49 0:10:54 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6300957 2021-07-29 08:08:37 2021-07-29 09:11:16 2021-07-29 09:53:05 0:41:49 0:30:51 0:10:58 smithi master centos 8.stream rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 2
pass 6300958 2021-07-29 08:08:38 2021-07-29 09:12:06 2021-07-29 09:32:55 0:20:49 0:11:35 0:09:14 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
dead 6300959 2021-07-29 08:08:39 2021-07-29 09:12:17 2021-07-29 16:34:31 7:22:14 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6300960 2021-07-29 08:08:40 2021-07-29 09:15:07 2021-07-29 09:58:18 0:43:11 0:37:15 0:05:56 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6300961 2021-07-29 08:08:40 2021-07-29 09:15:08 2021-07-29 09:48:14 0:33:06 0:10:15 0:22:51 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*SyntheticMatrixC*/2 --gtest_catch_exceptions=0\''

fail 6300962 2021-07-29 08:08:41 2021-07-29 09:16:48 2021-07-29 09:53:23 0:36:35 0:28:55 0:07:40 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi045 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 6300963 2021-07-29 08:08:42 2021-07-29 09:16:48 2021-07-29 09:45:23 0:28:35 0:17:00 0:11:35 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} 2
pass 6300964 2021-07-29 08:08:43 2021-07-29 09:17:39 2021-07-29 09:43:24 0:25:45 0:14:52 0:10:53 smithi master centos 8.stream rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6300965 2021-07-29 08:08:44 2021-07-29 09:17:39 2021-07-29 09:37:08 0:19:29 0:10:33 0:08:56 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6300966 2021-07-29 08:08:46 2021-07-29 09:17:39 2021-07-29 09:48:05 0:30:26 0:21:57 0:08:29 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6300967 2021-07-29 08:08:46 2021-07-29 09:19:00 2021-07-29 09:45:12 0:26:12 0:15:15 0:10:57 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs2 3-final} 2
pass 6300968 2021-07-29 08:08:47 2021-07-29 09:20:10 2021-07-29 09:45:34 0:25:24 0:14:55 0:10:29 smithi master centos 8.stream rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
pass 6300969 2021-07-29 08:08:48 2021-07-29 09:20:51 2021-07-29 09:45:49 0:24:58 0:17:10 0:07:48 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
pass 6300970 2021-07-29 08:08:49 2021-07-29 09:20:51 2021-07-29 09:52:43 0:31:52 0:17:46 0:14:06 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
pass 6300971 2021-07-29 08:08:50 2021-07-29 09:22:42 2021-07-29 10:10:07 0:47:25 0:37:54 0:09:31 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 6300972 2021-07-29 08:08:51 2021-07-29 09:23:12 2021-07-29 09:55:23 0:32:11 0:22:16 0:09:55 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6300973 2021-07-29 08:08:53 2021-07-29 09:24:22 2021-07-29 09:50:45 0:26:23 0:13:43 0:12:40 smithi master centos 8.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 3
pass 6300974 2021-07-29 08:08:54 2021-07-29 09:25:33 2021-07-29 09:57:11 0:31:38 0:24:00 0:07:38 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6300975 2021-07-29 08:08:55 2021-07-29 09:26:13 2021-07-29 09:52:13 0:26:00 0:12:59 0:13:01 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6300976 2021-07-29 08:08:56 2021-07-29 09:27:04 2021-07-29 10:06:52 0:39:48 0:29:46 0:10:02 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6300977 2021-07-29 08:08:57 2021-07-29 09:27:44 2021-07-29 09:57:15 0:29:31 0:20:04 0:09:27 smithi master ubuntu 20.04 rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300978 2021-07-29 08:08:58 2021-07-29 09:27:44 2021-07-29 09:54:13 0:26:29 0:19:24 0:07:05 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6300979 2021-07-29 08:08:59 2021-07-29 09:29:05 2021-07-29 09:56:04 0:26:59 0:17:12 0:09:47 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300980 2021-07-29 08:09:00 2021-07-29 09:29:05 2021-07-29 10:18:01 0:48:56 0:37:54 0:11:02 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
pass 6300981 2021-07-29 08:09:01 2021-07-29 09:30:35 2021-07-29 10:04:25 0:33:50 0:22:44 0:11:06 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} 2
fail 6300982 2021-07-29 08:09:02 2021-07-29 09:31:16 2021-07-29 10:18:01 0:46:45 0:37:19 0:09:26 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
Failure Reason:

Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi184 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh'

pass 6300983 2021-07-29 08:09:03 2021-07-29 09:31:16 2021-07-29 10:13:07 0:41:51 0:30:05 0:11:46 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 6300984 2021-07-29 08:09:04 2021-07-29 09:31:36 2021-07-29 10:03:11 0:31:35 0:21:22 0:10:13 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6300985 2021-07-29 08:09:05 2021-07-29 09:31:47 2021-07-29 10:03:37 0:31:50 0:23:21 0:08:29 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} 2
pass 6300986 2021-07-29 08:09:06 2021-07-29 09:33:57 2021-07-29 09:53:25 0:19:28 0:10:03 0:09:25 smithi master centos 8.stream rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} 2
pass 6300987 2021-07-29 08:09:07 2021-07-29 09:34:08 2021-07-29 09:53:11 0:19:03 0:10:29 0:08:34 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6300988 2021-07-29 08:09:08 2021-07-29 09:34:08 2021-07-29 09:51:54 0:17:46 0:08:01 0:09:45 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_5925} 2
pass 6300989 2021-07-29 08:09:09 2021-07-29 09:34:28 2021-07-29 10:00:01 0:25:33 0:13:22 0:12:11 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} tasks/prometheus} 2
pass 6300990 2021-07-29 08:09:10 2021-07-29 09:36:29 2021-07-29 10:12:35 0:36:06 0:26:53 0:09:13 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} 1
pass 6300991 2021-07-29 08:09:11 2021-07-29 09:37:09 2021-07-29 10:01:13 0:24:04 0:12:43 0:11:21 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 6300992 2021-07-29 08:09:12 2021-07-29 09:38:09 2021-07-29 10:07:32 0:29:23 0:18:44 0:10:39 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} 2
pass 6300993 2021-07-29 08:09:13 2021-07-29 09:38:10 2021-07-29 10:16:50 0:38:40 0:27:21 0:11:19 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} 1
pass 6300994 2021-07-29 08:09:14 2021-07-29 09:39:30 2021-07-29 09:56:51 0:17:21 0:07:23 0:09:58 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6300995 2021-07-29 08:09:15 2021-07-29 09:39:31 2021-07-29 10:19:07 0:39:36 0:28:45 0:10:51 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
fail 6300996 2021-07-29 08:09:16 2021-07-29 09:39:31 2021-07-29 10:08:13 0:28:42 0:13:19 0:15:23 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

Command failed on smithi139 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 6300997 2021-07-29 08:09:17 2021-07-29 09:42:32 2021-07-29 10:16:11 0:33:39 0:24:03 0:09:36 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6300998 2021-07-29 08:09:18 2021-07-29 09:42:52 2021-07-29 10:01:36 0:18:44 0:10:40 0:08:04 smithi master centos 8.stream rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6300999 2021-07-29 08:09:19 2021-07-29 09:42:52 2021-07-29 10:00:16 0:17:24 0:07:38 0:09:46 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
dead 6301000 2021-07-29 08:09:20 2021-07-29 09:42:52 2021-07-29 16:34:42 6:51:50 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6301001 2021-07-29 08:09:21 2021-07-29 09:45:13 2021-07-29 10:04:51 0:19:38 0:08:43 0:10:55 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_striper} 2
pass 6301002 2021-07-29 08:09:22 2021-07-29 09:45:33 2021-07-29 10:11:47 0:26:14 0:14:53 0:11:21 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/basic 3-final} 2
pass 6301003 2021-07-29 08:09:23 2021-07-29 09:45:44 2021-07-29 10:20:35 0:34:51 0:21:57 0:12:54 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 6301004 2021-07-29 08:09:24 2021-07-29 09:47:44 2021-07-29 10:39:59 0:52:15 0:41:13 0:11:02 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301005 2021-07-29 08:09:25 2021-07-29 09:48:15 2021-07-29 10:35:19 0:47:04 0:36:38 0:10:26 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6301006 2021-07-29 08:09:26 2021-07-29 09:48:15 2021-07-29 10:15:58 0:27:43 0:16:45 0:10:58 smithi master centos 8.3 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6301007 2021-07-29 08:09:27 2021-07-29 09:50:55 2021-07-29 10:18:33 0:27:38 0:17:03 0:10:35 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
dead 6301008 2021-07-29 08:09:28 2021-07-29 09:50:56 2021-07-29 16:36:22 6:45:26 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6301009 2021-07-29 08:09:29 2021-07-29 09:50:56 2021-07-29 10:11:41 0:20:45 0:07:12 0:13:33 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6301010 2021-07-29 08:09:30 2021-07-29 09:52:16 2021-07-29 10:16:50 0:24:34 0:11:35 0:12:59 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301011 2021-07-29 08:09:31 2021-07-29 09:52:47 2021-07-29 10:20:13 0:27:26 0:20:03 0:07:23 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/client-keyring 3-final} 2
pass 6301012 2021-07-29 08:09:32 2021-07-29 09:53:07 2021-07-29 10:12:29 0:19:22 0:10:35 0:08:47 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6301013 2021-07-29 08:09:33 2021-07-29 09:53:07 2021-07-29 10:10:16 0:17:09 0:07:42 0:09:27 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301014 2021-07-29 08:09:34 2021-07-29 09:53:17 2021-07-29 10:26:50 0:33:33 0:24:09 0:09:24 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
dead 6301015 2021-07-29 08:09:35 2021-07-29 09:53:28 2021-07-29 16:35:05 6:41:37 smithi master centos 8.stream rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 2
pass 6301016 2021-07-29 08:09:36 2021-07-29 09:53:28 2021-07-29 10:21:57 0:28:29 0:17:20 0:11:09 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} 2
pass 6301017 2021-07-29 08:09:37 2021-07-29 09:54:21 2021-07-29 10:34:00 0:39:39 0:33:27 0:06:12 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 6301018 2021-07-29 08:09:38 2021-07-29 09:54:41 2021-07-29 10:28:34 0:33:53 0:23:58 0:09:55 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_kubic_stable fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} 2
dead 6301019 2021-07-29 08:09:39 2021-07-29 09:55:31 2021-07-29 16:36:05 6:40:34 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6301020 2021-07-29 08:09:40 2021-07-29 09:56:12 2021-07-29 10:16:30 0:20:18 0:08:11 0:12:07 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 6301021 2021-07-29 08:09:41 2021-07-29 09:57:12 2021-07-29 10:44:32 0:47:20 0:40:14 0:07:06 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} 2
pass 6301022 2021-07-29 08:09:42 2021-07-29 09:57:22 2021-07-29 11:23:26 1:26:04 1:14:43 0:11:21 smithi master centos 8.2 rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
fail 6301023 2021-07-29 08:09:42 2021-07-29 09:58:23 2021-07-29 10:18:50 0:20:27 0:09:50 0:10:37 smithi master centos 8.stream rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8.stream}} 1
Failure Reason:

"2021-07-29T10:15:48.813278+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6301024 2021-07-29 08:09:43 2021-07-29 10:00:03 2021-07-29 10:19:00 0:18:57 0:10:31 0:08:26 smithi master centos 8.3 rados/rest/{mgr-restful supported-random-distro$/{centos_8}} 1
pass 6301025 2021-07-29 08:09:44 2021-07-29 10:00:03 2021-07-29 10:25:06 0:25:03 0:16:15 0:08:48 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6301026 2021-07-29 08:09:45 2021-07-29 10:00:04 2021-07-29 10:22:23 0:22:19 0:11:50 0:10:29 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
pass 6301027 2021-07-29 08:09:46 2021-07-29 10:00:04 2021-07-29 11:36:35 1:36:31 1:25:11 0:11:20 smithi master ubuntu 20.04 rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6301028 2021-07-29 08:09:47 2021-07-29 10:01:14 2021-07-29 10:32:50 0:31:36 0:21:55 0:09:41 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6301029 2021-07-29 08:09:48 2021-07-29 10:01:14 2021-07-29 11:00:20 0:59:06 0:46:38 0:12:28 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 6301030 2021-07-29 08:09:49 2021-07-29 10:03:15 2021-07-29 11:04:55 1:01:40 0:50:10 0:11:30 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 6301031 2021-07-29 08:09:50 2021-07-29 10:03:45 2021-07-29 10:45:50 0:42:05 0:30:29 0:11:36 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} 2
dead 6301032 2021-07-29 08:09:51 2021-07-29 10:04:26 2021-07-29 16:34:38 6:30:12 smithi master rhel 8.4 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 2
pass 6301033 2021-07-29 08:09:52 2021-07-29 10:04:56 2021-07-29 10:32:02 0:27:06 0:15:47 0:11:19 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/mirror 3-final} 2
pass 6301034 2021-07-29 08:09:54 2021-07-29 10:06:56 2021-07-29 10:44:46 0:37:50 0:26:32 0:11:18 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6301035 2021-07-29 08:09:55 2021-07-29 10:07:37 2021-07-29 10:47:27 0:39:50 0:33:26 0:06:24 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6301036 2021-07-29 08:09:56 2021-07-29 10:08:17 2021-07-29 10:39:02 0:30:45 0:19:06 0:11:39 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6301037 2021-07-29 08:09:57 2021-07-29 10:10:08 2021-07-29 10:49:15 0:39:07 0:27:58 0:11:09 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6301038 2021-07-29 08:09:58 2021-07-29 10:10:18 2021-07-29 10:49:39 0:39:21 0:26:21 0:13:00 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6301039 2021-07-29 08:09:59 2021-07-29 10:11:48 2021-07-29 10:34:55 0:23:07 0:17:40 0:05:27 smithi master rhel 8.4 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 6301040 2021-07-29 08:10:00 2021-07-29 10:11:49 2021-07-29 10:34:51 0:23:02 0:12:18 0:10:44 smithi master centos 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_kubic_stable} 2-node-mgr orchestrator_cli} 2
Failure Reason:

Test failure: test_host_rm (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli)

fail 6301041 2021-07-29 08:10:01 2021-07-29 10:11:49 2021-07-29 13:37:49 3:26:00 3:13:46 0:12:14 smithi master centos 8.stream rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 2
Failure Reason:

Command failed (workunit test rados/load-gen-mix-small.sh) on smithi091 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-mix-small.sh'

fail 6301042 2021-07-29 08:10:02 2021-07-29 10:12:39 2021-07-29 10:34:28 0:21:49 0:12:07 0:09:42 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
Failure Reason:

"2021-07-29T10:30:49.807362+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request MOSDPGPush(9.e1 34/33 [PushOp(9:87bf72e5:::benchmark_data_smithi138_22006_object2161:head, version: 32'16, data_included: [0~4096], data_size: 4096, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(9:87bf72e5:::benchmark_data_smithi138_22006_object2161:head@32'16, size: 4096, copy_subset: [0~4096], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:4096, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))]) initiated 2021-07-29T10:30:18.569979+0000 currently queued for pg" in cluster log

pass 6301043 2021-07-29 08:10:03 2021-07-29 10:13:10 2021-07-29 10:41:03 0:27:53 0:15:17 0:12:36 smithi master centos 8.3 rados/cephadm/smoke/{distro/centos_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6301044 2021-07-29 08:10:04 2021-07-29 10:16:00 2021-07-29 10:39:25 0:23:25 0:15:51 0:07:34 smithi master rhel 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.3_kubic_stable} 1-start 2-services/basic 3-final} 1
pass 6301045 2021-07-29 08:10:05 2021-07-29 10:16:20 2021-07-29 10:57:30 0:41:10 0:35:09 0:06:01 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6301046 2021-07-29 08:10:06 2021-07-29 10:16:32 2021-07-29 10:40:35 0:24:03 0:12:22 0:11:41 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301047 2021-07-29 08:10:07 2021-07-29 10:16:52 2021-07-29 10:40:10 0:23:18 0:15:45 0:07:33 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6301048 2021-07-29 08:10:08 2021-07-29 10:16:52 2021-07-29 10:37:05 0:20:13 0:09:43 0:10:30 smithi master centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
fail 6301049 2021-07-29 08:10:09 2021-07-29 10:18:03 2021-07-29 10:54:56 0:36:53 0:27:14 0:09:39 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi075 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 6301050 2021-07-29 08:10:10 2021-07-29 10:18:03 2021-07-29 10:54:10 0:36:07 0:24:31 0:11:36 smithi master centos 8.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 2
pass 6301051 2021-07-29 08:10:11 2021-07-29 10:18:43 2021-07-29 10:55:40 0:36:57 0:26:15 0:10:42 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} 2
pass 6301052 2021-07-29 08:10:12 2021-07-29 10:18:53 2021-07-29 10:37:56 0:19:03 0:10:53 0:08:10 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
pass 6301053 2021-07-29 08:10:12 2021-07-29 10:19:04 2021-07-29 10:48:41 0:29:37 0:19:17 0:10:20 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} 2
dead 6301054 2021-07-29 08:10:13 2021-07-29 10:19:14 2021-07-29 16:36:01 6:16:47 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 6301055 2021-07-29 08:10:14 2021-07-29 10:20:44 2021-07-29 10:47:47 0:27:03 0:21:13 0:05:50 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6301056 2021-07-29 08:10:15 2021-07-29 10:20:46 2021-07-29 10:51:24 0:30:38 0:18:14 0:12:24 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache} 2
pass 6301057 2021-07-29 08:10:16 2021-07-29 10:22:06 2021-07-29 10:47:21 0:25:15 0:10:18 0:14:57 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 6301058 2021-07-29 08:10:17 2021-07-29 10:25:07 2021-07-29 10:42:45 0:17:38 0:06:52 0:10:46 smithi master ubuntu 20.04 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301059 2021-07-29 08:10:18 2021-07-29 10:26:57 2021-07-29 10:49:28 0:22:31 0:08:01 0:14:30 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301060 2021-07-29 08:10:19 2021-07-29 10:32:08 2021-07-29 11:04:10 0:32:02 0:19:52 0:12:10 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} 2
pass 6301061 2021-07-29 08:10:20 2021-07-29 10:32:48 2021-07-29 11:04:32 0:31:44 0:23:53 0:07:51 smithi master rhel 8.4 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 6301062 2021-07-29 08:10:21 2021-07-29 10:32:58 2021-07-29 11:09:48 0:36:50 0:29:18 0:07:32 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 6301063 2021-07-29 08:10:22 2021-07-29 10:34:29 2021-07-29 11:42:11 1:07:42 1:01:32 0:06:10 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} 2
pass 6301064 2021-07-29 08:10:23 2021-07-29 10:34:59 2021-07-29 11:10:18 0:35:19 0:26:14 0:09:05 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 6301065 2021-07-29 08:10:24 2021-07-29 10:35:19 2021-07-29 11:02:00 0:26:41 0:16:46 0:09:55 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6301066 2021-07-29 08:10:25 2021-07-29 10:35:20 2021-07-29 10:56:32 0:21:12 0:10:39 0:10:33 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
dead 6301067 2021-07-29 08:10:26 2021-07-29 10:37:10 2021-07-29 16:34:36 5:57:26 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6301068 2021-07-29 08:10:27 2021-07-29 10:39:11 2021-07-29 11:02:10 0:22:59 0:13:44 0:09:15 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} 1
pass 6301069 2021-07-29 08:10:28 2021-07-29 10:39:11 2021-07-29 11:03:49 0:24:38 0:10:47 0:13:51 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6301070 2021-07-29 08:10:29 2021-07-29 10:40:11 2021-07-29 11:23:50 0:43:39 0:36:33 0:07:06 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 6301071 2021-07-29 08:10:30 2021-07-29 10:40:42 2021-07-29 16:34:48 5:54:06 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 6301072 2021-07-29 08:10:31 2021-07-29 10:40:42 2021-07-29 10:56:04 0:15:22 0:06:59 0:08:23 smithi master ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301073 2021-07-29 08:10:32 2021-07-29 10:40:42 2021-07-29 10:58:23 0:17:41 0:08:22 0:09:19 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6301074 2021-07-29 08:10:33 2021-07-29 10:41:12 2021-07-29 11:10:11 0:28:59 0:17:14 0:11:45 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs-ingress2 3-final} 2
pass 6301075 2021-07-29 08:10:34 2021-07-29 10:42:53 2021-07-29 11:09:37 0:26:44 0:19:07 0:07:37 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6301076 2021-07-29 08:10:36 2021-07-29 10:44:33 2021-07-29 11:38:00 0:53:27 0:46:51 0:06:36 smithi master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 6301077 2021-07-29 08:10:37 2021-07-29 10:44:53 2021-07-29 11:09:23 0:24:30 0:17:59 0:06:31 smithi master rhel 8.4 rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6301078 2021-07-29 08:10:38 2021-07-29 10:44:54 2021-07-29 11:08:47 0:23:53 0:16:15 0:07:38 smithi master rhel 8.4 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
dead 6301079 2021-07-29 08:10:39 2021-07-29 10:45:54 2021-07-29 16:35:53 5:49:59 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 6301080 2021-07-29 08:10:40 2021-07-29 10:47:24 2021-07-29 11:15:13 0:27:49 0:15:06 0:12:43 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} 3
pass 6301081 2021-07-29 08:10:41 2021-07-29 10:47:36 2021-07-29 11:14:52 0:27:16 0:19:53 0:07:23 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs 3-final} 2
pass 6301082 2021-07-29 08:10:42 2021-07-29 10:47:56 2021-07-29 11:14:44 0:26:48 0:12:58 0:13:50 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301083 2021-07-29 08:10:43 2021-07-29 10:49:17 2021-07-29 11:29:06 0:39:49 0:28:52 0:10:57 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6301084 2021-07-29 08:10:44 2021-07-29 10:49:47 2021-07-29 11:16:07 0:26:20 0:19:14 0:07:06 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
pass 6301085 2021-07-29 08:10:45 2021-07-29 10:50:07 2021-07-29 11:29:32 0:39:25 0:29:06 0:10:19 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6301086 2021-07-29 08:10:46 2021-07-29 10:50:07 2021-07-29 11:26:42 0:36:35 0:26:13 0:10:22 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6301087 2021-07-29 08:10:47 2021-07-29 10:51:28 2021-07-29 11:11:35 0:20:07 0:07:53 0:12:14 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
pass 6301088 2021-07-29 08:10:48 2021-07-29 10:54:18 2021-07-29 11:11:30 0:17:12 0:08:01 0:09:11 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301089 2021-07-29 08:10:49 2021-07-29 10:54:19 2021-07-29 11:14:08 0:19:49 0:11:05 0:08:44 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6301090 2021-07-29 08:10:50 2021-07-29 10:54:59 2021-07-29 11:14:41 0:19:42 0:08:58 0:10:44 smithi master centos 8.stream rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6301091 2021-07-29 08:10:51 2021-07-29 10:55:49 2021-07-29 11:23:33 0:27:44 0:17:22 0:10:22 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} 2
pass 6301092 2021-07-29 08:10:52 2021-07-29 10:56:09 2021-07-29 11:46:44 0:50:35 0:38:48 0:11:47 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6301093 2021-07-29 08:10:53 2021-07-29 10:57:40 2021-07-29 11:20:33 0:22:53 0:16:02 0:06:51 smithi master rhel 8.4 rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} 1
pass 6301094 2021-07-29 08:10:54 2021-07-29 10:57:40 2021-07-29 11:22:51 0:25:11 0:14:40 0:10:31 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/failover} 2
pass 6301095 2021-07-29 08:10:55 2021-07-29 10:58:30 2021-07-29 11:47:12 0:48:42 0:37:31 0:11:11 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6301096 2021-07-29 08:10:56 2021-07-29 11:00:21 2021-07-29 11:39:05 0:38:44 0:26:20 0:12:24 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6301097 2021-07-29 08:10:57 2021-07-29 11:02:01 2021-07-29 11:39:10 0:37:09 0:28:04 0:09:05 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/rados_mon_workunits} 2
pass 6301098 2021-07-29 08:10:58 2021-07-29 11:02:12 2021-07-29 13:01:12 1:59:00 1:47:39 0:11:21 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
pass 6301099 2021-07-29 08:10:59 2021-07-29 11:03:52 2021-07-29 11:22:54 0:19:02 0:10:20 0:08:42 smithi master centos 8.3 rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6301100 2021-07-29 08:10:59 2021-07-29 11:03:52 2021-07-29 11:41:16 0:37:24 0:27:45 0:09:39 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6301101 2021-07-29 08:11:00 2021-07-29 11:04:13 2021-07-29 11:24:09 0:19:56 0:10:14 0:09:42 smithi master centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6301102 2021-07-29 08:11:01 2021-07-29 11:04:33 2021-07-29 11:32:38 0:28:05 0:17:28 0:10:37 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6301103 2021-07-29 08:11:02 2021-07-29 11:05:03 2021-07-29 11:55:47 0:50:44 0:37:07 0:13:37 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 6301104 2021-07-29 08:11:03 2021-07-29 11:08:54 2021-07-29 11:52:55 0:44:01 0:31:24 0:12:37 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6301105 2021-07-29 08:11:04 2021-07-29 11:09:44 2021-07-29 16:36:00 5:26:16 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6301106 2021-07-29 08:11:05 2021-07-29 11:09:55 2021-07-29 11:39:33 0:29:38 0:18:36 0:11:02 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} 2
fail 6301107 2021-07-29 08:11:06 2021-07-29 11:10:15 2021-07-29 11:34:15 0:24:00 0:11:40 0:12:20 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi115 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:91a9515e94715ccd6b5f81448489a1ce64eacad9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a7d0278-f060-11eb-8c24-001a4aab830c -- ceph mon dump -f json'

fail 6301108 2021-07-29 08:11:07 2021-07-29 11:11:05 2021-07-29 11:55:50 0:44:45 0:34:45 0:10:00 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/erasure-code} 1
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-eio.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh'

pass 6301109 2021-07-29 08:11:08 2021-07-29 11:11:05 2021-07-29 11:32:53 0:21:48 0:10:59 0:10:49 smithi master centos 8.3 rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6301110 2021-07-29 08:11:09 2021-07-29 11:11:36 2021-07-29 11:44:34 0:32:58 0:24:10 0:08:48 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
pass 6301111 2021-07-29 08:11:10 2021-07-29 11:11:36 2021-07-29 11:36:00 0:24:24 0:13:55 0:10:29 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 6301112 2021-07-29 08:11:11 2021-07-29 11:14:47 2021-07-29 11:33:49 0:19:02 0:09:22 0:09:40 smithi master centos 8.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6301113 2021-07-29 08:11:12 2021-07-29 11:14:47 2021-07-29 11:41:41 0:26:54 0:21:37 0:05:17 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw 3-final} 2
pass 6301114 2021-07-29 08:11:13 2021-07-29 11:14:47 2021-07-29 11:34:12 0:19:25 0:10:10 0:09:15 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6301115 2021-07-29 08:11:14 2021-07-29 11:14:47 2021-07-29 12:14:25 0:59:38 0:49:09 0:10:29 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6301116 2021-07-29 08:11:15 2021-07-29 11:14:58 2021-07-29 11:54:37 0:39:39 0:33:40 0:05:59 smithi master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 6301117 2021-07-29 08:11:16 2021-07-29 11:15:18 2021-07-29 11:46:23 0:31:05 0:19:15 0:11:50 smithi master centos 8.2 rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6301118 2021-07-29 08:11:17 2021-07-29 11:16:08 2021-07-29 11:48:06 0:31:58 0:12:31 0:19:27 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301119 2021-07-29 08:11:18 2021-07-29 11:23:00 2021-07-29 12:20:54 0:57:54 0:47:21 0:10:33 smithi master ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301120 2021-07-29 08:11:19 2021-07-29 11:23:30 2021-07-29 11:46:35 0:23:05 0:16:43 0:06:22 smithi master rhel 8.4 rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
pass 6301121 2021-07-29 08:11:20 2021-07-29 11:23:40 2021-07-29 11:51:24 0:27:44 0:15:59 0:11:45 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} 2
pass 6301122 2021-07-29 08:11:21 2021-07-29 11:24:00 2021-07-29 11:47:34 0:23:34 0:17:20 0:06:14 smithi master rhel 8.4 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6301123 2021-07-29 08:11:22 2021-07-29 11:24:11 2021-07-29 12:14:11 0:50:00 0:36:23 0:13:37 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6301124 2021-07-29 08:11:23 2021-07-29 11:26:51 2021-07-29 14:01:44 2:34:53 2:24:29 0:10:24 smithi master centos 8.3 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} 1
pass 6301125 2021-07-29 08:11:24 2021-07-29 11:28:42 2021-07-29 13:16:40 1:47:58 1:40:07 0:07:51 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 6301126 2021-07-29 08:11:25 2021-07-29 11:29:32 2021-07-29 11:55:23 0:25:51 0:12:18 0:13:33 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 6301127 2021-07-29 08:11:26 2021-07-29 11:32:03 2021-07-29 11:57:55 0:25:52 0:15:30 0:10:22 smithi master centos 8.3 rados/cephadm/smoke/{distro/centos_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6301128 2021-07-29 08:11:27 2021-07-29 11:32:43 2021-07-29 11:55:51 0:23:08 0:16:19 0:06:49 smithi master rhel 8.4 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6301129 2021-07-29 08:11:28 2021-07-29 11:32:43 2021-07-29 11:56:35 0:23:52 0:13:13 0:10:39 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
dead 6301130 2021-07-29 08:11:29 2021-07-29 11:32:53 2021-07-29 16:35:27 5:02:34 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6301131 2021-07-29 08:11:30 2021-07-29 11:34:14 2021-07-29 12:17:26 0:43:12 0:34:11 0:09:01 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} 2
pass 6301132 2021-07-29 08:11:31 2021-07-29 11:34:24 2021-07-29 11:53:19 0:18:55 0:10:40 0:08:15 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6301133 2021-07-29 08:11:32 2021-07-29 11:34:24 2021-07-29 11:59:22 0:24:58 0:13:29 0:11:29 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 6301134 2021-07-29 08:11:33 2021-07-29 11:36:05 2021-07-29 12:16:11 0:40:06 0:28:38 0:11:28 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} 2
fail 6301135 2021-07-29 08:11:34 2021-07-29 11:36:45 2021-07-29 12:15:08 0:38:23 0:27:07 0:11:16 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi097 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 6301136 2021-07-29 08:11:35 2021-07-29 11:38:06 2021-07-29 12:12:35 0:34:29 0:22:26 0:12:03 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
fail 6301137 2021-07-29 08:11:36 2021-07-29 11:39:06 2021-07-29 12:04:09 0:25:03 0:15:20 0:09:43 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/repair_test} 2
Failure Reason:

++ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --pgid 11.0s0 --op list ++ grep '"oid":"repair_test_obj"' Error getting attr on : 11.0s0_head,0#11:00000000::::head#, (61) No data available + object='["11.0s0",{"oid":"repair_test_obj","key":"","snapid":-2,"hash":1039565829,"max":0,"pool":11,"namespace":"","shard_id":0,"max":0}]' + sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --pgid 11.0s0 '["11.0s0",{"oid":"repair_test_obj","key":"","snapid":-2,"hash":1039565829,"max":0,"pool":11,"namespace":"","shard_id":0,"max":0}]' rm-attr hinfo_key *** Caught signal (Segmentation fault) ** in thread 7f4743530ec0 thread_name:ceph-objectstor ceph version 17.0.0-6457-g91a9515e (91a9515e94715ccd6b5f81448489a1ce64eacad9) quincy (dev) 1: /lib64/libpthread.so.0(+0x12b20) [0x7f47409b3b20] 2: (BlueStore::store_allocator(Allocator*)+0xdc1) [0x55f480d87001] 3: (BlueStore::umount()+0x13f) [0x55f480dcdecf] 4: main() 5: __libc_start_main() 6: _start()

pass 6301138 2021-07-29 08:11:37 2021-07-29 11:39:16 2021-07-29 11:59:54 0:20:38 0:10:57 0:09:41 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
pass 6301139 2021-07-29 08:11:38 2021-07-29 11:39:16 2021-07-29 12:04:54 0:25:38 0:14:53 0:10:45 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/redirect} 2
pass 6301140 2021-07-29 08:11:39 2021-07-29 11:39:37 2021-07-29 13:16:15 1:36:38 1:26:09 0:10:29 smithi master centos 8.3 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6301141 2021-07-29 08:11:40 2021-07-29 11:41:17 2021-07-29 12:00:38 0:19:21 0:09:24 0:09:57 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
fail 6301142 2021-07-29 08:11:41 2021-07-29 11:41:17 2021-07-29 12:03:26 0:22:09 0:09:25 0:12:44 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

No module named 'tasks.thrashosds'

fail 6301143 2021-07-29 08:11:42 2021-07-29 11:42:18 2021-07-29 12:01:55 0:19:37 0:09:34 0:10:03 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

No module named 'tasks.thrashosds'

pass 6301144 2021-07-29 08:11:43 2021-07-29 11:43:48 2021-07-29 12:09:32 0:25:44 0:15:45 0:09:59 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/client-keyring 3-final} 2
pass 6301145 2021-07-29 08:11:44 2021-07-29 11:44:39 2021-07-29 12:11:41 0:27:02 0:16:12 0:10:50 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6301146 2021-07-29 08:11:45 2021-07-29 11:46:29 2021-07-29 12:11:42 0:25:13 0:19:22 0:05:51 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/iscsi 3-final} 2
pass 6301147 2021-07-29 08:11:46 2021-07-29 11:46:39 2021-07-29 12:07:04 0:20:25 0:12:48 0:07:37 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/mgr} 1
fail 6301148 2021-07-29 08:11:47 2021-07-29 11:46:40 2021-07-29 12:04:14 0:17:34 0:06:36 0:10:58 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

Command failed on smithi090 with status 1: 'sudo yum -y install cephfs-java'

fail 6301149 2021-07-29 08:11:48 2021-07-29 11:46:41 2021-07-29 12:02:09 0:15:28 0:05:32 0:09:56 smithi master ubuntu 20.04 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

No module named 'tasks.ceph'

fail 6301150 2021-07-29 08:11:49 2021-07-29 11:46:51 2021-07-29 12:03:29 0:16:38 0:07:50 0:08:48 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed on smithi019 with status 1: 'sudo yum -y install cephfs-java'

pass 6301151 2021-07-29 08:11:50 2021-07-29 11:46:51 2021-07-29 12:16:31 0:29:40 0:19:15 0:10:25 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 6301152 2021-07-29 08:11:51 2021-07-29 11:47:22 2021-07-29 12:47:17 0:59:55 0:49:17 0:10:38 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6301153 2021-07-29 08:11:52 2021-07-29 11:48:12 2021-07-29 12:14:26 0:26:14 0:12:05 0:14:09 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301154 2021-07-29 08:11:53 2021-07-29 11:51:33 2021-07-29 12:24:36 0:33:03 0:21:01 0:12:02 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 2
pass 6301155 2021-07-29 08:11:54 2021-07-29 11:53:03 2021-07-29 12:17:04 0:24:01 0:16:48 0:07:13 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
fail 6301156 2021-07-29 08:11:55 2021-07-29 11:53:23 2021-07-29 12:10:27 0:17:04 0:04:01 0:13:03 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} 2
Failure Reason:

No module named 'tasks'

pass 6301157 2021-07-29 08:11:56 2021-07-29 11:54:44 2021-07-29 12:39:40 0:44:56 0:32:07 0:12:49 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
fail 6301158 2021-07-29 08:11:57 2021-07-29 11:55:44 2021-07-29 12:18:41 0:22:57 0:15:46 0:07:11 smithi master rhel 8.4 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} 1
Failure Reason:

No module named 'tasks'

pass 6301159 2021-07-29 08:11:58 2021-07-29 11:55:44 2021-07-29 12:13:27 0:17:43 0:07:21 0:10:22 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
fail 6301160 2021-07-29 08:11:59 2021-07-29 11:55:55 2021-07-29 12:12:50 0:16:55 0:06:28 0:10:27 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

No module named 'tasks'

pass 6301161 2021-07-29 08:12:00 2021-07-29 11:55:55 2021-07-29 12:22:03 0:26:08 0:15:12 0:10:56 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 6301162 2021-07-29 08:12:01 2021-07-29 11:56:45 2021-07-29 12:35:39 0:38:54 0:27:53 0:11:01 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 6301163 2021-07-29 08:12:02 2021-07-29 11:58:06 2021-07-29 12:24:53 0:26:47 0:19:34 0:07:13 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6301164 2021-07-29 08:12:03 2021-07-29 11:59:26 2021-07-29 12:36:52 0:37:26 0:26:27 0:10:59 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6301165 2021-07-29 08:12:04 2021-07-29 11:59:56 2021-07-29 12:29:55 0:29:59 0:19:20 0:10:39 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6301166 2021-07-29 08:12:05 2021-07-29 12:01:14 2021-07-29 12:20:25 0:19:11 0:13:11 0:06:00 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
pass 6301167 2021-07-29 08:12:06 2021-07-29 12:02:04 2021-07-29 12:50:50 0:48:46 0:37:41 0:11:05 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 6301168 2021-07-29 08:12:07 2021-07-29 12:03:34 2021-07-29 12:38:36 0:35:02 0:24:41 0:10:21 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6301169 2021-07-29 08:12:08 2021-07-29 12:03:35 2021-07-29 12:30:20 0:26:45 0:20:34 0:06:11 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6301170 2021-07-29 08:12:09 2021-07-29 12:03:35 2021-07-29 12:32:12 0:28:37 0:17:26 0:11:11 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} 2
pass 6301171 2021-07-29 08:12:10 2021-07-29 12:04:15 2021-07-29 13:04:16 1:00:01 0:48:58 0:11:03 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} 2
pass 6301172 2021-07-29 08:12:11 2021-07-29 12:04:56 2021-07-29 12:33:48 0:28:52 0:17:00 0:11:52 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6301173 2021-07-29 08:12:12 2021-07-29 12:07:06 2021-07-29 12:54:12 0:47:06 0:30:50 0:16:16 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} 3
pass 6301174 2021-07-29 08:12:13 2021-07-29 12:10:37 2021-07-29 12:36:40 0:26:03 0:14:51 0:11:12 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 6301175 2021-07-29 08:12:14 2021-07-29 12:11:47 2021-07-29 12:48:37 0:36:50 0:27:09 0:09:41 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6301176 2021-07-29 08:12:15 2021-07-29 12:11:47 2021-07-29 12:31:18 0:19:31 0:09:39 0:09:52 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
dead 6301177 2021-07-29 08:12:16 2021-07-29 12:12:38 2021-07-29 16:34:28 4:21:50 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6301178 2021-07-29 08:12:17 2021-07-29 12:12:58 2021-07-29 16:35:52 4:22:54 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6301179 2021-07-29 08:12:18 2021-07-29 12:14:19 2021-07-29 12:31:25 0:17:06 0:07:59 0:09:07 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
pass 6301180 2021-07-29 08:12:22 2021-07-29 12:14:19 2021-07-29 12:41:26 0:27:07 0:20:13 0:06:54 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6301181 2021-07-29 08:12:23 2021-07-29 12:14:29 2021-07-29 12:43:23 0:28:54 0:22:08 0:06:46 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs-ingress 3-final} 2
pass 6301182 2021-07-29 08:12:24 2021-07-29 12:14:29 2021-07-29 12:57:40 0:43:11 0:32:13 0:10:58 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6301183 2021-07-29 08:12:25 2021-07-29 12:14:30 2021-07-29 12:48:11 0:33:41 0:23:48 0:09:53 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
pass 6301184 2021-07-29 08:12:26 2021-07-29 12:15:10 2021-07-29 13:13:19 0:58:09 0:51:14 0:06:55 smithi master rhel 8.4 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6301185 2021-07-29 08:12:27 2021-07-29 12:16:20 2021-07-29 13:03:28 0:47:08 0:40:10 0:06:58 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} 1
pass 6301186 2021-07-29 08:12:28 2021-07-29 12:16:20 2021-07-29 12:42:47 0:26:27 0:12:53 0:13:34 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6301187 2021-07-29 08:12:29 2021-07-29 12:17:11 2021-07-29 12:47:00 0:29:49 0:19:21 0:10:28 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final} 2
pass 6301188 2021-07-29 08:12:30 2021-07-29 12:17:31 2021-07-29 12:54:01 0:36:30 0:24:26 0:12:04 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6301189 2021-07-29 08:12:31 2021-07-29 12:18:52 2021-07-29 12:45:01 0:26:09 0:18:17 0:07:52 smithi master rhel 8.4 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 6301190 2021-07-29 08:12:32 2021-07-29 12:20:32 2021-07-29 12:43:06 0:22:34 0:13:59 0:08:35 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6301191 2021-07-29 08:12:33 2021-07-29 12:20:32 2021-07-29 12:36:25 0:15:53 0:06:30 0:09:23 smithi master ubuntu 20.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 6301192 2021-07-29 08:12:34 2021-07-29 12:21:03 2021-07-29 12:41:25 0:20:22 0:08:30 0:11:52 smithi master centos 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 2
pass 6301193 2021-07-29 08:12:36 2021-07-29 12:22:13 2021-07-29 12:52:17 0:30:04 0:17:08 0:12:56 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6301194 2021-07-29 08:12:37 2021-07-29 12:24:44 2021-07-29 12:50:11 0:25:27 0:19:25 0:06:02 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 6301195 2021-07-29 08:12:38 2021-07-29 12:24:54 2021-07-29 13:04:56 0:40:02 0:24:58 0:15:04 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
pass 6301196 2021-07-29 08:12:39 2021-07-29 12:30:05 2021-07-29 13:06:44 0:36:39 0:28:06 0:08:33 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/progress} 2
pass 6301197 2021-07-29 08:12:40 2021-07-29 12:31:25 2021-07-29 13:06:33 0:35:08 0:25:42 0:09:26 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 6301198 2021-07-29 08:12:41 2021-07-29 12:31:25 2021-07-29 12:50:29 0:19:04 0:10:36 0:08:28 smithi master centos 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6301199 2021-07-29 08:12:42 2021-07-29 12:31:35 2021-07-29 12:53:03 0:21:28 0:11:08 0:10:20 smithi master centos 8.3 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6301200 2021-07-29 08:12:43 2021-07-29 12:32:16 2021-07-29 12:58:46 0:26:30 0:15:37 0:10:53 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs 3-final} 2
pass 6301201 2021-07-29 08:12:44 2021-07-29 12:33:56 2021-07-29 13:11:05 0:37:09 0:24:30 0:12:39 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_kubic_stable fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
pass 6301202 2021-07-29 08:12:45 2021-07-29 12:35:47 2021-07-29 14:00:09 1:24:22 1:14:03 0:10:19 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 6301203 2021-07-29 08:12:47 2021-07-29 12:36:27 2021-07-29 12:57:45 0:21:18 0:09:46 0:11:32 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/rados_5925} 2
pass 6301204 2021-07-29 08:12:48 2021-07-29 12:38:39 2021-07-29 13:09:26 0:30:47 0:18:09 0:12:38 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} 2
pass 6301205 2021-07-29 08:12:49 2021-07-29 12:39:49 2021-07-29 13:06:43 0:26:54 0:20:04 0:06:50 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/nfs2 3-final} 2
pass 6301206 2021-07-29 08:12:50 2021-07-29 12:39:49 2021-07-29 14:04:51 1:25:02 1:13:23 0:11:39 smithi master centos 8.2 rados/dashboard/{centos_8.2_kubic_stable debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} 2
pass 6301207 2021-07-29 08:12:51 2021-07-29 12:41:30 2021-07-29 13:06:36 0:25:06 0:16:43 0:08:23 smithi master centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6301208 2021-07-29 08:12:52 2021-07-29 12:41:30 2021-07-29 14:18:28 1:36:58 1:28:38 0:08:20 smithi master rhel 8.3 rados/upgrade/parallel/{0-distro$/{rhel_8.3_kubic_stable} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
dead 6301209 2021-07-29 08:12:53 2021-07-29 12:42:50 2021-07-29 12:58:11 0:15:21 0:04:03 0:11:18 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} 2
Failure Reason:

{'Failure object was': {'smithi028.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6301210 2021-07-29 08:12:54 2021-07-29 12:42:51 2021-07-29 13:11:40 0:28:49 0:22:57 0:05:52 smithi master rhel 8.4 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6301211 2021-07-29 08:12:55 2021-07-29 12:43:11 2021-07-29 14:13:54 1:30:43 1:18:01 0:12:42 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} 3
dead 6301212 2021-07-29 08:12:56 2021-07-29 12:45:01 2021-07-29 16:35:07 3:50:06 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6301213 2021-07-29 08:12:57 2021-07-29 12:47:02 2021-07-29 13:11:22 0:24:20 0:11:49 0:12:31 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
dead 6301214 2021-07-29 08:12:58 2021-07-29 12:48:13 2021-07-29 16:36:19 3:48:06 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6301215 2021-07-29 08:12:59 2021-07-29 12:48:44 2021-07-29 13:29:33 0:40:49 0:29:08 0:11:41 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_kubic_stable 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6301216 2021-07-29 08:13:00 2021-07-29 12:50:14 2021-07-29 13:09:40 0:19:26 0:10:28 0:08:58 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 6301217 2021-07-29 08:13:01 2021-07-29 12:50:14 2021-07-29 13:19:55 0:29:41 0:23:07 0:06:34 smithi master rhel 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.3_kubic_stable} 2-node-mgr orchestrator_cli} 2
Failure Reason:

Test failure: test_host_rm (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli)

pass 6301218 2021-07-29 08:13:02 2021-07-29 12:50:55 2021-07-29 13:09:48 0:18:53 0:10:33 0:08:20 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6301219 2021-07-29 08:13:03 2021-07-29 12:50:55 2021-07-29 13:11:30 0:20:35 0:10:15 0:10:20 smithi master centos 8.3 rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
dead 6301220 2021-07-29 08:13:04 2021-07-29 12:52:25 2021-07-29 16:34:49 3:42:24 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6301221 2021-07-29 08:13:05 2021-07-29 12:53:06 2021-07-29 13:29:04 0:35:58 0:29:04 0:06:54 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
pass 6301222 2021-07-29 08:13:06 2021-07-29 12:54:06 2021-07-29 13:21:29 0:27:23 0:17:45 0:09:38 smithi master centos 8.3 rados/cephadm/smoke/{distro/centos_8.3_kubic_stable fixed-2 mon_election/classic start} 2
fail 6301223 2021-07-29 08:13:07 2021-07-29 12:54:16 2021-07-29 13:29:36 0:35:20 0:25:28 0:09:52 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi101 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91a9515e94715ccd6b5f81448489a1ce64eacad9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 6301224 2021-07-29 08:13:08 2021-07-29 12:54:17 2021-07-29 13:22:56 0:28:39 0:13:02 0:15:37 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4