Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5595699 2020-11-06 15:51:32 2020-11-06 15:53:07 2020-11-06 16:49:07 0:56:00 0:42:58 0:13:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5595700 2020-11-06 15:51:33 2020-11-06 15:53:07 2020-11-06 16:51:07 0:58:00 0:48:35 0:09:25 smithi master rhel 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} 1
fail 5595701 2020-11-06 15:51:34 2020-11-06 15:53:07 2020-11-06 19:23:11 3:30:04 3:15:42 0:14:22 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
Failure Reason:

Command failed (workunit test mon/caps.sh) on smithi150 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=035b993cefb5754a0e8bcb9b3f9713c4ab833458 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

pass 5595702 2020-11-06 15:51:34 2020-11-06 15:53:07 2020-11-06 16:53:07 1:00:00 0:32:42 0:27:18 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5595703 2020-11-06 15:51:35 2020-11-06 15:55:01 2020-11-06 16:17:01 0:22:00 0:05:45 0:16:15 smithi master ubuntu 18.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5595704 2020-11-06 15:51:36 2020-11-06 15:55:01 2020-11-06 16:51:01 0:56:00 0:48:18 0:07:42 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5595705 2020-11-06 15:51:37 2020-11-06 15:55:03 2020-11-06 16:23:02 0:27:59 0:19:28 0:08:31 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} 2
pass 5595706 2020-11-06 15:51:38 2020-11-06 15:56:47 2020-11-06 17:48:48 1:52:01 1:43:24 0:08:37 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench} 2
pass 5595707 2020-11-06 15:51:38 2020-11-06 15:56:47 2020-11-06 16:10:46 0:13:59 0:08:05 0:05:54 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5595708 2020-11-06 15:51:39 2020-11-06 15:56:47 2020-11-06 16:26:47 0:30:00 0:21:28 0:08:32 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 5595709 2020-11-06 15:51:40 2020-11-06 15:56:49 2020-11-06 16:16:48 0:19:59 0:11:56 0:08:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 5595710 2020-11-06 15:51:41 2020-11-06 15:57:04 2020-11-06 16:17:03 0:19:59 0:12:23 0:07:36 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 5595711 2020-11-06 15:51:41 2020-11-06 15:59:40 2020-11-06 16:21:39 0:21:59 0:12:10 0:09:49 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} 2
pass 5595712 2020-11-06 15:51:42 2020-11-06 15:59:40 2020-11-06 16:25:40 0:26:00 0:09:35 0:16:25 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595713 2020-11-06 15:51:43 2020-11-06 15:59:40 2020-11-06 16:11:39 0:11:59 0:05:11 0:06:48 smithi master ubuntu 18.04 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595714 2020-11-06 15:51:44 2020-11-06 15:59:40 2020-11-06 16:19:40 0:20:00 0:10:49 0:09:11 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5595715 2020-11-06 15:51:44 2020-11-06 16:00:26 2020-11-06 16:24:26 0:24:00 0:13:01 0:10:59 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 5595716 2020-11-06 15:51:45 2020-11-06 16:02:27 2020-11-06 16:22:26 0:19:59 0:11:35 0:08:24 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5595717 2020-11-06 15:51:46 2020-11-06 16:02:27 2020-11-06 16:26:27 0:24:00 0:15:00 0:09:00 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595718 2020-11-06 15:51:47 2020-11-06 16:02:27 2020-11-06 16:20:26 0:17:59 0:08:54 0:09:05 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} 2
pass 5595719 2020-11-06 15:51:48 2020-11-06 16:03:18 2020-11-06 16:31:17 0:27:59 0:17:42 0:10:17 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 5595720 2020-11-06 15:51:48 2020-11-06 16:05:58 2020-11-06 16:35:58 0:30:00 0:20:20 0:09:40 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 5595721 2020-11-06 15:51:49 2020-11-06 16:05:58 2020-11-06 16:29:58 0:24:00 0:11:54 0:12:06 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 5595722 2020-11-06 15:51:50 2020-11-06 16:05:58 2020-11-06 17:19:59 1:14:01 1:04:25 0:09:36 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5595723 2020-11-06 15:51:51 2020-11-06 16:06:34 2020-11-06 16:34:34 0:28:00 0:21:09 0:06:51 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 5595724 2020-11-06 15:51:52 2020-11-06 16:07:40 2020-11-06 16:17:39 0:09:59 0:04:17 0:05:42 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} 1
pass 5595725 2020-11-06 15:51:52 2020-11-06 16:07:40 2020-11-06 17:05:40 0:58:00 0:50:08 0:07:52 smithi master centos 8.1 rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 5595726 2020-11-06 15:51:53 2020-11-06 16:07:40 2020-11-06 16:37:40 0:30:00 0:16:21 0:13:39 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 5595727 2020-11-06 15:51:54 2020-11-06 16:09:30 2020-11-06 16:37:30 0:28:00 0:15:42 0:12:18 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} 2
pass 5595728 2020-11-06 15:51:55 2020-11-06 16:09:30 2020-11-06 16:47:30 0:38:00 0:19:34 0:18:26 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 2
pass 5595729 2020-11-06 15:51:55 2020-11-06 16:09:48 2020-11-06 19:19:52 3:10:04 3:04:05 0:05:59 smithi master centos 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd} 1
pass 5595730 2020-11-06 15:51:56 2020-11-06 16:09:52 2020-11-06 16:49:52 0:40:00 0:19:39 0:20:21 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 5595731 2020-11-06 15:51:57 2020-11-06 16:10:25 2020-11-06 16:48:25 0:38:00 0:30:51 0:07:09 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
pass 5595732 2020-11-06 15:51:58 2020-11-06 16:11:23 2020-11-06 17:03:24 0:52:01 0:08:46 0:43:15 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5595733 2020-11-06 15:51:58 2020-11-06 16:11:24 2020-11-06 17:35:25 1:24:01 1:03:56 0:20:05 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
pass 5595734 2020-11-06 15:51:59 2020-11-06 16:11:23 2020-11-06 16:53:23 0:42:00 0:31:50 0:10:10 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5595735 2020-11-06 15:52:00 2020-11-06 16:11:40 2020-11-06 16:51:40 0:40:00 0:29:46 0:10:14 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5595736 2020-11-06 15:52:01 2020-11-06 16:11:51 2020-11-06 16:57:51 0:46:00 0:38:31 0:07:29 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5595737 2020-11-06 15:52:01 2020-11-06 16:12:03 2020-11-06 17:16:03 1:04:00 0:57:26 0:06:34 smithi master rhel 8.1 rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5595738 2020-11-06 15:52:02 2020-11-06 16:13:05 2020-11-06 16:47:05 0:34:00 0:20:33 0:13:27 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595739 2020-11-06 15:52:03 2020-11-06 16:13:05 2020-11-06 16:57:05 0:44:00 0:33:29 0:10:31 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5595740 2020-11-06 15:52:04 2020-11-06 16:15:11 2020-11-06 16:35:11 0:20:00 0:11:48 0:08:12 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5595741 2020-11-06 15:52:04 2020-11-06 16:15:12 2020-11-06 16:43:11 0:27:59 0:14:51 0:13:08 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} 2
pass 5595742 2020-11-06 15:52:05 2020-11-06 16:15:25 2020-11-06 16:37:24 0:21:59 0:15:53 0:06:06 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595743 2020-11-06 15:52:06 2020-11-06 16:17:26 2020-11-06 16:59:26 0:42:00 0:31:17 0:10:43 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 5595744 2020-11-06 15:52:07 2020-11-06 16:17:26 2020-11-06 17:03:26 0:46:00 0:31:19 0:14:41 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5595745 2020-11-06 15:52:08 2020-11-06 16:17:26 2020-11-06 16:55:26 0:38:00 0:25:35 0:12:25 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 5595746 2020-11-06 15:52:08 2020-11-06 16:17:40 2020-11-06 16:35:39 0:17:59 0:08:50 0:09:09 smithi master centos 8.1 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 5595747 2020-11-06 15:52:09 2020-11-06 16:20:17 2020-11-06 17:30:17 1:10:00 0:59:23 0:10:37 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5595748 2020-11-06 15:52:10 2020-11-06 16:20:27 2020-11-06 21:48:34 5:28:07 5:13:22 0:14:45 smithi master rhel 8.1 rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} 1
pass 5595749 2020-11-06 15:52:11 2020-11-06 16:22:09 2020-11-06 16:54:08 0:31:59 0:12:04 0:19:55 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5595750 2020-11-06 15:52:12 2020-11-06 16:22:09 2020-11-06 16:54:08 0:31:59 0:18:41 0:13:18 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5595751 2020-11-06 15:52:12 2020-11-06 16:22:28 2020-11-06 16:54:27 0:31:59 0:18:29 0:13:30 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} 2
pass 5595752 2020-11-06 15:52:13 2020-11-06 16:23:04 2020-11-06 16:35:03 0:11:59 0:05:42 0:06:17 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595753 2020-11-06 15:52:14 2020-11-06 16:25:02 2020-11-06 17:17:03 0:52:01 0:35:39 0:16:22 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5595754 2020-11-06 15:52:15 2020-11-06 16:25:03 2020-11-06 17:07:03 0:42:00 0:14:36 0:27:24 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595755 2020-11-06 15:52:15 2020-11-06 16:25:03 2020-11-06 16:37:03 0:12:00 0:05:56 0:06:04 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595756 2020-11-06 15:52:16 2020-11-06 16:25:14 2020-11-06 17:11:14 0:46:00 0:21:19 0:24:41 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 5595757 2020-11-06 15:52:17 2020-11-06 16:25:22 2020-11-06 16:57:22 0:32:00 0:21:50 0:10:10 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 5595758 2020-11-06 15:52:18 2020-11-06 16:25:32 2020-11-06 17:13:33 0:48:01 0:32:33 0:15:28 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
pass 5595759 2020-11-06 15:52:18 2020-11-06 16:25:41 2020-11-06 16:45:40 0:19:59 0:13:31 0:06:28 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 5595760 2020-11-06 15:52:19 2020-11-06 16:27:03 2020-11-06 16:53:02 0:25:59 0:11:31 0:14:28 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 5595761 2020-11-06 15:52:20 2020-11-06 16:27:03 2020-11-06 16:53:03 0:26:00 0:09:44 0:16:16 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 5595762 2020-11-06 15:52:21 2020-11-06 16:30:36 2020-11-06 18:14:37 1:44:01 1:35:10 0:08:51 smithi master rhel 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/scrub} 1
pass 5595763 2020-11-06 15:52:22 2020-11-06 16:30:36 2020-11-06 16:54:36 0:24:00 0:15:24 0:08:36 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 5595764 2020-11-06 15:52:22 2020-11-06 16:31:19 2020-11-06 16:57:18 0:25:59 0:17:18 0:08:41 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} 1
pass 5595765 2020-11-06 15:52:23 2020-11-06 16:35:11 2020-11-06 17:11:10 0:35:59 0:28:54 0:07:05 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5595766 2020-11-06 15:52:24 2020-11-06 16:35:11 2020-11-06 16:51:10 0:15:59 0:08:48 0:07:11 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5595767 2020-11-06 15:52:24 2020-11-06 16:35:11 2020-11-06 17:13:11 0:38:00 0:31:18 0:06:42 smithi master rhel 8.1 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595768 2020-11-06 15:52:25 2020-11-06 16:35:12 2020-11-06 17:15:12 0:40:00 0:31:21 0:08:39 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5595769 2020-11-06 15:52:26 2020-11-06 16:35:25 2020-11-06 17:07:25 0:32:00 0:19:47 0:12:13 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 5595770 2020-11-06 15:52:27 2020-11-06 16:35:41 2020-11-06 17:41:41 1:06:00 0:59:49 0:06:11 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5595771 2020-11-06 15:52:28 2020-11-06 16:35:59 2020-11-06 17:05:58 0:29:59 0:23:09 0:06:50 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5595772 2020-11-06 15:52:28 2020-11-06 16:37:39 2020-11-06 17:07:39 0:30:00 0:14:00 0:16:00 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} 2
pass 5595773 2020-11-06 15:52:29 2020-11-06 16:37:40 2020-11-06 16:57:39 0:19:59 0:15:20 0:04:39 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5595774 2020-11-06 15:52:30 2020-11-06 16:37:40 2020-11-06 17:15:40 0:38:00 0:18:36 0:19:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 5595775 2020-11-06 15:52:31 2020-11-06 16:37:40 2020-11-06 17:37:40 1:00:00 0:32:46 0:27:14 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5595776 2020-11-06 15:52:31 2020-11-06 16:37:41 2020-11-06 17:13:40 0:35:59 0:15:13 0:20:46 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
pass 5595777 2020-11-06 15:52:32 2020-11-06 16:39:49 2020-11-06 17:09:49 0:30:00 0:11:47 0:18:13 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5595778 2020-11-06 15:52:33 2020-11-06 16:43:48 2020-11-06 17:09:48 0:26:00 0:13:13 0:12:47 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 5595779 2020-11-06 15:52:34 2020-11-06 16:45:41 2020-11-06 17:05:40 0:19:59 0:11:56 0:08:03 smithi master rhel 8.1 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5595780 2020-11-06 15:52:35 2020-11-06 16:45:41 2020-11-06 17:45:42 1:00:01 0:32:22 0:27:39 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 5595781 2020-11-06 15:52:35 2020-11-06 16:47:42 2020-11-06 17:21:42 0:34:00 0:21:53 0:12:07 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595782 2020-11-06 15:52:36 2020-11-06 16:47:42 2020-11-06 17:27:42 0:40:00 0:29:04 0:10:56 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5595783 2020-11-06 15:52:37 2020-11-06 16:48:26 2020-11-06 17:10:26 0:22:00 0:14:23 0:07:37 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} 2
pass 5595784 2020-11-06 15:52:38 2020-11-06 16:49:44 2020-11-06 19:05:46 2:16:02 2:05:31 0:10:31 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 5595785 2020-11-06 15:52:38 2020-11-06 16:49:53 2020-11-06 17:11:52 0:21:59 0:12:55 0:09:04 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} 2
pass 5595786 2020-11-06 15:52:39 2020-11-06 16:51:39 2020-11-06 17:09:38 0:17:59 0:10:39 0:07:20 smithi master rhel 8.1 rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 5595787 2020-11-06 15:52:40 2020-11-06 16:51:39 2020-11-06 17:05:38 0:13:59 0:07:50 0:06:09 smithi master centos 8.1 rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
fail 5595788 2020-11-06 15:52:41 2020-11-06 16:51:39 2020-11-06 17:21:38 0:29:59 0:22:19 0:07:40 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

"2020-11-06T17:11:59.540830+0000 osd.0 (osd.0) 211 : cluster [ERR] scrub 57.4 57:20778254:test-rados-api-smithi152-22014-74::foo:24 : size 0 != clone_size 10" in cluster log

pass 5595789 2020-11-06 15:52:41 2020-11-06 16:51:41 2020-11-06 17:17:41 0:26:00 0:20:19 0:05:41 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 5595790 2020-11-06 15:52:42 2020-11-06 16:52:29 2020-11-06 18:06:29 1:14:00 1:05:52 0:08:08 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5595791 2020-11-06 15:52:43 2020-11-06 16:53:39 2020-11-06 17:21:39 0:28:00 0:09:43 0:18:17 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595792 2020-11-06 15:52:44 2020-11-06 16:53:39 2020-11-06 17:23:39 0:30:00 0:23:23 0:06:37 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 2
pass 5595793 2020-11-06 15:52:45 2020-11-06 16:53:39 2020-11-06 18:05:40 1:12:01 1:05:01 0:07:00 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5595794 2020-11-06 15:52:45 2020-11-06 16:53:39 2020-11-06 17:07:38 0:13:59 0:07:39 0:06:20 smithi master centos 8.1 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 5595795 2020-11-06 15:52:46 2020-11-06 16:53:39 2020-11-06 17:13:39 0:20:00 0:11:49 0:08:11 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5595796 2020-11-06 15:52:47 2020-11-06 16:54:09 2020-11-06 17:10:09 0:16:00 0:06:54 0:09:06 smithi master ubuntu 18.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 5595797 2020-11-06 15:52:48 2020-11-06 16:54:09 2020-11-06 17:32:09 0:38:00 0:28:57 0:09:03 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5595798 2020-11-06 15:52:48 2020-11-06 16:54:28 2020-11-06 17:18:28 0:24:00 0:18:06 0:05:54 smithi master rhel 8.1 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595799 2020-11-06 15:52:49 2020-11-06 16:54:37 2020-11-06 17:10:36 0:15:59 0:09:43 0:06:16 smithi master centos 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} 1
pass 5595800 2020-11-06 15:52:50 2020-11-06 16:56:03 2020-11-06 22:34:09 5:38:06 5:18:29 0:19:37 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} 4
pass 5595801 2020-11-06 15:52:51 2020-11-06 16:57:42 2020-11-06 17:21:42 0:24:00 0:17:22 0:06:38 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 5595802 2020-11-06 15:52:52 2020-11-06 16:57:42 2020-11-06 18:47:44 1:50:02 1:39:10 0:10:52 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 5595803 2020-11-06 15:52:52 2020-11-06 16:57:42 2020-11-06 17:39:42 0:42:00 0:27:44 0:14:16 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5595804 2020-11-06 15:52:53 2020-11-06 16:57:42 2020-11-06 19:11:44 2:14:02 2:04:12 0:09:50 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 5595805 2020-11-06 15:52:54 2020-11-06 16:57:52 2020-11-06 17:27:52 0:30:00 0:15:21 0:14:39 smithi master centos 8.1 rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} 2
pass 5595806 2020-11-06 15:52:55 2020-11-06 17:00:04 2020-11-06 17:14:03 0:13:59 0:08:52 0:05:07 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595807 2020-11-06 15:52:55 2020-11-06 17:04:02 2020-11-06 17:22:01 0:17:59 0:10:00 0:07:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} 2
pass 5595808 2020-11-06 15:52:56 2020-11-06 17:04:02 2020-11-06 17:22:01 0:17:59 0:09:27 0:08:32 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 5595809 2020-11-06 15:52:57 2020-11-06 17:06:17 2020-11-06 17:26:17 0:20:00 0:10:28 0:09:32 smithi master centos 8.1 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} 2
pass 5595810 2020-11-06 15:52:58 2020-11-06 17:06:17 2020-11-06 17:26:17 0:20:00 0:12:11 0:07:49 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
fail 5595811 2020-11-06 15:52:58 2020-11-06 17:06:17 2020-11-06 17:24:17 0:18:00 0:12:16 0:05:44 smithi master rhel 8.1 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed on smithi082 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 5595812 2020-11-06 15:52:59 2020-11-06 17:06:17 2020-11-06 17:26:17 0:20:00 0:12:46 0:07:14 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} 2
pass 5595813 2020-11-06 15:53:00 2020-11-06 17:06:55 2020-11-06 17:26:55 0:20:00 0:12:53 0:07:07 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 5595814 2020-11-06 15:53:01 2020-11-06 17:07:04 2020-11-06 17:25:03 0:17:59 0:11:40 0:06:19 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5595815 2020-11-06 15:53:01 2020-11-06 17:08:05 2020-11-06 17:32:04 0:23:59 0:16:58 0:07:01 smithi master rhel 8.1 rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5595816 2020-11-06 15:53:02 2020-11-06 17:08:05 2020-11-06 17:30:04 0:21:59 0:14:59 0:07:00 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
fail 5595817 2020-11-06 15:53:03 2020-11-06 17:08:05 2020-11-06 17:38:05 0:30:00 0:22:54 0:07:06 smithi master centos 8.0 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/misc.log:2020-11-06T17:23:19.467949+00:00 smithi155 bash[23009]: debug 2020-11-06T17:23:19.467+0000 7f65f7dfa700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... ' in syslog

pass 5595818 2020-11-06 15:53:04 2020-11-06 17:08:05 2020-11-06 17:40:04 0:31:59 0:25:46 0:06:13 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 5595819 2020-11-06 15:53:04 2020-11-06 17:08:05 2020-11-06 18:14:05 1:06:00 0:59:24 0:06:36 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5595820 2020-11-06 15:53:05 2020-11-06 17:10:16 2020-11-06 17:30:16 0:20:00 0:12:19 0:07:41 smithi master rhel 8.1 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595821 2020-11-06 15:53:06 2020-11-06 17:10:17 2020-11-06 17:44:16 0:33:59 0:13:57 0:20:02 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5595822 2020-11-06 15:53:07 2020-11-06 17:10:17 2020-11-06 17:46:16 0:35:59 0:27:39 0:08:20 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 5595823 2020-11-06 15:53:08 2020-11-06 17:10:16 2020-11-06 17:26:16 0:16:00 0:09:25 0:06:35 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
fail 5595824 2020-11-06 15:53:08 2020-11-06 17:10:17 2020-11-06 17:26:16 0:15:59 0:06:40 0:09:19 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} 1
Failure Reason:

Command failed (workunit test cephadm/test_adoption.sh) on smithi204 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=035b993cefb5754a0e8bcb9b3f9713c4ab833458 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh'

pass 5595825 2020-11-06 15:53:09 2020-11-06 17:10:27 2020-11-06 17:44:27 0:34:00 0:22:36 0:11:24 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 5595826 2020-11-06 15:53:10 2020-11-06 17:10:37 2020-11-06 17:54:37 0:44:00 0:36:46 0:07:14 smithi master centos 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 5595827 2020-11-06 15:53:11 2020-11-06 17:10:47 2020-11-06 17:28:46 0:17:59 0:12:19 0:05:40 smithi master rhel 8.1 rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5595828 2020-11-06 15:53:11 2020-11-06 17:11:08 2020-11-06 18:15:09 1:04:01 0:22:07 0:41:54 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 5595829 2020-11-06 15:53:12 2020-11-06 17:11:11 2020-11-06 17:39:11 0:28:00 0:17:48 0:10:12 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 2
pass 5595830 2020-11-06 15:53:13 2020-11-06 17:11:15 2020-11-06 17:43:15 0:32:00 0:25:53 0:06:07 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595831 2020-11-06 15:53:14 2020-11-06 17:12:31 2020-11-06 17:32:31 0:20:00 0:13:05 0:06:55 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} 2
pass 5595832 2020-11-06 15:53:14 2020-11-06 17:13:12 2020-11-06 17:41:12 0:28:00 0:18:59 0:09:01 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5595833 2020-11-06 15:53:15 2020-11-06 17:14:13 2020-11-06 17:54:13 0:40:00 0:24:37 0:15:23 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5595834 2020-11-06 15:53:16 2020-11-06 17:14:13 2020-11-06 17:40:13 0:26:00 0:12:10 0:13:50 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} 2
pass 5595835 2020-11-06 15:53:17 2020-11-06 17:14:13 2020-11-06 17:52:13 0:38:00 0:30:35 0:07:25 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5595836 2020-11-06 15:53:17 2020-11-06 17:14:14 2020-11-06 17:32:13 0:17:59 0:05:46 0:12:13 smithi master ubuntu 18.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5595837 2020-11-06 15:53:18 2020-11-06 17:15:13 2020-11-06 17:31:13 0:16:00 0:07:13 0:08:47 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5595838 2020-11-06 15:53:19 2020-11-06 17:16:18 2020-11-06 17:52:18 0:36:00 0:25:55 0:10:05 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5595839 2020-11-06 15:53:19 2020-11-06 17:16:18 2020-11-06 17:40:18 0:24:00 0:10:08 0:13:52 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595840 2020-11-06 15:53:20 2020-11-06 17:17:04 2020-11-06 18:01:04 0:44:00 0:35:12 0:08:48 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 5595841 2020-11-06 15:53:21 2020-11-06 17:18:19 2020-11-06 17:44:19 0:26:00 0:19:49 0:06:11 smithi master ubuntu 18.04 rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595842 2020-11-06 15:53:22 2020-11-06 17:18:29 2020-11-06 17:50:29 0:32:00 0:24:16 0:07:44 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 5595843 2020-11-06 15:53:22 2020-11-06 17:23:56 2020-11-06 17:45:56 0:22:00 0:15:20 0:06:40 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} 2
pass 5595844 2020-11-06 15:53:23 2020-11-06 17:23:56 2020-11-06 17:47:56 0:24:00 0:14:07 0:09:53 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5595845 2020-11-06 15:53:24 2020-11-06 17:23:56 2020-11-06 18:29:57 1:06:01 0:59:35 0:06:26 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5595846 2020-11-06 15:53:25 2020-11-06 17:23:57 2020-11-06 17:43:56 0:19:59 0:14:44 0:05:15 smithi master rhel 8.1 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 5595847 2020-11-06 15:53:25 2020-11-06 17:23:56 2020-11-06 17:43:56 0:20:00 0:11:23 0:08:37 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5595848 2020-11-06 15:53:26 2020-11-06 17:23:56 2020-11-06 17:55:56 0:32:00 0:23:55 0:08:05 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 5595849 2020-11-06 15:53:27 2020-11-06 17:23:56 2020-11-06 17:35:56 0:12:00 0:04:59 0:07:01 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595850 2020-11-06 15:53:27 2020-11-06 17:23:59 2020-11-06 18:14:00 0:50:01 0:41:47 0:08:14 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5595851 2020-11-06 15:53:28 2020-11-06 17:24:18 2020-11-06 17:42:17 0:17:59 0:11:08 0:06:51 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5595852 2020-11-06 15:53:29 2020-11-06 17:24:29 2020-11-06 18:26:29 1:02:00 0:39:26 0:22:34 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 5595853 2020-11-06 15:53:30 2020-11-06 17:25:40 2020-11-06 17:47:39 0:21:59 0:16:17 0:05:42 smithi master centos 8.1 rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5595854 2020-11-06 15:53:30 2020-11-06 17:26:17 2020-11-06 18:00:17 0:34:00 0:24:11 0:09:49 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 5595855 2020-11-06 15:53:31 2020-11-06 17:26:17 2020-11-06 17:46:17 0:20:00 0:12:08 0:07:52 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} 1
pass 5595856 2020-11-06 15:53:32 2020-11-06 17:26:18 2020-11-06 17:50:17 0:23:59 0:13:47 0:10:12 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 5595857 2020-11-06 15:53:33 2020-11-06 17:26:18 2020-11-06 17:52:17 0:25:59 0:14:59 0:11:00 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} 2
pass 5595858 2020-11-06 15:53:33 2020-11-06 17:26:18 2020-11-06 17:42:17 0:15:59 0:09:45 0:06:14 smithi master centos 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5595859 2020-11-06 15:53:34 2020-11-06 17:27:33 2020-11-06 17:45:33 0:18:00 0:10:52 0:07:08 smithi master rhel 8.1 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5595860 2020-11-06 15:53:35 2020-11-06 17:27:44 2020-11-06 18:03:43 0:35:59 0:25:24 0:10:35 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5595861 2020-11-06 15:53:36 2020-11-06 17:27:53 2020-11-06 18:01:53 0:34:00 0:25:42 0:08:18 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5595862 2020-11-06 15:53:36 2020-11-06 17:29:23 2020-11-06 18:01:23 0:32:00 0:24:50 0:07:10 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 5595863 2020-11-06 15:53:37 2020-11-06 17:30:05 2020-11-06 17:48:05 0:18:00 0:12:13 0:05:47 smithi master ubuntu 18.04 rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595864 2020-11-06 15:53:38 2020-11-06 17:30:17 2020-11-06 18:04:17 0:34:00 0:26:08 0:07:52 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 5595865 2020-11-06 15:53:39 2020-11-06 17:30:18 2020-11-06 18:08:18 0:38:00 0:26:13 0:11:47 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5595866 2020-11-06 15:53:39 2020-11-06 17:31:40 2020-11-06 18:05:39 0:33:59 0:20:36 0:13:23 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
pass 5595867 2020-11-06 15:53:40 2020-11-06 17:31:40 2020-11-06 18:01:39 0:29:59 0:15:57 0:14:02 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
pass 5595868 2020-11-06 15:53:41 2020-11-06 17:32:05 2020-11-06 18:06:05 0:34:00 0:25:35 0:08:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 5595869 2020-11-06 15:53:42 2020-11-06 17:32:11 2020-11-06 17:54:10 0:21:59 0:10:21 0:11:38 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 5595870 2020-11-06 15:53:42 2020-11-06 17:32:14 2020-11-06 18:46:15 1:14:01 1:04:34 0:09:27 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5595871 2020-11-06 15:53:43 2020-11-06 17:32:32 2020-11-06 18:12:32 0:40:00 0:29:03 0:10:57 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595872 2020-11-06 15:53:44 2020-11-06 17:36:02 2020-11-06 18:04:02 0:28:00 0:16:03 0:11:57 smithi master centos 8.0 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} 2
pass 5595873 2020-11-06 15:53:45 2020-11-06 17:36:02 2020-11-06 18:12:02 0:36:00 0:23:39 0:12:21 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 5595874 2020-11-06 15:53:45 2020-11-06 17:36:49 2020-11-06 18:04:49 0:28:00 0:22:08 0:05:52 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5595875 2020-11-06 15:53:46 2020-11-06 17:38:16 2020-11-06 18:12:16 0:34:00 0:26:13 0:07:47 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 5595876 2020-11-06 15:53:47 2020-11-06 17:38:16 2020-11-06 17:56:16 0:18:00 0:11:54 0:06:06 smithi master rhel 8.1 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595877 2020-11-06 15:53:48 2020-11-06 17:39:12 2020-11-06 17:55:12 0:16:00 0:10:02 0:05:58 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 5595878 2020-11-06 15:53:49 2020-11-06 17:40:19 2020-11-06 18:00:19 0:20:00 0:13:24 0:06:36 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 5595879 2020-11-06 15:53:49 2020-11-06 17:40:19 2020-11-06 17:54:19 0:14:00 0:06:57 0:07:03 smithi master centos 8.1 rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5595880 2020-11-06 15:53:50 2020-11-06 17:40:19 2020-11-06 18:18:19 0:38:00 0:10:12 0:27:48 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595881 2020-11-06 15:53:51 2020-11-06 17:40:20 2020-11-06 18:00:19 0:19:59 0:13:16 0:06:43 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} 2
fail 5595882 2020-11-06 15:53:52 2020-11-06 17:41:13 2020-11-06 18:31:13 0:50:00 0:24:10 0:25:50 smithi master ubuntu 18.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
Failure Reason:

Command failed on smithi086 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status'

pass 5595883 2020-11-06 15:53:52 2020-11-06 17:42:19 2020-11-06 18:02:18 0:19:59 0:14:21 0:05:38 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5595884 2020-11-06 15:53:53 2020-11-06 17:42:19 2020-11-06 18:28:19 0:46:00 0:38:16 0:07:44 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5595885 2020-11-06 15:53:54 2020-11-06 17:42:20 2020-11-06 18:22:20 0:40:00 0:30:16 0:09:44 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
fail 5595886 2020-11-06 15:53:55 2020-11-06 17:43:16 2020-11-06 18:17:16 0:34:00 0:28:22 0:05:38 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

"2020-11-06T18:03:51.530679+0000 osd.0 (osd.0) 149 : cluster [ERR] scrub 59.8 59:15224b27:test-rados-api-smithi114-39579-74::foo:24 : size 0 != clone_size 10" in cluster log

pass 5595887 2020-11-06 15:53:55 2020-11-06 17:44:36 2020-11-06 18:04:35 0:19:59 0:12:30 0:07:29 smithi master rhel 8.1 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5595888 2020-11-06 15:53:56 2020-11-06 17:44:37 2020-11-06 18:16:36 0:31:59 0:19:41 0:12:18 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/progress} 2
pass 5595889 2020-11-06 15:53:57 2020-11-06 17:44:36 2020-11-06 18:06:36 0:22:00 0:09:59 0:12:01 smithi master centos 8.1 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
pass 5595890 2020-11-06 15:53:58 2020-11-06 17:44:37 2020-11-06 18:42:37 0:58:00 0:46:01 0:11:59 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5595891 2020-11-06 15:53:58 2020-11-06 17:44:37 2020-11-06 18:10:36 0:25:59 0:14:10 0:11:49 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} 2
pass 5595892 2020-11-06 15:53:59 2020-11-06 17:45:34 2020-11-06 18:15:34 0:30:00 0:23:14 0:06:46 smithi master centos 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} 1
pass 5595893 2020-11-06 15:54:00 2020-11-06 17:46:21 2020-11-06 19:32:23 1:46:02 1:37:44 0:08:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} 2
pass 5595894 2020-11-06 15:54:01 2020-11-06 21:28:21 2020-11-06 22:40:22 1:12:01 1:05:13 0:06:48 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5595895 2020-11-06 15:54:01 2020-11-06 21:30:08 2020-11-06 21:42:07 0:11:59 0:05:24 0:06:35 smithi master ubuntu 18.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 5595896 2020-11-06 15:54:02 2020-11-06 21:30:08 2020-11-06 22:08:08 0:38:00 0:32:17 0:05:43 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5595897 2020-11-06 15:54:03 2020-11-06 21:30:08 2020-11-06 21:50:08 0:20:00 0:13:45 0:06:15 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 5595898 2020-11-06 15:54:04 2020-11-06 21:30:12 2020-11-06 21:40:12 0:10:00 0:04:38 0:05:22 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} 1
pass 5595899 2020-11-06 15:54:04 2020-11-06 21:30:57 2020-11-06 21:44:56 0:13:59 0:07:20 0:06:39 smithi master centos 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5595900 2020-11-06 15:54:05 2020-11-06 21:32:13 2020-11-06 21:48:12 0:15:59 0:09:50 0:06:09 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 5595901 2020-11-06 15:54:06 2020-11-06 21:32:13 2020-11-06 21:50:12 0:17:59 0:11:27 0:06:32 smithi master rhel 8.1 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5595902 2020-11-06 15:54:07 2020-11-06 21:32:13 2020-11-06 21:50:12 0:17:59 0:10:38 0:07:21 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
pass 5595903 2020-11-06 15:54:07 2020-11-06 21:32:13 2020-11-06 21:52:12 0:19:59 0:13:26 0:06:33 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} 2
fail 5595904 2020-11-06 15:54:08 2020-11-06 21:32:19 2020-11-06 21:52:18 0:19:59 0:12:58 0:07:01 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
Failure Reason:

Command failed on smithi166 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 5595905 2020-11-06 15:54:09 2020-11-06 21:34:11 2020-11-06 22:10:11 0:36:00 0:29:09 0:06:51 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595906 2020-11-06 15:54:10 2020-11-06 21:34:11 2020-11-06 21:56:11 0:22:00 0:16:31 0:05:29 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 5595907 2020-11-06 15:54:10 2020-11-06 21:34:13 2020-11-06 21:54:13 0:20:00 0:13:49 0:06:11 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5595908 2020-11-06 15:54:11 2020-11-06 21:35:00 2020-11-06 21:50:59 0:15:59 0:09:38 0:06:21 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5595909 2020-11-06 15:54:12 2020-11-06 21:36:14 2020-11-07 00:54:18 3:18:04 3:11:24 0:06:40 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
pass 5595910 2020-11-06 15:54:13 2020-11-06 21:36:14 2020-11-06 21:56:14 0:20:00 0:13:38 0:06:22 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} 2
pass 5595911 2020-11-06 15:54:13 2020-11-06 21:36:14 2020-11-06 23:00:15 1:24:01 1:16:55 0:07:06 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 5595912 2020-11-06 15:54:14 2020-11-06 21:36:14 2020-11-06 21:50:14 0:14:00 0:08:08 0:05:52 smithi master centos 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5595913 2020-11-06 15:54:15 2020-11-06 21:36:21 2020-11-06 22:06:21 0:30:00 0:23:25 0:06:35 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 5595914 2020-11-06 15:54:16 2020-11-06 21:38:17 2020-11-06 22:02:16 0:23:59 0:17:11 0:06:48 smithi master rhel 8.1 rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5595915 2020-11-06 15:54:17 2020-11-06 21:38:17 2020-11-06 22:40:17 1:02:00 0:55:40 0:06:20 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 5595916 2020-11-06 15:54:17 2020-11-06 21:38:17 2020-11-06 22:14:17 0:36:00 0:28:57 0:07:03 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5595917 2020-11-06 15:54:18 2020-11-06 21:38:17 2020-11-06 22:16:16 0:37:59 0:30:50 0:07:09 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595918 2020-11-06 15:54:19 2020-11-06 21:38:17 2020-11-06 21:58:16 0:19:59 0:12:48 0:07:11 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} 2
pass 5595919 2020-11-06 15:54:20 2020-11-06 21:40:06 2020-11-06 22:02:05 0:21:59 0:14:48 0:07:11 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595920 2020-11-06 15:54:20 2020-11-06 21:40:06 2020-11-06 22:48:07 1:08:01 1:01:38 0:06:23 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5595921 2020-11-06 15:54:21 2020-11-06 21:40:06 2020-11-06 22:10:06 0:30:00 0:23:18 0:06:42 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
pass 5595922 2020-11-06 15:54:22 2020-11-06 21:40:06 2020-11-06 22:04:06 0:24:00 0:18:20 0:05:40 smithi master centos 8.1 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} 2
pass 5595923 2020-11-06 15:54:23 2020-11-06 21:40:13 2020-11-06 21:52:12 0:11:59 0:05:29 0:06:30 smithi master ubuntu 18.04 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
pass 5595924 2020-11-06 15:54:23 2020-11-06 21:42:26 2020-11-06 22:32:26 0:50:00 0:43:29 0:06:31 smithi master rhel 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} 1
pass 5595925 2020-11-06 15:54:24 2020-11-06 21:42:26 2020-11-06 22:14:26 0:32:00 0:26:11 0:05:49 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
pass 5595926 2020-11-06 15:54:25 2020-11-06 21:42:26 2020-11-06 22:12:25 0:29:59 0:23:42 0:06:17 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5595927 2020-11-06 15:54:26 2020-11-06 21:42:26 2020-11-06 22:12:26 0:30:00 0:22:13 0:07:47 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 5595928 2020-11-06 15:54:26 2020-11-06 21:42:26 2020-11-06 22:00:25 0:17:59 0:12:25 0:05:34 smithi master rhel 8.1 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595929 2020-11-06 15:54:27 2020-11-06 21:42:26 2020-11-06 22:12:26 0:30:00 0:22:42 0:07:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5595930 2020-11-06 15:54:28 2020-11-06 21:44:17 2020-11-06 22:10:16 0:25:59 0:19:10 0:06:49 smithi master ubuntu 18.04 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 5595931 2020-11-06 15:54:29 2020-11-06 21:44:17 2020-11-06 22:00:16 0:15:59 0:10:03 0:05:56 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 5595932 2020-11-06 15:54:29 2020-11-06 21:44:19 2020-11-06 22:28:19 0:44:00 0:33:37 0:10:23 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 5595933 2020-11-06 15:54:30 2020-11-06 21:44:57 2020-11-06 22:06:57 0:22:00 0:14:02 0:07:58 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 5595934 2020-11-06 15:54:31 2020-11-06 21:46:42 2020-11-06 22:26:42 0:40:00 0:33:43 0:06:17 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5595935 2020-11-06 15:54:32 2020-11-06 21:48:54 2020-11-06 22:12:52 0:23:58 0:17:18 0:06:40 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} 1
pass 5595936 2020-11-06 15:54:33 2020-11-06 21:48:54 2020-11-06 22:28:53 0:39:59 0:34:16 0:05:43 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
pass 5595937 2020-11-06 15:54:33 2020-11-06 21:48:54 2020-11-06 22:08:52 0:19:58 0:12:16 0:07:42 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} 2
pass 5595938 2020-11-06 15:54:34 2020-11-06 21:48:54 2020-11-06 22:06:52 0:17:58 0:12:30 0:05:28 smithi master centos 8.1 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5595939 2020-11-06 15:54:35 2020-11-06 21:49:05 2020-11-06 22:07:04 0:17:59 0:12:01 0:05:58 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5595940 2020-11-06 15:54:36 2020-11-06 21:49:27 2020-11-06 22:09:26 0:19:59 0:14:40 0:05:19 smithi master centos 8.1 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 5595941 2020-11-06 15:54:36 2020-11-06 21:50:46 2020-11-06 22:08:45 0:17:59 0:11:48 0:06:11 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5595942 2020-11-06 15:54:37 2020-11-06 21:50:46 2020-11-06 22:06:45 0:15:59 0:08:41 0:07:18 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 5595943 2020-11-06 15:54:38 2020-11-06 21:50:46 2020-11-06 23:04:47 1:14:01 1:07:30 0:06:31 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5595944 2020-11-06 15:54:39 2020-11-06 21:50:46 2020-11-07 00:34:49 2:44:03 2:38:42 0:05:21 smithi master rhel 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 5595945 2020-11-06 15:54:39 2020-11-06 21:50:46 2020-11-06 22:14:46 0:24:00 0:17:14 0:06:46 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5595946 2020-11-06 15:54:40 2020-11-06 21:51:00 2020-11-06 22:41:01 0:50:01 0:44:21 0:05:40 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5595947 2020-11-06 15:54:41 2020-11-06 21:51:09 2020-11-06 22:35:09 0:44:00 0:37:31 0:06:29 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 5595948 2020-11-06 15:54:42 2020-11-06 21:51:38 2020-11-06 22:15:38 0:24:00 0:16:39 0:07:21 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
pass 5595949 2020-11-06 15:54:42 2020-11-06 21:52:33 2020-11-06 22:08:33 0:16:00 0:08:49 0:07:11 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} 2
pass 5595950 2020-11-06 15:54:43 2020-11-06 21:52:33 2020-11-06 22:24:33 0:32:00 0:25:41 0:06:19 smithi master rhel 8.1 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} 2
pass 5595951 2020-11-06 15:54:44 2020-11-06 21:52:33 2020-11-06 22:16:33 0:24:00 0:17:52 0:06:08 smithi master centos 8.1 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 5595952 2020-11-06 15:54:45 2020-11-06 21:52:33 2020-11-06 22:16:33 0:24:00 0:15:40 0:08:20 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} 2
pass 5595953 2020-11-06 15:54:45 2020-11-06 21:54:16 2020-11-06 22:28:16 0:34:00 0:27:29 0:06:31 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5595954 2020-11-06 15:54:46 2020-11-06 21:54:16 2020-11-06 22:10:15 0:15:59 0:10:28 0:05:31 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 5595955 2020-11-06 15:54:47 2020-11-06 21:54:16 2020-11-07 01:04:20 3:10:04 3:03:34 0:06:30 smithi master centos 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd} 1
pass 5595956 2020-11-06 15:54:47 2020-11-06 21:54:40 2020-11-06 22:08:39 0:13:59 0:07:56 0:06:03 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5595957 2020-11-06 15:54:48 2020-11-06 21:56:13 2020-11-06 22:28:13 0:32:00 0:24:54 0:07:06 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5595958 2020-11-06 15:54:49 2020-11-06 21:56:13 2020-11-06 22:34:13 0:38:00 0:30:59 0:07:01 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
fail 5595959 2020-11-06 15:54:50 2020-11-06 21:56:13 2020-11-07 01:20:17 3:24:04 3:16:59 0:07:05 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} 2
Failure Reason:

Command failed (workunit test mon/caps.sh) on smithi092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=035b993cefb5754a0e8bcb9b3f9713c4ab833458 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

pass 5595960 2020-11-06 15:54:50 2020-11-06 21:56:13 2020-11-06 22:26:13 0:30:00 0:23:53 0:06:07 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5595961 2020-11-06 15:54:51 2020-11-06 21:56:15 2020-11-06 22:32:15 0:36:00 0:29:16 0:06:44 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5595962 2020-11-06 15:54:52 2020-11-06 21:56:19 2020-11-06 22:16:19 0:20:00 0:09:53 0:10:07 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5595963 2020-11-06 15:54:53 2020-11-06 21:58:07 2020-11-06 22:36:06 0:37:59 0:30:28 0:07:31 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} 2
pass 5595964 2020-11-06 15:54:53 2020-11-06 21:58:17 2020-11-06 22:20:17 0:22:00 0:15:20 0:06:40 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} 2
pass 5595965 2020-11-06 15:54:54 2020-11-06 21:58:29 2020-11-06 22:32:29 0:34:00 0:25:45 0:08:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} 2
pass 5595966 2020-11-06 15:54:55 2020-11-06 22:00:44 2020-11-06 22:14:43 0:13:59 0:06:56 0:07:03 smithi master ubuntu 18.04 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 5595967 2020-11-06 15:54:56 2020-11-06 22:00:44 2020-11-06 22:22:44 0:22:00 0:17:20 0:04:40 smithi master centos 8.1 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5595968 2020-11-06 15:54:56 2020-11-06 22:00:44 2020-11-06 22:20:43 0:19:59 0:12:40 0:07:19 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5595969 2020-11-06 15:54:57 2020-11-06 22:02:44 2020-11-06 22:20:43 0:17:59 0:10:50 0:07:09 smithi master rhel 8.1 rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 5595970 2020-11-06 15:54:58 2020-11-06 22:02:44 2020-11-06 23:14:45 1:12:01 1:01:30 0:10:31 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5595971 2020-11-06 15:54:58 2020-11-06 22:03:42 2020-11-06 22:33:42 0:30:00 0:23:36 0:06:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} 2
pass 5595972 2020-11-06 15:54:59 2020-11-06 22:04:43 2020-11-06 22:32:43 0:28:00 0:20:18 0:07:42 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
pass 5595973 2020-11-06 15:55:00 2020-11-06 22:04:43 2020-11-06 22:20:43 0:16:00 0:10:08 0:05:52 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} 2
pass 5595974 2020-11-06 15:55:01 2020-11-06 22:04:43 2020-11-06 22:24:43 0:20:00 0:12:11 0:07:49 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 5595975 2020-11-06 15:55:01 2020-11-06 22:06:58 2020-11-06 22:32:57 0:25:59 0:19:03 0:06:56 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} 2
pass 5595976 2020-11-06 15:55:02 2020-11-06 22:06:58 2020-11-06 22:40:58 0:34:00 0:26:45 0:07:15 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5595977 2020-11-06 15:55:03 2020-11-06 22:06:58 2020-11-06 22:20:57 0:13:59 0:08:40 0:05:19 smithi master centos 8.1 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5595978 2020-11-06 15:55:04 2020-11-06 22:06:58 2020-11-06 22:24:57 0:17:59 0:11:45 0:06:14 smithi master rhel 8.1 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5595979 2020-11-06 15:55:04 2020-11-06 22:07:05 2020-11-06 22:21:04 0:13:59 0:07:16 0:06:43 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} 1
pass 5595980 2020-11-06 15:55:05 2020-11-06 22:08:54 2020-11-06 22:42:54 0:34:00 0:27:41 0:06:19 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
pass 5595981 2020-11-06 15:55:06 2020-11-06 22:08:54 2020-11-06 22:40:54 0:32:00 0:24:46 0:07:14 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 2
pass 5595982 2020-11-06 15:55:07 2020-11-06 22:08:54 2020-11-06 22:40:54 0:32:00 0:24:34 0:07:26 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5595983 2020-11-06 15:55:07 2020-11-06 22:08:54 2020-11-06 22:28:54 0:20:00 0:13:17 0:06:43 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 5595984 2020-11-06 15:55:08 2020-11-06 22:08:54 2020-11-06 23:32:56 1:24:02 1:16:57 0:07:05 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5595985 2020-11-06 15:55:09 2020-11-06 22:09:28 2020-11-06 23:47:29 1:38:01 1:30:32 0:07:29 smithi master centos 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} 1
pass 5595986 2020-11-06 15:55:09 2020-11-06 22:10:46 2020-11-06 22:36:46 0:26:00 0:20:23 0:05:37 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 5595987 2020-11-06 15:55:10 2020-11-06 22:10:47 2020-11-06 22:50:47 0:40:00 0:33:20 0:06:40 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5595988 2020-11-06 15:55:11 2020-11-06 22:10:47 2020-11-06 23:40:48 1:30:01 1:24:36 0:05:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} 2
pass 5595989 2020-11-06 15:55:12 2020-11-06 22:10:47 2020-11-06 22:36:46 0:25:59 0:19:21 0:06:38 smithi master rhel 8.1 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 5595990 2020-11-06 15:55:12 2020-11-06 22:10:47 2020-11-06 22:44:47 0:34:00 0:26:38 0:07:22 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5595991 2020-11-06 15:55:13 2020-11-06 22:12:45 2020-11-06 22:46:45 0:34:00 0:26:16 0:07:44 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 5595992 2020-11-06 15:55:14 2020-11-06 22:12:45 2020-11-06 23:20:45 1:08:00 1:01:25 0:06:35 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5595993 2020-11-06 15:55:15 2020-11-06 22:12:45 2020-11-07 00:44:47 2:32:02 2:26:23 0:05:39 smithi master centos 8.1 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 5595994 2020-11-06 15:55:15 2020-11-06 22:12:45 2020-11-06 22:34:45 0:22:00 0:15:42 0:06:18 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} 2
pass 5595995 2020-11-06 15:55:16 2020-11-06 22:12:45 2020-11-06 22:28:44 0:15:59 0:09:15 0:06:44 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
dead 5595996 2020-11-06 15:55:17 2020-11-06 22:12:53 2020-11-07 10:15:25 12:02:32 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 5595997 2020-11-06 15:55:17 2020-11-06 22:14:55 2020-11-06 22:36:55 0:22:00 0:14:09 0:07:51 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} 2
pass 5595998 2020-11-06 15:55:18 2020-11-06 22:14:55 2020-11-06 22:40:55 0:26:00 0:19:58 0:06:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
fail 5595999 2020-11-06 15:55:19 2020-11-06 22:14:55 2020-11-07 01:36:59 3:22:04 3:14:24 0:07:40 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} 2
Failure Reason:

Command failed (workunit test mon/caps.sh) on smithi195 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=035b993cefb5754a0e8bcb9b3f9713c4ab833458 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

pass 5596000 2020-11-06 15:55:20 2020-11-06 22:14:55 2020-11-06 22:56:55 0:42:00 0:34:07 0:07:53 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5596001 2020-11-06 15:55:20 2020-11-06 22:14:55 2020-11-06 22:32:55 0:18:00 0:09:24 0:08:36 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5596002 2020-11-06 15:55:21 2020-11-06 22:15:39 2020-11-06 22:33:38 0:17:59 0:11:37 0:06:22 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5596003 2020-11-06 15:55:22 2020-11-06 22:17:00 2020-11-06 22:37:00 0:20:00 0:10:40 0:09:20 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} 2
pass 5596004 2020-11-06 15:55:22 2020-11-06 22:17:00 2020-11-06 23:27:01 1:10:01 1:04:49 0:05:12 smithi master centos 8.1 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
pass 5596005 2020-11-06 15:55:23 2020-11-06 22:17:01 2020-11-06 22:55:00 0:37:59 0:28:29 0:09:30 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5596006 2020-11-06 15:55:24 2020-11-06 22:17:01 2020-11-06 22:33:00 0:15:59 0:07:05 0:08:54 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596007 2020-11-06 15:55:25 2020-11-06 22:21:08 2020-11-07 00:01:08 1:40:00 1:34:01 0:05:59 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 5596008 2020-11-06 15:55:25 2020-11-06 22:21:08 2020-11-06 22:45:07 0:23:59 0:18:11 0:05:48 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 5596009 2020-11-06 15:55:26 2020-11-06 22:21:07 2020-11-06 22:39:06 0:17:59 0:11:41 0:06:18 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5596010 2020-11-06 15:55:27 2020-11-06 22:21:08 2020-11-06 22:41:07 0:19:59 0:11:44 0:08:15 smithi master centos 8.1 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5596011 2020-11-06 15:55:28 2020-11-06 22:21:09 2020-11-06 22:51:07 0:29:58 0:22:34 0:07:24 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 5596012 2020-11-06 15:55:28 2020-11-06 22:21:08 2020-11-06 23:03:07 0:41:59 0:35:43 0:06:16 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5596013 2020-11-06 15:55:29 2020-11-06 22:23:25 2020-11-06 22:57:24 0:33:59 0:23:52 0:10:07 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 5596014 2020-11-06 15:55:30 2020-11-06 22:23:24 2020-11-06 23:07:25 0:44:01 0:37:27 0:06:34 smithi master centos 8.1 rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 2
pass 5596015 2020-11-06 15:55:31 2020-11-06 22:25:12 2020-11-06 22:45:12 0:20:00 0:13:22 0:06:38 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} 2
pass 5596016 2020-11-06 15:55:31 2020-11-06 22:25:12 2020-11-06 22:47:12 0:22:00 0:13:26 0:08:34 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/crash} 2
pass 5596017 2020-11-06 15:55:32 2020-11-06 22:25:12 2020-11-06 22:53:12 0:28:00 0:19:43 0:08:17 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
pass 5596018 2020-11-06 15:55:33 2020-11-06 22:25:39 2020-11-06 23:35:40 1:10:01 1:02:27 0:07:34 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5596019 2020-11-06 15:55:34 2020-11-06 22:26:53 2020-11-06 23:06:53 0:40:00 0:33:18 0:06:42 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5596020 2020-11-06 15:55:34 2020-11-06 22:26:53 2020-11-06 22:46:52 0:19:59 0:12:56 0:07:03 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596021 2020-11-06 15:55:35 2020-11-06 22:28:54 2020-11-06 22:44:53 0:15:59 0:08:35 0:07:24 smithi master ubuntu 18.04 rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} 1
pass 5596022 2020-11-06 15:55:36 2020-11-06 22:28:55 2020-11-07 03:11:00 4:42:05 4:32:25 0:09:40 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} 4
pass 5596023 2020-11-06 15:55:36 2020-11-06 22:28:54 2020-11-06 22:58:54 0:30:00 0:24:44 0:05:16 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 5596024 2020-11-06 15:55:37 2020-11-06 22:28:55 2020-11-06 22:46:54 0:17:59 0:11:56 0:06:03 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} 1
pass 5596025 2020-11-06 15:55:38 2020-11-06 22:28:55 2020-11-06 23:08:54 0:39:59 0:34:01 0:05:58 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5596026 2020-11-06 15:55:39 2020-11-06 22:28:54 2020-11-06 22:50:54 0:22:00 0:15:27 0:06:33 smithi master centos 8.1 rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} 2
pass 5596027 2020-11-06 15:55:39 2020-11-06 22:28:55 2020-11-06 22:58:54 0:29:59 0:21:09 0:08:50 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5596028 2020-11-06 15:55:40 2020-11-06 22:33:00 2020-11-06 23:03:00 0:30:00 0:23:22 0:06:38 smithi master rhel 8.1 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 5596029 2020-11-06 15:55:41 2020-11-06 22:33:01 2020-11-06 22:51:00 0:17:59 0:09:43 0:08:16 smithi master ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
fail 5596030 2020-11-06 15:55:42 2020-11-06 22:33:00 2020-11-06 22:47:00 0:14:00 0:07:12 0:06:48 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed on smithi106 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 5596031 2020-11-06 15:55:42 2020-11-06 22:33:00 2020-11-06 23:09:00 0:36:00 0:29:27 0:06:33 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
pass 5596032 2020-11-06 15:55:43 2020-11-06 22:33:00 2020-11-06 22:53:00 0:20:00 0:12:55 0:07:05 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} 2
pass 5596033 2020-11-06 15:55:44 2020-11-06 22:33:01 2020-11-06 22:53:00 0:19:59 0:12:55 0:07:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5596034 2020-11-06 15:55:45 2020-11-06 22:33:01 2020-11-06 22:49:00 0:15:59 0:09:48 0:06:11 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5596035 2020-11-06 15:55:45 2020-11-06 22:33:01 2020-11-06 22:51:01 0:18:00 0:11:34 0:06:26 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5596036 2020-11-06 15:55:46 2020-11-06 22:33:40 2020-11-06 23:13:40 0:40:00 0:32:47 0:07:13 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5596037 2020-11-06 15:55:47 2020-11-06 22:33:45 2020-11-06 23:11:45 0:38:00 0:30:50 0:07:10 smithi master ubuntu 18.04 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 5596038 2020-11-06 15:55:48 2020-11-06 22:34:51 2020-11-06 23:10:51 0:36:00 0:28:13 0:07:47 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5596039 2020-11-06 15:55:49 2020-11-06 22:34:51 2020-11-06 23:02:51 0:28:00 0:20:55 0:07:05 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 5596040 2020-11-06 15:55:49 2020-11-06 22:34:51 2020-11-06 22:56:51 0:22:00 0:15:58 0:06:02 smithi master centos 8.0 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} 2
pass 5596041 2020-11-06 15:55:50 2020-11-06 22:35:10 2020-11-06 22:51:09 0:15:59 0:10:07 0:05:52 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5596042 2020-11-06 15:55:51 2020-11-06 22:36:46 2020-11-06 23:44:47 1:08:01 1:01:34 0:06:27 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5596043 2020-11-06 15:55:52 2020-11-06 22:36:47 2020-11-06 22:50:47 0:14:00 0:06:26 0:07:34 smithi master centos 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} 1
pass 5596044 2020-11-06 15:55:52 2020-11-06 22:36:48 2020-11-06 23:12:48 0:36:00 0:29:55 0:06:05 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
pass 5596045 2020-11-06 15:55:53 2020-11-06 22:36:57 2020-11-06 22:50:56 0:13:59 0:06:40 0:07:19 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596046 2020-11-06 15:55:54 2020-11-06 22:37:01 2020-11-06 23:15:01 0:38:00 0:30:06 0:07:54 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} 2
pass 5596047 2020-11-06 15:55:55 2020-11-06 22:37:36 2020-11-06 23:13:36 0:36:00 0:30:37 0:05:23 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5596048 2020-11-06 15:55:55 2020-11-06 22:39:50 2020-11-06 23:07:50 0:28:00 0:20:14 0:07:46 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 5596049 2020-11-06 15:55:56 2020-11-06 22:40:19 2020-11-06 23:08:19 0:28:00 0:22:03 0:05:57 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5596050 2020-11-06 15:55:57 2020-11-06 22:40:23 2020-11-06 23:04:22 0:23:59 0:17:33 0:06:26 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
pass 5596051 2020-11-06 15:55:58 2020-11-06 22:41:38 2020-11-06 23:27:38 0:46:00 0:40:14 0:05:46 smithi master rhel 8.1 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} 1
pass 5596052 2020-11-06 15:55:58 2020-11-06 22:41:39 2020-11-06 23:13:38 0:31:59 0:25:07 0:06:52 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 5596053 2020-11-06 15:55:59 2020-11-06 22:41:39 2020-11-06 23:07:38 0:25:59 0:19:13 0:06:46 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5596054 2020-11-06 15:56:00 2020-11-06 22:41:39 2020-11-06 23:17:38 0:35:59 0:30:06 0:05:53 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5596055 2020-11-06 15:56:01 2020-11-06 22:41:39 2020-11-06 22:59:38 0:17:59 0:11:45 0:06:14 smithi master rhel 8.1 rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5596056 2020-11-06 15:56:02 2020-11-06 22:41:39 2020-11-06 22:55:38 0:13:59 0:06:00 0:07:59 smithi master ubuntu 18.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 5596057 2020-11-06 15:56:02 2020-11-06 22:43:33 2020-11-06 23:01:33 0:18:00 0:12:04 0:05:56 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
pass 5596058 2020-11-06 15:56:03 2020-11-06 22:45:26 2020-11-06 23:03:26 0:18:00 0:11:59 0:06:01 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} 2
pass 5596059 2020-11-06 15:56:04 2020-11-06 22:45:26 2020-11-06 23:15:26 0:30:00 0:23:23 0:06:37 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 5596060 2020-11-06 15:56:05 2020-11-06 22:45:27 2020-11-06 22:59:26 0:13:59 0:07:39 0:06:20 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5596061 2020-11-06 15:56:05 2020-11-06 22:45:27 2020-11-06 23:03:26 0:17:59 0:11:03 0:06:56 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/failover} 2
pass 5596062 2020-11-06 15:56:06 2020-11-06 22:47:31 2020-11-06 23:29:31 0:42:00 0:35:50 0:06:10 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 5596063 2020-11-06 15:56:07 2020-11-06 22:47:31 2020-11-06 23:19:31 0:32:00 0:23:00 0:09:00 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
pass 5596064 2020-11-06 15:56:08 2020-11-06 22:47:31 2020-11-06 23:11:30 0:23:59 0:17:27 0:06:32 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
pass 5596065 2020-11-06 15:56:09 2020-11-06 22:47:31 2020-11-06 22:59:30 0:11:59 0:04:42 0:07:17 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} 1
pass 5596066 2020-11-06 15:56:09 2020-11-06 22:47:31 2020-11-06 23:19:31 0:32:00 0:23:12 0:08:48 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} 2
pass 5596067 2020-11-06 15:56:10 2020-11-06 22:48:08 2020-11-06 23:06:08 0:18:00 0:10:42 0:07:18 smithi master rhel 8.1 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5596068 2020-11-06 15:56:11 2020-11-06 22:49:42 2020-11-06 23:57:43 1:08:01 1:00:55 0:07:06 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5596069 2020-11-06 15:56:12 2020-11-06 22:51:34 2020-11-06 23:13:33 0:21:59 0:15:12 0:06:47 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} 2
pass 5596070 2020-11-06 15:56:12 2020-11-06 22:51:33 2020-11-06 23:13:33 0:22:00 0:15:48 0:06:12 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} 2
pass 5596071 2020-11-06 15:56:13 2020-11-06 22:51:34 2020-11-06 23:07:35 0:16:01 0:10:20 0:05:41 smithi master rhel 8.1 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5596072 2020-11-06 15:56:14 2020-11-06 22:51:34 2020-11-06 23:29:33 0:37:59 0:30:12 0:07:47 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5596073 2020-11-06 15:56:15 2020-11-06 22:51:34 2020-11-06 23:09:33 0:17:59 0:10:59 0:07:00 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5596074 2020-11-06 15:56:15 2020-11-06 22:51:34 2020-11-06 23:17:33 0:25:59 0:20:05 0:05:54 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 5596075 2020-11-06 15:56:16 2020-11-06 22:51:34 2020-11-06 23:03:33 0:11:59 0:06:11 0:05:48 smithi master ubuntu 18.04 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596076 2020-11-06 15:56:17 2020-11-06 22:51:34 2020-11-06 23:29:34 0:38:00 0:32:08 0:05:52 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5596077 2020-11-06 15:56:18 2020-11-06 22:52:07 2020-11-06 23:44:08 0:52:01 0:45:15 0:06:46 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5596078 2020-11-06 15:56:18 2020-11-06 22:53:52 2020-11-06 23:09:51 0:15:59 0:09:56 0:06:03 smithi master centos 8.1 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5596079 2020-11-06 15:56:19 2020-11-06 22:53:52 2020-11-06 23:15:51 0:21:59 0:15:18 0:06:41 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} 2
pass 5596080 2020-11-06 15:56:20 2020-11-06 22:53:52 2020-11-06 23:11:51 0:17:59 0:10:52 0:07:07 smithi master rhel 8.1 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5596081 2020-11-06 15:56:21 2020-11-06 22:54:20 2020-11-06 23:16:20 0:22:00 0:13:54 0:08:06 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5596082 2020-11-06 15:56:21 2020-11-06 22:55:39 2020-11-06 23:11:39 0:16:00 0:08:54 0:07:06 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5596083 2020-11-06 15:56:22 2020-11-06 22:55:39 2020-11-07 02:23:43 3:28:04 3:21:01 0:07:03 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
fail 5596084 2020-11-06 15:56:23 2020-11-06 22:57:33 2020-11-07 00:51:34 1:54:01 1:46:36 0:07:25 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} 2
Failure Reason:

"2020-11-06T23:10:34.503171+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 5596085 2020-11-06 15:56:24 2020-11-06 22:57:33 2020-11-06 23:23:33 0:26:00 0:19:40 0:06:20 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
pass 5596086 2020-11-06 15:56:24 2020-11-06 22:57:33 2020-11-06 23:17:32 0:19:59 0:13:33 0:06:26 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/pool-create-delete} 2
pass 5596087 2020-11-06 15:56:25 2020-11-06 22:59:34 2020-11-06 23:33:33 0:33:59 0:27:27 0:06:32 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5596088 2020-11-06 15:56:26 2020-11-06 22:59:34 2020-11-06 23:31:34 0:32:00 0:26:10 0:05:50 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
pass 5596089 2020-11-06 15:56:27 2020-11-06 22:59:34 2020-11-06 23:23:33 0:23:59 0:15:34 0:08:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 5596090 2020-11-06 15:56:27 2020-11-06 22:59:34 2020-11-06 23:15:33 0:15:59 0:07:59 0:08:00 smithi master centos 8.1 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5596091 2020-11-06 15:56:28 2020-11-06 22:59:39 2020-11-06 23:25:39 0:26:00 0:17:12 0:08:48 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} 2
pass 5596092 2020-11-06 15:56:29 2020-11-06 23:00:16 2020-11-06 23:34:17 0:34:01 0:25:40 0:08:21 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5596093 2020-11-06 15:56:30 2020-11-06 23:02:12 2020-11-06 23:22:11 0:19:59 0:14:40 0:05:19 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 5596094 2020-11-06 15:56:30 2020-11-06 23:02:52 2020-11-07 00:10:53 1:08:01 1:00:36 0:07:25 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5596095 2020-11-06 15:56:31 2020-11-06 23:03:01 2020-11-06 23:21:00 0:17:59 0:12:19 0:05:40 smithi master ubuntu 18.04 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} 1
pass 5596096 2020-11-06 15:56:32 2020-11-06 23:03:08 2020-11-06 23:27:08 0:24:00 0:18:56 0:05:04 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5596097 2020-11-06 15:56:32 2020-11-06 23:04:06 2020-11-06 23:28:05 0:23:59 0:17:29 0:06:30 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 5596098 2020-11-06 15:56:33 2020-11-06 23:04:06 2020-11-06 23:24:05 0:19:59 0:13:09 0:06:50 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 5596099 2020-11-06 15:56:34 2020-11-06 23:04:06 2020-11-06 23:18:05 0:13:59 0:07:25 0:06:34 smithi master centos 8.1 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5596100 2020-11-06 15:56:35 2020-11-06 23:04:24 2020-11-06 23:24:23 0:19:59 0:11:26 0:08:33 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 5596101 2020-11-06 15:56:35 2020-11-06 23:04:48 2020-11-06 23:22:47 0:17:59 0:10:28 0:07:31 smithi master rhel 8.1 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 5596102 2020-11-06 15:56:36 2020-11-06 23:06:47 2020-11-06 23:26:47 0:20:00 0:14:04 0:05:56 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5596103 2020-11-06 15:56:37 2020-11-06 23:06:54 2020-11-06 23:24:53 0:17:59 0:11:07 0:06:52 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/insights} 2
pass 5596104 2020-11-06 15:56:38 2020-11-06 23:07:26 2020-11-06 23:25:25 0:17:59 0:11:49 0:06:10 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 5596105 2020-11-06 15:56:38 2020-11-06 23:07:36 2020-11-06 23:21:35 0:13:59 0:08:08 0:05:51 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596106 2020-11-06 15:56:39 2020-11-06 23:07:40 2020-11-06 23:41:40 0:34:00 0:26:05 0:07:55 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 5596107 2020-11-06 15:56:40 2020-11-06 23:08:31 2020-11-06 23:36:31 0:28:00 0:20:21 0:07:39 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
pass 5596108 2020-11-06 15:56:41 2020-11-06 23:08:31 2020-11-06 23:32:31 0:24:00 0:16:42 0:07:18 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} 1
pass 5596109 2020-11-06 15:56:41 2020-11-06 23:08:55 2020-11-06 23:28:55 0:20:00 0:13:08 0:06:52 smithi master rhel 8.1 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5596110 2020-11-06 15:56:42 2020-11-06 23:09:02 2020-11-06 23:37:01 0:27:59 0:21:24 0:06:35 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 5596111 2020-11-06 15:56:43 2020-11-06 23:10:23 2020-11-06 23:38:23 0:28:00 0:22:26 0:05:34 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 5596112 2020-11-06 15:56:44 2020-11-06 23:10:23 2020-11-06 23:40:23 0:30:00 0:22:32 0:07:28 smithi master ubuntu 18.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 5596113 2020-11-06 15:56:44 2020-11-06 23:10:52 2020-11-06 23:38:52 0:28:00 0:21:41 0:06:19 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} 2
pass 5596114 2020-11-06 15:56:45 2020-11-06 23:12:10 2020-11-06 23:26:09 0:13:59 0:08:22 0:05:37 smithi master centos 8.1 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5596115 2020-11-06 15:56:46 2020-11-06 23:12:10 2020-11-06 23:50:10 0:38:00 0:32:20 0:05:40 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5596116 2020-11-06 15:56:47 2020-11-06 23:12:10 2020-11-06 23:30:10 0:18:00 0:10:51 0:07:09 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5596117 2020-11-06 15:56:47 2020-11-06 23:12:10 2020-11-07 00:20:11 1:08:01 1:02:33 0:05:28 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5596118 2020-11-06 15:56:48 2020-11-06 23:12:49 2020-11-06 23:32:48 0:19:59 0:14:22 0:05:37 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} 2
pass 5596119 2020-11-06 15:56:49 2020-11-06 23:14:13 2020-11-06 23:46:13 0:32:00 0:24:35 0:07:25 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5596120 2020-11-06 15:56:50 2020-11-06 23:14:13 2020-11-07 01:10:15 1:56:02 1:49:09 0:06:53 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 5596121 2020-11-06 15:56:50 2020-11-06 23:14:13 2020-11-06 23:48:13 0:34:00 0:27:12 0:06:48 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5596122 2020-11-06 15:56:51 2020-11-06 23:14:13 2020-11-06 23:26:12 0:11:59 0:06:21 0:05:38 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5596123 2020-11-06 15:56:52 2020-11-06 23:14:13 2020-11-06 23:36:13 0:22:00 0:15:00 0:07:00 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5596124 2020-11-06 15:56:53 2020-11-06 23:14:46 2020-11-06 23:48:46 0:34:00 0:27:03 0:06:57 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 5596125 2020-11-06 15:56:53 2020-11-06 23:15:02 2020-11-06 23:35:02 0:20:00 0:13:15 0:06:45 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} 2
pass 5596126 2020-11-06 15:56:54 2020-11-06 23:16:06 2020-11-06 23:54:06 0:38:00 0:31:43 0:06:17 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5596127 2020-11-06 15:56:55 2020-11-06 23:16:06 2020-11-06 23:50:06 0:34:00 0:26:39 0:07:21 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5596128 2020-11-06 15:56:56 2020-11-06 23:16:06 2020-11-06 23:32:05 0:15:59 0:09:36 0:06:23 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 5596129 2020-11-06 15:56:56 2020-11-06 23:16:21 2020-11-06 23:34:21 0:18:00 0:11:34 0:06:26 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 5596130 2020-11-06 15:56:57 2020-11-06 23:18:15 2020-11-06 23:58:14 0:39:59 0:33:43 0:06:16 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5596131 2020-11-06 15:56:58 2020-11-06 23:18:15 2020-11-06 23:38:14 0:19:59 0:13:07 0:06:52 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} 2
pass 5596132 2020-11-06 15:56:59 2020-11-06 23:18:15 2020-11-07 01:08:16 1:50:01 1:44:00 0:06:01 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5596133 2020-11-06 15:56:59 2020-11-06 23:18:15 2020-11-06 23:42:14 0:23:59 0:18:07 0:05:52 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5596134 2020-11-06 15:57:00 2020-11-06 23:18:42 2020-11-06 23:38:42 0:20:00 0:13:57 0:06:03 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5596135 2020-11-06 15:57:01 2020-11-06 23:20:12 2020-11-07 00:00:12 0:40:00 0:33:19 0:06:41 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5596136 2020-11-06 15:57:02 2020-11-06 23:20:12 2020-11-06 23:54:12 0:34:00 0:28:39 0:05:21 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5596137 2020-11-06 15:57:02 2020-11-06 23:20:47 2020-11-06 23:58:47 0:38:00 0:31:12 0:06:48 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5596138 2020-11-06 15:57:03 2020-11-06 23:21:01 2020-11-06 23:39:01 0:18:00 0:12:22 0:05:38 smithi master rhel 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5596139 2020-11-06 15:57:04 2020-11-06 23:22:21 2020-11-06 23:50:21 0:28:00 0:22:02 0:05:58 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 5596140 2020-11-06 15:57:05 2020-11-06 23:22:21 2020-11-06 23:40:21 0:18:00 0:12:42 0:05:18 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} 2
pass 5596141 2020-11-06 15:57:05 2020-11-06 23:22:49 2020-11-06 23:34:48 0:11:59 0:06:07 0:05:52 smithi master centos 8.1 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5596142 2020-11-06 15:57:06 2020-11-06 23:24:19 2020-11-07 00:32:19 1:08:00 1:01:47 0:06:13 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5596143 2020-11-06 15:57:07 2020-11-06 23:24:19 2020-11-06 23:56:19 0:32:00 0:25:43 0:06:17 smithi master rhel 8.1 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 5596144 2020-11-06 15:57:07 2020-11-06 23:24:19 2020-11-06 23:42:18 0:17:59 0:11:43 0:06:16 smithi master centos 8.1 rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2