Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5700758 2020-12-11 09:12:20 2020-12-11 09:12:26 2020-12-11 09:40:26 0:28:00 0:19:05 0:08:55 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5700759 2020-12-11 09:12:20 2020-12-11 09:14:17 2020-12-11 10:46:18 1:32:01 1:20:45 0:11:16 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5700760 2020-12-11 09:12:21 2020-12-11 09:14:17 2020-12-11 09:46:17 0:32:00 0:21:58 0:10:02 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700761 2020-12-11 09:12:22 2020-12-11 09:16:32 2020-12-11 09:46:31 0:29:59 0:22:50 0:07:09 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700762 2020-12-11 09:12:23 2020-12-11 09:16:32 2020-12-11 09:42:31 0:25:59 0:18:53 0:07:06 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700763 2020-12-11 09:12:23 2020-12-11 09:16:38 2020-12-11 10:50:39 1:34:01 1:26:45 0:07:16 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 5700764 2020-12-11 09:12:24 2020-12-11 09:18:16 2020-12-11 09:44:15 0:25:59 0:18:40 0:07:19 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700765 2020-12-11 09:12:25 2020-12-11 09:18:16 2020-12-11 09:52:15 0:33:59 0:23:26 0:10:33 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700766 2020-12-11 09:12:26 2020-12-11 09:18:15 2020-12-11 09:46:15 0:28:00 0:19:12 0:08:48 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700767 2020-12-11 09:12:27 2020-12-11 09:18:19 2020-12-11 10:38:20 1:20:01 1:14:12 0:05:49 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700768 2020-12-11 09:12:27 2020-12-11 09:18:19 2020-12-11 09:54:19 0:36:00 0:25:49 0:10:11 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700769 2020-12-11 09:12:28 2020-12-11 09:18:20 2020-12-11 09:54:20 0:36:00 0:26:35 0:09:25 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700770 2020-12-11 09:12:29 2020-12-11 09:18:30 2020-12-11 09:44:30 0:26:00 0:18:46 0:07:14 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5700771 2020-12-11 09:12:30 2020-12-11 09:19:00 2020-12-11 10:49:01 1:30:01 1:24:06 0:05:55 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700772 2020-12-11 09:12:31 2020-12-11 09:20:15 2020-12-11 09:50:15 0:30:00 0:20:39 0:09:21 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700773 2020-12-11 09:12:31 2020-12-11 09:20:15 2020-12-11 09:48:15 0:28:00 0:18:59 0:09:01 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700774 2020-12-11 09:12:32 2020-12-11 09:20:15 2020-12-11 09:54:15 0:34:00 0:27:23 0:06:37 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5700775 2020-12-11 09:12:33 2020-12-11 09:20:15 2020-12-11 11:04:17 1:44:02 1:31:52 0:12:10 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 5700776 2020-12-11 09:12:34 2020-12-11 09:20:15 2020-12-11 09:52:15 0:32:00 0:22:55 0:09:05 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700777 2020-12-11 09:12:34 2020-12-11 09:20:15 2020-12-11 09:50:15 0:30:00 0:22:55 0:07:05 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700778 2020-12-11 09:12:35 2020-12-11 09:20:37 2020-12-11 09:52:37 0:32:00 0:24:18 0:07:42 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5700779 2020-12-11 09:12:36 2020-12-11 09:24:16 2020-12-11 11:16:18 1:52:02 1:41:16 0:10:46 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5700780 2020-12-11 09:12:37 2020-12-11 09:26:17 2020-12-11 10:00:17 0:34:00 0:23:28 0:10:32 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700781 2020-12-11 09:12:38 2020-12-11 09:26:17 2020-12-11 10:04:17 0:38:00 0:27:22 0:10:38 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700782 2020-12-11 09:12:38 2020-12-11 09:26:17 2020-12-11 09:56:17 0:30:00 0:23:06 0:06:54 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700783 2020-12-11 09:12:39 2020-12-11 09:26:17 2020-12-11 10:48:18 1:22:01 1:16:19 0:05:42 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 5700784 2020-12-11 09:12:40 2020-12-11 09:26:17 2020-12-11 09:58:17 0:32:00 0:22:59 0:09:01 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700785 2020-12-11 09:12:41 2020-12-11 09:26:20 2020-12-11 09:54:20 0:28:00 0:19:09 0:08:51 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700786 2020-12-11 09:12:41 2020-12-11 09:26:30 2020-12-11 09:52:29 0:25:59 0:19:38 0:06:21 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700787 2020-12-11 09:12:42 2020-12-11 09:27:49 2020-12-11 11:01:51 1:34:02 1:24:29 0:09:33 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700788 2020-12-11 09:12:43 2020-12-11 09:27:51 2020-12-11 09:59:51 0:32:00 0:22:13 0:09:47 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700789 2020-12-11 09:12:44 2020-12-11 09:27:55 2020-12-11 10:05:55 0:38:00 0:27:55 0:10:05 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700790 2020-12-11 09:12:45 2020-12-11 09:28:18 2020-12-11 10:02:18 0:34:00 0:24:00 0:10:00 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5700791 2020-12-11 09:12:45 2020-12-11 09:28:20 2020-12-11 10:50:22 1:22:02 1:12:52 0:09:10 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700792 2020-12-11 09:12:46 2020-12-11 09:28:26 2020-12-11 10:04:26 0:36:00 0:24:50 0:11:10 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700793 2020-12-11 09:12:47 2020-12-11 09:28:30 2020-12-11 10:00:30 0:32:00 0:22:53 0:09:07 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700794 2020-12-11 09:12:48 2020-12-11 09:30:20 2020-12-11 10:00:20 0:30:00 0:23:38 0:06:22 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
fail 5700795 2020-12-11 09:12:49 2020-12-11 09:30:30 2020-12-11 11:44:32 2:14:02 2:06:27 0:07:35 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

failed to recover before timeout expired

pass 5700796 2020-12-11 09:12:50 2020-12-11 09:32:18 2020-12-11 09:58:17 0:25:59 0:19:41 0:06:18 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700797 2020-12-11 09:12:50 2020-12-11 09:32:18 2020-12-11 10:00:18 0:28:00 0:18:55 0:09:05 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700798 2020-12-11 09:12:51 2020-12-11 09:32:18 2020-12-11 10:02:17 0:29:59 0:20:44 0:09:15 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5700799 2020-12-11 09:12:52 2020-12-11 09:32:18 2020-12-11 11:04:19 1:32:01 1:23:10 0:08:51 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5700800 2020-12-11 09:12:53 2020-12-11 09:32:19 2020-12-11 10:06:19 0:34:00 0:23:55 0:10:05 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700801 2020-12-11 09:12:53 2020-12-11 09:32:20 2020-12-11 10:14:20 0:42:00 0:28:21 0:13:39 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700802 2020-12-11 09:12:54 2020-12-11 09:32:22 2020-12-11 10:02:22 0:30:00 0:19:04 0:10:56 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700803 2020-12-11 09:12:55 2020-12-11 09:32:30 2020-12-11 10:56:31 1:24:01 1:15:39 0:08:22 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 5700804 2020-12-11 09:12:56 2020-12-11 09:34:56 2020-12-11 10:06:56 0:32:00 0:19:20 0:12:40 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700805 2020-12-11 09:12:57 2020-12-11 09:36:34 2020-12-11 10:12:34 0:36:00 0:23:06 0:12:54 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700806 2020-12-11 09:12:58 2020-12-11 09:38:48 2020-12-11 10:06:48 0:28:00 0:19:12 0:08:48 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700807 2020-12-11 09:12:58 2020-12-11 09:40:57 2020-12-11 11:08:58 1:28:01 1:19:53 0:08:08 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700808 2020-12-11 09:12:59 2020-12-11 09:42:35 2020-12-11 10:08:34 0:25:59 0:19:19 0:06:40 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700809 2020-12-11 09:13:00 2020-12-11 09:42:35 2020-12-11 10:14:35 0:32:00 0:22:43 0:09:17 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700810 2020-12-11 09:13:01 2020-12-11 09:42:35 2020-12-11 10:12:35 0:30:00 0:19:32 0:10:28 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5700811 2020-12-11 09:13:02 2020-12-11 09:44:22 2020-12-11 11:30:23 1:46:01 1:36:49 0:09:12 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700812 2020-12-11 09:13:02 2020-12-11 09:44:21 2020-12-11 10:14:21 0:30:00 0:19:41 0:10:19 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700813 2020-12-11 09:13:03 2020-12-11 09:44:31 2020-12-11 10:14:31 0:30:00 0:23:15 0:06:45 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700814 2020-12-11 09:13:04 2020-12-11 09:44:37 2020-12-11 10:18:37 0:34:00 0:24:01 0:09:59 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5700815 2020-12-11 09:13:05 2020-12-11 09:46:45 2020-12-11 11:14:46 1:28:01 1:18:22 0:09:39 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 5700816 2020-12-11 09:13:06 2020-12-11 09:46:46 2020-12-11 10:18:45 0:31:59 0:24:23 0:07:36 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700817 2020-12-11 09:13:06 2020-12-11 09:46:46 2020-12-11 10:16:45 0:29:59 0:21:19 0:08:40 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
fail 5700818 2020-12-11 09:13:07 2020-12-11 09:46:46 2020-12-11 12:12:48 2:26:02 2:12:58 0:13:04 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

failed to recover before timeout expired

pass 5700819 2020-12-11 09:13:08 2020-12-11 09:48:26 2020-12-11 10:14:26 0:26:00 0:19:09 0:06:51 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700820 2020-12-11 09:13:09 2020-12-11 09:48:27 2020-12-11 10:22:26 0:33:59 0:27:28 0:06:31 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700821 2020-12-11 09:13:09 2020-12-11 09:50:55 2020-12-11 10:24:57 0:34:02 0:24:20 0:09:42 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700822 2020-12-11 09:13:10 2020-12-11 09:50:55 2020-12-11 11:10:58 1:20:03 1:10:51 0:09:12 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700823 2020-12-11 09:13:11 2020-12-11 09:50:56 2020-12-11 10:24:57 0:34:01 0:23:04 0:10:57 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700824 2020-12-11 09:13:12 2020-12-11 09:51:27 2020-12-11 10:29:26 0:37:59 0:27:36 0:10:23 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700825 2020-12-11 09:13:13 2020-12-11 09:52:48 2020-12-11 10:26:47 0:33:59 0:23:19 0:10:40 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5700826 2020-12-11 09:13:13 2020-12-11 09:52:50 2020-12-11 11:48:50 1:56:00 1:43:45 0:12:15 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700827 2020-12-11 09:13:14 2020-12-11 09:52:48 2020-12-11 10:26:48 0:34:00 0:24:14 0:09:46 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700828 2020-12-11 09:13:15 2020-12-11 09:52:48 2020-12-11 10:18:48 0:26:00 0:18:59 0:07:01 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700829 2020-12-11 09:13:16 2020-12-11 09:52:49 2020-12-11 10:16:47 0:23:58 0:18:45 0:05:13 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5700830 2020-12-11 09:13:17 2020-12-11 09:55:10 2020-12-11 11:33:10 1:38:00 1:25:25 0:12:35 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 5700831 2020-12-11 09:13:17 2020-12-11 09:55:10 2020-12-11 10:27:09 0:31:59 0:25:32 0:06:27 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700832 2020-12-11 09:13:18 2020-12-11 09:55:09 2020-12-11 10:33:08 0:37:59 0:27:49 0:10:10 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700833 2020-12-11 09:13:19 2020-12-11 09:55:09 2020-12-11 10:25:08 0:29:59 0:19:45 0:10:14 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5700834 2020-12-11 09:13:20 2020-12-11 09:55:09 2020-12-11 11:19:09 1:24:00 1:17:43 0:06:17 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5700835 2020-12-11 09:13:21 2020-12-11 09:55:10 2020-12-11 10:29:09 0:33:59 0:23:17 0:10:42 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700836 2020-12-11 09:13:21 2020-12-11 09:56:51 2020-12-11 10:28:51 0:32:00 0:21:51 0:10:09 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700837 2020-12-11 09:13:22 2020-12-11 09:58:24 2020-12-11 10:32:24 0:34:00 0:24:07 0:09:53 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700838 2020-12-11 09:13:23 2020-12-11 09:58:24 2020-12-11 11:30:25 1:32:01 1:21:50 0:10:11 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
pass 5700839 2020-12-11 09:13:24 2020-12-11 09:58:24 2020-12-11 10:24:24 0:26:00 0:19:19 0:06:41 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700840 2020-12-11 09:13:25 2020-12-11 10:00:08 2020-12-11 10:32:08 0:32:00 0:22:40 0:09:20 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700841 2020-12-11 09:13:25 2020-12-11 10:00:08 2020-12-11 10:30:08 0:30:00 0:19:59 0:10:01 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5700842 2020-12-11 09:13:26 2020-12-11 10:00:19 2020-12-11 11:46:20 1:46:01 1:38:54 0:07:07 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700843 2020-12-11 09:13:27 2020-12-11 10:00:18 2020-12-11 10:34:18 0:34:00 0:24:07 0:09:53 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5700844 2020-12-11 09:13:28 2020-12-11 10:00:20 2020-12-11 10:34:19 0:33:59 0:28:28 0:05:31 smithi master rhel 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5700845 2020-12-11 09:13:29 2020-12-11 10:00:21 2020-12-11 10:34:21 0:34:00 0:23:34 0:10:26 smithi master centos 7.8 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5700846 2020-12-11 09:13:29 2020-12-11 10:00:31 2020-12-11 11:24:32 1:24:01 1:13:23 0:10:38 smithi master ubuntu 16.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5700847 2020-12-11 09:13:30 2020-12-11 10:00:52 2020-12-11 10:26:51 0:25:59 0:18:50 0:07:09 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2