Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5455506 2020-09-21 06:14:25 2020-09-21 06:15:02 2020-09-21 06:59:02 0:44:00 0:35:41 0:08:19 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455507 2020-09-21 06:14:26 2020-09-21 06:17:30 2020-09-21 06:57:30 0:40:00 0:28:46 0:11:14 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455508 2020-09-21 06:14:27 2020-09-21 06:17:30 2020-09-21 18:19:59 12:02:29 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5455509 2020-09-21 06:14:27 2020-09-21 06:17:30 2020-09-21 07:59:31 1:42:01 1:35:30 0:06:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455510 2020-09-21 06:14:28 2020-09-21 06:18:12 2020-09-21 06:52:12 0:34:00 0:20:40 0:13:20 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455511 2020-09-21 06:14:29 2020-09-21 06:18:59 2020-09-21 07:23:00 1:04:01 0:19:16 0:44:45 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455512 2020-09-21 06:14:29 2020-09-21 06:19:26 2020-09-21 18:21:56 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455513 2020-09-21 06:14:30 2020-09-21 06:22:11 2020-09-21 06:54:10 0:31:59 0:23:52 0:08:07 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
dead 5455514 2020-09-21 06:14:31 2020-09-21 06:24:48 2020-09-21 18:27:17 12:02:29 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455515 2020-09-21 06:14:31 2020-09-21 06:24:53 2020-09-21 06:56:53 0:32:00 0:25:55 0:06:05 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455516 2020-09-21 06:14:32 2020-09-21 06:25:04 2020-09-21 09:05:06 2:40:02 0:28:16 2:11:46 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455517 2020-09-21 06:14:33 2020-09-21 06:25:04 2020-09-21 10:15:08 3:50:04 2:41:20 1:08:44 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455518 2020-09-21 06:14:33 2020-09-21 06:25:24 2020-09-21 06:55:24 0:30:00 0:24:05 0:05:55 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455519 2020-09-21 06:14:34 2020-09-21 06:25:45 2020-09-21 07:21:45 0:56:00 0:19:54 0:36:06 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455520 2020-09-21 06:14:35 2020-09-21 06:27:26 2020-09-21 06:55:25 0:27:59 0:18:01 0:09:58 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455521 2020-09-21 06:14:35 2020-09-21 06:27:37 2020-09-21 06:55:37 0:28:00 0:17:20 0:10:40 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455522 2020-09-21 06:14:36 2020-09-21 06:31:31 2020-09-21 07:39:31 1:08:00 0:36:13 0:31:47 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455523 2020-09-21 06:14:37 2020-09-21 06:31:31 2020-09-21 07:29:31 0:58:00 0:24:57 0:33:03 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455524 2020-09-21 06:14:37 2020-09-21 06:31:31 2020-09-21 07:25:32 0:54:01 0:26:51 0:27:10 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455525 2020-09-21 06:14:38 2020-09-21 06:32:29 2020-09-21 09:16:32 2:44:03 2:18:17 0:25:46 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455526 2020-09-21 06:14:39 2020-09-21 06:32:52 2020-09-21 07:06:52 0:34:00 0:20:52 0:13:08 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455527 2020-09-21 06:14:39 2020-09-21 06:32:52 2020-09-21 07:38:53 1:06:01 0:18:03 0:47:58 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455528 2020-09-21 06:14:40 2020-09-21 06:34:09 2020-09-21 18:36:35 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455529 2020-09-21 06:14:41 2020-09-21 06:34:13 2020-09-21 07:48:14 1:14:01 0:19:27 0:54:34 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455530 2020-09-21 06:14:41 2020-09-21 06:39:51 2020-09-21 07:23:50 0:43:59 0:24:52 0:19:07 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455531 2020-09-21 06:14:42 2020-09-21 06:41:44 2020-09-21 07:15:44 0:34:00 0:26:43 0:07:17 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455532 2020-09-21 06:14:43 2020-09-21 06:42:35 2020-09-21 07:58:36 1:16:01 0:23:07 0:52:54 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
dead 5455533 2020-09-21 06:14:43 2020-09-21 06:43:15 2020-09-21 18:45:41 12:02:26 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455534 2020-09-21 06:14:44 2020-09-21 06:43:45 2020-09-21 07:41:45 0:58:00 0:28:59 0:29:01 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5455535 2020-09-21 06:14:45 2020-09-21 06:47:26 2020-09-21 18:49:56 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455536 2020-09-21 06:14:45 2020-09-21 06:52:14 2020-09-21 18:54:44 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455537 2020-09-21 06:14:46 2020-09-21 06:52:37 2020-09-21 07:30:37 0:38:00 0:19:39 0:18:21 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5455538 2020-09-21 06:14:46 2020-09-21 06:54:24 2020-09-21 07:34:24 0:40:00 0:27:01 0:12:59 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455539 2020-09-21 06:14:47 2020-09-21 06:54:33 2020-09-21 07:24:32 0:29:59 0:23:28 0:06:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455540 2020-09-21 06:14:48 2020-09-21 06:55:37 2020-09-21 18:58:08 12:02:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455541 2020-09-21 06:14:48 2020-09-21 06:55:37 2020-09-21 09:19:40 2:24:03 2:08:38 0:15:25 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455542 2020-09-21 06:14:49 2020-09-21 06:55:38 2020-09-21 07:43:38 0:48:00 0:19:18 0:28:42 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455543 2020-09-21 06:14:50 2020-09-21 06:57:08 2020-09-21 08:35:09 1:38:01 0:19:36 1:18:25 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455544 2020-09-21 06:14:50 2020-09-21 06:57:31 2020-09-21 07:29:31 0:32:00 0:22:26 0:09:34 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455545 2020-09-21 06:14:51 2020-09-21 06:59:19 2020-09-21 08:21:19 1:22:00 0:18:09 1:03:51 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455546 2020-09-21 06:14:52 2020-09-21 07:29:51 2020-09-21 08:11:51 0:42:00 0:35:15 0:06:45 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455547 2020-09-21 06:14:52 2020-09-21 07:30:38 2020-09-21 08:14:38 0:44:00 0:35:40 0:08:20 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455548 2020-09-21 06:14:53 2020-09-21 07:33:43 2020-09-21 08:29:43 0:56:00 0:28:25 0:27:35 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455549 2020-09-21 06:14:53 2020-09-21 07:34:04 2020-09-21 10:08:07 2:34:03 2:19:01 0:15:02 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 5455550 2020-09-21 06:14:54 2020-09-21 07:34:25 2020-09-21 19:36:55 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455551 2020-09-21 06:14:55 2020-09-21 07:38:37 2020-09-21 08:10:37 0:32:00 0:17:45 0:14:15 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455552 2020-09-21 06:14:55 2020-09-21 07:38:54 2020-09-21 19:41:24 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455553 2020-09-21 06:14:56 2020-09-21 07:39:32 2020-09-21 08:15:32 0:36:00 0:24:09 0:11:51 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455554 2020-09-21 06:14:57 2020-09-21 07:41:03 2020-09-21 08:31:04 0:50:01 0:27:12 0:22:49 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455555 2020-09-21 06:14:57 2020-09-21 07:41:46 2020-09-21 08:45:47 1:04:01 0:26:25 0:37:36 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455556 2020-09-21 06:14:58 2020-09-21 07:41:52 2020-09-21 19:44:22 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5455557 2020-09-21 06:14:59 2020-09-21 07:43:55 2020-09-21 10:29:58 2:46:03 2:06:50 0:39:13 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455558 2020-09-21 06:14:59 2020-09-21 07:45:30 2020-09-21 08:17:29 0:31:59 0:24:24 0:07:35 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5455559 2020-09-21 06:15:00 2020-09-21 07:45:37 2020-09-21 19:48:08 12:02:31 11:53:24 0:09:07 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=26555)

dead 5455560 2020-09-21 06:15:01 2020-09-21 07:47:32 2020-09-21 19:50:01 12:02:29 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455561 2020-09-21 06:15:01 2020-09-21 07:48:15 2020-09-21 08:52:16 1:04:01 0:24:42 0:39:19 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
dead 5455562 2020-09-21 06:15:02 2020-09-21 07:49:41 2020-09-21 19:52:11 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455563 2020-09-21 06:15:03 2020-09-21 07:49:41 2020-09-21 08:31:41 0:42:00 0:28:21 0:13:39 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455564 2020-09-21 06:15:03 2020-09-21 07:50:05 2020-09-21 08:38:05 0:48:00 0:31:46 0:16:14 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455565 2020-09-21 06:15:04 2020-09-21 07:51:19 2020-09-21 10:47:22 2:56:03 2:09:48 0:46:15 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455566 2020-09-21 06:15:05 2020-09-21 07:55:05 2020-09-21 08:39:05 0:44:00 0:18:40 0:25:20 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455567 2020-09-21 06:15:05 2020-09-21 07:56:45 2020-09-21 08:26:44 0:29:59 0:23:54 0:06:05 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455568 2020-09-21 06:15:06 2020-09-21 07:56:49 2020-09-21 19:59:15 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455569 2020-09-21 06:15:07 2020-09-21 07:58:32 2020-09-21 08:38:32 0:40:00 0:18:55 0:21:05 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455570 2020-09-21 06:15:08 2020-09-21 07:58:37 2020-09-21 09:00:38 1:02:01 0:27:04 0:34:57 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455571 2020-09-21 06:15:08 2020-09-21 07:59:49 2020-09-21 09:01:49 1:02:00 0:25:43 0:36:17 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455572 2020-09-21 06:15:09 2020-09-21 07:59:49 2020-09-21 09:03:49 1:04:00 0:26:48 0:37:12 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5455573 2020-09-21 06:15:09 2020-09-21 08:33:21 2020-09-21 10:49:23 2:16:02 2:08:49 0:07:13 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5455574 2020-09-21 06:15:10 2020-09-21 08:35:24 2020-09-21 09:01:23 0:25:59 0:17:38 0:08:21 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455575 2020-09-21 06:15:11 2020-09-21 08:38:34 2020-09-21 09:16:34 0:38:00 0:23:13 0:14:47 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455576 2020-09-21 06:15:12 2020-09-21 08:38:40 2020-09-21 20:41:06 12:02:26 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
dead 5455577 2020-09-21 06:15:12 2020-09-21 08:39:06 2020-09-21 20:41:36 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455578 2020-09-21 06:15:13 2020-09-21 08:39:34 2020-09-21 09:27:34 0:48:00 0:36:23 0:11:37 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455579 2020-09-21 06:15:13 2020-09-21 08:39:34 2020-09-21 09:15:34 0:36:00 0:25:34 0:10:26 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455580 2020-09-21 06:15:14 2020-09-21 08:39:53 2020-09-21 09:15:53 0:36:00 0:26:24 0:09:36 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455581 2020-09-21 06:15:15 2020-09-21 08:43:37 2020-09-21 12:43:42 4:00:05 3:00:53 0:59:12 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 5455582 2020-09-21 06:15:16 2020-09-21 08:43:58 2020-09-21 20:46:25 12:02:27 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455583 2020-09-21 06:15:16 2020-09-21 08:46:00 2020-09-21 09:30:00 0:44:00 0:19:40 0:24:20 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455584 2020-09-21 06:15:17 2020-09-21 08:46:56 2020-09-21 20:49:22 12:02:26 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455585 2020-09-21 06:15:18 2020-09-21 08:52:18 2020-09-21 09:24:17 0:31:59 0:18:16 0:13:43 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
dead 5455586 2020-09-21 06:15:18 2020-09-21 08:55:05 2020-09-21 20:57:35 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455587 2020-09-21 06:15:19 2020-09-21 08:55:09 2020-09-21 09:33:09 0:38:00 0:23:11 0:14:49 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455588 2020-09-21 06:15:20 2020-09-21 08:55:47 2020-09-21 09:31:46 0:35:59 0:26:24 0:09:35 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455589 2020-09-21 06:15:20 2020-09-21 08:59:54 2020-09-21 11:15:56 2:16:02 2:07:55 0:08:07 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455590 2020-09-21 06:15:21 2020-09-21 09:00:39 2020-09-21 09:40:39 0:40:00 0:20:10 0:19:50 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455591 2020-09-21 06:15:22 2020-09-21 09:01:37 2020-09-21 09:33:37 0:32:00 0:24:55 0:07:05 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455592 2020-09-21 06:15:22 2020-09-21 09:01:45 2020-09-21 21:04:16 12:02:31 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455593 2020-09-21 06:15:23 2020-09-21 09:01:50 2020-09-21 09:37:50 0:36:00 0:18:54 0:17:06 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5455594 2020-09-21 06:15:24 2020-09-21 09:02:58 2020-09-21 09:52:58 0:50:00 0:27:22 0:22:38 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455595 2020-09-21 06:15:24 2020-09-21 09:03:18 2020-09-21 09:53:18 0:50:00 0:23:58 0:26:02 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455596 2020-09-21 06:15:25 2020-09-21 09:03:50 2020-09-21 09:53:51 0:50:01 0:30:25 0:19:36 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455597 2020-09-21 06:15:26 2020-09-21 09:04:33 2020-09-21 11:40:36 2:36:03 2:18:46 0:17:17 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455598 2020-09-21 06:15:26 2020-09-21 09:05:08 2020-09-21 09:41:07 0:35:59 0:19:31 0:16:28 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455599 2020-09-21 06:15:27 2020-09-21 09:05:48 2020-09-21 09:39:48 0:34:00 0:18:56 0:15:04 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455600 2020-09-21 06:15:28 2020-09-21 09:09:02 2020-09-21 09:45:02 0:36:00 0:24:56 0:11:04 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
dead 5455601 2020-09-21 06:15:28 2020-09-21 09:13:23 2020-09-21 21:15:53 12:02:30 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455602 2020-09-21 06:15:29 2020-09-21 09:15:52 2020-09-21 10:21:52 1:06:00 0:26:51 0:39:09 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455603 2020-09-21 06:15:30 2020-09-21 09:15:52 2020-09-21 10:11:51 0:55:59 0:28:32 0:27:27 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455604 2020-09-21 06:15:30 2020-09-21 09:15:54 2020-09-21 09:51:54 0:36:00 0:22:31 0:13:29 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455605 2020-09-21 06:15:31 2020-09-21 09:16:33 2020-09-21 11:38:35 2:22:02 2:07:05 0:14:57 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455606 2020-09-21 06:15:32 2020-09-21 09:16:35 2020-09-21 09:48:35 0:32:00 0:17:21 0:14:39 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455607 2020-09-21 06:15:32 2020-09-21 09:17:22 2020-09-21 10:07:23 0:50:01 0:24:34 0:25:27 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455608 2020-09-21 06:15:33 2020-09-21 09:19:32 2020-09-21 21:21:59 12:02:27 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455609 2020-09-21 06:15:33 2020-09-21 09:19:41 2020-09-21 09:51:41 0:32:00 0:23:18 0:08:42 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
dead 5455610 2020-09-21 06:15:34 2020-09-21 09:22:01 2020-09-21 21:24:30 12:02:29 11:54:01 0:08:28 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=18722)

pass 5455611 2020-09-21 06:15:35 2020-09-21 09:23:17 2020-09-21 09:57:16 0:33:59 0:23:02 0:10:57 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455612 2020-09-21 06:15:36 2020-09-21 09:24:12 2020-09-21 10:10:12 0:46:00 0:26:22 0:19:38 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455613 2020-09-21 06:15:36 2020-09-21 09:24:32 2020-09-21 12:48:36 3:24:04 3:10:14 0:13:50 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 5455614 2020-09-21 06:15:37 2020-09-21 09:27:48 2020-09-21 21:30:13 12:02:25 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455615 2020-09-21 06:15:38 2020-09-21 09:27:48 2020-09-21 09:53:46 0:25:58 0:19:33 0:06:25 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455616 2020-09-21 06:15:38 2020-09-21 09:29:53 2020-09-21 21:32:19 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455617 2020-09-21 06:15:39 2020-09-21 09:30:02 2020-09-21 09:56:02 0:26:00 0:18:50 0:07:10 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5455618 2020-09-21 06:15:40 2020-09-21 09:32:04 2020-09-21 10:24:04 0:52:00 0:23:09 0:28:51 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455619 2020-09-21 06:15:40 2020-09-21 09:32:04 2020-09-21 10:36:05 1:04:01 0:33:11 0:30:50 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455620 2020-09-21 06:15:41 2020-09-21 09:33:26 2020-09-21 21:35:56 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455621 2020-09-21 06:15:42 2020-09-21 09:33:38 2020-09-21 11:57:41 2:24:03 2:18:05 0:05:58 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 5455622 2020-09-21 06:15:42 2020-09-21 09:37:20 2020-09-21 21:39:50 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455623 2020-09-21 06:15:43 2020-09-21 09:37:35 2020-09-21 10:15:35 0:38:00 0:18:48 0:19:12 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455624 2020-09-21 06:15:44 2020-09-21 09:37:51 2020-09-21 10:13:51 0:36:00 0:28:48 0:07:12 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455625 2020-09-21 06:15:44 2020-09-21 09:39:32 2020-09-21 10:07:31 0:27:59 0:20:20 0:07:39 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
dead 5455626 2020-09-21 06:15:45 2020-09-21 09:39:36 2020-09-21 21:42:07 12:02:31 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455627 2020-09-21 06:15:46 2020-09-21 09:39:49 2020-09-21 10:09:49 0:30:00 0:23:05 0:06:55 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455628 2020-09-21 06:15:46 2020-09-21 09:40:20 2020-09-21 21:42:51 12:02:31 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455629 2020-09-21 06:15:47 2020-09-21 09:40:53 2020-09-21 14:32:58 4:52:05 4:41:38 0:10:27 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455630 2020-09-21 06:15:48 2020-09-21 09:41:08 2020-09-21 10:31:09 0:50:01 0:22:45 0:27:16 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5455631 2020-09-21 06:15:49 2020-09-21 09:56:11 2020-09-21 21:58:41 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455632 2020-09-21 06:15:49 2020-09-21 09:57:31 2020-09-21 21:59:56 12:02:25 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455633 2020-09-21 06:15:50 2020-09-21 09:57:55 2020-09-21 10:33:55 0:36:00 0:20:40 0:15:20 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5455634 2020-09-21 06:15:50 2020-09-21 09:59:49 2020-09-21 10:39:48 0:39:59 0:31:06 0:08:53 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455635 2020-09-21 06:15:51 2020-09-21 10:00:24 2020-09-21 10:32:24 0:32:00 0:24:22 0:07:38 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455636 2020-09-21 06:15:52 2020-09-21 10:03:22 2020-09-21 10:37:22 0:34:00 0:23:26 0:10:34 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455637 2020-09-21 06:15:53 2020-09-21 10:05:34 2020-09-21 12:57:37 2:52:03 2:27:12 0:24:51 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455638 2020-09-21 06:15:53 2020-09-21 10:05:56 2020-09-21 10:33:55 0:27:59 0:19:58 0:08:01 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455639 2020-09-21 06:15:54 2020-09-21 10:07:38 2020-09-21 11:03:38 0:56:00 0:18:49 0:37:11 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455640 2020-09-21 06:15:54 2020-09-21 10:07:38 2020-09-21 10:55:38 0:48:00 0:17:37 0:30:23 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455641 2020-09-21 06:15:55 2020-09-21 10:07:48 2020-09-21 10:55:48 0:48:00 0:22:57 0:25:03 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5455642 2020-09-21 06:15:56 2020-09-21 10:08:08 2020-09-21 10:38:08 0:30:00 0:21:55 0:08:05 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455643 2020-09-21 06:15:56 2020-09-21 10:09:03 2020-09-21 10:47:03 0:38:00 0:30:59 0:07:01 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455644 2020-09-21 06:15:57 2020-09-21 10:09:14 2020-09-21 10:49:14 0:40:00 0:29:45 0:10:15 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455645 2020-09-21 06:15:58 2020-09-21 10:09:50 2020-09-21 14:07:54 3:58:04 3:39:27 0:18:37 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455646 2020-09-21 06:15:58 2020-09-21 10:09:56 2020-09-21 10:49:56 0:40:00 0:18:46 0:21:14 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455647 2020-09-21 06:15:59 2020-09-21 10:10:27 2020-09-21 10:40:27 0:30:00 0:18:23 0:11:37 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455648 2020-09-21 06:16:00 2020-09-21 10:11:20 2020-09-21 10:55:20 0:44:00 0:27:56 0:16:04 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455649 2020-09-21 06:16:00 2020-09-21 10:11:57 2020-09-21 10:47:57 0:36:00 0:20:03 0:15:57 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455650 2020-09-21 06:16:01 2020-09-21 10:11:57 2020-09-21 10:57:57 0:46:00 0:29:15 0:16:45 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455651 2020-09-21 06:16:02 2020-09-21 10:14:08 2020-09-21 10:54:08 0:40:00 0:24:39 0:15:21 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455652 2020-09-21 06:16:02 2020-09-21 10:15:23 2020-09-21 10:49:23 0:34:00 0:28:40 0:05:20 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455653 2020-09-21 06:16:03 2020-09-21 10:15:36 2020-09-21 12:47:38 2:32:02 2:16:59 0:15:03 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455654 2020-09-21 06:16:04 2020-09-21 10:15:52 2020-09-21 10:47:52 0:32:00 0:19:25 0:12:35 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455655 2020-09-21 06:16:04 2020-09-21 10:31:30 2020-09-21 10:59:30 0:28:00 0:21:51 0:06:09 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455656 2020-09-21 06:16:05 2020-09-21 10:32:25 2020-09-21 22:34:52 12:02:27 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455657 2020-09-21 06:16:06 2020-09-21 10:34:10 2020-09-21 11:06:09 0:31:59 0:24:44 0:07:15 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455658 2020-09-21 06:16:06 2020-09-21 10:34:10 2020-09-21 11:02:09 0:27:59 0:22:50 0:05:09 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455659 2020-09-21 06:16:07 2020-09-21 10:34:12 2020-09-21 11:20:12 0:46:00 0:27:40 0:18:20 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455660 2020-09-21 06:16:08 2020-09-21 10:34:59 2020-09-21 11:10:59 0:36:00 0:27:16 0:08:44 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5455661 2020-09-21 06:16:08 2020-09-21 10:36:20 2020-09-21 12:36:21 2:00:01 1:44:51 0:15:10 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455662 2020-09-21 06:16:09 2020-09-21 10:37:36 2020-09-21 11:09:36 0:32:00 0:24:39 0:07:21 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455663 2020-09-21 06:16:10 2020-09-21 10:37:37 2020-09-21 11:05:37 0:28:00 0:21:03 0:06:57 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455664 2020-09-21 06:16:11 2020-09-21 10:38:09 2020-09-21 22:40:35 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455665 2020-09-21 06:16:11 2020-09-21 10:40:03 2020-09-21 11:16:03 0:36:00 0:24:24 0:11:36 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
dead 5455666 2020-09-21 06:16:12 2020-09-21 10:40:06 2020-09-21 22:42:37 12:02:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455667 2020-09-21 06:16:13 2020-09-21 10:40:19 2020-09-21 11:30:19 0:50:00 0:19:29 0:30:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455668 2020-09-21 06:16:13 2020-09-21 10:40:28 2020-09-21 22:42:59 12:02:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455669 2020-09-21 06:16:14 2020-09-21 10:43:15 2020-09-21 13:45:18 3:02:03 2:39:35 0:22:28 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455670 2020-09-21 06:16:15 2020-09-21 10:43:15 2020-09-21 11:31:15 0:48:00 0:24:16 0:23:44 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455671 2020-09-21 06:16:15 2020-09-21 10:46:28 2020-09-21 11:12:27 0:25:59 0:19:35 0:06:24 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455672 2020-09-21 06:16:16 2020-09-21 10:47:04 2020-09-21 22:49:34 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455673 2020-09-21 06:16:17 2020-09-21 10:47:23 2020-09-21 11:17:23 0:30:00 0:22:26 0:07:34 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455674 2020-09-21 06:16:17 2020-09-21 10:48:07 2020-09-21 11:26:07 0:38:00 0:31:13 0:06:47 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455675 2020-09-21 06:16:18 2020-09-21 10:48:07 2020-09-21 11:26:07 0:38:00 0:29:44 0:08:16 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455676 2020-09-21 06:16:19 2020-09-21 10:49:28 2020-09-21 11:25:28 0:36:00 0:24:00 0:12:00 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455677 2020-09-21 06:16:19 2020-09-21 10:49:29 2020-09-21 13:21:31 2:32:02 2:19:01 0:13:01 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455678 2020-09-21 06:16:20 2020-09-21 10:49:29 2020-09-21 11:25:28 0:35:59 0:25:11 0:10:48 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455679 2020-09-21 06:16:21 2020-09-21 10:49:57 2020-09-21 11:19:56 0:29:59 0:18:05 0:11:54 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455680 2020-09-21 06:16:21 2020-09-21 10:50:13 2020-09-21 22:52:43 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455681 2020-09-21 06:16:22 2020-09-21 10:54:24 2020-09-21 11:26:24 0:32:00 0:21:21 0:10:39 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455682 2020-09-21 06:16:23 2020-09-21 10:55:21 2020-09-21 11:37:21 0:42:00 0:24:52 0:17:08 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455683 2020-09-21 06:16:23 2020-09-21 10:55:53 2020-09-21 12:03:54 1:08:01 0:32:41 0:35:20 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455684 2020-09-21 06:16:24 2020-09-21 10:55:53 2020-09-21 11:55:54 1:00:01 0:23:50 0:36:11 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
dead 5455685 2020-09-21 06:16:25 2020-09-21 10:58:11 2020-09-21 23:00:42 12:02:31 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455686 2020-09-21 06:16:25 2020-09-21 10:59:45 2020-09-21 11:39:44 0:39:59 0:24:28 0:15:31 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455687 2020-09-21 06:16:26 2020-09-21 11:02:25 2020-09-21 12:28:26 1:26:01 0:23:57 1:02:04 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455688 2020-09-21 06:16:27 2020-09-21 11:03:53 2020-09-21 23:06:23 12:02:30 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455689 2020-09-21 06:16:27 2020-09-21 11:05:52 2020-09-21 11:35:51 0:29:59 0:19:42 0:10:17 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5455690 2020-09-21 06:16:28 2020-09-21 11:06:11 2020-09-21 11:46:10 0:39:59 0:30:58 0:09:01 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455691 2020-09-21 06:16:28 2020-09-21 11:09:29 2020-09-21 11:39:29 0:30:00 0:21:35 0:08:25 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455692 2020-09-21 06:16:29 2020-09-21 11:09:37 2020-09-21 11:47:37 0:38:00 0:25:01 0:12:59 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455693 2020-09-21 06:16:30 2020-09-21 11:11:13 2020-09-21 13:41:15 2:30:02 2:18:27 0:11:35 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455694 2020-09-21 06:16:30 2020-09-21 11:12:41 2020-09-21 11:44:40 0:31:59 0:21:46 0:10:13 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455695 2020-09-21 06:16:31 2020-09-21 11:16:10 2020-09-21 11:50:10 0:34:00 0:24:01 0:09:59 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455696 2020-09-21 06:16:32 2020-09-21 11:16:10 2020-09-21 23:18:40 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455697 2020-09-21 06:16:32 2020-09-21 11:17:36 2020-09-21 11:53:36 0:36:00 0:22:12 0:13:48 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455698 2020-09-21 06:16:33 2020-09-21 11:19:58 2020-09-21 12:29:58 1:10:00 0:39:03 0:30:57 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455699 2020-09-21 06:16:34 2020-09-21 11:20:13 2020-09-21 12:00:13 0:40:00 0:29:52 0:10:08 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455700 2020-09-21 06:16:34 2020-09-21 11:25:30 2020-09-21 23:28:00 12:02:30 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455701 2020-09-21 06:16:35 2020-09-21 11:25:30 2020-09-21 13:49:32 2:24:02 2:11:25 0:12:37 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455702 2020-09-21 06:16:36 2020-09-21 11:26:08 2020-09-21 12:06:08 0:40:00 0:23:25 0:16:35 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455703 2020-09-21 06:16:36 2020-09-21 11:26:08 2020-09-21 12:06:08 0:40:00 0:21:21 0:18:39 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455704 2020-09-21 06:16:37 2020-09-21 11:26:38 2020-09-21 23:29:03 12:02:25 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455705 2020-09-21 06:16:38 2020-09-21 11:30:33 2020-09-21 12:04:33 0:34:00 0:19:47 0:14:13 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} 2
pass 5455706 2020-09-21 06:16:38 2020-09-21 11:31:16 2020-09-21 12:23:17 0:52:01 0:41:33 0:10:28 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
dead 5455707 2020-09-21 06:16:39 2020-09-21 11:36:07 2020-09-21 23:38:36 12:02:29 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
dead 5455708 2020-09-21 06:16:40 2020-09-21 11:37:38 2020-09-21 23:40:08 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
dead 5455709 2020-09-21 06:16:40 2020-09-21 11:38:36 2020-09-21 23:41:02 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5455710 2020-09-21 06:16:41 2020-09-21 11:39:45 2020-09-21 12:09:44 0:29:59 0:19:26 0:10:33 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455711 2020-09-21 06:16:42 2020-09-21 11:39:46 2020-09-21 12:15:46 0:36:00 0:19:50 0:16:10 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455712 2020-09-21 06:16:42 2020-09-21 11:40:37 2020-09-21 23:43:07 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455713 2020-09-21 06:16:43 2020-09-21 11:45:02 2020-09-21 13:03:02 1:18:00 0:20:10 0:57:50 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects} 2
dead 5455714 2020-09-21 06:16:44 2020-09-21 11:46:27 2020-09-21 12:00:26 0:13:59 0:00:16 0:13:43 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
Failure Reason:

Failure object was: {'smithi073.front.sepia.ceph.com': {'msg': "The conditional check 'perform_users_role|bool' failed. The error was: template error while templating string: no filter named 'bool'. String: {% if perform_users_role|bool %} True {% else %} False {% endif %}\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/create_users.yml': line 10, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Create all admin users with sudo access.\n ^ here\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefinedyaml.representer.RepresenterError: ('cannot represent an object', "The conditional check 'perform_users_role|bool' failed. The error was: template error while templating string: no filter named 'bool'. String: {% if perform_users_role|bool %} True {% else %} False {% endif %}\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/create_users.yml': line 10, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Create all admin users with sudo access.\n ^ here\n")Failure object was: {'smithi022.front.sepia.ceph.com': {'msg': "The conditional check 'perform_users_role|bool' failed. The error was: template error while templating string: no filter named 'bool'. String: {% if perform_users_role|bool %} True {% else %} False {% endif %}\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/create_users.yml': line 10, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Create all admin users with sudo access.\n ^ here\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefinedyaml.representer.RepresenterError: ('cannot represent an object', "The conditional check 'perform_users_role|bool' failed. The error was: template error while templating string: no filter named 'bool'. String: {% if perform_users_role|bool %} True {% else %} False {% endif %}\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/create_users.yml': line 10, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Create all admin users with sudo access.\n ^ here\n")

pass 5455715 2020-09-21 06:16:44 2020-09-21 11:47:52 2020-09-21 12:19:52 0:32:00 0:21:47 0:10:13 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455716 2020-09-21 06:16:45 2020-09-21 11:50:28 2020-09-21 12:42:28 0:52:00 0:26:54 0:25:06 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455717 2020-09-21 06:16:46 2020-09-21 11:53:55 2020-09-21 14:31:57 2:38:02 2:13:39 0:24:23 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455718 2020-09-21 06:16:46 2020-09-21 11:56:13 2020-09-21 12:30:13 0:34:00 0:19:18 0:14:42 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455719 2020-09-21 06:16:47 2020-09-21 11:57:58 2020-09-21 12:29:58 0:32:00 0:23:30 0:08:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455720 2020-09-21 06:16:48 2020-09-21 12:01:05 2020-09-22 00:03:35 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455721 2020-09-21 06:16:48 2020-09-21 12:01:05 2020-09-21 12:53:05 0:52:00 0:17:16 0:34:44 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5455722 2020-09-21 06:16:49 2020-09-21 12:04:13 2020-09-21 12:38:12 0:33:59 0:26:14 0:07:45 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455723 2020-09-21 06:16:49 2020-09-21 12:04:34 2020-09-21 12:42:34 0:38:00 0:30:47 0:07:13 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455724 2020-09-21 06:16:50 2020-09-21 12:04:59 2020-09-21 12:44:59 0:40:00 0:31:49 0:08:11 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455725 2020-09-21 06:16:51 2020-09-21 12:06:22 2020-09-21 14:52:25 2:46:03 2:17:19 0:28:44 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455726 2020-09-21 06:16:51 2020-09-21 12:06:22 2020-09-21 12:40:22 0:34:00 0:24:19 0:09:41 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455727 2020-09-21 06:16:52 2020-09-21 12:09:32 2020-09-21 12:39:31 0:29:59 0:18:39 0:11:20 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455728 2020-09-21 06:16:53 2020-09-21 12:09:45 2020-09-21 12:51:46 0:42:01 0:21:40 0:20:21 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
dead 5455729 2020-09-21 06:16:53 2020-09-21 12:16:02 2020-09-22 00:18:29 12:02:27 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
dead 5455730 2020-09-21 06:16:54 2020-09-21 12:20:07 2020-09-22 00:22:40 12:02:33 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
dead 5455731 2020-09-21 06:16:55 2020-09-21 12:23:34 2020-09-22 00:26:04 12:02:30 11:50:01 0:12:29 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=9648)

dead 5455732 2020-09-21 06:16:55 2020-09-21 12:28:45 2020-09-22 00:31:16 12:02:31 11:51:33 0:10:58 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=10496)

fail 5455733 2020-09-21 06:16:56 2020-09-21 12:30:13 2020-09-21 14:56:15 2:26:02 2:11:57 0:14:05 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455734 2020-09-21 06:16:57 2020-09-21 12:30:13 2020-09-21 13:02:12 0:31:59 0:19:21 0:12:38 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5455735 2020-09-21 06:16:57 2020-09-21 12:30:14 2020-09-22 00:32:44 12:02:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5455736 2020-09-21 06:16:58 2020-09-21 12:36:41 2020-09-21 13:08:40 0:31:59 0:23:40 0:08:19 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455737 2020-09-21 06:16:58 2020-09-21 12:38:27 2020-09-21 13:06:26 0:27:59 0:19:33 0:08:26 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
dead 5455738 2020-09-21 06:16:59 2020-09-21 12:39:45 2020-09-22 00:42:15 12:02:30 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455739 2020-09-21 06:17:00 2020-09-21 12:40:23 2020-09-21 13:12:23 0:32:00 0:22:43 0:09:17 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455740 2020-09-21 06:17:00 2020-09-21 12:42:45 2020-09-21 13:34:46 0:52:01 0:26:24 0:25:37 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455741 2020-09-21 06:17:01 2020-09-21 12:42:45 2020-09-21 15:18:48 2:36:03 2:21:50 0:14:13 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 5455742 2020-09-21 06:17:02 2020-09-21 12:43:43 2020-09-22 00:46:13 12:02:30 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455743 2020-09-21 06:17:02 2020-09-21 12:45:14 2020-09-21 13:15:14 0:30:00 0:19:35 0:10:25 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455744 2020-09-21 06:17:03 2020-09-21 12:47:55 2020-09-22 00:50:29 12:02:34 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455745 2020-09-21 06:17:04 2020-09-21 12:48:37 2020-09-21 14:04:38 1:16:01 0:23:07 0:52:54 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5455746 2020-09-21 06:17:05 2020-09-21 12:52:01 2020-09-21 13:24:01 0:32:00 0:21:40 0:10:20 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455747 2020-09-21 06:17:05 2020-09-21 12:53:19 2020-09-21 13:47:20 0:54:01 0:25:31 0:28:30 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455748 2020-09-21 06:17:06 2020-09-21 12:57:54 2020-09-21 13:33:54 0:36:00 0:27:47 0:08:13 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455749 2020-09-21 06:17:07 2020-09-21 13:02:29 2020-09-21 16:58:33 3:56:04 2:43:14 1:12:50 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455750 2020-09-21 06:17:07 2020-09-21 13:03:03 2020-09-21 13:47:04 0:44:01 0:20:46 0:23:15 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5455751 2020-09-21 06:17:08 2020-09-21 13:06:42 2020-09-22 01:09:13 12:02:31 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455752 2020-09-21 06:17:09 2020-09-21 13:08:54 2020-09-22 01:11:24 12:02:30 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5455753 2020-09-21 06:17:09 2020-09-21 13:12:37 2020-09-21 13:48:37 0:36:00 0:20:34 0:15:26 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
dead 5455754 2020-09-21 06:17:10 2020-09-21 13:15:28 2020-09-22 01:17:54 12:02:26 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455755 2020-09-21 06:17:11 2020-09-21 13:21:37 2020-09-21 14:09:36 0:47:59 0:30:22 0:17:37 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455756 2020-09-21 06:17:11 2020-09-21 13:21:37 2020-09-21 14:17:37 0:56:00 0:24:58 0:31:02 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 5455757 2020-09-21 06:17:12 2020-09-21 13:24:14 2020-09-21 16:00:17 2:36:03 2:06:35 0:29:28 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

pass 5455758 2020-09-21 06:17:12 2020-09-21 13:34:09 2020-09-21 14:08:09 0:34:00 0:22:50 0:11:10 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5455759 2020-09-21 06:17:13 2020-09-21 13:34:47 2020-09-21 14:34:47 1:00:00 0:25:18 0:34:42 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 quorum-write/3-size-2-pw-size rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
dead 5455760 2020-09-21 06:17:14 2020-09-21 13:41:30 2020-09-22 01:44:00 12:02:30 11:51:06 0:11:24 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
Failure Reason:

SSH connection to smithi101 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400000 --objects 20 --max-in-flight 8 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 0 --op write 0 --op delete 20 --op append 5 --op write_excl 0 --op append_excl 5 --pool unique_pool_0'

pass 5455761 2020-09-21 06:17:14 2020-09-21 13:45:32 2020-09-21 14:17:32 0:32:00 0:24:07 0:07:53 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 5455762 2020-09-21 06:17:15 2020-09-21 13:47:17 2020-09-21 14:23:17 0:36:00 0:24:45 0:11:15 smithi master ubuntu 18.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd quorum-write/3-size-2-pw-size rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5455763 2020-09-21 06:17:16 2020-09-21 13:47:21 2020-09-21 14:51:21 1:04:00 0:28:42 0:35:18 smithi master rhel 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid quorum-write/3-size-2-pw-size rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5455764 2020-09-21 06:17:16 2020-09-21 13:48:51 2020-09-21 14:34:51 0:46:00 0:22:57 0:23:03 smithi master centos 8.1 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target quorum-write/3-size-2-pw-size rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2