Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6809751 2022-04-27 17:38:21 2022-04-28 11:47:20 2022-04-28 12:01:25 0:14:05 0:06:50 0:07:15 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

No module named 'tasks.ceph'

fail 6809752 2022-04-27 17:38:21 2022-04-28 11:47:41 2022-04-28 12:02:18 0:14:37 0:06:44 0:07:53 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

No module named 'tasks.ceph'

fail 6809753 2022-04-27 17:38:21 2022-04-28 11:48:41 2022-04-28 12:01:45 0:13:04 0:04:40 0:08:24 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

Command failed on smithi033 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11768-g5faec6ad-1focal ceph-mds=17.0.0-11768-g5faec6ad-1focal ceph-common=17.0.0-11768-g5faec6ad-1focal ceph-fuse=17.0.0-11768-g5faec6ad-1focal ceph-test=17.0.0-11768-g5faec6ad-1focal radosgw=17.0.0-11768-g5faec6ad-1focal python-ceph=17.0.0-11768-g5faec6ad-1focal libcephfs1=17.0.0-11768-g5faec6ad-1focal libcephfs-java=17.0.0-11768-g5faec6ad-1focal libcephfs-jni=17.0.0-11768-g5faec6ad-1focal librados2=17.0.0-11768-g5faec6ad-1focal librbd1=17.0.0-11768-g5faec6ad-1focal rbd-fuse=17.0.0-11768-g5faec6ad-1focal'

fail 6809754 2022-04-27 17:38:21 2022-04-28 11:50:22 2022-04-28 12:02:16 0:11:54 0:04:44 0:07:10 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

Command failed on smithi192 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11768-g5faec6ad-1focal ceph-mds=17.0.0-11768-g5faec6ad-1focal ceph-common=17.0.0-11768-g5faec6ad-1focal ceph-fuse=17.0.0-11768-g5faec6ad-1focal ceph-test=17.0.0-11768-g5faec6ad-1focal radosgw=17.0.0-11768-g5faec6ad-1focal python-ceph=17.0.0-11768-g5faec6ad-1focal libcephfs1=17.0.0-11768-g5faec6ad-1focal libcephfs-java=17.0.0-11768-g5faec6ad-1focal libcephfs-jni=17.0.0-11768-g5faec6ad-1focal librados2=17.0.0-11768-g5faec6ad-1focal librbd1=17.0.0-11768-g5faec6ad-1focal rbd-fuse=17.0.0-11768-g5faec6ad-1focal'

pass 6809755 2022-04-27 17:38:21 2022-04-28 11:50:53 2022-04-28 12:32:39 0:41:46 0:33:17 0:08:29 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809756 2022-04-27 17:38:21 2022-04-28 11:52:43 2022-04-28 12:02:51 0:10:08 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809757 2022-04-27 17:38:21 2022-04-28 11:54:44 2022-04-28 12:02:15 0:07:31 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 6809758 2022-04-27 17:38:21 2022-04-28 11:54:44 2022-04-28 12:11:00 0:16:16 0:06:44 0:09:32 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

No module named 'tasks'

dead 6809759 2022-04-27 17:38:21 2022-04-28 11:55:25 2022-04-28 18:39:12 6:43:47 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809760 2022-04-27 17:38:21 2022-04-28 11:57:05 2022-04-28 12:35:25 0:38:20 0:31:24 0:06:56 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809761 2022-04-27 17:38:21 2022-04-28 11:57:16 2022-04-28 12:37:59 0:40:43 0:32:33 0:08:10 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809762 2022-04-27 17:38:21 2022-04-28 11:58:37 2022-04-28 18:42:42 6:44:05 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809763 2022-04-27 17:38:21 2022-04-28 12:02:04 2022-04-28 12:41:26 0:39:22 0:33:49 0:05:33 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809764 2022-04-27 17:38:21 2022-04-28 12:02:04 2022-04-28 12:47:09 0:45:05 0:36:44 0:08:21 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809765 2022-04-27 17:38:21 2022-04-28 12:02:05 2022-04-28 12:43:31 0:41:26 0:33:58 0:07:28 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809766 2022-04-27 17:38:21 2022-04-28 12:02:05 2022-04-28 12:43:38 0:41:33 0:34:09 0:07:24 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809767 2022-04-27 17:38:21 2022-04-28 12:02:05 2022-04-28 12:49:35 0:47:30 0:40:07 0:07:23 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809768 2022-04-27 17:38:21 2022-04-28 12:02:06 2022-04-28 12:43:56 0:41:50 0:33:57 0:07:53 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809769 2022-04-27 17:38:21 2022-04-28 12:02:06 2022-04-28 12:42:04 0:39:58 0:32:59 0:06:59 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809770 2022-04-27 17:38:21 2022-04-28 12:02:27 2022-04-28 12:50:13 0:47:46 0:41:46 0:06:00 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809771 2022-04-27 17:38:21 2022-04-28 12:02:27 2022-04-28 12:41:53 0:39:26 0:33:44 0:05:42 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809772 2022-04-27 17:38:22 2022-04-28 12:02:27 2022-04-28 12:46:45 0:44:18 0:37:05 0:07:13 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809773 2022-04-27 17:38:22 2022-04-28 12:02:38 2022-04-28 12:50:53 0:48:15 0:40:24 0:07:51 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809774 2022-04-27 17:38:22 2022-04-28 12:02:48 2022-04-28 18:46:35 6:43:47 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

dead 6809775 2022-04-27 17:38:22 2022-04-28 12:03:08 2022-04-28 18:44:37 6:41:29 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809776 2022-04-27 17:38:22 2022-04-28 12:03:09 2022-04-28 12:48:52 0:45:43 0:39:08 0:06:35 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809777 2022-04-27 17:38:22 2022-04-28 12:03:19 2022-04-28 12:47:21 0:44:02 0:37:06 0:06:56 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809778 2022-04-27 17:38:22 2022-04-28 12:03:40 2022-04-28 12:48:04 0:44:24 0:36:20 0:08:04 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809779 2022-04-27 17:38:22 2022-04-28 12:05:22 2022-04-28 13:01:00 0:55:38 0:49:34 0:06:04 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809780 2022-04-27 17:38:22 2022-04-28 12:05:23 2022-04-28 12:46:24 0:41:01 0:33:16 0:07:45 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809781 2022-04-27 17:38:22 2022-04-28 12:07:13 2022-04-28 12:54:34 0:47:21 0:38:19 0:09:02 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809782 2022-04-27 17:38:22 2022-04-28 12:08:44 2022-04-28 12:48:59 0:40:15 0:32:43 0:07:32 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809783 2022-04-27 17:38:22 2022-04-28 12:09:34 2022-04-28 12:52:38 0:43:04 0:35:10 0:07:54 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809784 2022-04-27 17:38:22 2022-04-28 12:11:05 2022-04-28 12:52:08 0:41:03 0:33:06 0:07:57 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809785 2022-04-27 17:38:22 2022-04-28 12:11:56 2022-04-28 12:57:43 0:45:47 0:38:03 0:07:44 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809786 2022-04-27 17:38:22 2022-04-28 12:12:17 2022-04-28 13:02:52 0:50:35 0:32:08 0:18:27 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809787 2022-04-27 17:38:22 2022-04-28 12:22:49 2022-04-28 13:09:23 0:46:34 0:32:28 0:14:06 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809788 2022-04-27 17:38:22 2022-04-28 12:29:51 2022-04-28 13:06:08 0:36:17 0:29:34 0:06:43 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809789 2022-04-27 17:38:22 2022-04-28 12:30:32 2022-04-28 13:12:48 0:42:16 0:32:13 0:10:03 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809790 2022-04-27 17:38:22 2022-04-28 12:32:43 2022-04-28 13:15:46 0:43:03 0:32:25 0:10:38 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809791 2022-04-27 17:38:22 2022-04-28 12:35:35 2022-04-28 13:23:29 0:47:54 0:38:03 0:09:51 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809792 2022-04-27 17:38:22 2022-04-28 12:38:06 2022-04-28 19:21:26 6:43:20 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809793 2022-04-27 17:38:22 2022-04-28 12:41:28 2022-04-28 13:23:31 0:42:03 0:34:43 0:07:20 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809794 2022-04-27 17:38:22 2022-04-28 12:41:58 2022-04-28 13:21:33 0:39:35 0:33:34 0:06:01 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809795 2022-04-27 17:38:22 2022-04-28 12:42:09 2022-04-28 19:24:43 6:42:34 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809796 2022-04-27 17:38:22 2022-04-28 12:43:40 2022-04-28 13:29:04 0:45:24 0:38:12 0:07:12 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809797 2022-04-27 17:38:22 2022-04-28 12:43:40 2022-04-28 13:21:53 0:38:13 0:31:16 0:06:57 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809798 2022-04-27 17:38:22 2022-04-28 12:44:01 2022-04-28 13:27:54 0:43:53 0:34:12 0:09:41 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809799 2022-04-27 17:38:22 2022-04-28 12:46:32 2022-04-28 13:26:34 0:40:02 0:32:40 0:07:22 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809800 2022-04-27 17:38:22 2022-04-28 12:46:52 2022-04-28 13:23:36 0:36:44 0:28:53 0:07:51 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809801 2022-04-27 17:38:22 2022-04-28 12:47:13 2022-04-28 13:27:54 0:40:41 0:33:27 0:07:14 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809802 2022-04-27 17:38:22 2022-04-28 12:47:23 2022-04-28 13:27:56 0:40:33 0:32:28 0:08:05 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809803 2022-04-27 17:38:23 2022-04-28 12:48:14 2022-04-28 19:29:26 6:41:12 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809804 2022-04-27 17:38:23 2022-04-28 12:48:54 2022-04-28 13:26:38 0:37:44 0:31:30 0:06:14 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809805 2022-04-27 17:38:23 2022-04-28 12:49:05 2022-04-28 19:29:07 6:40:02 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809806 2022-04-27 17:38:23 2022-04-28 12:49:35 2022-04-28 13:27:49 0:38:14 0:30:37 0:07:37 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809807 2022-04-27 17:38:23 2022-04-28 12:50:16 2022-04-28 13:36:42 0:46:26 0:39:20 0:07:06 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809808 2022-04-27 17:38:23 2022-04-28 12:50:57 2022-04-28 13:30:33 0:39:36 0:31:37 0:07:59 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809809 2022-04-27 17:38:23 2022-04-28 12:52:17 2022-04-28 13:40:19 0:48:02 0:40:10 0:07:52 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809810 2022-04-27 17:38:23 2022-04-28 12:52:48 2022-04-28 13:38:46 0:45:58 0:36:37 0:09:21 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809811 2022-04-27 17:38:23 2022-04-28 12:54:38 2022-04-28 13:37:17 0:42:39 0:32:04 0:10:35 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809812 2022-04-27 17:38:23 2022-04-28 12:57:49 2022-04-28 19:41:19 6:43:30 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809813 2022-04-27 17:38:23 2022-04-28 13:01:01 2022-04-28 13:40:55 0:39:54 0:33:18 0:06:36 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809814 2022-04-27 17:38:23 2022-04-28 13:01:11 2022-04-28 19:44:35 6:43:24 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

dead 6809815 2022-04-27 17:38:23 2022-04-28 13:03:02 2022-04-28 19:46:11 6:43:09 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

dead 6809816 2022-04-27 17:38:23 2022-04-28 13:06:13 2022-04-28 19:51:15 6:45:02 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809817 2022-04-27 17:38:23 2022-04-28 13:09:24 2022-04-28 13:55:03 0:45:39 0:35:33 0:10:06 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809818 2022-04-27 17:38:23 2022-04-28 13:12:55 2022-04-28 13:51:37 0:38:42 0:30:51 0:07:51 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809819 2022-04-27 17:38:23 2022-04-28 13:14:16 2022-04-28 13:56:13 0:41:57 0:32:08 0:09:49 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809820 2022-04-27 17:38:23 2022-04-28 13:15:57 2022-04-28 14:03:28 0:47:31 0:34:07 0:13:24 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809821 2022-04-27 17:38:23 2022-04-28 13:21:57 2022-04-28 14:09:55 0:47:58 0:39:05 0:08:53 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809822 2022-04-27 17:38:23 2022-04-28 13:24:27 2022-04-28 14:30:24 1:05:57 0:57:35 0:08:22 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809823 2022-04-27 17:38:23 2022-04-28 13:28:02 2022-04-28 14:09:39 0:41:37 0:34:42 0:06:55 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809824 2022-04-27 17:38:23 2022-04-28 13:28:03 2022-04-28 14:09:27 0:41:24 0:33:53 0:07:31 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809825 2022-04-27 17:38:23 2022-04-28 13:28:03 2022-04-28 14:12:45 0:44:42 0:37:19 0:07:23 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809826 2022-04-27 17:38:23 2022-04-28 13:29:14 2022-04-28 14:10:55 0:41:41 0:31:58 0:09:43 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809827 2022-04-27 17:38:23 2022-04-28 13:30:35 2022-04-28 14:16:34 0:45:59 0:32:57 0:13:02 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809828 2022-04-27 17:38:23 2022-04-28 13:36:46 2022-04-28 14:17:00 0:40:14 0:32:09 0:08:05 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809829 2022-04-27 17:38:23 2022-04-28 13:37:27 2022-04-28 14:24:55 0:47:28 0:39:30 0:07:58 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809830 2022-04-27 17:38:23 2022-04-29 23:09:27 2022-04-29 23:59:08 0:49:41 0:30:07 0:19:34 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809831 2022-04-27 17:38:23 2022-04-29 23:21:39 2022-04-30 06:39:13 7:17:34 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809832 2022-04-27 17:38:23 2022-05-01 05:49:06 2022-05-01 06:29:17 0:40:11 0:32:21 0:07:50 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809833 2022-04-27 17:38:24 2022-05-01 05:49:06 2022-05-01 06:33:10 0:44:04 0:36:42 0:07:22 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809834 2022-04-27 17:38:24 2022-05-01 05:49:07 2022-05-01 06:31:29 0:42:22 0:35:21 0:07:01 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809835 2022-04-27 17:38:24 2022-05-01 05:49:07 2022-05-01 06:32:52 0:43:45 0:37:34 0:06:11 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809836 2022-04-27 17:38:24 2022-05-01 05:49:27 2022-05-01 06:30:04 0:40:37 0:33:22 0:07:15 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809837 2022-04-27 17:38:24 2022-05-01 05:49:48 2022-05-01 06:32:03 0:42:15 0:33:56 0:08:19 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809838 2022-04-27 17:38:24 2022-05-01 05:50:09 2022-05-01 06:28:05 0:37:56 0:30:16 0:07:40 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809839 2022-04-27 17:38:24 2022-05-01 05:50:39 2022-05-01 06:29:13 0:38:34 0:30:02 0:08:32 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809840 2022-04-27 17:38:24 2022-05-01 05:51:39 2022-05-01 06:36:27 0:44:48 0:36:42 0:08:06 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809841 2022-04-27 17:38:24 2022-05-01 05:52:42 2022-05-01 12:35:38 6:42:56 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809842 2022-04-27 17:38:24 2022-05-01 05:52:53 2022-05-01 06:39:08 0:46:15 0:38:40 0:07:35 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809843 2022-04-27 17:38:24 2022-05-01 05:53:43 2022-05-01 06:37:19 0:43:36 0:35:43 0:07:53 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809844 2022-04-27 17:38:24 2022-05-01 05:55:54 2022-05-01 12:37:23 6:41:29 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809845 2022-04-27 17:38:24 2022-05-01 05:56:05 2022-05-01 06:40:24 0:44:19 0:37:33 0:06:46 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809846 2022-04-27 17:38:24 2022-05-01 05:56:35 2022-05-01 12:38:58 6:42:23 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809847 2022-04-27 17:38:24 2022-05-01 05:58:16 2022-05-01 06:38:50 0:40:34 0:33:40 0:06:54 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 6809848 2022-04-27 17:38:24 2022-05-01 05:59:17 2022-05-01 12:39:56 6:40:39 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 6809849 2022-04-27 17:38:24 2022-05-01 06:01:18 2022-05-01 06:47:35 0:46:17 0:39:44 0:06:33 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6809850 2022-04-27 17:38:24 2022-05-01 06:01:58 2022-05-01 06:39:03 0:37:05 0:29:11 0:07:54 smithi master ubuntu 20.04 rados:thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3