Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5703934 2020-12-12 11:24:23 2020-12-12 11:25:23 2020-12-12 12:15:23 0:50:00 0:42:58 0:07:02 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:42:37.432117+0000 mon.g (mon.3) 17 : cluster [WRN] Health detail: HEALTH_WARN 3/9 mons down, quorum a,b,g,d,i,e" in cluster log

fail 5703935 2020-12-12 11:24:23 2020-12-12 11:25:23 2020-12-12 12:23:24 0:58:01 0:51:09 0:06:52 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:43:32.550263+0000 mon.a (mon.1) 14 : cluster [WRN] Health detail: HEALTH_WARN 1/9 mons down, quorum a,g,b,h,c,i,d,e" in cluster log

fail 5703936 2020-12-12 11:24:23 2020-12-12 11:27:25 2020-12-12 12:19:25 0:52:00 0:44:57 0:07:03 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703937 2020-12-12 11:24:23 2020-12-12 11:27:25 2020-12-12 12:25:25 0:58:00 0:50:50 0:07:10 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:45:14.315053+0000 mon.e (mon.8) 23 : cluster [WRN] Health detail: HEALTH_WARN 1/9 mons down, quorum f,a,g,b,h,c,i,e" in cluster log

fail 5703938 2020-12-12 11:24:23 2020-12-12 11:27:25 2020-12-12 12:27:25 1:00:00 0:52:20 0:07:40 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:45:14.310889+0000 mon.f (mon.1) 19 : cluster [WRN] Health detail: HEALTH_WARN 1/9 mons down, quorum a,f,b,g,c,h,i,e" in cluster log

fail 5703939 2020-12-12 11:24:23 2020-12-12 11:29:25 2020-12-12 12:25:26 0:56:01 0:49:09 0:06:52 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:46:24.743555+0000 mon.f (mon.1) 62 : cluster [WRN] Health detail: HEALTH_WARN 4/9 mons down, quorum f,g,c,i,e" in cluster log

fail 5703940 2020-12-12 11:24:23 2020-12-12 11:29:26 2020-12-12 12:33:26 1:04:00 0:49:46 0:14:14 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:53:36.936639+0000 mon.i (mon.6) 19 : cluster [WRN] Health detail: HEALTH_WARN 4/9 mons down, quorum f,g,b,i,e" in cluster log

fail 5703941 2020-12-12 11:24:23 2020-12-12 11:29:26 2020-12-12 12:25:26 0:56:00 0:47:36 0:08:24 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703942 2020-12-12 11:24:23 2020-12-12 11:29:26 2020-12-12 12:31:26 1:02:00 0:48:55 0:13:05 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:53:08.943986+0000 mon.d (mon.7) 22 : cluster [WRN] Health detail: HEALTH_WARN 1/9 mons down, quorum f,a,g,b,h,i,d,e" in cluster log

fail 5703943 2020-12-12 11:24:23 2020-12-12 11:29:26 2020-12-12 12:25:26 0:56:00 0:49:12 0:06:48 smithi master rhel 8.1 rados:monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:46:40.263745+0000 mon.e (mon.8) 22 : cluster [WRN] Health detail: HEALTH_WARN 2/9 mons down, quorum f,a,g,b,i,d,e" in cluster log

fail 5703944 2020-12-12 11:24:24 2020-12-12 11:29:27 2020-12-12 12:29:27 1:00:00 0:40:01 0:19:59 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703945 2020-12-12 11:24:24 2020-12-12 11:29:28 2020-12-12 12:31:28 1:02:00 0:46:20 0:15:40 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:50:07.141778+0000 mon.a (mon.1) 20 : cluster [WRN] Health detail: HEALTH_WARN 4/9 mons down, quorum a,h,c,i,e" in cluster log

fail 5703946 2020-12-12 11:24:24 2020-12-12 11:31:08 2020-12-12 12:27:08 0:56:00 0:40:29 0:15:31 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703947 2020-12-12 11:24:24 2020-12-12 11:31:25 2020-12-12 12:23:26 0:52:01 0:41:06 0:10:55 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703948 2020-12-12 11:24:24 2020-12-12 11:34:57 2020-12-12 12:34:57 1:00:00 0:47:17 0:12:43 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

"2020-12-12T11:52:33.233363+0000 mon.f (mon.0) 161 : cluster [WRN] Health detail: HEALTH_WARN 3/9 mons down, quorum f,a,g,c,i,d" in cluster log

fail 5703949 2020-12-12 11:24:24 2020-12-12 11:35:26 2020-12-12 12:29:26 0:54:00 0:42:18 0:11:42 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703950 2020-12-12 11:24:24 2020-12-12 11:37:23 2020-12-12 12:33:23 0:56:00 0:45:00 0:11:00 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703951 2020-12-12 11:24:24 2020-12-12 11:37:23 2020-12-12 12:27:23 0:50:00 0:39:50 0:10:10 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703952 2020-12-12 11:24:24 2020-12-12 11:37:24 2020-12-12 12:37:25 1:00:01 0:49:12 0:10:49 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

fail 5703953 2020-12-12 11:24:24 2020-12-12 11:37:47 2020-12-12 12:31:47 0:54:00 0:41:33 0:12:27 smithi master ubuntu 18.04 rados:monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired