Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6293397 2021-07-26 09:33:49 2021-07-26 09:34:00 2021-07-26 10:01:36 0:27:36 0:20:56 0:06:40 smithi master rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T09:52:00.447209+0000 mon.a (mon.0) 592 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293398 2021-07-26 09:33:50 2021-07-26 09:34:31 2021-07-26 10:01:29 0:26:58 0:20:12 0:06:46 smithi master rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T09:51:53.321830+0000 mon.a (mon.0) 537 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 4 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293399 2021-07-26 09:33:51 2021-07-26 09:34:41 2021-07-26 10:08:35 0:33:54 0:22:15 0:11:39 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T09:55:48.876581+0000 mon.a (mon.0) 458 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293400 2021-07-26 09:33:52 2021-07-26 09:35:01 2021-07-26 10:15:00 0:39:59 0:25:56 0:14:03 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T10:02:25.256784+0000 mon.a (mon.0) 542 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 5 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293401 2021-07-26 09:33:53 2021-07-26 09:35:42 2021-07-26 10:03:54 0:28:12 0:20:57 0:07:15 smithi master rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T09:54:17.418455+0000 mon.a (mon.0) 540 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 4 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293402 2021-07-26 09:33:53 2021-07-26 09:36:42 2021-07-26 10:04:41 0:27:59 0:20:53 0:07:06 smithi master rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T09:54:32.500219+0000 mon.a (mon.0) 429 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293403 2021-07-26 09:33:54 2021-07-26 09:38:12 2021-07-26 10:12:11 0:33:59 0:22:08 0:11:51 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T10:00:01.639329+0000 mon.a (mon.0) 590 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log

fail 6293404 2021-07-26 09:33:55 2021-07-26 09:38:13 2021-07-26 10:18:22 0:40:09 0:25:42 0:14:27 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

"2021-07-26T10:05:59.439026+0000 mon.a (mon.0) 604 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 3 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log