Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6308840 2021-08-03 07:20:28 2021-08-03 07:22:40 2021-08-03 07:42:07 0:19:27 0:13:13 0:06:14 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308841 2021-08-03 07:20:28 2021-08-03 07:22:40 2021-08-03 07:45:01 0:22:21 0:13:40 0:08:41 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308842 2021-08-03 07:20:28 2021-08-03 07:23:31 2021-08-03 07:46:02 0:22:31 0:13:27 0:09:04 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308843 2021-08-03 07:20:29 2021-08-03 07:26:21 2021-08-03 07:48:15 0:21:54 0:12:31 0:09:23 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308844 2021-08-03 07:20:29 2021-08-03 07:26:53 2021-08-03 07:51:22 0:24:29 0:12:49 0:11:40 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308845 2021-08-03 07:20:29 2021-08-03 07:27:54 2021-08-03 07:51:58 0:24:04 0:12:39 0:11:25 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308846 2021-08-03 07:20:30 2021-08-03 07:28:34 2021-08-03 07:48:03 0:19:29 0:13:03 0:06:26 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308847 2021-08-03 07:20:31 2021-08-03 07:28:55 2021-08-03 07:48:59 0:20:04 0:13:04 0:07:00 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308848 2021-08-03 07:20:31 2021-08-03 07:29:25 2021-08-03 07:49:03 0:19:38 0:13:12 0:06:26 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308849 2021-08-03 07:20:32 2021-08-03 07:29:45 2021-08-03 07:52:10 0:22:25 0:12:29 0:09:56 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308850 2021-08-03 07:20:32 2021-08-03 07:30:46 2021-08-03 07:55:47 0:25:01 0:12:26 0:12:35 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308851 2021-08-03 07:20:32 2021-08-03 07:32:36 2021-08-03 07:56:20 0:23:44 0:12:20 0:11:24 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308852 2021-08-03 07:20:33 2021-08-03 07:32:47 2021-08-03 07:56:42 0:23:55 0:11:02 0:12:53 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308853 2021-08-03 07:20:33 2021-08-03 07:33:27 2021-08-03 07:58:13 0:24:46 0:10:56 0:13:50 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308854 2021-08-03 07:20:33 2021-08-03 07:34:07 2021-08-03 07:58:40 0:24:33 0:11:20 0:13:13 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308855 2021-08-03 07:20:34 2021-08-03 07:35:08 2021-08-03 08:04:11 0:29:03 0:15:46 0:13:17 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308856 2021-08-03 07:20:34 2021-08-03 07:36:18 2021-08-03 08:01:32 0:25:14 0:14:17 0:10:57 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308857 2021-08-03 07:20:34 2021-08-03 07:36:28 2021-08-03 08:01:52 0:25:24 0:14:56 0:10:28 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308858 2021-08-03 07:20:35 2021-08-03 07:36:59 2021-08-03 08:00:38 0:23:39 0:11:13 0:12:26 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308859 2021-08-03 07:20:35 2021-08-03 07:37:49 2021-08-03 08:01:08 0:23:19 0:11:23 0:11:56 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308860 2021-08-03 07:20:35 2021-08-03 07:37:50 2021-08-03 08:00:49 0:22:59 0:11:08 0:11:51 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308861 2021-08-03 07:20:36 2021-08-03 07:39:40 2021-08-03 08:05:14 0:25:34 0:14:43 0:10:51 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

"2021-08-03T08:00:41.831687+0000 mon.a (mon.0) 147 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6308862 2021-08-03 07:20:36 2021-08-03 07:40:10 2021-08-03 08:06:28 0:26:18 0:14:58 0:11:20 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

"2021-08-03T08:02:10.596939+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6308863 2021-08-03 07:20:36 2021-08-03 07:41:31 2021-08-03 08:07:37 0:26:06 0:14:03 0:12:03 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308864 2021-08-03 07:20:37 2021-08-03 07:42:11 2021-08-03 08:07:36 0:25:25 0:13:11 0:12:14 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308865 2021-08-03 07:20:37 2021-08-03 07:44:44 2021-08-03 08:08:07 0:23:23 0:12:50 0:10:33 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308866 2021-08-03 07:20:37 2021-08-03 07:44:45 2021-08-03 08:08:17 0:23:32 0:13:08 0:10:24 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308867 2021-08-03 07:20:38 2021-08-03 07:44:55 2021-08-03 08:04:30 0:19:35 0:13:29 0:06:06 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308868 2021-08-03 07:20:38 2021-08-03 07:45:05 2021-08-03 08:05:40 0:20:35 0:13:31 0:07:04 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308869 2021-08-03 07:20:38 2021-08-03 07:46:06 2021-08-03 08:07:02 0:20:56 0:13:20 0:07:36 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308870 2021-08-03 07:20:39 2021-08-03 07:48:06 2021-08-03 08:09:33 0:21:27 0:12:20 0:09:07 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308871 2021-08-03 07:20:39 2021-08-03 07:48:17 2021-08-03 08:10:12 0:21:55 0:12:17 0:09:38 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308872 2021-08-03 07:20:39 2021-08-03 07:48:27 2021-08-03 08:10:28 0:22:01 0:12:02 0:09:59 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308873 2021-08-03 07:20:40 2021-08-03 07:49:08 2021-08-03 08:08:50 0:19:42 0:13:24 0:06:18 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308874 2021-08-03 07:20:40 2021-08-03 07:49:08 2021-08-03 08:10:23 0:21:15 0:13:12 0:08:03 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308875 2021-08-03 07:20:40 2021-08-03 07:52:12 2021-08-03 08:10:56 0:18:44 0:13:04 0:05:40 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308876 2021-08-03 07:20:41 2021-08-03 07:52:13 2021-08-03 08:20:48 0:28:35 0:15:25 0:13:10 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308877 2021-08-03 07:20:41 2021-08-03 07:55:54 2021-08-03 08:23:14 0:27:20 0:15:36 0:11:44 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308878 2021-08-03 07:20:41 2021-08-03 07:56:24 2021-08-03 08:23:29 0:27:05 0:15:30 0:11:35 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308879 2021-08-03 07:20:42 2021-08-03 07:56:44 2021-08-03 08:21:48 0:25:04 0:12:08 0:12:56 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308880 2021-08-03 07:20:42 2021-08-03 07:58:15 2021-08-03 08:21:46 0:23:31 0:12:32 0:10:59 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308881 2021-08-03 07:20:42 2021-08-03 07:58:45 2021-08-03 08:23:40 0:24:55 0:11:46 0:13:09 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308882 2021-08-03 07:20:43 2021-08-03 08:00:46 2021-08-03 08:25:50 0:25:04 0:14:38 0:10:26 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308883 2021-08-03 07:20:43 2021-08-03 08:00:57 2021-08-03 08:26:14 0:25:17 0:15:01 0:10:16 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308884 2021-08-03 07:20:43 2021-08-03 08:01:18 2021-08-03 08:26:23 0:25:05 0:14:28 0:10:37 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308885 2021-08-03 07:20:44 2021-08-03 08:01:38 2021-08-03 08:22:43 0:21:05 0:13:24 0:07:41 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308886 2021-08-03 07:20:44 2021-08-03 08:01:58 2021-08-03 08:25:57 0:23:59 0:13:53 0:10:06 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308887 2021-08-03 07:20:44 2021-08-03 08:04:19 2021-08-03 08:25:58 0:21:39 0:14:01 0:07:38 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308888 2021-08-03 07:20:46 2021-08-03 08:04:39 2021-08-03 08:26:06 0:21:27 0:14:40 0:06:47 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308889 2021-08-03 07:20:46 2021-08-03 08:05:19 2021-08-03 08:27:23 0:22:04 0:13:57 0:08:07 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308890 2021-08-03 07:20:46 2021-08-03 08:05:50 2021-08-03 08:26:17 0:20:27 0:13:18 0:07:09 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308891 2021-08-03 07:20:47 2021-08-03 08:06:30 2021-08-03 08:30:32 0:24:02 0:13:07 0:10:55 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308892 2021-08-03 07:20:47 2021-08-03 08:07:10 2021-08-03 08:29:22 0:22:12 0:12:11 0:10:01 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308893 2021-08-03 07:20:47 2021-08-03 08:07:41 2021-08-03 08:31:04 0:23:23 0:12:55 0:10:28 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308894 2021-08-03 07:20:48 2021-08-03 08:07:41 2021-08-03 08:27:06 0:19:25 0:12:20 0:07:05 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308895 2021-08-03 07:20:48 2021-08-03 08:08:11 2021-08-03 08:27:07 0:18:56 0:12:51 0:06:05 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308896 2021-08-03 07:20:48 2021-08-03 08:08:22 2021-08-03 08:28:36 0:20:14 0:13:27 0:06:47 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308897 2021-08-03 07:20:49 2021-08-03 08:08:52 2021-08-03 08:33:03 0:24:11 0:12:34 0:11:37 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308898 2021-08-03 07:20:49 2021-08-03 08:09:12 2021-08-03 08:30:58 0:21:46 0:11:55 0:09:51 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308899 2021-08-03 07:20:49 2021-08-03 08:09:43 2021-08-03 08:31:46 0:22:03 0:12:16 0:09:47 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308900 2021-08-03 07:20:50 2021-08-03 08:10:13 2021-08-03 08:33:34 0:23:21 0:11:56 0:11:25 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308901 2021-08-03 07:20:50 2021-08-03 08:10:33 2021-08-03 08:33:31 0:22:58 0:12:25 0:10:33 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308902 2021-08-03 07:20:50 2021-08-03 08:10:34 2021-08-03 08:33:50 0:23:16 0:11:59 0:11:17 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308903 2021-08-03 07:20:51 2021-08-03 08:11:04 2021-08-03 08:40:23 0:29:19 0:14:42 0:14:37 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308904 2021-08-03 07:20:51 2021-08-03 08:15:05 2021-08-03 08:42:13 0:27:08 0:15:08 0:12:00 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308905 2021-08-03 07:20:51 2021-08-03 08:17:05 2021-08-03 08:45:43 0:28:38 0:15:15 0:13:23 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308906 2021-08-03 07:20:52 2021-08-03 08:20:56 2021-08-03 08:44:48 0:23:52 0:10:41 0:13:11 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308907 2021-08-03 07:20:52 2021-08-03 08:21:36 2021-08-03 08:45:56 0:24:20 0:11:20 0:13:00 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308908 2021-08-03 07:20:52 2021-08-03 08:21:57 2021-08-03 08:45:15 0:23:18 0:10:52 0:12:26 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308909 2021-08-03 07:20:53 2021-08-03 08:21:57 2021-08-03 08:47:35 0:25:38 0:15:08 0:10:30 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308910 2021-08-03 07:20:53 2021-08-03 08:22:47 2021-08-03 08:50:16 0:27:29 0:15:30 0:11:59 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308911 2021-08-03 07:20:53 2021-08-03 08:23:18 2021-08-03 08:50:24 0:27:06 0:15:31 0:11:35 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308912 2021-08-03 07:20:54 2021-08-03 08:23:38 2021-08-03 08:47:02 0:23:24 0:13:31 0:09:53 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308913 2021-08-03 07:20:54 2021-08-03 08:23:48 2021-08-03 08:47:55 0:24:07 0:13:00 0:11:07 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308914 2021-08-03 07:20:54 2021-08-03 08:24:39 2021-08-03 08:49:41 0:25:02 0:13:10 0:11:52 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308915 2021-08-03 07:20:55 2021-08-03 08:25:59 2021-08-03 08:45:38 0:19:39 0:13:25 0:06:14 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308916 2021-08-03 07:20:55 2021-08-03 08:25:59 2021-08-03 08:44:42 0:18:43 0:13:15 0:05:28 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308917 2021-08-03 07:20:55 2021-08-03 08:26:00 2021-08-03 08:45:10 0:19:10 0:13:32 0:05:38 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308918 2021-08-03 07:20:56 2021-08-03 08:26:10 2021-08-03 08:49:34 0:23:24 0:12:43 0:10:41 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308919 2021-08-03 07:20:56 2021-08-03 08:26:20 2021-08-03 08:49:47 0:23:27 0:12:49 0:10:38 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308920 2021-08-03 07:20:56 2021-08-03 08:26:21 2021-08-03 08:49:47 0:23:26 0:13:02 0:10:24 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308921 2021-08-03 07:20:57 2021-08-03 08:26:31 2021-08-03 08:48:05 0:21:34 0:14:10 0:07:24 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308922 2021-08-03 07:20:57 2021-08-03 08:27:11 2021-08-03 08:46:18 0:19:07 0:13:19 0:05:48 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308923 2021-08-03 07:20:57 2021-08-03 08:27:12 2021-08-03 08:48:57 0:21:45 0:13:55 0:07:50 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308924 2021-08-03 07:20:58 2021-08-03 08:27:32 2021-08-03 08:56:17 0:28:45 0:15:27 0:13:18 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308925 2021-08-03 07:20:58 2021-08-03 08:28:42 2021-08-03 08:54:13 0:25:31 0:15:37 0:09:54 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308926 2021-08-03 07:20:59 2021-08-03 08:28:43 2021-08-03 08:55:11 0:26:28 0:15:15 0:11:13 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308927 2021-08-03 07:21:00 2021-08-03 08:29:23 2021-08-03 08:53:38 0:24:15 0:11:14 0:13:01 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308928 2021-08-03 07:21:00 2021-08-03 08:30:33 2021-08-03 08:54:04 0:23:31 0:11:22 0:12:09 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308929 2021-08-03 07:21:00 2021-08-03 08:31:04 2021-08-03 08:54:05 0:23:01 0:11:38 0:11:23 smithi wip-khiremat-remove-old-kernel-failures centos 8.stream fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308930 2021-08-03 07:21:01 2021-08-03 08:31:14 2021-08-03 08:57:09 0:25:55 0:14:16 0:11:39 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308931 2021-08-03 07:21:01 2021-08-03 08:31:54 2021-08-03 08:58:28 0:26:34 0:14:19 0:12:15 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308932 2021-08-03 07:21:01 2021-08-03 08:33:05 2021-08-03 08:58:35 0:25:30 0:14:34 0:10:56 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308933 2021-08-03 07:21:02 2021-08-03 08:33:35 2021-08-03 08:56:32 0:22:57 0:11:49 0:11:08 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308934 2021-08-03 07:21:02 2021-08-03 08:33:35 2021-08-03 08:56:46 0:23:11 0:12:06 0:11:05 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308935 2021-08-03 07:21:02 2021-08-03 08:33:56 2021-08-03 08:58:40 0:24:44 0:12:32 0:12:12 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308936 2021-08-03 07:21:03 2021-08-03 08:35:36 2021-08-03 08:58:41 0:23:05 0:13:56 0:09:09 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308937 2021-08-03 07:21:03 2021-08-03 08:37:47 2021-08-03 08:59:27 0:21:40 0:13:10 0:08:30 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308938 2021-08-03 07:21:03 2021-08-03 08:40:27 2021-08-03 09:01:35 0:21:08 0:13:29 0:07:39 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308939 2021-08-03 07:21:04 2021-08-03 08:42:18 2021-08-03 09:06:57 0:24:39 0:12:33 0:12:06 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308940 2021-08-03 07:21:04 2021-08-03 08:43:28 2021-08-03 09:05:06 0:21:38 0:12:46 0:08:52 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308941 2021-08-03 07:21:04 2021-08-03 08:43:49 2021-08-03 09:08:00 0:24:11 0:12:56 0:11:15 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308942 2021-08-03 07:21:05 2021-08-03 08:44:49 2021-08-03 09:03:32 0:18:43 0:12:59 0:05:44 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308943 2021-08-03 07:21:05 2021-08-03 08:44:50 2021-08-03 09:04:21 0:19:31 0:12:35 0:06:56 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308944 2021-08-03 07:21:05 2021-08-03 08:45:20 2021-08-03 09:04:09 0:18:49 0:13:06 0:05:43 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308945 2021-08-03 07:21:06 2021-08-03 08:45:21 2021-08-03 09:08:46 0:23:25 0:12:41 0:10:44 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308946 2021-08-03 07:21:06 2021-08-03 08:45:31 2021-08-03 09:07:40 0:22:09 0:12:24 0:09:45 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308947 2021-08-03 07:21:06 2021-08-03 08:45:41 2021-08-03 09:09:03 0:23:22 0:12:53 0:10:29 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308948 2021-08-03 07:21:07 2021-08-03 08:45:52 2021-08-03 09:09:58 0:24:06 0:11:23 0:12:43 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308949 2021-08-03 07:21:07 2021-08-03 08:46:02 2021-08-03 09:09:36 0:23:34 0:11:04 0:12:30 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308950 2021-08-03 07:21:07 2021-08-03 08:46:22 2021-08-03 09:10:25 0:24:03 0:11:25 0:12:38 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308951 2021-08-03 07:21:08 2021-08-03 08:47:13 2021-08-03 09:14:31 0:27:18 0:15:14 0:12:04 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308952 2021-08-03 07:21:08 2021-08-03 08:47:43 2021-08-03 09:12:45 0:25:02 0:14:57 0:10:05 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308953 2021-08-03 07:21:08 2021-08-03 08:48:03 2021-08-03 09:15:30 0:27:27 0:15:04 0:12:23 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308954 2021-08-03 07:21:09 2021-08-03 08:48:14 2021-08-03 09:08:33 0:20:19 0:12:52 0:07:27 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308955 2021-08-03 07:21:09 2021-08-03 08:49:04 2021-08-03 09:10:02 0:20:58 0:13:05 0:07:53 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308956 2021-08-03 07:21:09 2021-08-03 08:49:44 2021-08-03 09:08:24 0:18:40 0:12:49 0:05:51 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308957 2021-08-03 07:21:10 2021-08-03 08:49:45 2021-08-03 09:14:49 0:25:04 0:14:40 0:10:24 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308958 2021-08-03 07:21:10 2021-08-03 08:49:55 2021-08-03 09:14:53 0:24:58 0:15:02 0:09:56 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308959 2021-08-03 07:21:10 2021-08-03 08:49:55 2021-08-03 09:15:12 0:25:17 0:14:45 0:10:32 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308960 2021-08-03 07:21:11 2021-08-03 08:50:26 2021-08-03 09:13:41 0:23:15 0:12:59 0:10:16 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

"2021-08-03T09:09:27.144809+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6308961 2021-08-03 07:21:11 2021-08-03 08:50:26 2021-08-03 09:17:08 0:26:42 0:12:49 0:13:53 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308962 2021-08-03 07:21:11 2021-08-03 08:53:47 2021-08-03 09:17:28 0:23:41 0:12:43 0:10:58 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308963 2021-08-03 07:21:12 2021-08-03 08:54:07 2021-08-03 09:13:02 0:18:55 0:12:52 0:06:03 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308964 2021-08-03 07:21:12 2021-08-03 08:54:07 2021-08-03 09:15:38 0:21:31 0:13:51 0:07:40 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308965 2021-08-03 07:21:12 2021-08-03 08:54:18 2021-08-03 09:14:04 0:19:46 0:13:30 0:06:16 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308966 2021-08-03 07:21:13 2021-08-03 08:55:08 2021-08-03 09:16:57 0:21:49 0:12:18 0:09:31 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308967 2021-08-03 07:21:13 2021-08-03 08:55:18 2021-08-03 09:17:54 0:22:36 0:12:24 0:10:12 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308968 2021-08-03 07:21:13 2021-08-03 08:56:39 2021-08-03 09:18:03 0:21:24 0:12:25 0:08:59 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308969 2021-08-03 07:21:15 2021-08-03 08:56:49 2021-08-03 09:16:38 0:19:49 0:12:35 0:07:14 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308970 2021-08-03 07:21:16 2021-08-03 08:57:20 2021-08-03 09:17:45 0:20:25 0:13:14 0:07:11 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308971 2021-08-03 07:21:16 2021-08-03 08:58:30 2021-08-03 09:17:38 0:19:08 0:13:21 0:05:47 smithi wip-khiremat-remove-old-kernel-failures rhel 8.4 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308972 2021-08-03 07:21:17 2021-08-03 08:58:40 2021-08-03 09:25:45 0:27:05 0:15:40 0:11:25 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308973 2021-08-03 07:21:17 2021-08-03 08:58:51 2021-08-03 09:25:53 0:27:02 0:16:06 0:10:56 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308974 2021-08-03 07:21:17 2021-08-03 08:58:51 2021-08-03 09:24:31 0:25:40 0:15:00 0:10:40 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308975 2021-08-03 07:21:18 2021-08-03 08:59:31 2021-08-03 09:25:07 0:25:36 0:12:00 0:13:36 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308976 2021-08-03 07:21:18 2021-08-03 09:01:42 2021-08-03 09:26:58 0:25:16 0:11:30 0:13:46 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}

fail 6308977 2021-08-03 07:21:18 2021-08-03 09:03:42 2021-08-03 09:27:37 0:23:55 0:11:09 0:12:46 smithi wip-khiremat-remove-old-kernel-failures ubuntu 20.04 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308978 2021-08-03 07:21:19 2021-08-03 09:04:13 2021-08-03 09:29:17 0:25:04 0:14:04 0:11:00 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308979 2021-08-03 07:21:19 2021-08-03 09:04:23 2021-08-03 09:29:58 0:25:35 0:14:17 0:11:18 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308980 2021-08-03 07:21:19 2021-08-03 09:05:13 2021-08-03 09:32:05 0:26:52 0:14:00 0:12:52 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} 3
Failure Reason:

'BUG: testing... kernel log failure ' in syslog

fail 6308981 2021-08-03 07:21:20 2021-08-03 09:07:04 2021-08-03 09:31:28 0:24:24 0:11:36 0:12:48 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308982 2021-08-03 07:21:20 2021-08-03 09:07:44 2021-08-03 09:30:47 0:23:03 0:11:59 0:11:04 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}

fail 6308983 2021-08-03 07:21:20 2021-08-03 09:08:05 2021-08-03 09:32:13 0:24:08 0:11:42 0:12:26 smithi wip-khiremat-remove-old-kernel-failures centos 8.3 fs:workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'}