User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
teuthology | 2018-05-19 05:20:02 | 2018-05-21 18:12:52 | 2018-05-23 03:58:53 | 1 day, 9:46:01 | kcephfs | luminous | ovh | 49a0c32 | 126 | 17 | 32 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 2552716 | 2018-05-19 05:20:53 | 2018-05-21 18:12:52 | 2018-05-21 18:46:52 | 0:34:00 | 0:24:01 | 0:09:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
fail | 2552717 | 2018-05-19 05:20:53 | 2018-05-21 18:14:50 | 2018-05-21 21:00:52 | 2:46:02 | 1:34:03 | 1:11:59 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
Failure Reason:
"2018-05-21 19:48:21.404320 mon.a mon.0 158.69.94.208:6789/0 153 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552718 | 2018-05-19 05:20:54 | 2018-05-21 18:14:50 | 2018-05-22 03:49:00 | 9:34:10 | 0:24:46 | 9:09:24 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | |||
pass | 2552719 | 2018-05-19 05:20:55 | 2018-05-21 18:18:42 | 2018-05-21 19:42:43 | 1:24:01 | 1:13:51 | 0:10:10 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552720 | 2018-05-19 05:20:56 | 2018-05-21 18:18:56 | 2018-05-21 19:42:57 | 1:24:01 | 1:00:04 | 0:23:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
dead | 2552721 | 2018-05-19 05:20:57 | 2018-05-21 18:19:27 | 2018-05-22 06:21:40 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | |||||
pass | 2552722 | 2018-05-19 05:20:57 | 2018-05-21 18:22:20 | 2018-05-21 20:20:22 | 1:58:02 | 1:25:45 | 0:32:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552723 | 2018-05-19 05:20:58 | 2018-05-21 18:26:55 | 2018-05-21 19:08:54 | 0:41:59 | 0:26:54 | 0:15:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 2552724 | 2018-05-19 05:20:59 | 2018-05-21 18:30:35 | 2018-05-21 22:14:39 | 3:44:04 | 0:29:35 | 3:14:29 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | |||
pass | 2552725 | 2018-05-19 05:21:00 | 2018-05-21 18:31:59 | 2018-05-21 20:22:00 | 1:50:01 | 1:32:57 | 0:17:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
pass | 2552726 | 2018-05-19 05:21:01 | 2018-05-21 18:47:49 | 2018-05-21 20:41:50 | 1:54:01 | 1:21:44 | 0:32:17 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
dead | 2552727 | 2018-05-19 05:21:01 | 2018-05-21 18:48:19 | 2018-05-22 06:50:31 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | — | |||||
pass | 2552728 | 2018-05-19 05:21:02 | 2018-05-21 18:48:39 | 2018-05-21 19:50:39 | 1:02:00 | 0:48:22 | 0:13:38 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552729 | 2018-05-19 05:21:03 | 2018-05-21 18:52:54 | 2018-05-21 20:02:54 | 1:10:00 | 0:57:25 | 0:12:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-21 19:35:51.765176 mon.b mon.0 158.69.94.182:6789/0 129 : cluster [WRN] Health check failed: 86 slow requests are blocked > 32 sec. Implicated osds 2,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
dead | 2552730 | 2018-05-19 05:21:04 | 2018-05-21 18:53:35 | 2018-05-22 06:55:48 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | |||||
pass | 2552731 | 2018-05-19 05:21:05 | 2018-05-21 18:57:50 | 2018-05-21 20:21:51 | 1:24:01 | 0:28:04 | 0:55:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 2552732 | 2018-05-19 05:21:06 | 2018-05-21 19:06:57 | 2018-05-21 20:08:57 | 1:02:00 | 0:52:06 | 0:09:54 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
dead | 2552733 | 2018-05-19 05:21:06 | 2018-05-21 19:08:44 | 2018-05-22 07:10:58 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | |||||
pass | 2552734 | 2018-05-19 05:21:07 | 2018-05-21 19:08:55 | 2018-05-21 20:24:55 | 1:16:00 | 1:04:31 | 0:11:29 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552735 | 2018-05-19 05:21:08 | 2018-05-21 19:08:56 | 2018-05-21 19:42:55 | 0:33:59 | 0:19:14 | 0:14:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 2552736 | 2018-05-19 05:21:09 | 2018-05-21 19:13:01 | 2018-05-21 23:09:05 | 3:56:04 | 0:38:19 | 3:17:45 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | |||
pass | 2552737 | 2018-05-19 05:21:10 | 2018-05-21 19:13:30 | 2018-05-21 21:19:31 | 2:06:01 | 1:24:58 | 0:41:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552738 | 2018-05-19 05:21:10 | 2018-05-21 19:16:27 | 2018-05-21 20:10:27 | 0:54:00 | 0:18:44 | 0:35:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
pass | 2552739 | 2018-05-19 05:21:11 | 2018-05-21 19:50:59 | 2018-05-21 21:33:01 | 1:42:02 | 0:22:23 | 1:19:39 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | |||
pass | 2552740 | 2018-05-19 05:21:12 | 2018-05-21 20:00:27 | 2018-05-21 20:26:26 | 0:25:59 | 0:15:44 | 0:10:15 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552741 | 2018-05-19 05:21:13 | 2018-05-21 20:03:16 | 2018-05-21 20:31:15 | 0:27:59 | 0:17:39 | 0:10:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 2552742 | 2018-05-19 05:21:14 | 2018-05-21 20:04:39 | 2018-05-21 21:26:39 | 1:22:00 | 1:05:05 | 0:16:55 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
pass | 2552743 | 2018-05-19 05:21:15 | 2018-05-21 20:04:46 | 2018-05-22 02:56:53 | 6:52:07 | 0:27:41 | 6:24:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | |||
dead | 2552744 | 2018-05-19 05:21:15 | 2018-05-21 20:58:40 | 2018-05-22 09:01:11 | 12:02:31 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||||
pass | 2552745 | 2018-05-19 05:21:16 | 2018-05-21 21:00:56 | 2018-05-21 22:08:56 | 1:08:00 | 0:48:37 | 0:19:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
dead | 2552746 | 2018-05-19 05:21:17 | 2018-05-21 21:00:56 | 2018-05-22 09:11:23 | 12:10:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | |||||
pass | 2552747 | 2018-05-19 05:21:18 | 2018-05-21 21:03:27 | 2018-05-21 22:31:28 | 1:28:01 | 1:18:25 | 0:09:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552748 | 2018-05-19 05:21:19 | 2018-05-21 21:04:39 | 2018-05-21 21:50:39 | 0:46:00 | 0:26:14 | 0:19:46 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
dead | 2552749 | 2018-05-19 05:21:20 | 2018-05-21 21:07:12 | 2018-05-22 09:09:24 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | |||||
dead | 2552750 | 2018-05-19 05:21:20 | 2018-05-21 21:08:47 | 2018-05-22 09:11:27 | 12:02:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||||
pass | 2552751 | 2018-05-19 05:21:21 | 2018-05-21 21:10:50 | 2018-05-21 22:06:50 | 0:56:00 | 0:41:40 | 0:14:20 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
dead | 2552752 | 2018-05-19 05:21:22 | 2018-05-21 21:13:26 | 2018-05-22 09:15:38 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | |||||
pass | 2552753 | 2018-05-19 05:21:23 | 2018-05-21 21:14:43 | 2018-05-21 22:12:43 | 0:58:00 | 0:46:44 | 0:11:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552754 | 2018-05-19 05:21:23 | 2018-05-21 21:15:27 | 2018-05-21 22:15:28 | 1:00:01 | 0:45:17 | 0:14:44 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-21 22:00:04.089981 mon.b mon.0 158.69.64.221:6789/0 227 : cluster [WRN] Health check failed: 17 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552755 | 2018-05-19 05:21:24 | 2018-05-21 21:19:43 | 2018-05-21 23:57:45 | 2:38:02 | 0:23:25 | 2:14:37 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
pass | 2552756 | 2018-05-19 05:21:25 | 2018-05-21 21:26:50 | 2018-05-21 22:16:50 | 0:50:00 | 0:26:09 | 0:23:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 2552757 | 2018-05-19 05:21:26 | 2018-05-21 21:33:12 | 2018-05-21 22:39:12 | 1:06:00 | 0:46:59 | 0:19:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 2552758 | 2018-05-19 05:21:26 | 2018-05-21 21:50:50 | 2018-05-21 22:52:50 | 1:02:00 | 0:26:00 | 0:36:00 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | |||
pass | 2552759 | 2018-05-19 05:21:27 | 2018-05-21 21:52:55 | 2018-05-21 23:34:56 | 1:42:01 | 1:22:16 | 0:19:45 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552760 | 2018-05-19 05:21:28 | 2018-05-21 22:07:02 | 2018-05-21 22:37:01 | 0:29:59 | 0:16:51 | 0:13:08 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
dead | 2552761 | 2018-05-19 05:21:29 | 2018-05-21 22:09:08 | 2018-05-22 10:11:20 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | — | |||||
dead | 2552762 | 2018-05-19 05:21:30 | 2018-05-21 22:12:52 | 2018-05-22 10:15:27 | 12:02:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||||
pass | 2552763 | 2018-05-19 05:21:30 | 2018-05-21 22:14:50 | 2018-05-21 22:50:50 | 0:36:00 | 0:18:12 | 0:17:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
dead | 2552764 | 2018-05-19 05:21:31 | 2018-05-21 22:15:29 | 2018-05-22 10:17:42 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | |||||
pass | 2552765 | 2018-05-19 05:21:32 | 2018-05-21 22:17:01 | 2018-05-21 22:53:00 | 0:35:59 | 0:15:56 | 0:20:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552766 | 2018-05-19 05:21:33 | 2018-05-21 22:31:39 | 2018-05-21 23:01:39 | 0:30:00 | 0:16:41 | 0:13:19 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
fail | 2552767 | 2018-05-19 05:21:33 | 2018-05-21 22:37:12 | 2018-05-22 00:27:13 | 1:50:01 | 1:38:09 | 0:11:52 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
Failure Reason:
"2018-05-21 23:31:25.247968 mon.b mon.0 158.69.65.156:6789/0 199 : cluster [WRN] Health check failed: Degraded data redundancy: 5305/21276 objects degraded (24.934%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
dead | 2552768 | 2018-05-19 05:21:34 | 2018-05-21 22:39:23 | 2018-05-22 10:41:35 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | |||||
pass | 2552769 | 2018-05-19 05:21:35 | 2018-05-21 22:51:04 | 2018-05-21 23:53:04 | 1:02:00 | 0:52:52 | 0:09:08 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552770 | 2018-05-19 05:21:36 | 2018-05-21 22:53:04 | 2018-05-22 00:05:04 | 1:12:00 | 1:03:58 | 0:08:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
dead | 2552771 | 2018-05-19 05:21:36 | 2018-05-21 22:53:04 | 2018-05-22 10:55:16 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | |||||
pass | 2552772 | 2018-05-19 05:21:37 | 2018-05-21 23:01:49 | 2018-05-22 00:11:49 | 1:10:00 | 0:59:56 | 0:10:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552773 | 2018-05-19 05:21:38 | 2018-05-21 23:09:15 | 2018-05-22 00:17:15 | 1:08:00 | 0:26:07 | 0:41:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
dead | 2552774 | 2018-05-19 05:21:39 | 2018-05-21 23:35:13 | 2018-05-22 11:37:25 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | — | |||||
dead | 2552775 | 2018-05-19 05:21:39 | 2018-05-21 23:36:35 | 2018-05-22 11:39:18 | 12:02:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||||
fail | 2552776 | 2018-05-19 05:21:40 | 2018-05-21 23:51:33 | 2018-05-22 01:41:34 | 1:50:01 | 1:31:15 | 0:18:46 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
Found coredumps on ubuntu@ovh082.front.sepia.ceph.com |
||||||||||||||
dead | 2552777 | 2018-05-19 05:21:41 | 2018-05-21 23:53:14 | 2018-05-22 11:55:56 | 12:02:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | |||||
pass | 2552778 | 2018-05-19 05:21:41 | 2018-05-21 23:56:39 | 2018-05-22 01:02:40 | 1:06:01 | 0:47:44 | 0:18:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552779 | 2018-05-19 05:21:42 | 2018-05-21 23:58:06 | 2018-05-22 01:20:07 | 1:22:01 | 1:06:16 | 0:15:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-22 00:45:42.853864 mon.b mon.0 158.69.66.137:6789/0 140 : cluster [WRN] Health check failed: 286 slow requests are blocked > 32 sec. Implicated osds 0,4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
dead | 2552780 | 2018-05-19 05:21:43 | 2018-05-22 00:05:15 | 2018-05-22 12:07:27 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | |||||
pass | 2552781 | 2018-05-19 05:21:44 | 2018-05-22 00:11:59 | 2018-05-22 01:10:00 | 0:58:01 | 0:25:21 | 0:32:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 2552782 | 2018-05-19 05:21:44 | 2018-05-22 00:17:26 | 2018-05-22 01:09:26 | 0:52:00 | 0:34:24 | 0:17:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 2552783 | 2018-05-19 05:21:45 | 2018-05-22 03:55:31 | 2018-05-22 14:41:41 | 10:46:10 | 0:36:11 | 10:09:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | |||
pass | 2552784 | 2018-05-19 05:21:46 | 2018-05-22 03:57:27 | 2018-05-22 05:39:28 | 1:42:01 | 0:47:48 | 0:54:13 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552785 | 2018-05-19 05:21:47 | 2018-05-22 03:57:27 | 2018-05-22 04:57:27 | 1:00:00 | 0:29:00 | 0:31:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
dead | 2552786 | 2018-05-19 05:21:47 | 2018-05-22 04:19:30 | 2018-05-22 16:21:43 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | |||||
pass | 2552787 | 2018-05-19 05:21:48 | 2018-05-22 04:41:55 | 2018-05-22 06:19:56 | 1:38:01 | 1:23:35 | 0:14:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552788 | 2018-05-19 05:21:49 | 2018-05-22 04:47:30 | 2018-05-22 05:17:30 | 0:30:00 | 0:19:42 | 0:10:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
dead | 2552789 | 2018-05-19 05:21:49 | 2018-05-22 04:50:03 | 2018-05-22 16:52:16 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | — | |||||
pass | 2552790 | 2018-05-19 05:21:50 | 2018-05-22 04:55:44 | 2018-05-22 05:21:43 | 0:25:59 | 0:17:49 | 0:08:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552791 | 2018-05-19 05:21:51 | 2018-05-22 04:57:44 | 2018-05-22 05:39:44 | 0:42:00 | 0:17:58 | 0:24:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 2552792 | 2018-05-19 05:21:52 | 2018-05-22 10:47:26 | 2018-05-22 12:53:28 | 2:06:02 | 1:14:01 | 0:52:01 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
dead | 2552793 | 2018-05-19 05:21:52 | 2018-05-22 10:47:58 | 2018-05-22 22:50:11 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | |||||
pass | 2552794 | 2018-05-19 05:21:53 | 2018-05-22 10:50:43 | 2018-05-22 13:16:45 | 2:26:02 | 1:48:12 | 0:37:50 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
fail | 2552795 | 2018-05-19 05:21:54 | 2018-05-22 10:52:02 | 2018-05-22 12:24:03 | 1:32:01 | 1:15:21 | 0:16:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
Failure Reason:
"2018-05-22 11:30:14.622564 mon.b mon.0 158.69.74.185:6789/0 143 : cluster [WRN] Health check failed: 49 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
dead | 2552796 | 2018-05-19 05:21:54 | 2018-05-22 10:55:27 | 2018-05-22 22:57:40 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | |||||
pass | 2552797 | 2018-05-19 05:21:55 | 2018-05-22 10:57:40 | 2018-05-22 12:31:40 | 1:34:00 | 1:09:19 | 0:24:41 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552798 | 2018-05-19 05:21:56 | 2018-05-22 10:57:40 | 2018-05-22 12:03:40 | 1:06:00 | 0:28:56 | 0:37:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 2552799 | 2018-05-19 05:21:57 | 2018-05-22 10:58:21 | 2018-05-22 16:08:26 | 5:10:05 | 0:23:47 | 4:46:18 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | |||
pass | 2552800 | 2018-05-19 05:21:57 | 2018-05-22 11:00:56 | 2018-05-22 13:00:57 | 2:00:01 | 1:43:23 | 0:16:38 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
pass | 2552801 | 2018-05-19 05:21:58 | 2018-05-22 11:08:09 | 2018-05-22 12:42:10 | 1:34:01 | 1:10:08 | 0:23:53 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552802 | 2018-05-19 05:21:59 | 2018-05-22 11:12:12 | 2018-05-22 13:38:13 | 2:26:01 | 0:38:55 | 1:47:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | |||
pass | 2552803 | 2018-05-19 05:22:00 | 2018-05-22 11:15:01 | 2018-05-22 12:41:02 | 1:26:01 | 0:46:32 | 0:39:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552804 | 2018-05-19 05:22:00 | 2018-05-22 11:20:19 | 2018-05-22 12:42:20 | 1:22:01 | 1:10:31 | 0:11:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-22 11:57:14.587090 mon.a mon.0 158.69.74.45:6789/0 246 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552805 | 2018-05-19 05:22:01 | 2018-05-22 11:21:59 | 2018-05-22 15:38:04 | 4:16:05 | 0:25:15 | 3:50:50 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
pass | 2552806 | 2018-05-19 05:22:02 | 2018-05-22 11:23:35 | 2018-05-22 12:01:35 | 0:38:00 | 0:27:42 | 0:10:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
dead | 2552807 | 2018-05-19 05:22:03 | 2018-05-22 11:24:12 | 2018-05-22 23:26:54 | 12:02:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||||
dead | 2552808 | 2018-05-19 05:22:03 | 2018-05-22 11:25:46 | 2018-05-22 23:28:00 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | |||||
pass | 2552809 | 2018-05-19 05:22:04 | 2018-05-22 11:27:02 | 2018-05-22 13:01:03 | 1:34:01 | 1:24:01 | 0:10:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552810 | 2018-05-19 05:22:05 | 2018-05-22 11:28:51 | 2018-05-22 12:06:50 | 0:37:59 | 0:19:00 | 0:18:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 2552811 | 2018-05-19 05:22:06 | 2018-05-22 11:29:47 | 2018-05-22 22:48:00 | 11:18:13 | 0:59:08 | 10:19:05 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | |||
pass | 2552812 | 2018-05-19 05:22:06 | 2018-05-22 11:31:14 | 2018-05-22 13:23:15 | 1:52:01 | 1:25:57 | 0:26:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552813 | 2018-05-19 05:22:07 | 2018-05-22 11:34:59 | 2018-05-22 12:26:59 | 0:52:00 | 0:20:44 | 0:31:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
fail | 2552814 | 2018-05-19 05:22:08 | 2018-05-22 11:37:45 | 2018-05-22 18:39:52 | 7:02:07 | 0:40:22 | 6:21:45 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | |||
Failure Reason:
"2018-05-22 18:21:58.189498 mon.a mon.0 158.69.83.27:6789/0 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
pass | 2552815 | 2018-05-19 05:22:09 | 2018-05-22 11:39:29 | 2018-05-22 12:23:29 | 0:44:00 | 0:19:49 | 0:24:11 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552816 | 2018-05-19 05:22:09 | 2018-05-22 11:45:55 | 2018-05-22 12:35:55 | 0:50:00 | 0:25:24 | 0:24:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 2552817 | 2018-05-19 05:22:10 | 2018-05-22 11:47:47 | 2018-05-22 14:47:49 | 3:00:02 | 1:31:55 | 1:28:07 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 2552818 | 2018-05-19 05:22:11 | 2018-05-22 11:53:10 | 2018-05-22 21:15:20 | 9:22:10 | 0:26:34 | 8:55:36 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | |||
pass | 2552819 | 2018-05-19 05:22:11 | 2018-05-22 11:56:06 | 2018-05-22 13:34:07 | 1:38:01 | 1:11:02 | 0:26:59 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552820 | 2018-05-19 05:22:12 | 2018-05-22 12:01:53 | 2018-05-22 13:19:54 | 1:18:01 | 1:08:10 | 0:09:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
pass | 2552821 | 2018-05-19 05:22:13 | 2018-05-22 12:04:00 | 2018-05-22 17:52:06 | 5:48:06 | 0:23:33 | 5:24:33 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | |||
pass | 2552822 | 2018-05-19 05:22:14 | 2018-05-22 12:04:42 | 2018-05-22 13:32:43 | 1:28:01 | 1:10:28 | 0:17:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552823 | 2018-05-19 05:22:15 | 2018-05-22 12:07:09 | 2018-05-22 13:01:09 | 0:54:00 | 0:29:34 | 0:24:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 2552824 | 2018-05-19 05:22:15 | 2018-05-22 12:07:28 | 2018-05-22 19:27:36 | 7:20:08 | 0:33:36 | 6:46:32 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | |||
pass | 2552825 | 2018-05-19 05:22:16 | 2018-05-22 12:23:47 | 2018-05-22 14:13:48 | 1:50:01 | 1:39:21 | 0:10:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
dead | 2552826 | 2018-05-19 05:22:17 | 2018-05-22 12:24:04 | 2018-05-23 00:26:41 | 12:02:37 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||||
dead | 2552827 | 2018-05-19 05:22:18 | 2018-05-22 12:27:17 | 2018-05-23 00:29:59 | 12:02:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | |||||
pass | 2552828 | 2018-05-19 05:22:18 | 2018-05-22 12:27:41 | 2018-05-22 13:31:41 | 1:04:00 | 0:50:40 | 0:13:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552829 | 2018-05-19 05:22:19 | 2018-05-22 12:31:51 | 2018-05-22 13:33:51 | 1:02:00 | 0:49:34 | 0:12:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-22 13:16:40.734922 mon.a mon.0 158.69.75.7:6789/0 232 : cluster [WRN] Health check failed: 14 slow requests are blocked > 32 sec. Implicated osds 4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552830 | 2018-05-19 05:22:20 | 2018-05-22 12:36:05 | 2018-05-22 15:28:07 | 2:52:02 | 0:24:37 | 2:27:25 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | |||
pass | 2552831 | 2018-05-19 05:22:21 | 2018-05-22 12:41:20 | 2018-05-22 13:21:20 | 0:40:00 | 0:28:47 | 0:11:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
dead | 2552832 | 2018-05-19 05:22:21 | 2018-05-22 12:42:11 | 2018-05-23 00:45:02 | 12:02:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||||
dead | 2552833 | 2018-05-19 05:22:22 | 2018-05-22 12:42:39 | 2018-05-23 00:52:57 | 12:10:18 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | |||||
pass | 2552834 | 2018-05-19 05:22:23 | 2018-05-22 12:53:39 | 2018-05-22 13:57:39 | 1:04:00 | 0:48:44 | 0:15:16 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552835 | 2018-05-19 05:22:24 | 2018-05-22 13:00:39 | 2018-05-22 13:44:39 | 0:44:00 | 0:20:33 | 0:23:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 2552836 | 2018-05-19 05:22:24 | 2018-05-22 13:00:59 | 2018-05-22 21:01:07 | 8:00:08 | 0:40:42 | 7:19:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | |||
fail | 2552837 | 2018-05-19 05:22:25 | 2018-05-22 13:01:04 | 2018-05-22 14:53:05 | 1:52:01 | 1:28:22 | 0:23:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-05-22 13:45:32.041629 mon.b mon.0 158.69.76.31:6789/0 142 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552838 | 2018-05-19 05:22:26 | 2018-05-22 13:01:11 | 2018-05-22 13:45:10 | 0:43:59 | 0:21:01 | 0:22:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
pass | 2552839 | 2018-05-19 05:22:27 | 2018-05-22 13:15:44 | 2018-05-22 14:23:44 | 1:08:00 | 0:26:45 | 0:41:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | |||
pass | 2552840 | 2018-05-19 05:22:28 | 2018-05-22 13:17:04 | 2018-05-22 13:45:03 | 0:27:59 | 0:17:36 | 0:10:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552841 | 2018-05-19 05:22:28 | 2018-05-22 13:20:04 | 2018-05-22 13:56:04 | 0:36:00 | 0:25:17 | 0:10:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
fail | 2552842 | 2018-05-19 05:22:29 | 2018-05-22 13:21:31 | 2018-05-22 15:03:32 | 1:42:01 | 1:21:28 | 0:20:33 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
Failure Reason:
"2018-05-22 13:59:36.553426 mon.a mon.0 158.69.76.6:6789/0 145 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552843 | 2018-05-19 05:22:30 | 2018-05-22 13:23:25 | 2018-05-22 17:13:29 | 3:50:04 | 0:28:53 | 3:21:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | |||
pass | 2552844 | 2018-05-19 05:22:31 | 2018-05-22 13:32:01 | 2018-05-22 15:56:03 | 2:24:02 | 2:13:30 | 0:10:32 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552845 | 2018-05-19 05:22:32 | 2018-05-22 13:32:44 | 2018-05-22 14:56:45 | 1:24:01 | 1:05:29 | 0:18:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
dead | 2552846 | 2018-05-19 05:22:32 | 2018-05-22 13:34:09 | 2018-05-23 01:36:51 | 12:02:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | |||||
dead | 2552847 | 2018-05-19 05:22:33 | 2018-05-22 13:34:09 | 2018-05-23 01:44:33 | 12:10:24 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||||
pass | 2552848 | 2018-05-19 05:22:34 | 2018-05-22 13:38:24 | 2018-05-22 14:26:24 | 0:48:00 | 0:31:19 | 0:16:41 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 2552849 | 2018-05-19 05:22:35 | 2018-05-22 13:44:50 | 2018-05-22 15:04:50 | 1:20:00 | 0:25:44 | 0:54:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | |||
pass | 2552850 | 2018-05-19 05:22:35 | 2018-05-22 13:45:14 | 2018-05-22 15:37:15 | 1:52:01 | 1:30:48 | 0:21:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
pass | 2552851 | 2018-05-19 05:22:36 | 2018-05-22 13:45:14 | 2018-05-22 14:57:14 | 1:12:00 | 0:52:47 | 0:19:13 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552852 | 2018-05-19 05:22:37 | 2018-05-22 13:56:14 | 2018-05-22 16:04:16 | 2:08:02 | 0:39:46 | 1:28:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | |||
pass | 2552853 | 2018-05-19 05:22:38 | 2018-05-22 13:56:42 | 2018-05-22 14:56:42 | 1:00:00 | 0:50:17 | 0:09:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552854 | 2018-05-19 05:22:39 | 2018-05-22 13:57:49 | 2018-05-22 15:15:50 | 1:18:01 | 0:52:30 | 0:25:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-22 14:56:48.905237 mon.b mon.0 158.69.77.93:6789/0 144 : cluster [WRN] Health check failed: 492 slow requests are blocked > 32 sec. Implicated osds 0,1,3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552855 | 2018-05-19 05:22:39 | 2018-05-22 14:13:59 | 2018-05-22 16:12:01 | 1:58:02 | 0:22:58 | 1:35:04 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
pass | 2552856 | 2018-05-19 05:22:40 | 2018-05-22 14:23:54 | 2018-05-22 15:03:54 | 0:40:00 | 0:30:17 | 0:09:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 2552857 | 2018-05-19 05:22:41 | 2018-05-22 14:26:43 | 2018-05-22 15:36:43 | 1:10:00 | 0:48:51 | 0:21:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 2552858 | 2018-05-19 05:22:42 | 2018-05-22 14:41:52 | 2018-05-22 18:07:55 | 3:26:03 | 0:29:13 | 2:56:50 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | |||
fail | 2552859 | 2018-05-19 05:22:43 | 2018-05-22 14:48:00 | 2018-05-22 16:32:01 | 1:44:01 | 1:32:21 | 0:11:40 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
Found coredumps on ubuntu@ovh033.front.sepia.ceph.com |
||||||||||||||
pass | 2552860 | 2018-05-19 05:22:43 | 2018-05-22 14:53:15 | 2018-05-22 15:23:15 | 0:30:00 | 0:19:05 | 0:10:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 2552861 | 2018-05-19 05:22:44 | 2018-05-22 14:57:00 | 2018-05-22 20:05:06 | 5:08:06 | 1:01:17 | 4:06:49 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | |||
fail | 2552862 | 2018-05-19 05:22:45 | 2018-05-22 14:57:00 | 2018-05-22 16:35:01 | 1:38:01 | 1:24:29 | 0:13:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-05-22 15:30:38.456543 mon.a mon.0 158.69.79.154:6789/0 252 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552863 | 2018-05-19 05:22:46 | 2018-05-22 14:57:15 | 2018-05-22 15:33:15 | 0:36:00 | 0:21:35 | 0:14:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
fail | 2552864 | 2018-05-19 05:22:47 | 2018-05-22 14:58:41 | 2018-05-22 16:26:42 | 1:28:01 | 0:35:37 | 0:52:24 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | |||
Failure Reason:
"2018-05-22 16:11:39.470411 mon.a mon.0 158.69.79.9:6789/0 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 2552865 | 2018-05-19 05:22:47 | 2018-05-22 15:03:41 | 2018-05-22 15:33:41 | 0:30:00 | 0:18:17 | 0:11:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 2552866 | 2018-05-19 05:22:48 | 2018-05-22 15:04:00 | 2018-05-22 15:34:00 | 0:30:00 | 0:19:05 | 0:10:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 2552867 | 2018-05-19 05:22:49 | 2018-05-22 15:05:00 | 2018-05-22 16:59:02 | 1:54:02 | 1:30:31 | 0:23:31 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 2552868 | 2018-05-19 05:22:50 | 2018-05-22 15:16:10 | 2018-05-23 01:28:21 | 10:12:11 | 0:26:02 | 9:46:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | |||
pass | 2552869 | 2018-05-19 05:22:51 | 2018-05-22 15:23:25 | 2018-05-22 16:23:25 | 1:00:00 | 0:50:37 | 0:09:23 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552870 | 2018-05-19 05:22:51 | 2018-05-22 15:28:18 | 2018-05-22 16:40:18 | 1:12:00 | 1:00:44 | 0:11:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
pass | 2552871 | 2018-05-19 05:22:52 | 2018-05-22 15:33:25 | 2018-05-23 02:19:37 | 10:46:12 | 0:24:57 | 10:21:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | |||
pass | 2552872 | 2018-05-19 05:22:53 | 2018-05-22 15:33:42 | 2018-05-22 17:19:43 | 1:46:01 | 1:34:44 | 0:11:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 2552873 | 2018-05-19 05:22:54 | 2018-05-22 15:34:01 | 2018-05-22 16:14:01 | 0:40:00 | 0:28:40 | 0:11:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 2552874 | 2018-05-19 05:22:55 | 2018-05-22 15:36:54 | 2018-05-22 17:22:55 | 1:46:01 | 0:31:37 | 1:14:24 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | |||
dead | 2552875 | 2018-05-19 05:22:55 | 2018-05-22 15:37:20 | 2018-05-23 03:47:43 | 12:10:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||||
pass | 2552876 | 2018-05-19 05:22:56 | 2018-05-22 15:38:14 | 2018-05-22 17:30:15 | 1:52:01 | 1:24:16 | 0:27:45 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
dead | 2552877 | 2018-05-19 05:22:57 | 2018-05-22 15:56:14 | 2018-05-23 03:58:53 | 12:02:39 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | |||||
pass | 2552878 | 2018-05-19 05:22:58 | 2018-05-22 16:04:27 | 2018-05-22 17:04:27 | 1:00:00 | 0:50:39 | 0:09:21 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
fail | 2552879 | 2018-05-19 05:22:58 | 2018-05-22 16:08:45 | 2018-05-22 17:06:45 | 0:58:00 | 0:45:54 | 0:12:06 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-05-22 16:53:07.273686 mon.a mon.0 158.69.80.238:6789/0 151 : cluster [WRN] Health check failed: 297 slow requests are blocked > 32 sec. Implicated osds 0,3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 2552880 | 2018-05-19 05:22:59 | 2018-05-22 16:12:11 | 2018-05-22 18:06:12 | 1:54:01 | 0:25:09 | 1:28:52 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | |||
pass | 2552881 | 2018-05-19 05:23:00 | 2018-05-22 16:14:11 | 2018-05-22 16:54:11 | 0:40:00 | 0:28:55 | 0:11:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 2552882 | 2018-05-19 05:23:01 | 2018-05-22 16:22:03 | 2018-05-22 17:26:03 | 1:04:00 | 0:52:48 | 0:11:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 2552883 | 2018-05-19 05:23:02 | 2018-05-22 16:23:45 | 2018-05-22 17:29:45 | 1:06:00 | 0:33:53 | 0:32:07 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | |||
pass | 2552884 | 2018-05-19 05:23:02 | 2018-05-22 16:27:01 | 2018-05-22 17:49:02 | 1:22:01 | 1:09:37 | 0:12:24 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 2552885 | 2018-05-19 05:23:03 | 2018-05-22 16:32:12 | 2018-05-22 17:00:12 | 0:28:00 | 0:19:27 | 0:08:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 2552886 | 2018-05-19 05:23:04 | 2018-05-22 16:35:12 | 2018-05-23 00:25:20 | 7:50:08 | 0:41:26 | 7:08:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | |||
pass | 2552887 | 2018-05-19 05:23:05 | 2018-05-22 16:40:29 | 2018-05-22 18:26:30 | 1:46:01 | 1:24:07 | 0:21:54 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 2552888 | 2018-05-19 05:23:06 | 2018-05-22 16:52:35 | 2018-05-22 17:28:35 | 0:36:00 | 0:21:15 | 0:14:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
pass | 2552889 | 2018-05-19 05:23:06 | 2018-05-22 16:54:22 | 2018-05-22 20:00:24 | 3:06:02 | 0:25:51 | 2:40:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | |||
pass | 2552890 | 2018-05-19 05:23:07 | 2018-05-22 16:59:21 | 2018-05-22 17:27:20 | 0:27:59 | 0:17:34 | 0:10:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |