| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| yuriw | 2018-09-25 19:40:17 | 2018-09-25 22:10:44 | 2018-09-26 10:47:12 | 12:36:28 | kcephfs | wip-yuri-testing-2018-09-25-1558-luminous | smithi | 2834ae8 | 48 | 9 | 9 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3068610 |
|
2018-09-25 19:40:21 | 2018-09-25 21:10:58 | 2018-09-25 21:42:58 | 0:32:00 | 0:08:37 | 0:23:23 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3068611 |
|
2018-09-25 19:40:21 | 2018-09-25 21:11:11 | 2018-09-25 22:23:13 | 1:12:02 | 0:44:43 | 0:27:19 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| dead | 3068612 |
|
2018-09-25 19:40:22 | 2018-09-25 21:12:32 | 2018-09-26 09:14:48 | 12:02:16 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| fail | 3068613 |
|
2018-09-25 19:40:23 | 2018-09-25 21:12:35 | 2018-09-25 21:44:35 | 0:32:00 | 0:20:17 | 0:11:43 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-09-25 21:31:06.886075 mon.b mon.0 172.21.15.80:6789/0 366 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3068614 |
|
2018-09-25 19:40:23 | 2018-09-25 21:12:39 | 2018-09-25 22:04:39 | 0:52:00 | 0:28:45 | 0:23:15 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 3068615 |
|
2018-09-25 19:40:24 | 2018-09-25 21:22:43 | 2018-09-26 03:34:49 | 6:12:06 | 0:17:26 | 5:54:40 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-09-26 03:27:00.142492 mon.a mon.0 172.21.15.95:6789/0 462 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log |
||||||||||||||
| pass | 3068616 |
|
2018-09-25 19:40:25 | 2018-09-25 21:22:50 | 2018-09-25 21:58:50 | 0:36:00 | 0:24:42 | 0:11:18 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3068617 |
|
2018-09-25 19:40:25 | 2018-09-25 21:24:40 | 2018-09-26 04:08:47 | 6:44:07 | 0:10:07 | 6:34:00 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068618 |
|
2018-09-25 19:40:26 | 2018-09-25 21:24:40 | 2018-09-25 22:02:40 | 0:38:00 | 0:25:19 | 0:12:41 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3068619 |
|
2018-09-25 19:40:27 | 2018-09-25 21:24:41 | 2018-09-25 21:52:40 | 0:27:59 | 0:17:24 | 0:10:35 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3068620 |
|
2018-09-25 19:40:27 | 2018-09-25 21:24:51 | 2018-09-26 09:27:08 | 12:02:17 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| fail | 3068621 |
|
2018-09-25 19:40:28 | 2018-09-25 21:24:53 | 2018-09-25 22:38:54 | 1:14:01 | 0:44:26 | 0:29:35 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:10:27.143821 mon.b mon.0 172.21.15.80:6789/0 304 : cluster [WRN] Health check failed: 2561 slow requests are blocked > 32 sec. Implicated osds 2,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3068622 |
|
2018-09-25 19:40:28 | 2018-09-25 21:25:09 | 2018-09-25 23:33:11 | 2:08:02 | 0:11:37 | 1:56:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068623 |
|
2018-09-25 19:40:29 | 2018-09-25 21:26:43 | 2018-09-25 21:52:43 | 0:26:00 | 0:10:39 | 0:15:21 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3068624 |
|
2018-09-25 19:40:30 | 2018-09-25 21:26:43 | 2018-09-25 22:24:43 | 0:58:00 | 0:37:54 | 0:20:06 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| pass | 3068625 |
|
2018-09-25 19:40:30 | 2018-09-25 21:28:40 | 2018-09-25 22:34:40 | 1:06:00 | 0:42:34 | 0:23:26 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3068626 |
|
2018-09-25 19:40:31 | 2018-09-25 21:28:40 | 2018-09-26 03:22:46 | 5:54:06 | 0:11:57 | 5:42:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| fail | 3068627 |
|
2018-09-25 19:40:32 | 2018-09-25 21:28:41 | 2018-09-25 22:38:41 | 1:10:00 | 0:56:47 | 0:13:13 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-09-25 21:46:32.301048 mon.a mon.0 172.21.15.181:6789/0 234 : cluster [WRN] Health check failed: 11140 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3068628 |
|
2018-09-25 19:40:32 | 2018-09-25 21:28:54 | 2018-09-26 09:31:09 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | — | ||||
| pass | 3068629 |
|
2018-09-25 19:40:33 | 2018-09-25 21:31:14 | 2018-09-25 22:01:14 | 0:30:00 | 0:08:46 | 0:21:14 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3068630 |
|
2018-09-25 19:40:33 | 2018-09-25 21:32:46 | 2018-09-26 03:02:52 | 5:30:06 | 0:21:27 | 5:08:39 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068631 |
|
2018-09-25 19:40:34 | 2018-09-25 21:32:46 | 2018-09-25 22:14:46 | 0:42:00 | 0:25:59 | 0:16:01 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3068632 |
|
2018-09-25 19:40:35 | 2018-09-25 21:35:08 | 2018-09-25 22:27:08 | 0:52:00 | 0:16:04 | 0:35:56 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3068633 |
|
2018-09-25 19:40:35 | 2018-09-25 21:37:00 | 2018-09-26 09:39:14 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3068634 |
|
2018-09-25 19:40:36 | 2018-09-25 21:38:56 | 2018-09-25 22:30:56 | 0:52:00 | 0:22:11 | 0:29:49 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:16:53.482155 mon.a mon.1 172.21.15.121:6789/0 10 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3068635 |
|
2018-09-25 19:40:37 | 2018-09-25 21:38:56 | 2018-09-25 22:10:56 | 0:32:00 | 0:08:47 | 0:23:13 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3068636 |
|
2018-09-25 19:40:37 | 2018-09-25 21:41:00 | 2018-09-25 23:29:01 | 1:48:01 | 0:09:38 | 1:38:23 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068637 |
|
2018-09-25 19:40:38 | 2018-09-25 21:42:39 | 2018-09-25 22:20:39 | 0:38:00 | 0:10:07 | 0:27:53 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3068638 |
|
2018-09-25 19:40:38 | 2018-09-25 21:42:59 | 2018-09-25 22:40:59 | 0:58:00 | 0:36:11 | 0:21:49 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3068639 |
|
2018-09-25 19:40:39 | 2018-09-25 21:44:37 | 2018-09-25 22:42:37 | 0:58:00 | 0:15:49 | 0:42:11 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068640 |
|
2018-09-25 19:40:40 | 2018-09-25 21:48:35 | 2018-09-25 22:10:35 | 0:22:00 | 0:09:06 | 0:12:54 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3068641 |
|
2018-09-25 19:40:40 | 2018-09-25 21:52:51 | 2018-09-26 09:55:05 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | — | ||||
| pass | 3068642 |
|
2018-09-25 19:40:41 | 2018-09-25 21:52:51 | 2018-09-25 22:14:51 | 0:22:00 | 0:07:20 | 0:14:40 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3068643 |
|
2018-09-25 19:40:42 | 2018-09-25 21:54:43 | 2018-09-25 22:18:43 | 0:24:00 | 0:07:52 | 0:16:08 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3068644 |
|
2018-09-25 19:40:42 | 2018-09-25 21:58:33 | 2018-09-25 23:22:34 | 1:24:01 | 0:31:25 | 0:52:36 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| dead | 3068645 |
|
2018-09-25 19:40:43 | 2018-09-25 21:58:51 | 2018-09-26 10:01:06 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| fail | 3068646 |
|
2018-09-25 19:40:44 | 2018-09-25 21:59:14 | 2018-09-25 22:37:14 | 0:38:00 | 0:20:12 | 0:17:48 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:23:54.274156 mon.b mon.0 172.21.15.97:6789/0 659 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3068647 |
|
2018-09-25 19:40:44 | 2018-09-25 22:01:23 | 2018-09-25 22:43:23 | 0:42:00 | 0:28:02 | 0:13:58 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| pass | 3068648 |
|
2018-09-25 19:40:45 | 2018-09-25 22:02:51 | 2018-09-26 03:06:56 | 5:04:05 | 0:18:56 | 4:45:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068649 |
|
2018-09-25 19:40:46 | 2018-09-25 22:04:49 | 2018-09-25 22:44:49 | 0:40:00 | 0:24:22 | 0:15:38 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3068650 |
|
2018-09-25 19:40:46 | 2018-09-25 22:06:43 | 2018-09-26 00:06:45 | 2:00:02 | 0:22:37 | 1:37:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068651 |
|
2018-09-25 19:40:47 | 2018-09-25 22:06:43 | 2018-09-25 23:12:44 | 1:06:01 | 0:39:12 | 0:26:49 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3068652 |
|
2018-09-25 19:40:47 | 2018-09-25 22:08:47 | 2018-09-25 22:36:47 | 0:28:00 | 0:17:52 | 0:10:08 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3068653 |
|
2018-09-25 19:40:48 | 2018-09-25 22:10:44 | 2018-09-26 04:32:51 | 6:22:07 | 0:13:56 | 6:08:11 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068654 |
|
2018-09-25 19:40:49 | 2018-09-25 22:10:44 | 2018-09-25 23:00:44 | 0:50:00 | 0:34:09 | 0:15:51 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| dead | 3068655 |
|
2018-09-25 19:40:49 | 2018-09-25 22:10:57 | 2018-09-26 10:13:11 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| fail | 3068656 |
|
2018-09-25 19:40:50 | 2018-09-25 22:14:57 | 2018-09-25 23:32:58 | 1:18:01 | 1:05:11 | 0:12:50 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:34:54.879756 mon.b mon.0 172.21.15.36:6789/0 182 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3068657 |
|
2018-09-25 19:40:51 | 2018-09-25 22:14:57 | 2018-09-25 23:06:57 | 0:52:00 | 0:36:41 | 0:15:19 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| pass | 3068658 |
|
2018-09-25 19:40:51 | 2018-09-25 22:14:57 | 2018-09-25 23:16:57 | 1:02:00 | 0:31:13 | 0:30:47 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3068659 |
|
2018-09-25 19:40:52 | 2018-09-25 22:18:52 | 2018-09-25 23:08:52 | 0:50:00 | 0:17:55 | 0:32:05 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3068660 |
|
2018-09-25 19:40:53 | 2018-09-25 22:20:48 | 2018-09-25 23:34:49 | 1:14:01 | 1:02:58 | 0:11:03 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:38:54.793365 mon.b mon.0 172.21.15.150:6789/0 151 : cluster [WRN] Health check failed: 33934 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3068661 |
|
2018-09-25 19:40:53 | 2018-09-25 22:23:22 | 2018-09-26 04:45:28 | 6:22:06 | 0:09:46 | 6:12:20 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068662 |
|
2018-09-25 19:40:54 | 2018-09-25 22:24:45 | 2018-09-25 22:46:44 | 0:21:59 | 0:09:35 | 0:12:24 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| dead | 3068663 |
|
2018-09-25 19:40:55 | 2018-09-25 22:27:19 | 2018-09-26 10:29:34 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3068664 |
|
2018-09-25 19:40:55 | 2018-09-25 22:31:06 | 2018-09-25 23:55:07 | 1:24:01 | 0:39:07 | 0:44:54 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3068665 |
|
2018-09-25 19:40:56 | 2018-09-25 22:34:49 | 2018-09-25 23:10:49 | 0:36:00 | 0:24:09 | 0:11:51 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3068666 |
|
2018-09-25 19:40:57 | 2018-09-25 22:36:56 | 2018-09-26 03:11:01 | 4:34:05 | 0:10:25 | 4:23:40 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068667 |
|
2018-09-25 19:40:57 | 2018-09-25 22:37:15 | 2018-09-25 22:57:15 | 0:20:00 | 0:10:26 | 0:09:34 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3068668 |
|
2018-09-25 19:40:58 | 2018-09-25 22:38:52 | 2018-09-25 22:56:51 | 0:17:59 | 0:08:44 | 0:09:15 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3068669 |
|
2018-09-25 19:40:58 | 2018-09-25 22:38:55 | 2018-09-26 04:11:01 | 5:32:06 | 0:12:38 | 5:19:28 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| fail | 3068670 |
|
2018-09-25 19:40:59 | 2018-09-25 22:40:23 | 2018-09-25 23:08:23 | 0:28:00 | 0:14:01 | 0:13:59 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-09-25 22:59:25.076298 mon.b mon.0 172.21.15.63:6789/0 227 : cluster [WRN] Health check failed: 19 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3068671 |
|
2018-09-25 19:41:00 | 2018-09-25 22:41:00 | 2018-09-25 23:35:01 | 0:54:01 | 0:22:44 | 0:31:17 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3068672 |
|
2018-09-25 19:41:00 | 2018-09-25 22:42:45 | 2018-09-26 03:46:50 | 5:04:05 | 0:24:11 | 4:39:54 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| pass | 3068673 |
|
2018-09-25 19:41:01 | 2018-09-25 22:43:24 | 2018-09-25 23:03:24 | 0:20:00 | 0:08:59 | 0:11:01 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3068674 |
|
2018-09-25 19:41:02 | 2018-09-25 22:44:58 | 2018-09-26 10:47:12 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | ||||
| pass | 3068675 |
|
2018-09-25 19:41:02 | 2018-09-25 22:46:54 | 2018-09-25 23:06:53 | 0:19:59 | 0:08:33 | 0:11:26 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
Pulpito