| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| yuriw | 2019-01-15 20:53:56 | 2019-01-16 01:12:42 | 2019-01-16 13:15:10 | 12:02:28 | kcephfs | wip-yuri3-testing-2019-01-15-1812-luminous | smithi | deddc48 | 55 | 7 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3468427 |
|
2019-01-15 20:54:01 | 2019-01-16 00:44:27 | 2019-01-16 01:08:27 | 0:24:00 | 0:09:19 | 0:14:41 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3468428 |
|
2019-01-15 20:54:02 | 2019-01-16 00:44:27 | 2019-01-16 02:34:28 | 1:50:01 | 0:43:51 | 1:06:10 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| dead | 3468429 |
|
2019-01-15 20:54:03 | 2019-01-16 00:44:27 | 2019-01-16 12:46:40 | 12:02:13 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| pass | 3468430 |
|
2019-01-15 20:54:03 | 2019-01-16 00:44:28 | 2019-01-16 01:22:27 | 0:37:59 | 0:22:31 | 0:15:28 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3468431 |
|
2019-01-15 20:54:04 | 2019-01-16 00:44:31 | 2019-01-16 01:30:31 | 0:46:00 | 0:26:05 | 0:19:55 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3468432 |
|
2019-01-15 20:54:05 | 2019-01-16 00:46:29 | 2019-01-16 12:48:41 | 12:02:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| pass | 3468433 |
|
2019-01-15 20:54:06 | 2019-01-16 00:46:29 | 2019-01-16 01:34:29 | 0:48:00 | 0:27:10 | 0:20:50 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3468434 |
|
2019-01-15 20:54:06 | 2019-01-16 00:46:29 | 2019-01-16 08:30:36 | 7:44:07 | 0:10:01 | 7:34:06 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468435 |
|
2019-01-15 20:54:07 | 2019-01-16 00:48:16 | 2019-01-16 01:28:15 | 0:39:59 | 0:26:17 | 0:13:42 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3468436 |
|
2019-01-15 20:54:08 | 2019-01-16 00:48:26 | 2019-01-16 01:22:26 | 0:34:00 | 0:19:07 | 0:14:53 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3468437 |
|
2019-01-15 20:54:09 | 2019-01-16 00:50:20 | 2019-01-16 03:02:21 | 2:12:01 | 0:28:44 | 1:43:17 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| fail | 3468438 |
|
2019-01-15 20:54:09 | 2019-01-16 00:50:20 | 2019-01-16 01:54:20 | 1:04:00 | 0:45:16 | 0:18:44 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2019-01-16 01:26:10.673816 mon.a mon.0 172.21.15.5:6789/0 326 : cluster [WRN] Health check failed: 442 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3468439 |
|
2019-01-15 20:54:10 | 2019-01-16 00:52:18 | 2019-01-16 07:10:24 | 6:18:06 | 0:10:49 | 6:07:17 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468440 |
|
2019-01-15 20:54:11 | 2019-01-16 00:52:19 | 2019-01-16 01:26:18 | 0:33:59 | 0:11:17 | 0:22:42 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3468441 |
|
2019-01-15 20:54:12 | 2019-01-16 00:52:19 | 2019-01-16 02:16:19 | 1:24:00 | 0:38:34 | 0:45:26 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| pass | 3468442 |
|
2019-01-15 20:54:12 | 2019-01-16 00:52:20 | 2019-01-16 01:50:20 | 0:58:00 | 0:42:55 | 0:15:05 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3468443 |
|
2019-01-15 20:54:13 | 2019-01-16 00:52:25 | 2019-01-16 02:36:26 | 1:44:01 | 0:12:15 | 1:31:46 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| fail | 3468444 |
|
2019-01-15 20:54:14 | 2019-01-16 00:52:28 | 2019-01-16 02:10:29 | 1:18:01 | 1:02:33 | 0:15:28 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-16 01:14:17.977479 mon.a mon.0 172.21.15.110:6789/0 240 : cluster [WRN] Health check failed: 5083 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3468445 |
|
2019-01-15 20:54:15 | 2019-01-16 00:53:29 | 2019-01-16 03:11:31 | 2:18:02 | 0:23:07 | 1:54:55 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468446 |
|
2019-01-15 20:54:16 | 2019-01-16 00:53:52 | 2019-01-16 01:15:51 | 0:21:59 | 0:12:23 | 0:09:36 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3468447 |
|
2019-01-15 20:54:16 | 2019-01-16 00:54:15 | 2019-01-16 12:34:27 | 11:40:12 | 0:20:03 | 11:20:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468448 |
|
2019-01-15 20:54:17 | 2019-01-16 00:54:16 | 2019-01-16 01:32:15 | 0:37:59 | 0:26:28 | 0:11:31 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3468449 |
|
2019-01-15 20:54:18 | 2019-01-16 00:54:22 | 2019-01-16 01:22:21 | 0:27:59 | 0:15:34 | 0:12:25 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3468450 |
|
2019-01-15 20:54:18 | 2019-01-16 00:54:27 | 2019-01-16 08:22:34 | 7:28:07 | 0:10:58 | 7:17:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468451 |
|
2019-01-15 20:54:19 | 2019-01-16 00:55:58 | 2019-01-16 01:29:57 | 0:33:59 | 0:21:50 | 0:12:09 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3468452 |
|
2019-01-15 20:54:20 | 2019-01-16 00:56:13 | 2019-01-16 01:24:13 | 0:28:00 | 0:10:28 | 0:17:32 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3468453 |
|
2019-01-15 20:54:21 | 2019-01-16 00:56:16 | 2019-01-16 12:42:27 | 11:46:11 | 0:09:49 | 11:36:22 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468454 |
|
2019-01-15 20:54:21 | 2019-01-16 00:56:19 | 2019-01-16 01:28:18 | 0:31:59 | 0:10:56 | 0:21:03 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3468455 |
|
2019-01-15 20:54:22 | 2019-01-16 00:56:21 | 2019-01-16 01:48:21 | 0:52:00 | 0:36:18 | 0:15:42 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3468456 |
|
2019-01-15 20:54:23 | 2019-01-16 00:56:41 | 2019-01-16 04:34:44 | 3:38:03 | 0:16:38 | 3:21:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468457 |
|
2019-01-15 20:54:24 | 2019-01-16 00:56:43 | 2019-01-16 01:38:43 | 0:42:00 | 0:09:37 | 0:32:23 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3468458 |
|
2019-01-15 20:54:24 | 2019-01-16 00:56:52 | 2019-01-16 03:50:54 | 2:54:02 | 0:36:15 | 2:17:47 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468459 |
|
2019-01-15 20:54:25 | 2019-01-16 00:57:44 | 2019-01-16 01:23:43 | 0:25:59 | 0:08:30 | 0:17:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3468460 |
|
2019-01-15 20:54:26 | 2019-01-16 00:57:58 | 2019-01-16 01:19:58 | 0:22:00 | 0:08:37 | 0:13:23 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3468461 |
|
2019-01-15 20:54:26 | 2019-01-16 00:58:15 | 2019-01-16 02:10:16 | 1:12:01 | 0:34:56 | 0:37:05 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2019-01-16 01:41:48.063161 mon.b mon.0 172.21.15.55:6789/0 144 : cluster [WRN] Health check failed: 1481 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3468462 |
|
2019-01-15 20:54:27 | 2019-01-16 00:58:18 | 2019-01-16 05:14:22 | 4:16:04 | 0:10:51 | 4:05:13 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468463 |
|
2019-01-15 20:54:28 | 2019-01-16 00:58:19 | 2019-01-16 01:38:19 | 0:40:00 | 0:24:11 | 0:15:49 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3468464 |
|
2019-01-15 20:54:29 | 2019-01-16 00:58:20 | 2019-01-16 02:06:20 | 1:08:00 | 0:27:02 | 0:40:58 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 3468465 |
|
2019-01-15 20:54:29 | 2019-01-16 00:58:24 | 2019-01-16 02:20:25 | 1:22:01 | 0:20:24 | 1:01:37 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2019-01-16 02:12:31.483233 mon.a mon.0 172.21.15.17:6789/0 836 : cluster [WRN] Health check failed: 1 MDSs are read only (MDS_READ_ONLY)" in cluster log |
||||||||||||||
| pass | 3468466 |
|
2019-01-15 20:54:30 | 2019-01-16 00:58:29 | 2019-01-16 01:38:29 | 0:40:00 | 0:25:06 | 0:14:54 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3468467 |
|
2019-01-15 20:54:31 | 2019-01-16 01:00:22 | 2019-01-16 02:56:23 | 1:56:01 | 0:21:36 | 1:34:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468468 |
|
2019-01-15 20:54:32 | 2019-01-16 01:02:12 | 2019-01-16 02:02:12 | 1:00:00 | 0:39:08 | 0:20:52 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3468469 |
|
2019-01-15 20:54:32 | 2019-01-16 01:02:15 | 2019-01-16 01:38:15 | 0:36:00 | 0:18:31 | 0:17:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3468470 |
|
2019-01-15 20:54:33 | 2019-01-16 01:02:15 | 2019-01-16 13:04:27 | 12:02:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | — | ||||
| pass | 3468471 |
|
2019-01-15 20:54:34 | 2019-01-16 01:02:19 | 2019-01-16 02:06:19 | 1:04:00 | 0:33:31 | 0:30:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| dead | 3468472 |
|
2019-01-15 20:54:35 | 2019-01-16 01:02:20 | 2019-01-16 13:04:32 | 12:02:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| pass | 3468473 |
|
2019-01-15 20:54:35 | 2019-01-16 01:02:20 | 2019-01-16 02:32:21 | 1:30:01 | 1:09:21 | 0:20:40 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3468474 |
|
2019-01-15 20:54:36 | 2019-01-16 01:04:30 | 2019-01-16 02:12:30 | 1:08:00 | 0:38:21 | 0:29:39 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| pass | 3468475 |
|
2019-01-15 20:54:37 | 2019-01-16 01:04:30 | 2019-01-16 02:50:30 | 1:46:00 | 0:32:07 | 1:13:53 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3468476 |
|
2019-01-15 20:54:38 | 2019-01-16 01:06:05 | 2019-01-16 04:06:08 | 3:00:03 | 0:18:02 | 2:42:01 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3468477 |
|
2019-01-15 20:54:38 | 2019-01-16 01:06:15 | 2019-01-16 02:24:15 | 1:18:00 | 0:59:50 | 0:18:10 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-16 01:31:36.118681 mon.a mon.0 172.21.15.92:6789/0 163 : cluster [WRN] Health check failed: 24664 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3468478 |
|
2019-01-15 20:54:39 | 2019-01-16 01:06:18 | 2019-01-16 07:38:25 | 6:32:07 | 0:10:35 | 6:21:32 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468479 |
|
2019-01-15 20:54:40 | 2019-01-16 01:06:19 | 2019-01-16 01:36:19 | 0:30:00 | 0:12:07 | 0:17:53 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3468480 |
|
2019-01-15 20:54:40 | 2019-01-16 01:06:53 | 2019-01-16 03:36:54 | 2:30:01 | 0:28:19 | 2:01:42 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468481 |
|
2019-01-15 20:54:41 | 2019-01-16 01:08:36 | 2019-01-16 02:12:35 | 1:03:59 | 0:39:53 | 0:24:06 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| pass | 3468482 |
|
2019-01-15 20:54:42 | 2019-01-16 01:08:36 | 2019-01-16 01:54:35 | 0:45:59 | 0:23:18 | 0:22:41 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3468483 |
|
2019-01-15 20:54:43 | 2019-01-16 01:08:36 | 2019-01-16 04:44:38 | 3:36:02 | 0:10:04 | 3:25:58 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468484 |
|
2019-01-15 20:54:43 | 2019-01-16 01:10:06 | 2019-01-16 01:42:06 | 0:32:00 | 0:11:22 | 0:20:38 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3468485 |
|
2019-01-15 20:54:44 | 2019-01-16 01:10:06 | 2019-01-16 01:40:06 | 0:30:00 | 0:09:09 | 0:20:51 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3468486 |
|
2019-01-15 20:54:45 | 2019-01-16 01:10:12 | 2019-01-16 07:26:18 | 6:16:06 | 0:12:28 | 6:03:38 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| fail | 3468487 |
|
2019-01-15 20:54:46 | 2019-01-16 01:10:22 | 2019-01-16 01:46:21 | 0:35:59 | 0:19:15 | 0:16:44 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2019-01-16 01:33:54.778107 mon.b mon.0 172.21.15.25:6789/0 136 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3468488 |
|
2019-01-15 20:54:46 | 2019-01-16 01:12:42 | 2019-01-16 02:24:42 | 1:12:00 | 0:24:08 | 0:47:52 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| fail | 3468489 |
|
2019-01-15 20:54:47 | 2019-01-16 01:12:42 | 2019-01-16 13:15:10 | 12:02:28 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||||
Failure Reason:
psutil.NoSuchProcess process no longer exists (pid=1991) |
||||||||||||||
| pass | 3468491 |
|
2019-01-15 20:54:48 | 2019-01-16 01:14:19 | 2019-01-16 01:48:19 | 0:34:00 | 0:09:40 | 0:24:20 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3468493 |
|
2019-01-15 20:54:49 | 2019-01-16 01:16:05 | 2019-01-16 13:06:18 | 11:50:13 | 0:19:34 | 11:30:39 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3468495 |
|
2019-01-15 20:54:49 | 2019-01-16 01:16:23 | 2019-01-16 01:38:23 | 0:22:00 | 0:08:09 | 0:13:51 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
Pulpito