| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| yuriw | 2018-11-07 23:57:37 | 2018-11-07 23:59:52 | 2018-11-08 02:21:45 | 2:21:53 | kcephfs | luminous | smithi | 9386263 | 12 | 12 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3234981 |
|
2018-11-07 23:57:41 | 2018-11-07 23:59:52 | 2018-11-08 00:53:53 | 0:54:01 | 0:43:25 | 0:10:36 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3234982 |
|
2018-11-07 23:57:41 | 2018-11-08 00:00:49 | 2018-11-08 00:32:48 | 0:31:59 | 0:20:34 | 0:11:25 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:17:27.134985 mon.a mon.0 172.21.15.110:6789/0 148 : cluster [WRN] Health check failed: 4612 slow requests are blocked > 32 sec. Implicated osds 3,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3234983 |
|
2018-11-07 23:57:42 | 2018-11-08 00:01:11 | 2018-11-08 00:27:11 | 0:26:00 | 0:10:46 | 0:15:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| fail | 3234984 |
|
2018-11-07 23:57:43 | 2018-11-08 00:01:27 | 2018-11-08 00:33:26 | 0:31:59 | 0:20:45 | 0:11:14 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:18:24.131236 mon.b mon.0 172.21.15.131:6789/0 137 : cluster [WRN] Health check failed: 48 slow requests are blocked > 32 sec. Implicated osds 3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3234985 |
|
2018-11-07 23:57:44 | 2018-11-08 00:01:27 | 2018-11-08 01:47:28 | 1:46:01 | 0:25:41 | 1:20:20 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-11-08 01:36:38.416881 mon.a mon.0 172.21.15.42:6789/0 1343 : cluster [WRN] Health check failed: 9 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3234986 |
|
2018-11-07 23:57:45 | 2018-11-08 00:01:29 | 2018-11-08 01:09:29 | 1:08:00 | 0:56:11 | 0:11:49 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:19:27.992818 mon.a mon.0 172.21.15.74:6789/0 156 : cluster [WRN] Health check failed: 9741 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3234987 |
|
2018-11-07 23:57:45 | 2018-11-08 00:01:44 | 2018-11-08 01:21:44 | 1:20:00 | 1:06:13 | 0:13:47 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:21:13.454595 mon.b mon.0 172.21.15.50:6789/0 141 : cluster [WRN] Health check failed: 25836 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3234988 |
|
2018-11-07 23:57:46 | 2018-11-08 00:01:44 | 2018-11-08 00:31:43 | 0:29:59 | 0:17:14 | 0:12:45 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:20:52.523270 mon.b mon.0 172.21.15.91:6789/0 143 : cluster [WRN] Health check failed: 18 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3234989 |
|
2018-11-07 23:57:47 | 2018-11-08 00:01:43 | 2018-11-08 00:35:43 | 0:34:00 | 0:21:44 | 0:12:16 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:20:41.133950 mon.b mon.0 172.21.15.176:6789/0 140 : cluster [WRN] Health check failed: 3534 slow requests are blocked > 32 sec. Implicated osds 0,2,4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3234990 |
|
2018-11-07 23:57:48 | 2018-11-08 00:01:44 | 2018-11-08 02:21:45 | 2:20:01 | 0:23:36 | 1:56:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3234991 |
|
2018-11-07 23:57:49 | 2018-11-08 00:01:44 | 2018-11-08 00:37:43 | 0:35:59 | 0:21:24 | 0:14:35 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:22:18.432951 mon.a mon.0 172.21.15.44:6789/0 146 : cluster [WRN] Health check failed: 14018 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3234992 |
|
2018-11-07 23:57:49 | 2018-11-08 00:03:29 | 2018-11-08 01:47:30 | 1:44:01 | 0:23:13 | 1:20:48 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3234993 |
|
2018-11-07 23:57:50 | 2018-11-08 00:03:29 | 2018-11-08 01:01:29 | 0:58:00 | 0:47:04 | 0:10:56 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3234994 |
|
2018-11-07 23:57:51 | 2018-11-08 00:03:37 | 2018-11-08 00:39:37 | 0:36:00 | 0:20:39 | 0:15:21 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:25:02.333819 mon.a mon.0 172.21.15.129:6789/0 145 : cluster [WRN] Health check failed: 23 slow requests are blocked > 32 sec. Implicated osds 0,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3234995 |
|
2018-11-07 23:57:52 | 2018-11-08 00:03:38 | 2018-11-08 00:45:38 | 0:42:00 | 0:18:23 | 0:23:37 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3234996 |
|
2018-11-07 23:57:53 | 2018-11-08 00:03:42 | 2018-11-08 01:17:43 | 1:14:01 | 1:02:28 | 0:11:33 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3234997 |
|
2018-11-07 23:57:53 | 2018-11-08 00:05:05 | 2018-11-08 01:21:05 | 1:16:00 | 1:03:06 | 0:12:54 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:23:48.808330 mon.b mon.0 172.21.15.37:6789/0 140 : cluster [WRN] Health check failed: 10797 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3234998 |
|
2018-11-07 23:57:54 | 2018-11-08 00:05:23 | 2018-11-08 01:43:24 | 1:38:01 | 0:23:36 | 1:14:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3234999 |
|
2018-11-07 23:57:55 | 2018-11-08 00:05:27 | 2018-11-08 01:19:27 | 1:14:00 | 1:00:23 | 0:13:37 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:25:04.067543 mon.a mon.0 172.21.15.95:6789/0 148 : cluster [WRN] Health check failed: 27991 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3235000 |
|
2018-11-07 23:57:56 | 2018-11-08 00:05:36 | 2018-11-08 00:33:36 | 0:28:00 | 0:14:53 | 0:13:07 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-11-08 00:24:56.101351 mon.b mon.0 172.21.15.79:6789/0 216 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3235001 |
|
2018-11-07 23:57:56 | 2018-11-08 00:05:36 | 2018-11-08 02:21:38 | 2:16:02 | 0:13:06 | 2:02:56 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| pass | 3235002 |
|
2018-11-07 23:57:57 | 2018-11-08 00:05:39 | 2018-11-08 01:55:41 | 1:50:02 | 0:18:18 | 1:31:44 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
| dead | 3235003 |
|
2018-11-07 23:57:58 | 2018-11-08 00:06:00 | 2018-11-08 00:24:00 | 0:18:00 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | — | ||||
Failure Reason:
reached maximum tries (60) after waiting for 900 seconds |
||||||||||||||
| pass | 3235004 |
|
2018-11-07 23:57:59 | 2018-11-08 00:07:51 | 2018-11-08 01:11:52 | 1:04:01 | 0:13:42 | 0:50:19 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| pass | 3235005 |
|
2018-11-07 23:58:00 | 2018-11-08 00:07:59 | 2018-11-08 01:56:00 | 1:48:01 | 0:23:36 | 1:24:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Pulpito