User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2018-10-17 15:48:26 | 2018-10-17 15:59:27 | 2018-10-18 03:51:31 | 11:52:04 | kcephfs | luminous | smithi | 1cde6d6 | 8 | 14 | 1 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 3151568 | 2018-10-17 15:48:31 | 2018-10-17 15:49:02 | 2018-10-17 16:21:02 | 0:32:00 | 0:21:16 | 0:10:44 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:06:19.487314 mon.a mon.0 172.21.15.6:6789/0 144 : cluster [WRN] Health check failed: 1336 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
dead | 3151569 | 2018-10-17 15:48:32 | 2018-10-17 15:49:17 | 2018-10-18 03:51:31 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | |||||
fail | 3151570 | 2018-10-17 15:48:33 | 2018-10-17 15:49:22 | 2018-10-17 16:23:22 | 0:34:00 | 0:20:46 | 0:13:14 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:08:37.171268 mon.b mon.0 172.21.15.166:6789/0 137 : cluster [WRN] Health check failed: 13 slow requests are blocked > 32 sec. Implicated osds 3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151571 | 2018-10-17 15:48:33 | 2018-10-17 15:51:37 | 2018-10-17 17:01:37 | 1:10:00 | 0:10:13 | 0:59:47 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
fail | 3151572 | 2018-10-17 15:48:34 | 2018-10-17 15:53:12 | 2018-10-17 17:15:12 | 1:22:00 | 0:25:37 | 0:56:23 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | |||
Failure Reason:
"2018-10-17 17:04:43.485528 mon.a mon.0 172.21.15.121:6789/0 1356 : cluster [WRN] Health check failed: 34 slow requests are blocked > 32 sec. Implicated osds 0,3,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
fail | 3151573 | 2018-10-17 15:48:35 | 2018-10-17 15:53:31 | 2018-10-17 17:03:31 | 1:10:00 | 0:58:48 | 0:11:12 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:10:01.357497 mon.b mon.0 172.21.15.105:6789/0 143 : cluster [WRN] Health check failed: 28104 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151574 | 2018-10-17 15:48:36 | 2018-10-17 15:53:49 | 2018-10-17 18:45:52 | 2:52:03 | 0:21:31 | 2:30:32 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | |||
fail | 3151575 | 2018-10-17 15:48:37 | 2018-10-17 15:53:52 | 2018-10-17 17:01:52 | 1:08:00 | 0:57:26 | 0:10:34 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:10:26.476623 mon.a mon.0 172.21.15.165:6789/0 249 : cluster [WRN] Health check failed: 427 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
fail | 3151576 | 2018-10-17 15:48:38 | 2018-10-17 15:54:55 | 2018-10-17 16:22:54 | 0:27:59 | 0:14:44 | 0:13:15 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:15:11.195037 mon.a mon.0 172.21.15.5:6789/0 234 : cluster [WRN] Health check failed: 515 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151577 | 2018-10-17 15:48:39 | 2018-10-17 15:55:14 | 2018-10-17 18:25:16 | 2:30:02 | 0:16:25 | 2:13:37 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | |||
fail | 3151578 | 2018-10-17 15:48:40 | 2018-10-17 15:55:22 | 2018-10-17 16:29:21 | 0:33:59 | 0:21:30 | 0:12:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:14:30.315965 mon.b mon.0 172.21.15.102:6789/0 233 : cluster [WRN] Health check failed: 4052 slow requests are blocked > 32 sec. Implicated osds 0,2,4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151579 | 2018-10-17 15:48:41 | 2018-10-17 15:55:28 | 2018-10-17 16:35:28 | 0:40:00 | 0:18:48 | 0:21:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | |||
pass | 3151580 | 2018-10-17 15:48:41 | 2018-10-17 15:55:33 | 2018-10-17 17:35:33 | 1:40:00 | 0:21:33 | 1:18:27 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | |||
fail | 3151581 | 2018-10-17 15:48:42 | 2018-10-17 15:57:57 | 2018-10-17 16:29:56 | 0:31:59 | 0:20:10 | 0:11:49 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:15:00.780306 mon.a mon.0 172.21.15.117:6789/0 159 : cluster [WRN] Health check failed: 28052 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151582 | 2018-10-17 15:48:43 | 2018-10-17 15:59:27 | 2018-10-18 01:43:39 | 9:44:12 | 0:37:56 | 9:06:16 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | |||
fail | 3151583 | 2018-10-17 15:48:44 | 2018-10-17 15:59:35 | 2018-10-17 16:31:34 | 0:31:59 | 0:20:34 | 0:11:25 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:15:55.025536 mon.a mon.0 172.21.15.68:6789/0 232 : cluster [WRN] Health check failed: 43 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
fail | 3151584 | 2018-10-17 15:48:45 | 2018-10-17 16:01:32 | 2018-10-17 17:13:32 | 1:12:00 | 1:01:39 | 0:10:21 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:18:25.484007 mon.b mon.0 172.21.15.8:6789/0 231 : cluster [WRN] Health check failed: 23683 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151585 | 2018-10-17 15:48:46 | 2018-10-17 16:01:32 | 2018-10-17 16:39:31 | 0:37:59 | 0:11:54 | 0:26:05 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | |||
fail | 3151586 | 2018-10-17 15:48:47 | 2018-10-17 16:01:32 | 2018-10-17 17:11:32 | 1:10:00 | 0:58:24 | 0:11:36 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:19:11.529736 mon.b mon.0 172.21.15.3:6789/0 135 : cluster [WRN] Health check failed: 30234 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
fail | 3151587 | 2018-10-17 15:48:48 | 2018-10-17 16:03:28 | 2018-10-17 16:29:27 | 0:25:59 | 0:14:50 | 0:11:09 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:20:18.801159 mon.a mon.0 172.21.15.37:6789/0 241 : cluster [WRN] Health check failed: 430 slow requests are blocked > 32 sec. Implicated osds 0,1,4,5,7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3151588 | 2018-10-17 15:48:48 | 2018-10-17 16:03:36 | 2018-10-17 19:19:39 | 3:16:03 | 0:17:55 | 2:58:08 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | |||
fail | 3151589 | 2018-10-17 15:48:49 | 2018-10-17 16:03:55 | 2018-10-18 00:34:04 | 8:30:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 4 | |||||
Failure Reason:
machine smithi165.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_yuriw@teuthology |
||||||||||||||
fail | 3151590 | 2018-10-17 15:48:50 | 2018-10-17 16:04:57 | 2018-10-17 16:36:56 | 0:31:59 | 0:21:30 | 0:10:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-17 16:21:41.753701 mon.a mon.0 172.21.15.71:6789/0 240 : cluster [WRN] Health check failed: 1423 slow requests are blocked > 32 sec. Implicated osds 0,3 (REQUEST_SLOW)" in cluster log |