| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| yuriw | 2019-01-29 17:36:03 | 2019-01-29 18:40:11 | 2019-01-30 06:42:22 | 12:02:11 | kcephfs | luminous | smithi | a8985ec | 9 | 13 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3524149 |
|
2019-01-29 17:36:12 | 2019-01-29 18:40:10 | 2019-01-29 21:10:12 | 2:30:02 | 0:37:15 | 1:52:47 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||
| fail | 3524150 |
|
2019-01-29 17:36:13 | 2019-01-29 18:40:11 | 2019-01-29 20:58:12 | 2:18:01 | 0:20:53 | 1:57:08 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:43:56.368427 mon.a mon.0 172.21.15.59:6789/0 225 : cluster [WRN] Health check failed: 3183 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3524151 |
|
2019-01-29 17:36:14 | 2019-01-29 18:40:09 | 2019-01-29 19:24:09 | 0:44:00 | 0:28:59 | 0:15:01 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| fail | 3524152 |
|
2019-01-29 17:36:14 | 2019-01-29 18:40:11 | 2019-01-29 20:52:12 | 2:12:01 | 0:21:08 | 1:50:53 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:37:13.980581 mon.b mon.0 172.21.15.72:6789/0 224 : cluster [WRN] Health check failed: 39 slow requests are blocked > 32 sec. Implicated osds 3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524153 |
|
2019-01-29 17:36:15 | 2019-01-29 18:40:09 | 2019-01-29 19:28:11 | 0:48:02 | 0:26:22 | 0:21:40 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2019-01-29 19:18:39.685183 mon.b mon.0 172.21.15.17:6789/0 959 : cluster [WRN] Health check failed: 370 slow requests are blocked > 32 sec. Implicated osds 0,2,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3524154 |
|
2019-01-29 17:36:16 | 2019-01-29 18:40:11 | 2019-01-30 02:52:18 | 8:12:07 | 0:11:19 | 8:00:48 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3524155 |
|
2019-01-29 17:36:16 | 2019-01-29 18:40:10 | 2019-01-29 20:26:11 | 1:46:01 | 0:47:36 | 0:58:25 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3524156 |
|
2019-01-29 17:36:17 | 2019-01-29 18:40:10 | 2019-01-29 20:00:10 | 1:20:00 | 0:57:53 | 0:22:07 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 19:09:32.436050 mon.b mon.0 172.21.15.64:6789/0 225 : cluster [WRN] Health check failed: 8626 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3524157 |
|
2019-01-29 17:36:18 | 2019-01-29 18:40:10 | 2019-01-30 00:16:15 | 5:36:05 | 0:12:32 | 5:23:33 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3524158 |
|
2019-01-29 17:36:19 | 2019-01-29 18:51:14 | 2019-01-29 20:31:14 | 1:40:00 | 0:57:43 | 0:42:17 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 19:40:11.998485 mon.a mon.0 172.21.15.26:6789/0 164 : cluster [WRN] Health check failed: 1440 slow requests are blocked > 32 sec. Implicated osds 0,3,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524159 |
|
2019-01-29 17:36:19 | 2019-01-29 18:40:11 | 2019-01-29 20:36:11 | 1:56:00 | 0:18:15 | 1:37:45 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:25:23.196418 mon.a mon.0 172.21.15.23:6789/0 157 : cluster [WRN] Health check failed: 10 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524160 |
|
2019-01-29 17:36:20 | 2019-01-29 18:40:10 | 2019-01-29 20:02:10 | 1:22:00 | 0:21:34 | 1:00:26 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 19:47:16.886815 mon.a mon.0 172.21.15.148:6789/0 148 : cluster [WRN] Health check failed: 2317 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3524161 |
|
2019-01-29 17:36:21 | 2019-01-29 18:40:10 | 2019-01-30 06:42:21 | 12:02:11 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| pass | 3524162 |
|
2019-01-29 17:36:22 | 2019-01-29 18:40:09 | 2019-01-29 19:32:09 | 0:52:00 | 0:29:06 | 0:22:54 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| fail | 3524163 |
|
2019-01-29 17:36:22 | 2019-01-29 18:40:10 | 2019-01-29 20:50:11 | 2:10:01 | 0:20:42 | 1:49:19 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:35:48.149484 mon.b mon.0 172.21.15.87:6789/0 229 : cluster [WRN] Health check failed: 8382 slow requests are blocked > 32 sec. Implicated osds 2,4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524164 |
|
2019-01-29 17:36:23 | 2019-01-29 18:40:11 | 2019-01-29 20:02:11 | 1:22:00 | 0:20:34 | 1:01:26 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 19:46:19.119922 mon.a mon.0 172.21.15.71:6789/0 225 : cluster [WRN] Health check failed: 92 slow requests are blocked > 32 sec. Implicated osds 3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3524165 |
|
2019-01-29 17:36:24 | 2019-01-29 18:40:10 | 2019-01-30 06:42:22 | 12:02:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | ||||
| dead | 3524166 |
|
2019-01-29 17:36:24 | 2019-01-29 18:40:10 | 2019-01-30 06:42:22 | 12:02:12 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | ||||
| dead | 3524167 |
|
2019-01-29 17:36:25 | 2019-01-29 18:40:10 | 2019-01-30 06:42:21 | 12:02:11 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| pass | 3524168 |
|
2019-01-29 17:36:26 | 2019-01-29 18:40:11 | 2019-01-29 20:30:12 | 1:50:01 | 0:42:46 | 1:07:15 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3524169 |
|
2019-01-29 17:36:27 | 2019-01-29 18:40:10 | 2019-01-29 21:02:12 | 2:22:02 | 1:05:08 | 1:16:54 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:02:42.759090 mon.a mon.0 172.21.15.88:6789/0 234 : cluster [WRN] Health check failed: 6723 slow requests are blocked > 32 sec. Implicated osds 0,2,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524170 |
|
2019-01-29 17:36:27 | 2019-01-29 18:40:10 | 2019-01-29 21:20:12 | 2:40:02 | 1:06:33 | 1:33:29 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 20:19:40.034265 mon.a mon.0 172.21.15.44:6789/0 234 : cluster [WRN] Health check failed: 26489 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3524171 |
|
2019-01-29 17:36:28 | 2019-01-29 18:40:09 | 2019-01-29 22:32:12 | 3:52:03 | 3:27:29 | 0:24:34 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on smithi097 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8985eca49a813688ca283c334fed07d086db8e9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3524172 |
|
2019-01-29 17:36:29 | 2019-01-29 18:40:11 | 2019-01-30 00:36:16 | 5:56:05 | 0:10:29 | 5:45:36 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| fail | 3524173 |
|
2019-01-29 17:36:29 | 2019-01-29 18:51:14 | 2019-01-29 19:57:14 | 1:06:00 | 0:20:57 | 0:45:03 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2019-01-29 19:41:39.621529 mon.a mon.0 172.21.15.110:6789/0 151 : cluster [WRN] Health check failed: 26589 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3524174 |
|
2019-01-29 17:36:30 | 2019-01-29 18:51:14 | 2019-01-29 20:11:14 | 1:20:00 | 0:20:00 | 1:00:00 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
Pulpito