| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2018-12-01 05:20:02 | 2018-12-11 17:59:14 | 2018-12-13 09:39:43 | 1 day, 15:40:29 | kcephfs | luminous | ovh | b79a524 | 133 | 64 | 53 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3300201 |
|
2018-12-01 05:20:26 | 2018-12-11 17:59:14 | 2018-12-11 19:07:14 | 1:08:00 | 0:32:21 | 0:35:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300202 |
|
2018-12-01 05:20:27 | 2018-12-11 18:03:18 | 2018-12-11 21:09:21 | 3:06:03 | 1:45:59 | 1:20:04 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-12-11 19:44:07.778058 mon.a mon.0 158.69.65.191:6789/0 243 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 0,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300203 |
|
2018-12-01 05:20:27 | 2018-12-11 18:05:23 | 2018-12-12 02:41:30 | 8:36:07 | 0:27:16 | 8:08:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300204 |
|
2018-12-01 05:20:28 | 2018-12-11 18:11:13 | 2018-12-11 19:53:14 | 1:42:01 | 1:17:14 | 0:24:47 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3300205 |
|
2018-12-01 05:20:29 | 2018-12-11 18:13:11 | 2018-12-11 19:37:12 | 1:24:01 | 0:58:29 | 0:25:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3300206 |
|
2018-12-01 05:20:30 | 2018-12-11 18:13:11 | 2018-12-12 06:20:28 | 12:07:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3300207 |
|
2018-12-01 05:20:30 | 2018-12-11 18:15:23 | 2018-12-11 20:57:25 | 2:42:02 | 1:50:13 | 0:51:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300208 |
|
2018-12-01 05:20:31 | 2018-12-11 18:16:49 | 2018-12-11 19:24:49 | 1:08:00 | 0:42:17 | 0:25:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300209 |
|
2018-12-01 05:20:32 | 2018-12-11 18:22:59 | 2018-12-12 06:25:12 | 12:02:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | — | ||||
| fail | 3300210 |
|
2018-12-01 05:20:32 | 2018-12-11 18:29:07 | 2018-12-11 20:37:09 | 2:08:02 | 1:37:00 | 0:31:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-12-11 20:08:26.646383 mon.b mon.0 158.69.67.19:6789/0 316 : cluster [WRN] Health check failed: 38 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300211 |
|
2018-12-01 05:20:33 | 2018-12-11 18:31:24 | 2018-12-11 20:41:25 | 2:10:01 | 1:26:12 | 0:43:49 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3300212 |
|
2018-12-01 05:20:34 | 2018-12-11 20:07:29 | 2018-12-12 08:14:55 | 12:07:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3300213 |
|
2018-12-01 05:20:35 | 2018-12-11 20:07:29 | 2018-12-11 21:57:29 | 1:50:00 | 1:06:48 | 0:43:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300214 |
|
2018-12-01 05:20:35 | 2018-12-11 20:07:28 | 2018-12-11 21:21:27 | 1:13:59 | 0:52:02 | 0:21:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-11 20:57:41.151481 mon.a mon.0 158.69.66.19:6789/0 148 : cluster [WRN] Health check failed: 108 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300215 |
|
2018-12-01 05:20:36 | 2018-12-11 20:07:28 | 2018-12-12 03:35:39 | 7:28:11 | 0:23:46 | 7:04:25 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300216 |
|
2018-12-01 05:20:37 | 2018-12-11 20:07:29 | 2018-12-11 21:19:28 | 1:11:59 | 0:37:45 | 0:34:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300217 |
|
2018-12-01 05:20:38 | 2018-12-11 20:07:28 | 2018-12-11 21:35:28 | 1:28:00 | 0:48:01 | 0:39:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3300218 |
|
2018-12-01 05:20:38 | 2018-12-11 20:07:27 | 2018-12-11 23:39:30 | 3:32:03 | 0:33:33 | 2:58:30 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300219 |
|
2018-12-01 05:20:39 | 2018-12-11 20:07:30 | 2018-12-11 22:05:30 | 1:58:00 | 1:03:41 | 0:54:19 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-11 21:27:51.928730 mon.a mon.0 158.69.64.176:6789/0 123 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3300220 |
|
2018-12-01 05:20:40 | 2018-12-11 20:07:31 | 2018-12-11 22:23:31 | 2:16:00 | 0:46:44 | 1:29:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3300221 |
|
2018-12-01 05:20:41 | 2018-12-11 20:07:30 | 2018-12-12 08:09:39 | 12:02:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | ||||
| pass | 3300222 |
|
2018-12-01 05:20:41 | 2018-12-11 20:07:30 | 2018-12-11 22:25:30 | 2:18:00 | 2:07:08 | 0:10:52 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300223 |
|
2018-12-01 05:20:42 | 2018-12-11 20:07:31 | 2018-12-11 22:27:31 | 2:20:00 | 0:47:07 | 1:32:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300224 |
|
2018-12-01 05:20:43 | 2018-12-11 20:07:28 | 2018-12-12 00:57:31 | 4:50:03 | 0:36:34 | 4:13:29 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300225 |
|
2018-12-01 05:20:43 | 2018-12-11 20:07:30 | 2018-12-11 22:01:30 | 1:54:00 | 0:41:29 | 1:12:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300226 |
|
2018-12-01 05:20:44 | 2018-12-11 20:07:30 | 2018-12-11 20:55:29 | 0:47:59 | 0:23:04 | 0:24:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300227 |
|
2018-12-01 05:20:45 | 2018-12-11 20:07:29 | 2018-12-11 22:49:30 | 2:42:01 | 1:59:15 | 0:42:46 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-12-11 21:28:23.192081 mon.b mon.0 158.69.71.70:6789/0 138 : cluster [WRN] Health check failed: 61 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300228 |
|
2018-12-01 05:20:46 | 2018-12-11 20:07:30 | 2018-12-12 08:09:39 | 12:02:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| dead | 3300229 |
|
2018-12-01 05:20:46 | 2018-12-11 20:07:29 | 2018-12-12 08:24:08 | 12:16:39 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||||
| fail | 3300230 |
|
2018-12-01 05:20:47 | 2018-12-11 20:09:08 | 2018-12-11 22:17:09 | 2:08:01 | 1:45:14 | 0:22:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-11 20:49:26.014842 mon.a mon.0 158.69.66.152:6789/0 144 : cluster [WRN] Health check failed: 127 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300231 |
|
2018-12-01 05:20:48 | 2018-12-11 20:10:51 | 2018-12-12 08:18:08 | 12:07:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3300232 |
|
2018-12-01 05:20:48 | 2018-12-11 20:20:14 | 2018-12-11 23:58:08 | 3:37:54 | 3:18:36 | 0:19:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300233 |
|
2018-12-01 05:20:49 | 2018-12-11 20:28:55 | 2018-12-11 21:12:55 | 0:44:00 | 0:28:03 | 0:15:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300234 |
|
2018-12-01 05:20:50 | 2018-12-11 20:29:02 | 2018-12-12 08:31:13 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| dead | 3300235 |
|
2018-12-01 05:20:51 | 2018-12-11 20:37:14 | 2018-12-12 08:44:22 | 12:07:08 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3300236 |
|
2018-12-01 05:20:51 | 2018-12-11 20:37:15 | 2018-12-11 22:17:15 | 1:40:00 | 0:45:42 | 0:54:18 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3300237 |
|
2018-12-01 05:20:52 | 2018-12-11 20:37:15 | 2018-12-12 01:51:19 | 5:14:04 | 0:29:05 | 4:44:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
Test failure: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) |
||||||||||||||
| pass | 3300238 |
|
2018-12-01 05:20:53 | 2018-12-11 20:38:59 | 2018-12-11 21:58:59 | 1:20:00 | 1:02:24 | 0:17:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300239 |
|
2018-12-01 05:20:53 | 2018-12-11 20:41:40 | 2018-12-11 22:15:40 | 1:34:00 | 1:09:59 | 0:24:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-11 21:29:20.506725 mon.b mon.0 158.69.64.66:6789/0 141 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300240 |
|
2018-12-01 05:20:54 | 2018-12-11 20:45:04 | 2018-12-12 03:55:10 | 7:10:06 | 0:29:52 | 6:40:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300241 |
|
2018-12-01 05:20:55 | 2018-12-11 20:55:42 | 2018-12-11 23:03:43 | 2:08:01 | 1:48:33 | 0:19:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300242 |
|
2018-12-01 05:20:56 | 2018-12-11 20:57:38 | 2018-12-11 23:25:40 | 2:28:02 | 1:45:01 | 0:43:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3300243 |
|
2018-12-01 05:20:56 | 2018-12-11 21:02:54 | 2018-12-12 09:05:04 | 12:02:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| pass | 3300244 |
|
2018-12-01 05:20:57 | 2018-12-11 21:07:10 | 2018-12-11 22:53:11 | 1:46:01 | 1:27:33 | 0:18:28 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300245 |
|
2018-12-01 05:20:58 | 2018-12-11 21:09:33 | 2018-12-11 21:51:33 | 0:42:00 | 0:19:17 | 0:22:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3300246 |
|
2018-12-01 05:20:59 | 2018-12-11 21:13:08 | 2018-12-12 09:15:19 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | — | ||||
| fail | 3300247 |
|
2018-12-01 05:20:59 | 2018-12-11 21:19:39 | 2018-12-11 23:01:40 | 1:42:01 | 1:23:49 | 0:18:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-11 22:07:54.406572 mon.a mon.0 158.69.65.140:6789/0 153 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300248 |
|
2018-12-01 05:21:00 | 2018-12-11 21:21:40 | 2018-12-11 22:27:40 | 1:06:00 | 0:19:34 | 0:46:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3300249 |
|
2018-12-01 05:21:01 | 2018-12-11 21:35:41 | 2018-12-12 09:37:53 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | ||||
| pass | 3300250 |
|
2018-12-01 05:21:01 | 2018-12-11 21:51:46 | 2018-12-11 22:31:46 | 0:40:00 | 0:16:37 | 0:23:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300251 |
|
2018-12-01 05:21:02 | 2018-12-11 21:57:31 | 2018-12-11 22:25:31 | 0:28:00 | 0:18:00 | 0:10:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300252 |
|
2018-12-01 05:21:03 | 2018-12-11 21:59:12 | 2018-12-12 00:33:13 | 2:34:01 | 2:01:10 | 0:32:51 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-12-11 23:04:03.916823 mon.a mon.0 158.69.66.163:6789/0 161 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec. Implicated osds 3,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300253 |
|
2018-12-01 05:21:04 | 2018-12-11 22:01:43 | 2018-12-12 10:03:54 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| pass | 3300254 |
|
2018-12-01 05:21:04 | 2018-12-11 22:05:43 | 2018-12-11 23:47:44 | 1:42:01 | 1:11:30 | 0:30:31 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| dead | 3300255 |
|
2018-12-01 05:21:05 | 2018-12-11 22:15:54 | 2018-12-12 10:23:05 | 12:07:11 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||||
| dead | 3300256 |
|
2018-12-01 05:21:06 | 2018-12-11 22:17:22 | 2018-12-12 10:19:33 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | ||||
| pass | 3300257 |
|
2018-12-01 05:21:07 | 2018-12-11 22:17:22 | 2018-12-11 23:51:23 | 1:34:01 | 1:18:40 | 0:15:21 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300258 |
|
2018-12-01 05:21:07 | 2018-12-11 22:23:46 | 2018-12-11 23:01:46 | 0:38:00 | 0:27:00 | 0:11:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3300259 |
|
2018-12-01 05:21:08 | 2018-12-11 22:25:43 | 2018-12-12 00:11:44 | 1:46:01 | 0:39:49 | 1:06:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3300260 |
|
2018-12-01 05:21:09 | 2018-12-11 22:25:43 | 2018-12-12 10:32:53 | 12:07:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| fail | 3300261 |
|
2018-12-01 05:21:10 | 2018-12-11 22:27:43 | 2018-12-12 00:49:44 | 2:22:01 | 1:59:20 | 0:22:41 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Found coredumps on ubuntu@ovh022.front.sepia.ceph.com |
||||||||||||||
| dead | 3300262 |
|
2018-12-01 05:21:10 | 2018-12-11 22:27:43 | 2018-12-12 10:30:37 | 12:02:54 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3300263 |
|
2018-12-01 05:21:11 | 2018-12-11 22:31:48 | 2018-12-11 23:51:48 | 1:20:00 | 1:03:25 | 0:16:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-12-11 23:24:17.919560 mon.b mon.0 158.69.64.28:6789/0 149 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 3300264 |
|
2018-12-01 05:21:12 | 2018-12-11 22:40:56 | 2018-12-12 00:44:57 | 2:04:01 | 1:44:41 | 0:19:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-11 23:21:44.611451 mon.a mon.0 158.69.69.251:6789/0 164 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300265 |
|
2018-12-01 05:21:12 | 2018-12-11 22:49:42 | 2018-12-12 03:25:46 | 4:36:04 | 0:28:33 | 4:07:31 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300266 |
|
2018-12-01 05:21:13 | 2018-12-11 22:53:25 | 2018-12-11 23:37:25 | 0:44:00 | 0:35:09 | 0:08:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300267 |
|
2018-12-01 05:21:14 | 2018-12-11 23:01:54 | 2018-12-12 00:41:54 | 1:40:00 | 1:05:24 | 0:34:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3300268 |
|
2018-12-01 05:21:15 | 2018-12-11 23:01:54 | 2018-12-12 01:03:55 | 2:02:01 | 0:43:29 | 1:18:32 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300269 |
|
2018-12-01 05:21:15 | 2018-12-11 23:03:56 | 2018-12-12 00:47:57 | 1:44:01 | 1:17:18 | 0:26:43 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Found coredumps on ubuntu@ovh028.front.sepia.ceph.com |
||||||||||||||
| pass | 3300270 |
|
2018-12-01 05:21:16 | 2018-12-11 23:20:51 | 2018-12-12 00:02:51 | 0:42:00 | 0:18:00 | 0:24:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3300271 |
|
2018-12-01 05:21:17 | 2018-12-11 23:22:13 | 2018-12-12 05:32:18 | 6:10:05 | 0:44:01 | 5:26:04 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300272 |
|
2018-12-01 05:21:17 | 2018-12-11 23:25:52 | 2018-12-12 02:09:54 | 2:44:02 | 1:49:42 | 0:54:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 00:46:16.302321 mon.b mon.0 158.69.70.56:6789/0 136 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300273 |
|
2018-12-01 05:21:18 | 2018-12-11 23:37:38 | 2018-12-12 00:05:37 | 0:27:59 | 0:18:46 | 0:09:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3300274 |
|
2018-12-01 05:21:19 | 2018-12-11 23:39:17 | 2018-12-12 11:41:28 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | — | ||||
| pass | 3300275 |
|
2018-12-01 05:21:20 | 2018-12-11 23:39:31 | 2018-12-12 00:23:30 | 0:43:59 | 0:16:04 | 0:27:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300276 |
|
2018-12-01 05:21:20 | 2018-12-11 23:47:58 | 2018-12-12 01:09:58 | 1:22:00 | 0:26:46 | 0:55:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3300277 |
|
2018-12-01 05:21:21 | 2018-12-11 23:51:35 | 2018-12-12 01:17:36 | 1:26:01 | 1:07:25 | 0:18:36 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3300278 |
|
2018-12-01 05:21:22 | 2018-12-11 23:51:49 | 2018-12-12 02:03:50 | 2:12:01 | 0:31:28 | 1:40:33 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300279 |
|
2018-12-01 05:21:23 | 2018-12-11 23:58:10 | 2018-12-12 02:38:12 | 2:40:02 | 1:42:40 | 0:57:22 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| fail | 3300280 |
|
2018-12-01 05:21:23 | 2018-12-12 00:03:03 | 2018-12-12 01:41:04 | 1:38:01 | 1:20:45 | 0:17:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 00:35:21.962756 mon.a mon.0 158.69.68.168:6789/0 156 : cluster [WRN] Health check failed: 107 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3300281 |
|
2018-12-01 05:21:24 | 2018-12-12 00:05:39 | 2018-12-12 09:19:48 | 9:14:09 | 0:27:42 | 8:46:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
Test failure: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair), test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) |
||||||||||||||
| pass | 3300282 |
|
2018-12-01 05:21:25 | 2018-12-12 00:07:54 | 2018-12-12 01:57:55 | 1:50:01 | 1:23:33 | 0:26:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300283 |
|
2018-12-01 05:21:26 | 2018-12-12 00:11:57 | 2018-12-12 01:33:57 | 1:22:00 | 0:29:42 | 0:52:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3300284 |
|
2018-12-01 05:21:26 | 2018-12-12 00:23:44 | 2018-12-12 04:41:48 | 4:18:04 | 0:24:04 | 3:54:00 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300285 |
|
2018-12-01 05:21:27 | 2018-12-12 00:33:26 | 2018-12-12 02:31:28 | 1:58:02 | 1:39:56 | 0:18:06 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3300286 |
|
2018-12-01 05:21:28 | 2018-12-12 00:41:57 | 2018-12-12 01:49:57 | 1:08:00 | 0:52:52 | 0:15:08 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh042 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b79a5246a73f0cad183f0e6c176e6d7208a50872 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| dead | 3300287 |
|
2018-12-01 05:21:29 | 2018-12-12 00:44:59 | 2018-12-12 12:47:11 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3300288 |
|
2018-12-01 05:21:29 | 2018-12-12 00:46:28 | 2018-12-12 01:52:29 | 1:06:01 | 0:47:52 | 0:18:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300289 |
|
2018-12-01 05:21:30 | 2018-12-12 00:48:09 | 2018-12-12 03:04:10 | 2:16:01 | 1:54:26 | 0:21:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 01:25:01.908423 mon.b mon.0 158.69.69.0:6789/0 233 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300290 |
|
2018-12-01 05:21:31 | 2018-12-12 00:49:56 | 2018-12-12 12:52:07 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | — | ||||
| pass | 3300291 |
|
2018-12-01 05:21:32 | 2018-12-12 00:57:43 | 2018-12-12 02:45:44 | 1:48:01 | 0:40:51 | 1:07:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3300292 |
|
2018-12-01 05:21:32 | 2018-12-12 01:00:23 | 2018-12-12 04:34:25 | 3:34:02 | 3:14:58 | 0:19:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-12-12 01:27:52.922609 mon.a mon.0 158.69.69.122:6789/0 168 : cluster [WRN] Health check failed: 1653 slow requests are blocked > 32 sec. Implicated osds 0,1,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300293 |
|
2018-12-01 05:21:33 | 2018-12-12 01:04:07 | 2018-12-12 13:06:18 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| pass | 3300294 |
|
2018-12-01 05:21:34 | 2018-12-12 01:10:00 | 2018-12-12 02:50:01 | 1:40:01 | 1:28:57 | 0:11:04 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300295 |
|
2018-12-01 05:21:35 | 2018-12-12 01:17:50 | 2018-12-12 01:59:50 | 0:42:00 | 0:22:05 | 0:19:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3300296 |
|
2018-12-01 05:21:35 | 2018-12-12 01:34:11 | 2018-12-12 13:36:22 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | — | ||||
| pass | 3300297 |
|
2018-12-01 05:21:36 | 2018-12-12 01:41:17 | 2018-12-12 03:47:18 | 2:06:01 | 1:23:05 | 0:42:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300298 |
|
2018-12-01 05:21:37 | 2018-12-12 01:50:10 | 2018-12-12 02:40:10 | 0:50:00 | 0:19:17 | 0:30:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3300299 |
|
2018-12-01 05:21:38 | 2018-12-12 01:51:31 | 2018-12-12 13:53:42 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | ||||
| pass | 3300300 |
|
2018-12-01 05:21:38 | 2018-12-12 01:52:30 | 2018-12-12 02:26:29 | 0:33:59 | 0:19:22 | 0:14:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300301 |
|
2018-12-01 05:21:39 | 2018-12-12 01:58:08 | 2018-12-12 02:52:07 | 0:53:59 | 0:30:06 | 0:23:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300302 |
|
2018-12-01 05:21:40 | 2018-12-12 02:00:02 | 2018-12-12 04:20:03 | 2:20:01 | 1:53:20 | 0:26:41 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-12-12 02:39:38.616693 mon.b mon.0 158.69.64.226:6789/0 140 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300303 |
|
2018-12-01 05:21:41 | 2018-12-12 02:04:02 | 2018-12-12 14:06:13 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3300304 |
|
2018-12-01 05:21:41 | 2018-12-12 02:10:08 | 2018-12-12 04:20:09 | 2:10:01 | 1:28:25 | 0:41:36 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 03:35:31.142656 mon.b mon.0 158.69.66.90:6789/0 3164 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3300305 |
|
2018-12-01 05:21:42 | 2018-12-12 02:22:14 | 2018-12-12 03:44:15 | 1:22:01 | 1:05:33 | 0:16:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3300306 |
|
2018-12-01 05:21:43 | 2018-12-12 03:47:35 | 2018-12-12 15:49:46 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | ||||
| pass | 3300307 |
|
2018-12-01 05:21:44 | 2018-12-12 03:52:26 | 2018-12-12 05:38:26 | 1:46:00 | 1:08:31 | 0:37:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300308 |
|
2018-12-01 05:21:44 | 2018-12-12 03:52:26 | 2018-12-12 04:38:26 | 0:46:00 | 0:30:21 | 0:15:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300309 |
|
2018-12-01 05:21:45 | 2018-12-12 03:55:12 | 2018-12-12 15:57:23 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | — | ||||
| fail | 3300310 |
|
2018-12-01 05:21:46 | 2018-12-12 03:56:34 | 2018-12-12 05:54:36 | 1:58:02 | 1:43:40 | 0:14:22 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-12-12 04:47:46.230711 mon.b mon.0 158.69.68.182:6789/0 325 : cluster [WRN] Health check failed: 75 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300311 |
|
2018-12-01 05:21:46 | 2018-12-12 04:03:53 | 2018-12-12 16:11:53 | 12:08:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||||
| dead | 3300312 |
|
2018-12-01 05:21:47 | 2018-12-12 04:10:30 | 2018-12-12 16:22:29 | 12:11:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3300313 |
|
2018-12-01 05:21:48 | 2018-12-12 04:20:17 | 2018-12-12 05:52:17 | 1:32:00 | 0:57:29 | 0:34:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300314 |
|
2018-12-01 05:21:49 | 2018-12-12 04:20:17 | 2018-12-12 05:40:17 | 1:20:00 | 1:00:44 | 0:19:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 04:52:12.654140 mon.b mon.0 158.69.67.103:6789/0 142 : cluster [WRN] Health check failed: 11 slow requests are blocked > 32 sec. Implicated osds 0,2,4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300315 |
|
2018-12-01 05:21:49 | 2018-12-12 04:26:37 | 2018-12-12 16:28:47 | 12:02:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| pass | 3300316 |
|
2018-12-01 05:21:50 | 2018-12-12 04:34:38 | 2018-12-12 05:48:38 | 1:14:00 | 0:53:18 | 0:20:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3300317 |
|
2018-12-01 05:21:51 | 2018-12-12 04:36:13 | 2018-12-12 07:26:14 | 2:50:01 | 2:32:11 | 0:17:50 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-12-12 05:09:50.109346 mon.a mon.0 158.69.68.212:6789/0 157 : cluster [WRN] Health check failed: 11 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300318 |
|
2018-12-01 05:21:52 | 2018-12-12 04:38:37 | 2018-12-12 09:04:40 | 4:26:03 | 0:35:14 | 3:50:49 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300319 |
|
2018-12-01 05:21:53 | 2018-12-12 04:41:59 | 2018-12-12 06:30:00 | 1:48:01 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||||
Failure Reason:
Command failed on ovh011 with status 2: 'sudo dpkg -i /tmp/linux-image.deb' |
||||||||||||||
| pass | 3300320 |
|
2018-12-01 05:21:53 | 2018-12-12 04:45:53 | 2018-12-12 06:11:54 | 1:26:01 | 0:20:49 | 1:05:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3300321 |
|
2018-12-01 05:21:54 | 2018-12-12 11:41:45 | 2018-12-12 18:21:50 | 6:40:05 | 0:48:48 | 5:51:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300322 |
|
2018-12-01 05:21:55 | 2018-12-12 11:44:31 | 2018-12-12 13:54:32 | 2:10:01 | 1:39:58 | 0:30:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 13:01:45.141986 mon.b mon.0 158.69.69.148:6789/0 178 : cluster [WRN] Health check failed: Degraded data redundancy: 2565/10284 objects degraded (24.942%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| pass | 3300323 |
|
2018-12-01 05:21:56 | 2018-12-12 11:46:57 | 2018-12-12 13:32:57 | 1:46:00 | 0:33:51 | 1:12:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300324 |
|
2018-12-01 05:21:56 | 2018-12-12 11:49:01 | 2018-12-12 20:41:09 | 8:52:08 | 0:25:55 | 8:26:13 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300325 |
|
2018-12-01 05:21:57 | 2018-12-12 11:51:15 | 2018-12-12 12:39:14 | 0:47:59 | 0:26:08 | 0:21:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300326 |
|
2018-12-01 05:21:58 | 2018-12-12 11:53:23 | 2018-12-12 12:41:22 | 0:47:59 | 0:31:49 | 0:16:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300327 |
|
2018-12-01 05:21:58 | 2018-12-12 11:54:25 | 2018-12-12 14:50:27 | 2:56:02 | 1:50:24 | 1:05:38 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-12-12 13:34:07.838692 mon.b mon.0 158.69.66.132:6789/0 140 : cluster [WRN] Health check failed: 185 slow requests are blocked > 32 sec. Implicated osds 4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300328 |
|
2018-12-01 05:21:59 | 2018-12-12 11:58:58 | 2018-12-12 15:49:01 | 3:50:03 | 0:35:58 | 3:14:05 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300329 |
|
2018-12-01 05:22:00 | 2018-12-12 12:00:12 | 2018-12-12 14:26:13 | 2:26:01 | 1:58:00 | 0:28:01 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed on ovh070 with status 1: 'sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-4 --journal-path /var/lib/ceph/osd/ceph-4/journal --log-file=/var/log/ceph/objectstore_tool.\\$pid.log --op export --pgid 3.2s3 --file /home/ubuntu/cephtest/ceph.data/exp.3.2s3.4' |
||||||||||||||
| fail | 3300330 |
|
2018-12-01 05:22:01 | 2018-12-12 12:00:51 | 2018-12-12 13:40:52 | 1:40:01 | 1:22:48 | 0:17:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 12:44:15.974381 mon.a mon.0 158.69.70.251:6789/0 255 : cluster [WRN] Health check failed: 68 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300331 |
|
2018-12-01 05:22:01 | 2018-12-12 12:01:37 | 2018-12-13 00:03:48 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3300332 |
|
2018-12-01 05:22:02 | 2018-12-12 12:05:02 | 2018-12-12 14:59:04 | 2:54:02 | 2:18:44 | 0:35:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300333 |
|
2018-12-01 05:22:03 | 2018-12-12 12:06:52 | 2018-12-12 13:06:52 | 1:00:00 | 0:36:00 | 0:24:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300334 |
|
2018-12-01 05:22:03 | 2018-12-12 12:06:59 | 2018-12-13 00:09:11 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| pass | 3300335 |
|
2018-12-01 05:22:04 | 2018-12-12 12:07:08 | 2018-12-12 13:39:09 | 1:32:01 | 1:18:24 | 0:13:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3300336 |
|
2018-12-01 05:22:05 | 2018-12-12 12:07:32 | 2018-12-12 14:05:33 | 1:58:01 | 1:01:25 | 0:56:36 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b79a5246a73f0cad183f0e6c176e6d7208a50872 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| dead | 3300337 |
|
2018-12-01 05:22:06 | 2018-12-12 12:07:48 | 2018-12-13 00:09:59 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3300338 |
|
2018-12-01 05:22:06 | 2018-12-12 12:16:45 | 2018-12-12 14:24:46 | 2:08:01 | 0:47:29 | 1:20:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300339 |
|
2018-12-01 05:22:07 | 2018-12-12 12:16:45 | 2018-12-12 13:56:45 | 1:40:00 | 1:24:08 | 0:15:52 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 13:01:24.760589 mon.a mon.0 158.69.66.238:6789/0 152 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300340 |
|
2018-12-01 05:22:08 | 2018-12-12 12:16:45 | 2018-12-13 00:19:01 | 12:02:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | — | ||||
| fail | 3300341 |
|
2018-12-01 05:22:08 | 2018-12-12 12:18:48 | 2018-12-12 14:08:49 | 1:50:01 | 1:02:45 | 0:47:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-12-12 13:44:48.352184 mon.b mon.0 158.69.72.141:6789/0 136 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300342 |
|
2018-12-01 05:22:09 | 2018-12-12 12:23:11 | 2018-12-12 14:43:12 | 2:20:01 | 0:54:04 | 1:25:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3300343 |
|
2018-12-01 05:22:10 | 2018-12-12 12:24:49 | 2018-12-13 00:08:59 | 11:44:10 | 0:32:04 | 11:12:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300344 |
|
2018-12-01 05:22:11 | 2018-12-12 12:39:18 | 2018-12-12 14:31:19 | 1:52:01 | 1:39:05 | 0:12:56 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Scrubbing terminated -- not all pgs were active and clean. |
||||||||||||||
| fail | 3300345 |
|
2018-12-01 05:22:11 | 2018-12-12 12:40:49 | 2018-12-12 13:18:48 | 0:37:59 | 0:18:27 | 0:19:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
Failure Reason:
"2018-12-12 13:05:10.941786 mon.a mon.0 158.69.70.45:6789/0 148 : cluster [WRN] Health check failed: 8 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300346 |
|
2018-12-01 05:22:12 | 2018-12-12 12:41:39 | 2018-12-12 17:21:43 | 4:40:04 | 1:23:34 | 3:16:30 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300347 |
|
2018-12-01 05:22:13 | 2018-12-12 12:44:43 | 2018-12-12 15:00:44 | 2:16:01 | 1:37:49 | 0:38:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 13:41:37.585347 mon.a mon.0 158.69.68.167:6789/0 170 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300348 |
|
2018-12-01 05:22:14 | 2018-12-12 12:47:13 | 2018-12-12 13:35:13 | 0:48:00 | 0:33:12 | 0:14:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300349 |
|
2018-12-01 05:22:15 | 2018-12-12 12:48:28 | 2018-12-12 15:22:34 | 2:34:06 | 0:50:45 | 1:43:21 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300350 |
|
2018-12-01 05:22:15 | 2018-12-12 12:49:53 | 2018-12-12 14:07:53 | 1:18:00 | 0:21:15 | 0:56:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300351 |
|
2018-12-01 05:22:16 | 2018-12-12 12:52:19 | 2018-12-12 13:34:19 | 0:42:00 | 0:19:15 | 0:22:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300352 |
|
2018-12-01 05:22:17 | 2018-12-12 12:53:04 | 2018-12-12 15:25:05 | 2:32:01 | 1:31:34 | 1:00:27 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-12-12 14:05:52.856692 mon.b mon.0 158.69.72.30:6789/0 229 : cluster [WRN] Health check failed: 6 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300353 |
|
2018-12-01 05:22:18 | 2018-12-12 13:03:23 | 2018-12-12 19:03:28 | 6:00:05 | 0:28:54 | 5:31:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300354 |
|
2018-12-01 05:22:18 | 2018-12-12 13:06:32 | 2018-12-12 14:34:32 | 1:28:00 | 1:04:33 | 0:23:27 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 14:13:59.777490 mon.b mon.0 158.69.66.34:6789/0 2812 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 3300355 |
|
2018-12-01 05:22:19 | 2018-12-12 13:06:53 | 2018-12-12 17:12:56 | 4:06:03 | 2:52:40 | 1:13:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 15:20:05.417788 mon.b mon.1 158.69.70.100:6789/0 35 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 3300356 |
|
2018-12-01 05:22:20 | 2018-12-12 13:12:51 | 2018-12-12 18:30:55 | 5:18:04 | 0:31:09 | 4:46:55 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300357 |
|
2018-12-01 05:22:21 | 2018-12-12 13:19:03 | 2018-12-12 17:29:06 | 4:10:03 | 2:47:57 | 1:22:06 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300358 |
|
2018-12-01 05:22:21 | 2018-12-12 13:24:50 | 2018-12-12 14:28:50 | 1:04:00 | 0:34:21 | 0:29:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3300359 |
|
2018-12-01 05:22:22 | 2018-12-12 13:33:00 | 2018-12-12 22:17:07 | 8:44:07 | 0:35:19 | 8:08:48 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3300360 |
|
2018-12-01 05:22:23 | 2018-12-12 13:34:23 | 2018-12-13 01:41:30 | 12:07:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3300361 |
|
2018-12-01 05:22:24 | 2018-12-12 13:34:32 | 2018-12-12 17:08:35 | 3:34:03 | 2:42:42 | 0:51:21 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3300362 |
|
2018-12-01 05:22:24 | 2018-12-12 13:35:14 | 2018-12-13 01:42:37 | 12:07:23 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3300363 |
|
2018-12-01 05:22:25 | 2018-12-12 13:36:35 | 2018-12-12 14:58:36 | 1:22:01 | 0:56:05 | 0:25:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300364 |
|
2018-12-01 05:22:26 | 2018-12-12 13:39:22 | 2018-12-12 14:59:22 | 1:20:00 | 0:47:29 | 0:32:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 14:44:47.199205 mon.a mon.0 158.69.65.239:6789/0 142 : cluster [WRN] Health check failed: 254 slow requests are blocked > 32 sec. Implicated osds 0,1,3,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300365 |
|
2018-12-01 05:22:27 | 2018-12-12 13:41:05 | 2018-12-13 01:43:15 | 12:02:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| pass | 3300366 |
|
2018-12-01 05:22:28 | 2018-12-12 13:53:45 | 2018-12-12 15:05:45 | 1:12:00 | 0:37:20 | 0:34:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300367 |
|
2018-12-01 05:22:28 | 2018-12-12 13:54:43 | 2018-12-12 15:08:43 | 1:14:00 | 1:01:03 | 0:12:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3300368 |
|
2018-12-01 05:22:29 | 2018-12-12 13:56:58 | 2018-12-13 01:59:09 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | ||||
| dead | 3300369 |
|
2018-12-01 05:22:30 | 2018-12-12 14:05:45 | 2018-12-13 02:13:06 | 12:07:21 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||||
| pass | 3300370 |
|
2018-12-01 05:22:31 | 2018-12-12 14:06:14 | 2018-12-12 14:50:14 | 0:44:00 | 0:33:03 | 0:10:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| fail | 3300371 |
|
2018-12-01 05:22:31 | 2018-12-12 14:07:07 | 2018-12-12 22:45:15 | 8:38:08 | 0:42:47 | 7:55:21 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-12-12 22:18:35.454592 mon.a mon.0 158.69.65.206:6789/0 356 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300372 |
|
2018-12-01 05:22:32 | 2018-12-12 14:07:54 | 2018-12-12 16:43:56 | 2:36:02 | 1:49:23 | 0:46:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300373 |
|
2018-12-01 05:22:33 | 2018-12-12 14:09:02 | 2018-12-12 15:31:02 | 1:22:00 | 0:19:23 | 1:02:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300374 |
|
2018-12-01 05:22:34 | 2018-12-12 14:13:12 | 2018-12-12 19:15:16 | 5:02:04 | 0:33:05 | 4:28:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300375 |
|
2018-12-01 05:22:34 | 2018-12-12 14:24:58 | 2018-12-12 15:10:58 | 0:46:00 | 0:26:29 | 0:19:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300376 |
|
2018-12-01 05:22:35 | 2018-12-12 14:26:26 | 2018-12-12 15:48:26 | 1:22:00 | 0:17:31 | 1:04:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300377 |
|
2018-12-01 05:22:36 | 2018-12-12 14:29:02 | 2018-12-12 17:35:04 | 3:06:02 | 1:52:25 | 1:13:37 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-12-12 16:28:02.916298 mon.b mon.0 158.69.66.249:6789/0 238 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300378 |
|
2018-12-01 05:22:37 | 2018-12-12 14:31:21 | 2018-12-12 23:13:29 | 8:42:08 | 0:25:59 | 8:16:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300379 |
|
2018-12-01 05:22:37 | 2018-12-12 14:34:34 | 2018-12-12 17:56:37 | 3:22:03 | 2:49:25 | 0:32:38 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| fail | 3300380 |
|
2018-12-01 05:22:38 | 2018-12-12 14:43:15 | 2018-12-12 17:25:16 | 2:42:01 | 2:25:09 | 0:16:52 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 15:22:37.716602 mon.b mon.0 158.69.64.18:6789/0 247 : cluster [WRN] Health check failed: 43 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300381 |
|
2018-12-01 05:22:39 | 2018-12-12 14:50:30 | 2018-12-13 02:57:57 | 12:07:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| dead | 3300382 |
|
2018-12-01 05:22:40 | 2018-12-12 14:50:30 | 2018-12-13 02:53:19 | 12:02:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||||
| pass | 3300383 |
|
2018-12-01 05:22:41 | 2018-12-12 14:58:49 | 2018-12-12 15:34:48 | 0:35:59 | 0:26:48 | 0:09:11 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300384 |
|
2018-12-01 05:22:41 | 2018-12-12 14:59:05 | 2018-12-13 03:01:15 | 12:02:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| dead | 3300385 |
|
2018-12-01 05:22:42 | 2018-12-12 14:59:23 | 2018-12-13 03:11:18 | 12:11:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| fail | 3300386 |
|
2018-12-01 05:22:43 | 2018-12-12 15:00:56 | 2018-12-12 17:28:58 | 2:28:02 | 2:07:15 | 0:20:47 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 16:45:20.034552 mon.a mon.0 158.69.66.59:6789/0 1623 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| dead | 3300387 |
|
2018-12-01 05:22:44 | 2018-12-12 15:05:47 | 2018-12-13 03:07:58 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3300388 |
|
2018-12-01 05:22:44 | 2018-12-12 15:08:57 | 2018-12-12 16:08:57 | 1:00:00 | 0:47:44 | 0:12:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300389 |
|
2018-12-01 05:22:45 | 2018-12-12 15:11:10 | 2018-12-12 17:39:12 | 2:28:02 | 2:07:25 | 0:20:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 16:38:46.722563 mon.a mon.0 158.69.70.66:6789/0 1684 : cluster [ERR] Health check failed: mon a is very low on available space (MON_DISK_CRIT)" in cluster log |
||||||||||||||
| pass | 3300390 |
|
2018-12-01 05:22:46 | 2018-12-12 15:22:48 | 2018-12-12 22:58:55 | 7:36:07 | 0:25:40 | 7:10:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300391 |
|
2018-12-01 05:22:47 | 2018-12-12 15:25:08 | 2018-12-12 18:29:09 | 3:04:01 | 0:53:13 | 2:10:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300392 |
|
2018-12-01 05:22:47 | 2018-12-12 15:31:04 | 2018-12-12 17:23:05 | 1:52:01 | 0:39:11 | 1:12:50 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3300393 |
|
2018-12-01 05:22:48 | 2018-12-12 15:34:50 | 2018-12-13 03:37:01 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| fail | 3300394 |
|
2018-12-01 05:22:49 | 2018-12-12 15:48:40 | 2018-12-12 20:20:44 | 4:32:04 | 4:01:37 | 0:30:27 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh041 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b79a5246a73f0cad183f0e6c176e6d7208a50872 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3300395 |
|
2018-12-01 05:22:50 | 2018-12-12 15:49:02 | 2018-12-12 16:43:02 | 0:54:00 | 0:18:19 | 0:35:41 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3300396 |
|
2018-12-01 05:22:50 | 2018-12-12 15:49:58 | 2018-12-12 20:38:02 | 4:48:04 | 1:06:22 | 3:41:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300397 |
|
2018-12-01 05:22:51 | 2018-12-12 15:57:25 | 2018-12-12 19:17:27 | 3:20:02 | 1:41:10 | 1:38:52 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 17:51:54.143940 mon.b mon.0 158.69.65.239:6789/0 253 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300398 |
|
2018-12-01 05:22:52 | 2018-12-12 16:08:59 | 2018-12-12 17:06:59 | 0:58:00 | 0:36:37 | 0:21:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300399 |
|
2018-12-01 05:22:53 | 2018-12-12 16:11:55 | 2018-12-12 20:17:58 | 4:06:03 | 0:51:53 | 3:14:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300400 |
|
2018-12-01 05:22:54 | 2018-12-12 16:22:42 | 2018-12-12 18:20:43 | 1:58:01 | 0:27:56 | 1:30:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300401 |
|
2018-12-01 05:22:55 | 2018-12-12 16:28:59 | 2018-12-12 17:10:59 | 0:42:00 | 0:18:53 | 0:23:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3300402 |
|
2018-12-01 05:22:55 | 2018-12-12 16:43:14 | 2018-12-12 21:55:18 | 5:12:04 | 4:03:57 | 1:08:07 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
| pass | 3300403 |
|
2018-12-01 05:22:56 | 2018-12-12 16:43:57 | 2018-12-12 18:19:58 | 1:36:01 | 0:35:19 | 1:00:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300404 |
|
2018-12-01 05:22:57 | 2018-12-12 17:07:13 | 2018-12-12 18:27:13 | 1:20:00 | 0:52:50 | 0:27:10 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3300405 |
|
2018-12-01 05:22:58 | 2018-12-12 17:08:40 | 2018-12-12 19:12:41 | 2:04:01 | 1:28:19 | 0:35:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 18:13:21.720950 mon.b mon.0 158.69.67.202:6789/0 235 : cluster [WRN] Health check failed: 94 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300406 |
|
2018-12-01 05:22:59 | 2018-12-12 17:11:01 | 2018-12-12 19:09:02 | 1:58:01 | 0:27:31 | 1:30:30 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300407 |
|
2018-12-01 05:22:59 | 2018-12-12 17:13:09 | 2018-12-12 19:05:10 | 1:52:01 | 1:30:53 | 0:21:08 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3300408 |
|
2018-12-01 05:23:00 | 2018-12-12 17:21:56 | 2018-12-12 18:15:56 | 0:54:00 | 0:39:37 | 0:14:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3300409 |
|
2018-12-01 05:23:01 | 2018-12-12 17:23:18 | 2018-12-13 02:55:26 | 9:32:08 | 0:30:31 | 9:01:37 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300410 |
|
2018-12-01 05:23:02 | 2018-12-12 17:25:30 | 2018-12-12 20:17:32 | 2:52:02 | 1:46:50 | 1:05:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-12-12 19:13:59.803669 mon.b mon.0 158.69.68.68:6789/0 430 : cluster [WRN] Health check failed: 20 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300411 |
|
2018-12-01 05:23:02 | 2018-12-12 17:29:10 | 2018-12-12 19:59:12 | 2:30:02 | 1:31:56 | 0:58:06 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3300412 |
|
2018-12-01 05:23:03 | 2018-12-12 17:29:10 | 2018-12-13 05:36:22 | 12:07:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3300413 |
|
2018-12-01 05:23:04 | 2018-12-12 17:35:06 | 2018-12-12 18:51:07 | 1:16:01 | 0:55:42 | 0:20:19 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| dead | 3300414 |
|
2018-12-01 05:23:05 | 2018-12-12 17:39:14 | 2018-12-13 05:55:43 | 12:16:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||||
| dead | 3300415 |
|
2018-12-01 05:23:05 | 2018-12-12 17:56:52 | 2018-12-13 05:59:03 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| pass | 3300416 |
|
2018-12-01 05:23:06 | 2018-12-12 18:15:59 | 2018-12-12 18:57:59 | 0:42:00 | 0:33:06 | 0:08:54 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3300417 |
|
2018-12-01 05:23:07 | 2018-12-12 18:20:10 | 2018-12-12 22:08:13 | 3:48:03 | 3:07:36 | 0:40:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-12-12 21:14:21.353559 mon.a mon.0 158.69.70.251:6789/0 153 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300418 |
|
2018-12-01 05:23:08 | 2018-12-12 18:20:44 | 2018-12-13 06:22:55 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | ||||
| fail | 3300419 |
|
2018-12-01 05:23:08 | 2018-12-12 18:21:52 | 2018-12-12 20:29:53 | 2:08:01 | 1:22:57 | 0:45:04 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 19:43:04.444010 mon.b mon.0 158.69.69.16:6789/0 77 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3300420 |
|
2018-12-01 05:23:09 | 2018-12-12 18:27:25 | 2018-12-12 18:59:25 | 0:32:00 | 0:17:30 | 0:14:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3300421 |
|
2018-12-01 05:23:10 | 2018-12-12 18:29:22 | 2018-12-12 20:07:23 | 1:38:01 | 0:46:52 | 0:51:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300422 |
|
2018-12-01 05:23:11 | 2018-12-12 18:31:09 | 2018-12-12 20:19:10 | 1:48:01 | 1:28:22 | 0:19:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 19:21:23.681478 mon.b mon.0 158.69.64.219:6789/0 141 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300423 |
|
2018-12-01 05:23:12 | 2018-12-12 18:51:21 | 2018-12-12 19:33:21 | 0:42:00 | 0:23:33 | 0:18:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3300424 |
|
2018-12-01 05:23:12 | 2018-12-12 18:58:01 | 2018-12-12 21:40:03 | 2:42:02 | 0:36:00 | 2:06:02 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300425 |
|
2018-12-01 05:23:13 | 2018-12-12 18:59:27 | 2018-12-12 19:35:27 | 0:36:00 | 0:21:51 | 0:14:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3300426 |
|
2018-12-01 05:23:14 | 2018-12-12 19:03:42 | 2018-12-12 20:31:42 | 1:28:00 | 0:42:03 | 0:45:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3300427 |
|
2018-12-01 05:23:15 | 2018-12-12 19:05:12 | 2018-12-12 21:37:14 | 2:32:02 | 1:04:54 | 1:27:08 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3300428 |
|
2018-12-01 05:23:16 | 2018-12-12 19:09:14 | 2018-12-13 00:21:18 | 5:12:04 | 0:37:37 | 4:34:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3300429 |
|
2018-12-01 05:23:16 | 2018-12-12 19:12:54 | 2018-12-12 21:32:56 | 2:20:02 | 1:56:33 | 0:23:29 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed on ovh095 with status 1: 'sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --log-file=/var/log/ceph/objectstore_tool.\\$pid.log --op export --pgid 3.2s1 --file /home/ubuntu/cephtest/ceph.data/exp.3.2s1.5' |
||||||||||||||
| fail | 3300430 |
|
2018-12-01 05:23:17 | 2018-12-12 19:15:29 | 2018-12-12 21:21:30 | 2:06:01 | 1:20:33 | 0:45:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-12-12 20:14:19.590965 mon.a mon.0 158.69.70.235:6789/0 168 : cluster [WRN] Health check failed: 127 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3300431 |
|
2018-12-01 05:23:18 | 2018-12-12 19:17:30 | 2018-12-13 07:19:40 | 12:02:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3300432 |
|
2018-12-01 05:23:19 | 2018-12-12 19:33:34 | 2018-12-12 21:55:35 | 2:22:01 | 1:39:30 | 0:42:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-12-12 20:33:01.246797 mon.b mon.1 158.69.73.242:6789/0 21 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 3300433 |
|
2018-12-01 05:23:19 | 2018-12-12 19:35:40 | 2018-12-12 21:17:40 | 1:42:00 | 0:28:27 | 1:13:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3300434 |
|
2018-12-01 05:23:20 | 2018-12-12 19:59:24 | 2018-12-13 08:01:35 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| pass | 3300435 |
|
2018-12-01 05:23:21 | 2018-12-12 20:07:25 | 2018-12-12 22:03:26 | 1:56:01 | 1:42:54 | 0:13:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3300436 |
|
2018-12-01 05:23:22 | 2018-12-12 20:17:34 | 2018-12-12 21:23:34 | 1:06:00 | 0:45:45 | 0:20:15 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b79a5246a73f0cad183f0e6c176e6d7208a50872 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| dead | 3300437 |
|
2018-12-01 05:23:22 | 2018-12-12 20:17:59 | 2018-12-13 08:20:10 | 12:02:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3300438 |
|
2018-12-01 05:23:23 | 2018-12-12 20:19:12 | 2018-12-12 21:35:12 | 1:16:00 | 0:59:00 | 0:17:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3300439 |
|
2018-12-01 05:23:24 | 2018-12-12 20:20:57 | 2018-12-12 21:46:57 | 1:26:00 | 1:00:28 | 0:25:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-12-12 20:59:01.954877 mon.a mon.0 158.69.67.149:6789/0 154 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300440 |
|
2018-12-01 05:23:25 | 2018-12-12 20:30:06 | 2018-12-12 23:46:08 | 3:16:02 | 0:35:11 | 2:40:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3300441 |
|
2018-12-01 05:23:26 | 2018-12-12 20:31:54 | 2018-12-12 21:43:54 | 1:12:00 | 0:44:15 | 0:27:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3300442 |
|
2018-12-01 05:23:26 | 2018-12-12 20:38:03 | 2018-12-12 22:46:04 | 2:08:01 | 1:52:18 | 0:15:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3300443 |
|
2018-12-01 05:23:27 | 2018-12-12 20:41:20 | 2018-12-13 08:43:32 | 12:02:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| pass | 3300444 |
|
2018-12-01 05:23:28 | 2018-12-12 21:17:52 | 2018-12-12 23:41:54 | 2:24:02 | 1:41:19 | 0:42:43 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3300445 |
|
2018-12-01 05:23:29 | 2018-12-12 21:21:42 | 2018-12-12 22:21:42 | 1:00:00 | 0:24:12 | 0:35:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| fail | 3300446 |
|
2018-12-01 05:23:30 | 2018-12-12 21:23:44 | 2018-12-13 01:45:48 | 4:22:04 | 1:03:13 | 3:18:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-12-13 01:04:52.323662 mon.a mon.0 158.69.70.187:6789/0 1090 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3300447 |
|
2018-12-01 05:23:30 | 2018-12-12 21:33:10 | 2018-12-12 23:19:10 | 1:46:00 | 1:29:30 | 0:16:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-12-12 22:05:36.881634 mon.b mon.0 158.69.64.136:6789/0 150 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3300448 |
|
2018-12-01 05:23:31 | 2018-12-12 21:35:25 | 2018-12-12 22:05:24 | 0:29:59 | 0:19:34 | 0:10:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3300449 |
|
2018-12-01 05:23:32 | 2018-12-12 21:37:26 | 2018-12-13 09:39:43 | 12:02:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | ||||
| pass | 3300450 |
|
2018-12-01 05:23:33 | 2018-12-12 21:40:05 | 2018-12-12 22:22:04 | 0:41:59 | 0:25:31 | 0:16:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
Pulpito