| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2018-10-06 05:20:02 | 2018-10-15 11:03:02 | 2018-10-17 02:21:56 | 1 day, 15:18:54 | kcephfs | luminous | ovh | 3375562 | 149 | 61 | 40 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3110835 |
|
2018-10-06 05:20:24 | 2018-10-15 11:03:02 | 2018-10-15 11:51:02 | 0:48:00 | 0:22:58 | 0:25:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3110836 |
|
2018-10-06 05:20:25 | 2018-10-15 11:04:04 | 2018-10-15 15:24:09 | 4:20:05 | 1:37:04 | 2:43:01 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-15 13:40:09.328906 mon.b mon.0 158.69.64.67:6789/0 224 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110837 |
|
2018-10-06 05:20:25 | 2018-10-15 11:06:51 | 2018-10-15 23:09:05 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3110838 |
|
2018-10-06 05:20:26 | 2018-10-15 11:10:44 | 2018-10-15 13:08:46 | 1:58:02 | 1:35:02 | 0:23:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Socket is closed |
||||||||||||||
| pass | 3110839 |
|
2018-10-06 05:20:27 | 2018-10-15 11:12:28 | 2018-10-15 13:06:29 | 1:54:01 | 1:06:08 | 0:47:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3110840 |
|
2018-10-06 05:20:28 | 2018-10-15 11:12:28 | 2018-10-15 23:14:42 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | ||||
| pass | 3110841 |
|
2018-10-06 05:20:28 | 2018-10-15 11:12:31 | 2018-10-15 13:52:33 | 2:40:02 | 1:38:09 | 1:01:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3110842 |
|
2018-10-06 05:20:29 | 2018-10-15 11:14:21 | 2018-10-15 12:20:21 | 1:06:00 | 0:26:34 | 0:39:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110843 |
|
2018-10-06 05:20:30 | 2018-10-15 11:15:50 | 2018-10-15 20:46:01 | 9:30:11 | 0:32:08 | 8:58:03 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110844 |
|
2018-10-06 05:20:30 | 2018-10-15 11:26:47 | 2018-10-15 13:52:49 | 2:26:02 | 1:34:33 | 0:51:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| pass | 3110845 |
|
2018-10-06 05:20:31 | 2018-10-15 11:27:13 | 2018-10-15 14:41:16 | 3:14:03 | 1:25:48 | 1:48:15 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3110846 |
|
2018-10-06 05:20:32 | 2018-10-15 11:27:24 | 2018-10-15 23:29:38 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | — | ||||
| pass | 3110847 |
|
2018-10-06 05:20:32 | 2018-10-15 11:43:35 | 2018-10-15 13:17:36 | 1:34:01 | 0:52:54 | 0:41:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110848 |
|
2018-10-06 05:20:33 | 2018-10-15 11:46:24 | 2018-10-15 13:22:25 | 1:36:01 | 0:57:51 | 0:38:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 12:39:25.620380 mon.b mon.0 158.69.66.8:6789/0 137 : cluster [WRN] Health check failed: 55 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110849 |
|
2018-10-06 05:20:34 | 2018-10-15 11:50:39 | 2018-10-15 23:52:54 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| pass | 3110850 |
|
2018-10-06 05:20:34 | 2018-10-15 11:51:03 | 2018-10-15 13:27:04 | 1:36:01 | 0:40:10 | 0:55:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3110851 |
|
2018-10-06 05:20:35 | 2018-10-15 11:54:45 | 2018-10-15 13:14:46 | 1:20:01 | 0:55:28 | 0:24:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3110852 |
|
2018-10-06 05:20:36 | 2018-10-15 11:56:47 | 2018-10-15 20:14:56 | 8:18:09 | 0:36:16 | 7:41:53 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110853 |
|
2018-10-06 05:20:36 | 2018-10-15 12:02:33 | 2018-10-15 13:36:34 | 1:34:01 | 1:16:17 | 0:17:44 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 12:52:21.543733 mon.b mon.0 158.69.65.225:6789/0 116 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3110854 |
|
2018-10-06 05:20:37 | 2018-10-15 12:02:33 | 2018-10-15 12:32:33 | 0:30:00 | 0:19:28 | 0:10:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3110855 |
|
2018-10-06 05:20:38 | 2018-10-15 12:02:54 | 2018-10-15 16:28:59 | 4:26:05 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | ||||
Failure Reason:
'ssh_keyscan ovh012.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds |
||||||||||||||
| fail | 3110856 |
|
2018-10-06 05:20:38 | 2018-10-15 12:08:19 | 2018-10-15 13:50:20 | 1:42:01 | 1:26:25 | 0:15:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-15 12:44:11.922379 mon.a mon.0 158.69.64.62:6789/0 154 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110857 |
|
2018-10-06 05:20:39 | 2018-10-15 12:10:15 | 2018-10-15 13:06:15 | 0:56:00 | 0:19:25 | 0:36:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3110858 |
|
2018-10-06 05:20:40 | 2018-10-15 12:12:06 | 2018-10-15 18:26:13 | 6:14:07 | 0:29:14 | 5:44:53 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110859 |
|
2018-10-06 05:20:41 | 2018-10-15 12:20:37 | 2018-10-15 13:36:37 | 1:16:00 | 0:16:26 | 0:59:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110860 |
|
2018-10-06 05:20:41 | 2018-10-15 12:25:37 | 2018-10-15 13:21:37 | 0:56:00 | 0:18:18 | 0:37:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3110861 |
|
2018-10-06 05:20:42 | 2018-10-15 12:26:26 | 2018-10-15 18:22:33 | 5:56:07 | 1:09:44 | 4:46:23 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| dead | 3110862 |
|
2018-10-06 05:20:43 | 2018-10-15 12:30:30 | 2018-10-16 00:32:44 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||
| fail | 3110863 |
|
2018-10-06 05:20:44 | 2018-10-15 12:32:28 | 2018-10-15 16:32:32 | 4:00:04 | 3:35:25 | 0:24:39 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh044 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3110864 |
|
2018-10-06 05:20:44 | 2018-10-15 12:32:34 | 2018-10-15 14:20:35 | 1:48:01 | 1:02:59 | 0:45:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3110865 |
|
2018-10-06 05:20:45 | 2018-10-15 12:38:28 | 2018-10-16 00:40:42 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3110866 |
|
2018-10-06 05:20:46 | 2018-10-15 12:38:28 | 2018-10-15 15:24:30 | 2:46:02 | 1:34:38 | 1:11:24 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-15 13:41:58.478835 mon.b mon.0 158.69.65.134:6789/0 267 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110867 |
|
2018-10-06 05:20:47 | 2018-10-15 13:06:30 | 2018-10-15 14:08:31 | 1:02:01 | 0:28:55 | 0:33:06 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110868 |
|
2018-10-06 05:20:47 | 2018-10-15 13:06:30 | 2018-10-16 00:14:43 | 11:08:13 | 0:23:03 | 10:45:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| dead | 3110869 |
|
2018-10-06 05:20:48 | 2018-10-15 13:08:55 | 2018-10-16 01:23:20 | 12:14:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3110870 |
|
2018-10-06 05:20:49 | 2018-10-15 13:14:52 | 2018-10-15 15:30:53 | 2:16:01 | 0:50:55 | 1:25:06 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| dead | 3110871 |
|
2018-10-06 05:20:50 | 2018-10-15 13:17:39 | 2018-10-16 01:19:53 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | ||||
| pass | 3110872 |
|
2018-10-06 05:20:50 | 2018-10-15 13:21:40 | 2018-10-15 15:29:42 | 2:08:02 | 0:51:13 | 1:16:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110873 |
|
2018-10-06 05:20:51 | 2018-10-15 13:22:32 | 2018-10-15 15:28:34 | 2:06:02 | 0:45:42 | 1:20:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 14:10:44.256540 mon.a mon.0 158.69.64.85:6789/0 153 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110874 |
|
2018-10-06 05:20:52 | 2018-10-15 13:22:33 | 2018-10-15 20:08:40 | 6:46:07 | 0:24:17 | 6:21:50 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110875 |
|
2018-10-06 05:20:52 | 2018-10-15 13:27:07 | 2018-10-15 15:37:13 | 2:10:06 | 0:42:34 | 1:27:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3110876 |
|
2018-10-06 05:20:53 | 2018-10-15 13:30:59 | 2018-10-15 15:37:01 | 2:06:02 | 0:58:20 | 1:07:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3110877 |
|
2018-10-06 05:20:54 | 2018-10-15 13:36:47 | 2018-10-15 17:52:51 | 4:16:04 | 0:26:53 | 3:49:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110878 |
|
2018-10-06 05:20:54 | 2018-10-15 13:36:47 | 2018-10-15 18:28:52 | 4:52:05 | 1:29:59 | 3:22:06 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| fail | 3110879 |
|
2018-10-06 05:20:55 | 2018-10-15 13:36:48 | 2018-10-15 17:00:52 | 3:24:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||||
Failure Reason:
Could not reconnect to ubuntu@ovh097.front.sepia.ceph.com |
||||||||||||||
| fail | 3110880 |
|
2018-10-06 05:20:56 | 2018-10-15 13:50:35 | 2018-10-15 20:06:42 | 6:16:07 | 1:02:57 | 5:13:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-15 19:29:11.353749 mon.b mon.0 158.69.64.157:6789/0 970 : cluster [WRN] Health check failed: 7 slow requests are blocked > 32 sec. Implicated osds 2,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110881 |
|
2018-10-06 05:20:57 | 2018-10-15 13:52:36 | 2018-10-15 17:56:39 | 4:04:03 | 1:24:45 | 2:39:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3110882 |
|
2018-10-06 05:20:57 | 2018-10-15 13:52:51 | 2018-10-15 16:44:53 | 2:52:02 | 0:20:07 | 2:31:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3110883 |
|
2018-10-06 05:20:58 | 2018-10-15 14:01:45 | 2018-10-15 21:11:53 | 7:10:08 | 0:42:03 | 6:28:05 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110884 |
|
2018-10-06 05:20:58 | 2018-10-15 14:08:44 | 2018-10-15 16:52:46 | 2:44:02 | 0:18:34 | 2:25:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110885 |
|
2018-10-06 05:20:59 | 2018-10-15 14:20:38 | 2018-10-15 17:06:40 | 2:46:02 | 0:20:01 | 2:26:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3110886 |
|
2018-10-06 05:21:00 | 2018-10-15 14:28:50 | 2018-10-15 18:56:55 | 4:28:05 | 1:39:55 | 2:48:10 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-15 17:27:02.126781 mon.a mon.0 158.69.65.199:6789/0 243 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110887 |
|
2018-10-06 05:21:01 | 2018-10-15 14:41:18 | 2018-10-15 18:31:22 | 3:50:04 | 0:25:14 | 3:24:50 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110888 |
|
2018-10-06 05:21:01 | 2018-10-15 15:11:59 | 2018-10-15 17:44:01 | 2:32:02 | 1:00:42 | 1:31:20 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3110889 |
|
2018-10-06 05:21:02 | 2018-10-15 15:19:40 | 2018-10-15 18:07:43 | 2:48:03 | 1:20:06 | 1:27:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-15 16:56:04.954820 mon.a mon.0 158.69.66.80:6789/0 156 : cluster [WRN] Health check failed: 81 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110890 |
|
2018-10-06 05:21:03 | 2018-10-15 15:24:24 | 2018-10-15 17:40:26 | 2:16:02 | 0:24:27 | 1:51:35 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110891 |
|
2018-10-06 05:21:04 | 2018-10-15 15:24:32 | 2018-10-15 18:06:34 | 2:42:02 | 1:13:47 | 1:28:15 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3110892 |
|
2018-10-06 05:21:04 | 2018-10-15 15:24:33 | 2018-10-15 17:30:34 | 2:06:01 | 0:28:02 | 1:37:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110893 |
|
2018-10-06 05:21:05 | 2018-10-15 15:25:55 | 2018-10-16 02:54:08 | 11:28:13 | 0:33:16 | 10:54:57 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3110894 |
|
2018-10-06 05:21:06 | 2018-10-15 15:27:24 | 2018-10-16 03:34:49 | 12:07:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| fail | 3110895 |
|
2018-10-06 05:21:07 | 2018-10-15 15:28:48 | 2018-10-15 18:54:51 | 3:26:03 | 1:33:02 | 1:53:01 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Found coredumps on ubuntu@ovh055.front.sepia.ceph.com |
||||||||||||||
| dead | 3110896 |
|
2018-10-06 05:21:07 | 2018-10-15 15:29:43 | 2018-10-16 03:46:31 | 12:16:48 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3110897 |
|
2018-10-06 05:21:08 | 2018-10-15 15:30:56 | 2018-10-15 18:14:58 | 2:44:02 | 0:51:55 | 1:52:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110898 |
|
2018-10-06 05:21:09 | 2018-10-15 15:35:05 | 2018-10-15 18:17:07 | 2:42:02 | 1:31:29 | 1:10:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 16:52:44.626017 mon.b mon.0 158.69.64.7:6789/0 139 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110899 |
|
2018-10-06 05:21:10 | 2018-10-15 15:37:03 | 2018-10-16 03:39:22 | 12:02:19 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| fail | 3110900 |
|
2018-10-06 05:21:10 | 2018-10-15 15:37:14 | 2018-10-15 16:55:15 | 1:18:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | — | ||||
Failure Reason:
'ssh_keyscan ovh036.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds |
||||||||||||||
| pass | 3110901 |
|
2018-10-06 05:21:11 | 2018-10-15 15:41:48 | 2018-10-15 17:27:49 | 1:46:01 | 0:42:49 | 1:03:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3110902 |
|
2018-10-06 05:21:12 | 2018-10-15 15:43:45 | 2018-10-15 21:33:51 | 5:50:06 | 0:38:09 | 5:11:57 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110903 |
|
2018-10-06 05:21:13 | 2018-10-15 15:49:07 | 2018-10-15 17:23:08 | 1:34:01 | 0:50:46 | 0:43:15 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 17:07:03.443041 mon.b mon.0 158.69.64.51:6789/0 183 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3110904 |
|
2018-10-06 05:21:14 | 2018-10-15 16:05:37 | 2018-10-15 16:53:37 | 0:48:00 | 0:18:03 | 0:29:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3110905 |
|
2018-10-06 05:21:14 | 2018-10-15 16:29:02 | 2018-10-16 04:31:17 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | ||||
| pass | 3110906 |
|
2018-10-06 05:21:15 | 2018-10-15 16:32:48 | 2018-10-15 18:38:50 | 2:06:02 | 1:24:45 | 0:41:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3110907 |
|
2018-10-06 05:21:16 | 2018-10-15 16:45:09 | 2018-10-15 17:33:09 | 0:48:00 | 0:20:33 | 0:27:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3110908 |
|
2018-10-06 05:21:17 | 2018-10-15 16:53:04 | 2018-10-15 22:33:09 | 5:40:05 | 0:30:21 | 5:09:44 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110909 |
|
2018-10-06 05:21:17 | 2018-10-15 16:53:39 | 2018-10-15 17:47:39 | 0:54:00 | 0:17:33 | 0:36:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110910 |
|
2018-10-06 05:21:18 | 2018-10-15 16:55:18 | 2018-10-15 17:59:19 | 1:04:01 | 0:18:47 | 0:45:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3110911 |
|
2018-10-06 05:21:19 | 2018-10-15 17:01:07 | 2018-10-15 19:15:09 | 2:14:02 | 1:20:46 | 0:53:16 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-10-15 18:31:32.787973 mon.a mon.0 158.69.64.215:6789/0 237 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 3,5,7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110912 |
|
2018-10-06 05:21:20 | 2018-10-15 18:29:12 | 2018-10-16 02:01:21 | 7:32:09 | 0:27:44 | 7:04:25 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110913 |
|
2018-10-06 05:21:20 | 2018-10-15 18:31:20 | 2018-10-15 20:45:22 | 2:14:02 | 1:43:13 | 0:30:49 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
timed out waiting for admin_socket to appear after osd.7 restart |
||||||||||||||
| fail | 3110914 |
|
2018-10-06 05:21:21 | 2018-10-15 18:31:23 | 2018-10-15 20:13:24 | 1:42:01 | 1:22:19 | 0:19:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-15 19:03:32.383093 mon.b mon.0 158.69.65.149:6789/0 140 : cluster [WRN] Health check failed: 126 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110915 |
|
2018-10-06 05:21:22 | 2018-10-15 18:33:09 | 2018-10-16 06:43:34 | 12:10:25 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3110916 |
|
2018-10-06 05:21:23 | 2018-10-15 18:37:22 | 2018-10-15 20:31:24 | 1:54:02 | 1:28:14 | 0:25:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-15 19:28:19.525768 mon.a mon.0 158.69.65.55:6789/0 154 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110917 |
|
2018-10-06 05:21:23 | 2018-10-15 18:39:04 | 2018-10-15 19:23:04 | 0:44:00 | 0:29:11 | 0:14:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3110918 |
|
2018-10-06 05:21:24 | 2018-10-15 18:39:04 | 2018-10-16 06:41:18 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| fail | 3110919 |
|
2018-10-06 05:21:25 | 2018-10-15 18:41:58 | 2018-10-15 20:48:00 | 2:06:02 | 1:45:53 | 0:20:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-10-15 19:32:07.340806 mon.a mon.0 158.69.64.116:6789/0 299 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 1,2,3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110920 |
|
2018-10-06 05:21:26 | 2018-10-15 18:43:30 | 2018-10-16 06:55:28 | 12:11:58 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||||
| pass | 3110921 |
|
2018-10-06 05:21:26 | 2018-10-15 18:45:11 | 2018-10-15 23:49:16 | 5:04:05 | 0:41:08 | 4:22:57 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110922 |
|
2018-10-06 05:21:27 | 2018-10-15 18:48:20 | 2018-10-15 20:12:26 | 1:24:06 | 0:51:06 | 0:33:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-10-15 19:31:08.486034 mon.b mon.0 158.69.64.85:6789/0 238 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110923 |
|
2018-10-06 05:21:28 | 2018-10-15 18:49:03 | 2018-10-16 07:01:04 | 12:12:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||||
| pass | 3110924 |
|
2018-10-06 05:21:29 | 2018-10-15 18:49:12 | 2018-10-15 22:23:15 | 3:34:03 | 0:23:51 | 3:10:12 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110925 |
|
2018-10-06 05:21:29 | 2018-10-15 18:51:02 | 2018-10-15 19:49:02 | 0:58:00 | 0:36:59 | 0:21:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-10-15 19:32:09.875649 mon.a mon.0 158.69.66.227:6789/0 158 : cluster [WRN] Health check failed: 15 slow requests are blocked > 32 sec. Implicated osds 4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3110926 |
|
2018-10-06 05:21:30 | 2018-10-15 18:52:20 | 2018-10-15 22:52:24 | 4:00:04 | 3:35:04 | 0:25:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh030 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| dead | 3110927 |
|
2018-10-06 05:21:31 | 2018-10-15 18:54:54 | 2018-10-16 06:57:08 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| pass | 3110928 |
|
2018-10-06 05:21:32 | 2018-10-15 18:57:06 | 2018-10-15 21:25:08 | 2:28:02 | 1:25:51 | 1:02:11 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3110929 |
|
2018-10-06 05:21:32 | 2018-10-15 18:57:44 | 2018-10-15 19:59:44 | 1:02:00 | 0:17:57 | 0:44:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3110930 |
|
2018-10-06 05:21:33 | 2018-10-15 19:00:31 | 2018-10-15 22:08:34 | 3:08:03 | 1:01:09 | 2:06:54 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110931 |
|
2018-10-06 05:21:34 | 2018-10-15 19:11:04 | 2018-10-15 20:55:05 | 1:44:01 | 1:23:58 | 0:20:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3110932 |
|
2018-10-06 05:21:35 | 2018-10-15 19:13:14 | 2018-10-15 20:23:14 | 1:10:00 | 0:20:22 | 0:49:38 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| fail | 3110933 |
|
2018-10-06 05:21:35 | 2018-10-15 19:15:25 | 2018-10-15 21:23:26 | 2:08:01 | 0:40:45 | 1:27:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-15 20:52:11.408411 mon.a mon.0 158.69.65.58:6789/0 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 3110934 |
|
2018-10-06 05:21:36 | 2018-10-15 19:17:20 | 2018-10-15 19:59:20 | 0:42:00 | 0:17:30 | 0:24:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110935 |
|
2018-10-06 05:21:37 | 2018-10-15 19:19:27 | 2018-10-15 20:17:28 | 0:58:01 | 0:24:36 | 0:33:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3110936 |
|
2018-10-06 05:21:37 | 2018-10-15 19:23:18 | 2018-10-15 22:03:20 | 2:40:02 | 1:34:12 | 1:05:50 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
| dead | 3110937 |
|
2018-10-06 05:21:38 | 2018-10-15 19:49:18 | 2018-10-16 07:51:32 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3110938 |
|
2018-10-06 05:21:39 | 2018-10-15 22:09:31 | 2018-10-16 00:01:32 | 1:52:01 | 1:22:10 | 0:29:51 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 23:03:13.254549 mon.b mon.0 158.69.66.26:6789/0 2299 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3110939 |
|
2018-10-06 05:21:39 | 2018-10-15 22:17:34 | 2018-10-16 00:13:36 | 1:56:02 | 1:03:03 | 0:52:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| pass | 3110940 |
|
2018-10-06 05:21:40 | 2018-10-15 22:19:30 | 2018-10-16 00:17:31 | 1:58:01 | 0:22:35 | 1:35:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110941 |
|
2018-10-06 05:21:41 | 2018-10-15 22:21:58 | 2018-10-16 00:18:00 | 1:56:02 | 1:08:49 | 0:47:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3110942 |
|
2018-10-06 05:21:42 | 2018-10-15 22:23:29 | 2018-10-15 23:13:29 | 0:50:00 | 0:27:31 | 0:22:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110943 |
|
2018-10-06 05:21:42 | 2018-10-15 22:23:51 | 2018-10-16 00:59:53 | 2:36:02 | 0:33:03 | 2:02:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110944 |
|
2018-10-06 05:21:43 | 2018-10-15 22:29:25 | 2018-10-16 01:03:27 | 2:34:02 | 1:35:28 | 0:58:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3110945 |
|
2018-10-06 05:21:44 | 2018-10-15 22:33:27 | 2018-10-16 02:29:31 | 3:56:04 | 3:36:11 | 0:19:53 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh014 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| dead | 3110946 |
|
2018-10-06 05:21:45 | 2018-10-15 22:33:54 | 2018-10-16 10:43:12 | 12:09:18 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3110947 |
|
2018-10-06 05:21:45 | 2018-10-15 22:37:28 | 2018-10-15 23:49:29 | 1:12:01 | 0:53:00 | 0:19:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110948 |
|
2018-10-06 05:21:46 | 2018-10-15 22:39:12 | 2018-10-15 23:47:12 | 1:08:00 | 0:49:03 | 0:18:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-15 23:23:18.398810 mon.a mon.0 158.69.65.104:6789/0 142 : cluster [WRN] Health check failed: 55 slow requests are blocked > 32 sec. Implicated osds 1,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110949 |
|
2018-10-06 05:21:47 | 2018-10-15 22:39:22 | 2018-10-16 01:15:24 | 2:36:02 | 0:25:36 | 2:10:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110950 |
|
2018-10-06 05:21:48 | 2018-10-15 22:41:29 | 2018-10-15 23:37:30 | 0:56:01 | 0:33:30 | 0:22:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3110951 |
|
2018-10-06 05:21:48 | 2018-10-15 22:41:42 | 2018-10-16 02:35:46 | 3:54:04 | 3:35:30 | 0:18:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh074 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| fail | 3110952 |
|
2018-10-06 05:21:49 | 2018-10-15 22:42:05 | 2018-10-16 01:40:08 | 2:58:03 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||||
Failure Reason:
[Errno None] Unable to connect to port 22 on 158.69.65.216 |
||||||||||||||
| pass | 3110953 |
|
2018-10-06 05:21:50 | 2018-10-15 22:43:36 | 2018-10-15 23:53:37 | 1:10:01 | 0:47:27 | 0:22:34 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3110954 |
|
2018-10-06 05:21:51 | 2018-10-15 22:48:06 | 2018-10-15 23:20:06 | 0:32:00 | 0:18:05 | 0:13:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3110955 |
|
2018-10-06 05:21:52 | 2018-10-15 22:50:00 | 2018-10-16 01:06:02 | 2:16:02 | 0:43:16 | 1:32:46 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110956 |
|
2018-10-06 05:21:52 | 2018-10-15 22:52:04 | 2018-10-16 01:16:06 | 2:24:02 | 1:31:02 | 0:53:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-15 23:52:42.839756 mon.a mon.0 158.69.64.67:6789/0 155 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110957 |
|
2018-10-06 05:21:53 | 2018-10-15 22:52:25 | 2018-10-15 23:56:26 | 1:04:01 | 0:19:10 | 0:44:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3110958 |
|
2018-10-06 05:21:54 | 2018-10-15 23:09:20 | 2018-10-16 11:11:34 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | — | ||||
| pass | 3110959 |
|
2018-10-06 05:21:55 | 2018-10-15 23:12:49 | 2018-10-15 23:50:49 | 0:38:00 | 0:16:57 | 0:21:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110960 |
|
2018-10-06 05:21:55 | 2018-10-15 23:13:30 | 2018-10-16 00:07:30 | 0:54:00 | 0:24:15 | 0:29:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3110961 |
|
2018-10-06 05:21:56 | 2018-10-15 23:14:45 | 2018-10-16 01:52:47 | 2:38:02 | 1:36:35 | 1:01:27 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-10-16 00:34:07.290214 mon.b mon.0 158.69.65.166:6789/0 228 : cluster [WRN] Health check failed: 12 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110962 |
|
2018-10-06 05:21:57 | 2018-10-15 23:19:40 | 2018-10-16 03:45:45 | 4:26:05 | 0:29:25 | 3:56:40 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110963 |
|
2018-10-06 05:21:58 | 2018-10-15 23:20:07 | 2018-10-15 23:54:07 | 0:34:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||||
Failure Reason:
Could not reconnect to ubuntu@ovh012.front.sepia.ceph.com |
||||||||||||||
| pass | 3110964 |
|
2018-10-06 05:21:58 | 2018-10-15 23:29:11 | 2018-10-16 01:05:12 | 1:36:01 | 1:10:44 | 0:25:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3110965 |
|
2018-10-06 05:21:59 | 2018-10-15 23:29:39 | 2018-10-16 11:31:54 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| dead | 3110966 |
|
2018-10-06 05:22:00 | 2018-10-15 23:37:32 | 2018-10-16 11:44:48 | 12:07:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||||
| pass | 3110967 |
|
2018-10-06 05:22:01 | 2018-10-15 23:47:25 | 2018-10-16 00:51:26 | 1:04:01 | 0:28:18 | 0:35:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110968 |
|
2018-10-06 05:22:01 | 2018-10-15 23:49:19 | 2018-10-16 01:29:20 | 1:40:01 | 0:24:00 | 1:16:01 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110969 |
|
2018-10-06 05:22:02 | 2018-10-15 23:49:30 | 2018-10-16 01:53:31 | 2:04:01 | 1:27:42 | 0:36:19 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| fail | 3110970 |
|
2018-10-06 05:22:03 | 2018-10-15 23:50:51 | 2018-10-16 01:06:52 | 1:16:01 | 0:50:01 | 0:26:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| fail | 3110971 |
|
2018-10-06 05:22:04 | 2018-10-15 23:52:56 | 2018-10-16 02:04:58 | 2:12:02 | 0:25:39 | 1:46:23 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
Test failure: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) |
||||||||||||||
| pass | 3110972 |
|
2018-10-06 05:22:05 | 2018-10-15 23:53:38 | 2018-10-16 01:07:39 | 1:14:01 | 0:51:47 | 0:22:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110973 |
|
2018-10-06 05:22:06 | 2018-10-15 23:54:09 | 2018-10-16 01:10:10 | 1:16:01 | 0:57:14 | 0:18:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 00:36:24.341754 mon.a mon.0 158.69.66.135:6789/0 153 : cluster [WRN] Health check failed: 15 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110974 |
|
2018-10-06 05:22:06 | 2018-10-15 23:56:28 | 2018-10-16 04:00:33 | 4:04:05 | 0:24:35 | 3:39:30 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110975 |
|
2018-10-06 05:22:07 | 2018-10-16 00:01:47 | 2018-10-16 01:15:47 | 1:14:00 | 0:40:27 | 0:33:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3110976 |
|
2018-10-06 05:22:08 | 2018-10-16 00:07:33 | 2018-10-16 01:25:33 | 1:18:00 | 0:59:02 | 0:18:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3110977 |
|
2018-10-06 05:22:09 | 2018-10-16 00:13:43 | 2018-10-16 12:15:58 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| fail | 3110978 |
|
2018-10-06 05:22:09 | 2018-10-16 00:14:58 | 2018-10-16 02:16:59 | 2:02:01 | 1:32:31 | 0:29:30 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Found coredumps on ubuntu@ovh065.front.sepia.ceph.com |
||||||||||||||
| pass | 3110979 |
|
2018-10-06 05:22:10 | 2018-10-16 00:17:48 | 2018-10-16 01:05:48 | 0:48:00 | 0:18:53 | 0:29:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3110980 |
|
2018-10-06 05:22:11 | 2018-10-16 00:18:01 | 2018-10-16 03:14:04 | 2:56:03 | 1:00:57 | 1:55:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3110981 |
|
2018-10-06 05:22:12 | 2018-10-16 00:32:57 | 2018-10-16 02:18:58 | 1:46:01 | 1:26:13 | 0:19:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-16 01:15:07.068733 mon.b mon.0 158.69.65.214:6789/0 155 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3110982 |
|
2018-10-06 05:22:13 | 2018-10-16 00:40:45 | 2018-10-16 01:30:45 | 0:50:00 | 0:20:09 | 0:29:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3110983 |
|
2018-10-06 05:22:13 | 2018-10-16 00:51:39 | 2018-10-16 03:31:41 | 2:40:02 | 0:42:23 | 1:57:39 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3110984 |
|
2018-10-06 05:22:14 | 2018-10-16 01:00:08 | 2018-10-16 01:30:07 | 0:29:59 | 0:16:08 | 0:13:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3110985 |
|
2018-10-06 05:22:15 | 2018-10-16 01:03:37 | 2018-10-16 01:51:37 | 0:48:00 | 0:18:07 | 0:29:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3110986 |
|
2018-10-06 05:22:15 | 2018-10-16 01:05:26 | 2018-10-16 03:19:28 | 2:14:02 | 1:36:48 | 0:37:14 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-16 01:55:39.362813 mon.a mon.0 158.69.64.125:6789/0 243 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110987 |
|
2018-10-06 05:22:16 | 2018-10-16 01:05:50 | 2018-10-16 13:08:06 | 12:02:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | — | ||||
| fail | 3110988 |
|
2018-10-06 05:22:17 | 2018-10-16 01:06:03 | 2018-10-16 02:12:03 | 1:06:00 | 0:51:41 | 0:14:19 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 01:51:48.072622 mon.a mon.0 158.69.64.236:6789/0 2664 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3110989 |
|
2018-10-06 05:22:18 | 2018-10-16 01:07:06 | 2018-10-16 02:37:07 | 1:30:01 | 0:58:36 | 0:31:25 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3110990 |
|
2018-10-06 05:22:18 | 2018-10-16 01:07:40 | 2018-10-16 13:09:55 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | — | ||||
| pass | 3110991 |
|
2018-10-06 05:22:19 | 2018-10-16 01:10:13 | 2018-10-16 03:14:14 | 2:04:01 | 1:31:02 | 0:32:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3110992 |
|
2018-10-06 05:22:20 | 2018-10-16 01:15:41 | 2018-10-16 02:09:41 | 0:54:00 | 0:28:30 | 0:25:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3110993 |
|
2018-10-06 05:22:20 | 2018-10-16 01:15:49 | 2018-10-16 12:16:01 | 11:00:12 | 0:31:44 | 10:28:28 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3110994 |
|
2018-10-06 05:22:21 | 2018-10-16 01:16:07 | 2018-10-16 13:23:27 | 12:07:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3110995 |
|
2018-10-06 05:22:22 | 2018-10-16 01:20:08 | 2018-10-16 03:02:09 | 1:42:01 | 1:24:09 | 0:17:52 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3110996 |
|
2018-10-06 05:22:23 | 2018-10-16 01:23:34 | 2018-10-16 13:25:49 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | — | ||||
| pass | 3110997 |
|
2018-10-06 05:22:23 | 2018-10-16 01:25:36 | 2018-10-16 02:43:37 | 1:18:01 | 0:50:58 | 0:27:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3110998 |
|
2018-10-06 05:22:24 | 2018-10-16 01:29:35 | 2018-10-16 02:47:35 | 1:18:00 | 0:50:06 | 0:27:54 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 02:15:02.549881 mon.b mon.0 158.69.64.132:6789/0 220 : cluster [WRN] Health check failed: 103 slow requests are blocked > 32 sec. Implicated osds 2,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3110999 |
|
2018-10-06 05:22:25 | 2018-10-16 01:30:08 | 2018-10-16 13:32:23 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | — | ||||
| pass | 3111000 |
|
2018-10-06 05:22:25 | 2018-10-16 01:30:59 | 2018-10-16 02:49:00 | 1:18:01 | 0:41:24 | 0:36:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3111001 |
|
2018-10-06 05:22:26 | 2018-10-16 01:40:12 | 2018-10-16 03:04:13 | 1:24:01 | 0:58:52 | 0:25:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3111002 |
|
2018-10-06 05:22:27 | 2018-10-16 01:51:51 | 2018-10-16 13:54:07 | 12:02:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | — | ||||
| fail | 3111003 |
|
2018-10-06 05:22:27 | 2018-10-16 01:52:48 | 2018-10-16 04:32:51 | 2:40:03 | 2:22:20 | 0:17:43 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 03:14:02.238645 mon.a mon.0 158.69.64.235:6789/0 166 : cluster [ERR] Health check failed: 3 stuck requests are blocked > 4096 sec. Implicated osds 1 (REQUEST_STUCK)" in cluster log |
||||||||||||||
| pass | 3111004 |
|
2018-10-06 05:22:28 | 2018-10-16 01:53:45 | 2018-10-16 02:29:45 | 0:36:00 | 0:17:25 | 0:18:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3111005 |
|
2018-10-06 05:22:29 | 2018-10-16 02:01:34 | 2018-10-16 14:03:49 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | — | ||||
| fail | 3111006 |
|
2018-10-06 05:22:30 | 2018-10-16 02:05:00 | 2018-10-16 07:19:06 | 5:14:06 | 3:32:52 | 1:41:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh027 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3111007 |
|
2018-10-06 05:22:30 | 2018-10-16 02:09:54 | 2018-10-16 02:55:54 | 0:46:00 | 0:19:37 | 0:26:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3111008 |
|
2018-10-06 05:22:31 | 2018-10-16 02:12:12 | 2018-10-16 03:46:13 | 1:34:01 | 0:28:53 | 1:05:08 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111009 |
|
2018-10-06 05:22:32 | 2018-10-16 02:17:02 | 2018-10-16 02:53:01 | 0:35:59 | 0:16:52 | 0:19:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3111010 |
|
2018-10-06 05:22:33 | 2018-10-16 02:19:13 | 2018-10-16 03:03:13 | 0:44:00 | 0:20:45 | 0:23:15 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3111011 |
|
2018-10-06 05:22:33 | 2018-10-16 03:32:00 | 2018-10-16 05:38:02 | 2:06:02 | 1:34:22 | 0:31:40 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3111012 |
|
2018-10-06 05:22:34 | 2018-10-16 03:34:52 | 2018-10-16 11:39:06 | 8:04:14 | 0:28:31 | 7:35:43 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111013 |
|
2018-10-06 05:22:35 | 2018-10-16 03:38:21 | 2018-10-16 05:50:23 | 2:12:02 | 1:42:22 | 0:29:40 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
ceph-objectstore-tool: exp list-pgs failure with status -1 |
||||||||||||||
| fail | 3111014 |
|
2018-10-06 05:22:35 | 2018-10-16 03:39:35 | 2018-10-16 05:19:36 | 1:40:01 | 1:24:47 | 0:15:14 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-16 04:07:42.078304 mon.b mon.0 158.69.65.95:6789/0 142 : cluster [WRN] Health check failed: 106 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3111015 |
|
2018-10-06 05:22:36 | 2018-10-16 03:45:58 | 2018-10-16 15:24:12 | 11:38:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
Failure Reason:
Could not reconnect to ubuntu@ovh085.front.sepia.ceph.com |
||||||||||||||
| pass | 3111016 |
|
2018-10-06 05:22:37 | 2018-10-16 03:46:14 | 2018-10-16 05:12:15 | 1:26:01 | 1:16:56 | 0:09:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3111017 |
|
2018-10-06 05:22:38 | 2018-10-16 03:46:32 | 2018-10-16 04:46:32 | 1:00:00 | 0:27:29 | 0:32:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| dead | 3111018 |
|
2018-10-06 05:22:38 | 2018-10-16 04:00:50 | 2018-10-16 16:03:06 | 12:02:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | — | ||||
| dead | 3111019 |
|
2018-10-06 05:22:39 | 2018-10-16 04:18:05 | 2018-10-16 16:27:20 | 12:09:15 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3111020 |
|
2018-10-06 05:22:40 | 2018-10-16 04:18:13 | 2018-10-16 06:20:15 | 2:02:02 | 1:18:14 | 0:43:48 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3111021 |
|
2018-10-06 05:22:40 | 2018-10-16 04:31:35 | 2018-10-16 06:07:36 | 1:36:01 | 0:38:47 | 0:57:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111022 |
|
2018-10-06 05:22:41 | 2018-10-16 04:33:04 | 2018-10-16 06:01:05 | 1:28:01 | 0:51:05 | 0:36:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3111023 |
|
2018-10-06 05:22:42 | 2018-10-16 04:46:37 | 2018-10-16 06:24:38 | 1:38:01 | 1:24:59 | 0:13:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 05:21:26.712768 mon.a mon.0 158.69.64.75:6789/0 258 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3111024 |
|
2018-10-06 05:22:42 | 2018-10-16 04:51:59 | 2018-10-16 16:54:14 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | — | ||||
| pass | 3111025 |
|
2018-10-06 05:22:43 | 2018-10-16 11:46:41 | 2018-10-16 12:50:41 | 1:04:00 | 0:34:32 | 0:29:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3111026 |
|
2018-10-06 05:22:44 | 2018-10-16 11:49:10 | 2018-10-16 13:09:11 | 1:20:01 | 0:41:31 | 0:38:30 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| dead | 3111027 |
|
2018-10-06 05:22:45 | 2018-10-16 11:53:33 | 2018-10-16 23:55:48 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | — | ||||
| pass | 3111028 |
|
2018-10-06 05:22:45 | 2018-10-16 11:53:34 | 2018-10-16 13:59:36 | 2:06:02 | 1:24:45 | 0:41:17 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3111029 |
|
2018-10-06 05:22:46 | 2018-10-16 12:05:18 | 2018-10-16 13:03:23 | 0:58:05 | 0:18:58 | 0:39:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| dead | 3111030 |
|
2018-10-06 05:22:47 | 2018-10-16 12:05:18 | 2018-10-17 00:07:32 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | — | ||||
| pass | 3111031 |
|
2018-10-06 05:22:48 | 2018-10-16 12:07:30 | 2018-10-16 14:49:32 | 2:42:02 | 1:26:45 | 1:15:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3111032 |
|
2018-10-06 05:22:48 | 2018-10-16 12:11:22 | 2018-10-16 13:45:23 | 1:34:01 | 0:20:00 | 1:14:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| dead | 3111033 |
|
2018-10-06 05:22:49 | 2018-10-16 12:16:00 | 2018-10-17 00:25:27 | 12:09:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3111034 |
|
2018-10-06 05:22:50 | 2018-10-16 12:16:03 | 2018-10-16 13:38:03 | 1:22:00 | 0:17:52 | 1:04:08 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3111035 |
|
2018-10-06 05:22:50 | 2018-10-16 12:20:55 | 2018-10-16 14:04:56 | 1:44:01 | 0:19:39 | 1:24:22 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3111036 |
|
2018-10-06 05:22:51 | 2018-10-16 12:27:44 | 2018-10-16 17:35:50 | 5:08:06 | 3:55:18 | 1:12:48 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
| pass | 3111037 |
|
2018-10-06 05:22:52 | 2018-10-16 12:31:16 | 2018-10-16 19:59:24 | 7:28:08 | 0:24:11 | 7:03:57 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111038 |
|
2018-10-06 05:22:52 | 2018-10-16 12:35:25 | 2018-10-16 13:55:26 | 1:20:01 | 0:53:57 | 0:26:04 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| dead | 3111039 |
|
2018-10-06 05:22:53 | 2018-10-16 12:37:15 | 2018-10-17 00:46:33 | 12:09:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||||
| pass | 3111040 |
|
2018-10-06 05:22:54 | 2018-10-16 12:40:03 | 2018-10-16 18:28:11 | 5:48:08 | 0:24:46 | 5:23:22 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111041 |
|
2018-10-06 05:22:55 | 2018-10-16 12:41:39 | 2018-10-16 14:25:40 | 1:44:01 | 1:26:57 | 0:17:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-16 13:45:00.101665 mon.b mon.0 158.69.64.196:6789/0 160 : cluster [WRN] Health check failed: 20 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3111042 |
|
2018-10-06 05:22:55 | 2018-10-16 12:50:56 | 2018-10-16 14:06:56 | 1:16:00 | 0:29:11 | 0:46:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3111043 |
|
2018-10-06 05:22:56 | 2018-10-16 12:51:40 | 2018-10-16 18:55:46 | 6:04:06 | 0:33:00 | 5:31:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111044 |
|
2018-10-06 05:22:57 | 2018-10-16 13:03:26 | 2018-10-16 15:11:28 | 2:08:02 | 1:47:26 | 0:20:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-10-16 13:44:41.076044 mon.b mon.0 158.69.66.79:6789/0 338 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 5,7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3111045 |
|
2018-10-06 05:22:58 | 2018-10-16 13:03:26 | 2018-10-16 14:47:27 | 1:44:01 | 1:31:21 | 0:12:40 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
'/home/ubuntu/cephtest/archive/syslog/kern.log:2018-10-16T13:44:34.637924+00:00 ovh051 kernel: [ 1787.204972] watchdog: BUG: soft lockup - CPU#1 stuck for 33s! [log:9824] ' in syslog |
||||||||||||||
| dead | 3111046 |
|
2018-10-06 05:22:58 | 2018-10-16 13:05:49 | 2018-10-17 01:08:03 | 12:02:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | — | ||||
| fail | 3111047 |
|
2018-10-06 05:22:59 | 2018-10-16 13:08:21 | 2018-10-16 14:20:21 | 1:12:00 | 0:49:05 | 0:22:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-10-16 13:44:36.486956 mon.a mon.0 158.69.65.3:6789/0 293 : cluster [WRN] Health check failed: 127 slow requests are blocked > 32 sec. Implicated osds 0,3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3111048 |
|
2018-10-06 05:23:00 | 2018-10-16 13:09:12 | 2018-10-16 17:31:17 | 4:22:05 | 3:54:00 | 0:28:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh094 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 3111049 |
|
2018-10-06 05:23:01 | 2018-10-16 13:09:57 | 2018-10-16 19:06:04 | 5:56:07 | 0:25:57 | 5:30:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111050 |
|
2018-10-06 05:23:01 | 2018-10-16 13:21:24 | 2018-10-16 15:09:26 | 1:48:02 | 0:36:39 | 1:11:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3111051 |
|
2018-10-06 05:23:02 | 2018-10-16 13:21:24 | 2018-10-16 17:21:28 | 4:00:04 | 3:36:07 | 0:23:57 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh057 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| pass | 3111052 |
|
2018-10-06 05:23:03 | 2018-10-16 13:23:30 | 2018-10-16 16:47:33 | 3:24:03 | 0:36:46 | 2:47:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111053 |
|
2018-10-06 05:23:04 | 2018-10-16 13:23:51 | 2018-10-16 14:49:52 | 1:26:01 | 0:52:40 | 0:33:21 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3111054 |
|
2018-10-06 05:23:04 | 2018-10-16 13:25:51 | 2018-10-16 14:37:52 | 1:12:01 | 0:18:10 | 0:53:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3111055 |
|
2018-10-06 05:23:05 | 2018-10-16 13:32:26 | 2018-10-16 17:26:30 | 3:54:04 | 0:41:32 | 3:12:32 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111056 |
|
2018-10-06 05:23:06 | 2018-10-16 13:38:19 | 2018-10-16 16:18:21 | 2:40:02 | 1:24:52 | 1:15:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-16 15:03:49.768964 mon.a mon.0 158.69.64.62:6789/0 142 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3111057 |
|
2018-10-06 05:23:07 | 2018-10-16 13:45:39 | 2018-10-16 14:19:38 | 0:33:59 | 0:18:50 | 0:15:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3111058 |
|
2018-10-06 05:23:07 | 2018-10-16 13:48:13 | 2018-10-16 19:42:21 | 5:54:08 | 0:29:14 | 5:24:54 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111059 |
|
2018-10-06 05:23:08 | 2018-10-16 13:54:09 | 2018-10-16 14:38:09 | 0:44:00 | 0:17:31 | 0:26:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3111060 |
|
2018-10-06 05:23:09 | 2018-10-16 13:55:29 | 2018-10-16 15:01:29 | 1:06:00 | 0:23:59 | 0:42:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3111061 |
|
2018-10-06 05:23:10 | 2018-10-16 13:59:38 | 2018-10-16 15:55:40 | 1:56:02 | 1:07:50 | 0:48:12 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3111062 |
|
2018-10-06 05:23:10 | 2018-10-16 14:03:52 | 2018-10-16 18:59:57 | 4:56:05 | 0:27:19 | 4:28:46 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111063 |
|
2018-10-06 05:23:11 | 2018-10-16 14:05:10 | 2018-10-16 18:09:14 | 4:04:04 | 3:36:16 | 0:27:48 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh066 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3111064 |
|
2018-10-06 05:23:12 | 2018-10-16 14:07:11 | 2018-10-16 16:05:13 | 1:58:02 | 1:09:29 | 0:48:33 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3111065 |
|
2018-10-06 05:23:13 | 2018-10-16 14:19:41 | 2018-10-17 02:21:56 | 12:02:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | ||||
| pass | 3111066 |
|
2018-10-06 05:23:13 | 2018-10-16 14:20:33 | 2018-10-16 15:52:34 | 1:32:01 | 1:13:39 | 0:18:22 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3111067 |
|
2018-10-06 05:23:14 | 2018-10-16 14:25:21 | 2018-10-16 15:43:21 | 1:18:00 | 0:27:44 | 0:50:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3111068 |
|
2018-10-06 05:23:15 | 2018-10-16 14:25:41 | 2018-10-16 19:05:46 | 4:40:05 | 0:23:03 | 4:17:02 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111069 |
|
2018-10-06 05:23:15 | 2018-10-16 14:37:54 | 2018-10-16 16:47:56 | 2:10:02 | 1:35:39 | 0:34:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| pass | 3111070 |
|
2018-10-06 05:23:16 | 2018-10-16 14:38:10 | 2018-10-16 16:20:12 | 1:42:02 | 0:52:53 | 0:49:09 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3111071 |
|
2018-10-06 05:23:17 | 2018-10-16 14:47:30 | 2018-10-16 17:59:33 | 3:12:03 | 0:27:11 | 2:44:52 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
Test failure: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) |
||||||||||||||
| pass | 3111072 |
|
2018-10-06 05:23:18 | 2018-10-16 14:49:22 | 2018-10-16 15:59:23 | 1:10:01 | 0:53:18 | 0:16:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3111073 |
|
2018-10-06 05:23:18 | 2018-10-16 14:49:33 | 2018-10-16 15:55:34 | 1:06:01 | 0:45:54 | 0:20:07 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-16 15:37:26.751220 mon.b mon.0 158.69.66.2:6789/0 151 : cluster [WRN] Health check failed: 50 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3111074 |
|
2018-10-06 05:23:19 | 2018-10-16 14:49:53 | 2018-10-16 17:39:55 | 2:50:02 | 0:24:08 | 2:25:54 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111075 |
|
2018-10-06 05:23:20 | 2018-10-16 14:55:17 | 2018-10-16 15:49:17 | 0:54:00 | 0:32:59 | 0:21:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3111076 |
|
2018-10-06 05:23:21 | 2018-10-16 14:55:36 | 2018-10-16 18:57:40 | 4:02:04 | 3:37:06 | 0:24:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh081 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| pass | 3111077 |
|
2018-10-06 05:23:21 | 2018-10-16 14:58:56 | 2018-10-16 17:00:58 | 2:02:02 | 0:28:23 | 1:33:39 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| pass | 3111078 |
|
2018-10-06 05:23:22 | 2018-10-16 15:01:31 | 2018-10-16 16:53:33 | 1:52:02 | 1:24:45 | 0:27:17 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3111079 |
|
2018-10-06 05:23:23 | 2018-10-16 15:09:28 | 2018-10-16 16:17:29 | 1:08:01 | 0:17:10 | 0:50:51 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3111080 |
|
2018-10-06 05:23:24 | 2018-10-16 15:11:30 | 2018-10-16 20:11:36 | 5:00:06 | 0:57:44 | 4:02:22 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3111081 |
|
2018-10-06 05:23:24 | 2018-10-16 15:15:36 | 2018-10-16 17:07:38 | 1:52:02 | 1:30:38 | 0:21:24 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-16 15:49:36.081065 mon.a mon.0 158.69.65.99:6789/0 162 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3111082 |
|
2018-10-06 05:23:25 | 2018-10-16 15:24:28 | 2018-10-16 16:04:27 | 0:39:59 | 0:19:40 | 0:20:19 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| fail | 3111083 |
|
2018-10-06 05:23:26 | 2018-10-16 15:26:58 | 2018-10-16 21:39:05 | 6:12:07 | 0:40:32 | 5:31:35 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-16 21:02:53.367732 mon.a mon.1 158.69.66.244:6789/0 8 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 3111084 |
|
2018-10-06 05:23:27 | 2018-10-16 15:28:17 | 2018-10-16 16:10:17 | 0:42:00 | 0:15:59 | 0:26:01 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
Pulpito