| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2018-10-20 05:20:01 | 2018-10-29 18:16:06 | 2018-10-31 09:42:25 | 1 day, 15:26:19 | kcephfs | luminous | ovh | a4eed4e | 112 | 55 | 16 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3165922 |
|
2018-10-20 05:20:24 | 2018-10-28 04:01:49 | 2018-10-28 04:45:49 | 0:44:00 | 0:29:44 | 0:14:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3165923 |
|
2018-10-20 05:20:24 | 2018-10-28 04:30:51 | 2018-10-28 06:28:53 | 1:58:02 | 1:42:53 | 0:15:09 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-28 05:10:20.977169 mon.a mon.0 158.69.64.61:6789/0 260 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165924 |
|
2018-10-20 05:20:25 | 2018-10-28 04:43:43 | 2018-10-28 05:49:44 | 1:06:01 | 0:26:08 | 0:39:53 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165925 |
|
2018-10-20 05:20:26 | 2018-10-28 04:46:02 | 2018-10-28 08:52:06 | 4:06:04 | 3:41:04 | 0:25:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh061 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| fail | 3165926 |
|
2018-10-20 05:20:27 | 2018-10-28 04:46:30 | 2018-10-28 05:00:29 | 0:13:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||||
Failure Reason:
Command failed on ovh083 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master' |
||||||||||||||
| pass | 3165927 |
|
2018-10-20 05:20:27 | 2018-10-28 04:47:39 | 2018-10-28 05:49:39 | 1:02:00 | 0:24:16 | 0:37:44 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165928 |
|
2018-10-20 05:20:28 | 2018-10-28 15:40:07 | 2018-10-28 18:08:09 | 2:28:02 | 1:40:16 | 0:47:46 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3165929 |
|
2018-10-20 05:20:29 | 2018-10-28 15:41:42 | 2018-10-28 16:31:42 | 0:50:00 | 0:31:25 | 0:18:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3165930 |
|
2018-10-20 05:20:29 | 2018-10-28 15:41:46 | 2018-10-28 16:59:47 | 1:18:01 | 0:31:46 | 0:46:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165931 |
|
2018-10-20 05:20:30 | 2018-10-28 15:47:30 | 2018-10-28 18:05:32 | 2:18:02 | 1:49:59 | 0:28:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
| pass | 3165932 |
|
2018-10-20 05:20:31 | 2018-10-28 15:52:39 | 2018-10-28 17:48:41 | 1:56:02 | 1:29:17 | 0:26:45 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3165933 |
|
2018-10-20 05:20:32 | 2018-10-28 15:54:49 | 2018-10-29 04:06:55 | 12:12:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3165934 |
|
2018-10-20 05:20:32 | 2018-10-28 16:00:03 | 2018-10-28 17:08:04 | 1:08:01 | 0:54:59 | 0:13:02 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3165935 |
|
2018-10-20 05:20:33 | 2018-10-28 16:00:47 | 2018-10-28 17:26:48 | 1:26:01 | 1:02:45 | 0:23:16 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-28 16:50:21.236499 mon.a mon.0 158.69.65.245:6789/0 149 : cluster [WRN] Health check failed: 181 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165936 |
|
2018-10-20 05:20:34 | 2018-10-28 16:01:25 | 2018-10-28 17:33:26 | 1:32:01 | 0:23:21 | 1:08:40 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165937 |
|
2018-10-20 05:20:35 | 2018-10-28 16:03:10 | 2018-10-28 17:19:10 | 1:16:00 | 0:42:14 | 0:33:46 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3165938 |
|
2018-10-20 05:20:35 | 2018-10-28 16:22:12 | 2018-10-28 17:38:12 | 1:16:00 | 1:03:31 | 0:12:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3165939 |
|
2018-10-20 05:20:36 | 2018-10-28 16:26:10 | 2018-10-28 17:44:10 | 1:18:00 | 0:36:14 | 0:41:46 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165940 |
|
2018-10-20 05:20:37 | 2018-10-28 16:31:57 | 2018-10-28 18:13:58 | 1:42:01 | 1:17:59 | 0:24:02 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-28 17:24:10.962122 mon.a mon.0 158.69.64.188:6789/0 130 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 3165941 |
|
2018-10-20 05:20:38 | 2018-10-28 16:44:12 | 2018-10-28 17:24:12 | 0:40:00 | 0:21:17 | 0:18:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3165942 |
|
2018-10-20 05:20:38 | 2018-10-28 16:59:50 | 2018-10-28 18:25:51 | 1:26:01 | 0:40:58 | 0:45:03 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165943 |
|
2018-10-20 05:20:39 | 2018-10-28 17:08:07 | 2018-10-28 18:52:08 | 1:44:01 | 1:31:29 | 0:12:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-28 17:42:07.815792 mon.b mon.0 158.69.64.229:6789/0 142 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 0,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165944 |
|
2018-10-20 05:20:40 | 2018-10-28 17:09:43 | 2018-10-28 17:45:43 | 0:36:00 | 0:21:25 | 0:14:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3165945 |
|
2018-10-20 05:20:41 | 2018-10-28 17:19:25 | 2018-10-28 18:33:25 | 1:14:00 | 0:28:01 | 0:45:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165946 |
|
2018-10-20 05:20:41 | 2018-10-28 17:24:25 | 2018-10-28 18:02:25 | 0:38:00 | 0:20:25 | 0:17:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3165947 |
|
2018-10-20 05:20:42 | 2018-10-28 17:27:02 | 2018-10-28 18:15:02 | 0:48:00 | 0:22:23 | 0:25:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| pass | 3165948 |
|
2018-10-20 05:20:43 | 2018-10-28 17:33:45 | 2018-10-28 19:21:46 | 1:48:01 | 1:13:40 | 0:34:21 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
| pass | 3165949 |
|
2018-10-20 05:20:44 | 2018-10-28 17:38:27 | 2018-10-28 18:48:28 | 1:10:01 | 0:27:00 | 0:43:01 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| dead | 3165950 |
|
2018-10-20 05:20:45 | 2018-10-28 17:44:24 | 2018-10-29 05:51:44 | 12:07:20 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||||
| pass | 3165951 |
|
2018-10-20 05:20:45 | 2018-10-28 17:45:56 | 2018-10-28 19:09:56 | 1:24:00 | 1:03:02 | 0:20:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3165952 |
|
2018-10-20 05:20:46 | 2018-10-28 17:48:54 | 2018-10-29 06:01:04 | 12:12:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3165953 |
|
2018-10-20 05:20:47 | 2018-10-28 18:02:42 | 2018-10-28 19:58:43 | 1:56:01 | 1:41:26 | 0:14:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-28 19:07:35.654068 mon.b mon.0 158.69.64.116:6789/0 164 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 0,3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165954 |
|
2018-10-20 05:20:48 | 2018-10-28 18:05:47 | 2018-10-28 19:05:48 | 1:00:01 | 0:31:02 | 0:28:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3165955 |
|
2018-10-20 05:20:48 | 2018-10-28 18:08:23 | 2018-10-28 19:16:24 | 1:08:01 | 0:23:40 | 0:44:21 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| dead | 3165956 |
|
2018-10-20 05:20:49 | 2018-10-28 18:14:12 | 2018-10-29 06:26:15 | 12:12:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3165957 |
|
2018-10-20 05:20:50 | 2018-10-28 18:15:04 | 2018-10-28 19:29:05 | 1:14:01 | 0:50:55 | 0:23:06 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3165958 |
|
2018-10-20 05:20:51 | 2018-10-28 18:26:09 | 2018-10-28 19:42:09 | 1:16:00 | 0:40:01 | 0:35:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165959 |
|
2018-10-20 05:20:51 | 2018-10-28 18:33:41 | 2018-10-28 19:53:42 | 1:20:01 | 0:53:05 | 0:26:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3165960 |
|
2018-10-20 05:20:52 | 2018-10-28 18:48:34 | 2018-10-28 19:58:34 | 1:10:00 | 0:55:51 | 0:14:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-28 19:33:53.755948 mon.b mon.0 158.69.64.75:6789/0 140 : cluster [WRN] Health check failed: 64 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165961 |
|
2018-10-20 05:20:53 | 2018-10-28 18:52:20 | 2018-10-28 19:48:21 | 0:56:01 | 0:24:43 | 0:31:18 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165962 |
|
2018-10-20 05:20:54 | 2018-10-28 19:06:04 | 2018-10-28 20:34:04 | 1:28:00 | 0:45:17 | 0:42:43 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3165963 |
|
2018-10-20 05:20:54 | 2018-10-28 19:10:12 | 2018-10-28 20:34:12 | 1:24:00 | 1:15:15 | 0:08:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3165964 |
|
2018-10-20 05:20:55 | 2018-10-28 19:16:39 | 2018-10-28 20:38:40 | 1:22:01 | 0:27:24 | 0:54:37 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165965 |
|
2018-10-20 05:20:56 | 2018-10-28 19:22:02 | 2018-10-28 21:14:03 | 1:52:01 | 1:31:57 | 0:20:04 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3165966 |
|
2018-10-20 05:20:57 | 2018-10-28 19:29:09 | 2018-10-28 20:15:09 | 0:46:00 | 0:21:26 | 0:24:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3165967 |
|
2018-10-20 05:20:57 | 2018-10-28 19:42:26 | 2018-10-28 21:10:26 | 1:28:00 | 1:01:18 | 0:26:42 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165968 |
|
2018-10-20 05:20:58 | 2018-10-28 19:48:38 | 2018-10-28 23:38:42 | 3:50:04 | 3:36:32 | 0:13:32 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh008 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| pass | 3165969 |
|
2018-10-20 05:20:59 | 2018-10-28 19:53:56 | 2018-10-28 20:25:56 | 0:32:00 | 0:23:11 | 0:08:49 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3165970 |
|
2018-10-20 05:21:00 | 2018-10-28 19:58:37 | 2018-10-28 21:30:38 | 1:32:01 | 0:42:35 | 0:49:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165971 |
|
2018-10-20 05:21:00 | 2018-10-28 19:58:44 | 2018-10-28 20:42:44 | 0:44:00 | 0:20:29 | 0:23:31 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3165972 |
|
2018-10-20 05:21:01 | 2018-10-28 20:15:15 | 2018-10-28 21:01:15 | 0:46:00 | 0:23:10 | 0:22:50 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3165973 |
|
2018-10-20 05:21:02 | 2018-10-28 20:26:09 | 2018-10-28 22:46:11 | 2:20:02 | 1:48:51 | 0:31:11 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-28 21:01:46.198916 mon.a mon.0 158.69.64.20:6789/0 171 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165974 |
|
2018-10-20 05:21:03 | 2018-10-28 20:34:18 | 2018-10-28 21:38:18 | 1:04:00 | 0:27:42 | 0:36:18 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165975 |
|
2018-10-20 05:21:04 | 2018-10-28 20:34:18 | 2018-10-28 22:32:20 | 1:58:02 | 1:38:30 | 0:19:32 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-28 21:27:21.421573 mon.a mon.0 158.69.64.235:6789/0 3420 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 3165976 |
|
2018-10-20 05:21:04 | 2018-10-28 20:38:42 | 2018-10-28 22:32:44 | 1:54:02 | 1:31:21 | 0:22:41 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-28 21:12:30.139296 mon.a mon.0 158.69.65.170:6789/0 158 : cluster [WRN] Health check failed: 121 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165977 |
|
2018-10-20 05:21:05 | 2018-10-28 20:42:47 | 2018-10-28 21:56:48 | 1:14:01 | 0:24:25 | 0:49:36 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| fail | 3165978 |
|
2018-10-20 05:21:06 | 2018-10-28 21:01:30 | 2018-10-28 22:53:32 | 1:52:02 | 1:34:07 | 0:17:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-28 21:45:14.415189 mon.a mon.0 158.69.65.134:6789/0 151 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165979 |
|
2018-10-20 05:21:06 | 2018-10-28 21:10:37 | 2018-10-28 22:00:37 | 0:50:00 | 0:32:57 | 0:17:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3165980 |
|
2018-10-20 05:21:07 | 2018-10-28 21:14:19 | 2018-10-28 22:12:19 | 0:58:00 | 0:33:11 | 0:24:49 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3165981 |
|
2018-10-20 05:21:08 | 2018-10-28 21:30:42 | 2018-10-29 09:37:55 | 12:07:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| fail | 3165982 |
|
2018-10-20 05:21:09 | 2018-10-28 21:38:31 | 2018-10-28 23:40:32 | 2:02:01 | 1:37:09 | 0:24:52 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Found coredumps on ubuntu@ovh080.front.sepia.ceph.com |
||||||||||||||
| dead | 3165983 |
|
2018-10-20 05:21:10 | 2018-10-28 21:56:52 | 2018-10-29 10:19:37 | 12:22:45 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3165984 |
|
2018-10-20 05:21:10 | 2018-10-28 22:00:39 | 2018-10-28 23:04:40 | 1:04:01 | 0:51:05 | 0:12:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3165985 |
|
2018-10-20 05:21:11 | 2018-10-28 22:12:34 | 2018-10-28 23:52:35 | 1:40:01 | 1:31:26 | 0:08:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-28 22:40:12.354486 mon.b mon.0 158.69.64.250:6789/0 145 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec. Implicated osds 0,3,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165986 |
|
2018-10-20 05:21:12 | 2018-10-28 22:32:35 | 2018-10-28 23:46:36 | 1:14:01 | 0:26:28 | 0:47:33 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165987 |
|
2018-10-20 05:21:13 | 2018-10-28 22:32:45 | 2018-10-28 23:30:45 | 0:58:00 | 0:40:31 | 0:17:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3165988 |
|
2018-10-20 05:21:13 | 2018-10-28 22:46:27 | 2018-10-29 00:08:28 | 1:22:01 | 0:48:57 | 0:33:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3165989 |
|
2018-10-20 05:21:14 | 2018-10-28 22:53:35 | 2018-10-29 00:21:36 | 1:28:01 | 0:36:56 | 0:51:05 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165990 |
|
2018-10-20 05:21:15 | 2018-10-28 23:04:56 | 2018-10-29 00:14:56 | 1:10:00 | 0:55:52 | 0:14:08 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3165991 |
|
2018-10-20 05:21:16 | 2018-10-28 23:31:00 | 2018-10-29 00:03:00 | 0:32:00 | 0:21:26 | 0:10:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| fail | 3165992 |
|
2018-10-20 05:21:17 | 2018-10-28 23:38:58 | 2018-10-29 00:28:58 | 0:50:00 | 0:24:54 | 0:25:06 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) |
||||||||||||||
| fail | 3165993 |
|
2018-10-20 05:21:17 | 2018-10-28 23:40:47 | 2018-10-29 01:34:48 | 1:54:01 | 1:30:13 | 0:23:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-29 00:21:51.776079 mon.a mon.0 158.69.64.191:6789/0 143 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165994 |
|
2018-10-20 05:21:18 | 2018-10-28 23:46:49 | 2018-10-29 00:42:49 | 0:56:00 | 0:22:51 | 0:33:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3165995 |
|
2018-10-20 05:21:19 | 2018-10-28 23:52:41 | 2018-10-29 00:46:42 | 0:54:01 | 0:28:40 | 0:25:21 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3165996 |
|
2018-10-20 05:21:20 | 2018-10-29 00:03:10 | 2018-10-29 00:31:09 | 0:27:59 | 0:19:41 | 0:08:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3165997 |
|
2018-10-20 05:21:21 | 2018-10-29 00:03:10 | 2018-10-29 01:05:10 | 1:02:00 | 0:22:40 | 0:39:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3165998 |
|
2018-10-20 05:21:21 | 2018-10-29 00:08:43 | 2018-10-29 01:56:44 | 1:48:01 | 1:26:45 | 0:21:16 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-10-29 00:50:14.342953 mon.b mon.0 158.69.65.112:6789/0 139 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3165999 |
|
2018-10-20 05:21:22 | 2018-10-29 00:13:10 | 2018-10-29 01:17:11 | 1:04:01 | 0:27:46 | 0:36:15 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| dead | 3166000 |
|
2018-10-20 05:21:23 | 2018-10-29 00:15:14 | 2018-10-29 12:22:29 | 12:07:15 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||||
| fail | 3166001 |
|
2018-10-20 05:21:24 | 2018-10-29 00:21:41 | 2018-10-29 02:21:43 | 2:00:02 | 1:40:59 | 0:19:03 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-29 00:50:17.595448 mon.b mon.0 158.69.65.228:6789/0 138 : cluster [WRN] Health check failed: 137 slow requests are blocked > 32 sec. Implicated osds 0,3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3166002 |
|
2018-10-20 05:21:25 | 2018-10-29 00:29:13 | 2018-10-29 12:46:01 | 12:16:48 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3166003 |
|
2018-10-20 05:21:25 | 2018-10-29 00:31:12 | 2018-10-29 02:05:13 | 1:34:01 | 1:22:19 | 0:11:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-29 01:25:09.293099 mon.b mon.0 158.69.64.250:6789/0 155 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec. Implicated osds 4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166004 |
|
2018-10-20 05:21:26 | 2018-10-29 00:43:07 | 2018-10-29 01:39:07 | 0:56:00 | 0:33:13 | 0:22:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3166005 |
|
2018-10-20 05:21:27 | 2018-10-29 00:46:56 | 2018-10-29 02:04:57 | 1:18:01 | 0:24:37 | 0:53:24 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166006 |
|
2018-10-20 05:21:28 | 2018-10-29 01:05:28 | 2018-10-29 03:11:29 | 2:06:01 | 1:52:20 | 0:13:41 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-10-29 01:40:16.186317 mon.a mon.0 158.69.64.75:6789/0 274 : cluster [WRN] Health check failed: 46 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166007 |
|
2018-10-20 05:21:29 | 2018-10-29 01:17:24 | 2018-10-29 02:37:25 | 1:20:01 | 1:06:09 | 0:13:52 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh011 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 3166008 |
|
2018-10-20 05:21:30 | 2018-10-29 01:34:52 | 2018-10-29 02:50:53 | 1:16:01 | 0:40:51 | 0:35:10 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166009 |
|
2018-10-20 05:21:30 | 2018-10-29 01:39:10 | 2018-10-29 03:07:11 | 1:28:01 | 0:53:27 | 0:34:34 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3166010 |
|
2018-10-20 05:21:31 | 2018-10-29 01:56:49 | 2018-10-29 06:38:54 | 4:42:05 | 3:49:42 | 0:52:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh069 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 3166011 |
|
2018-10-20 05:21:32 | 2018-10-29 02:05:03 | 2018-10-29 03:03:03 | 0:58:00 | 0:25:46 | 0:32:14 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166012 |
|
2018-10-20 05:21:33 | 2018-10-29 02:05:14 | 2018-10-29 02:59:15 | 0:54:01 | 0:39:21 | 0:14:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-10-29 02:37:00.885930 mon.a mon.0 158.69.67.33:6789/0 147 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 1,2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166013 |
|
2018-10-20 05:21:33 | 2018-10-29 02:21:56 | 2018-10-29 06:17:59 | 3:56:03 | 3:37:39 | 0:18:24 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh007 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| pass | 3166014 |
|
2018-10-20 05:21:34 | 2018-10-29 18:16:06 | 2018-10-29 19:26:07 | 1:10:01 | 0:27:35 | 0:42:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166015 |
|
2018-10-20 05:21:35 | 2018-10-29 18:19:26 | 2018-10-29 20:41:28 | 2:22:02 | 1:28:01 | 0:54:01 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3166016 |
|
2018-10-20 05:21:36 | 2018-10-29 18:24:52 | 2018-10-29 19:28:52 | 1:04:00 | 0:22:20 | 0:41:40 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| fail | 3166017 |
|
2018-10-20 05:21:37 | 2018-10-29 18:32:15 | 2018-10-29 20:14:16 | 1:42:01 | 1:01:52 | 0:40:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-29 19:21:14.581323 mon.b mon.0 158.69.65.127:6789/0 628 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec. Implicated osds 1,2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166018 |
|
2018-10-20 05:21:37 | 2018-10-29 18:32:47 | 2018-10-29 20:18:49 | 1:46:02 | 1:26:12 | 0:19:50 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-29 19:30:18.518944 mon.b mon.0 158.69.64.209:6789/0 233 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166019 |
|
2018-10-20 05:21:38 | 2018-10-29 18:35:13 | 2018-10-29 19:21:13 | 0:46:00 | 0:23:31 | 0:22:29 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| fail | 3166020 |
|
2018-10-20 05:21:39 | 2018-10-29 18:39:55 | 2018-10-29 19:41:56 | 1:02:01 | 0:40:29 | 0:21:32 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-29 19:17:15.971841 mon.a mon.0 158.69.67.92:6789/0 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 3166021 |
|
2018-10-20 05:21:40 | 2018-10-29 18:42:06 | 2018-10-29 19:24:06 | 0:42:00 | 0:19:43 | 0:22:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3166022 |
|
2018-10-20 05:21:40 | 2018-10-29 18:43:31 | 2018-10-29 19:59:31 | 1:16:00 | 0:27:48 | 0:48:12 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3166023 |
|
2018-10-20 05:21:41 | 2018-10-29 19:04:21 | 2018-10-29 21:04:22 | 2:00:01 | 1:39:18 | 0:20:43 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||
Failure Reason:
"2018-10-29 19:36:58.491201 mon.a mon.0 158.69.65.116:6789/0 241 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166024 |
|
2018-10-20 05:21:42 | 2018-10-29 19:05:37 | 2018-10-29 20:05:37 | 1:00:00 | 0:26:19 | 0:33:41 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166025 |
|
2018-10-20 05:21:43 | 2018-10-29 19:21:28 | 2018-10-29 21:17:29 | 1:56:01 | 1:30:26 | 0:25:35 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:20:51.225799 mon.b mon.0 158.69.64.51:6789/0 3211 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 3166026 |
|
2018-10-20 05:21:44 | 2018-10-29 19:23:23 | 2018-10-29 21:09:25 | 1:46:02 | 1:13:44 | 0:32:18 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:04:25.567852 mon.a mon.0 158.69.65.75:6789/0 152 : cluster [WRN] Health check failed: 36 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166027 |
|
2018-10-20 05:21:44 | 2018-10-29 19:24:19 | 2018-10-29 20:44:19 | 1:20:00 | 0:24:44 | 0:55:16 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166028 |
|
2018-10-20 05:21:45 | 2018-10-29 19:26:10 | 2018-10-29 21:16:11 | 1:50:01 | 1:29:06 | 0:20:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:38:09.338495 mon.b mon.0 158.69.66.59:6789/0 241 : cluster [WRN] Health check failed: 163 slow requests are blocked > 32 sec. Implicated osds 1,2,4,5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166029 |
|
2018-10-20 05:21:46 | 2018-10-29 19:28:45 | 2018-10-29 20:42:45 | 1:14:00 | 0:31:56 | 0:42:04 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3166030 |
|
2018-10-20 05:21:47 | 2018-10-29 19:28:54 | 2018-10-29 21:04:55 | 1:36:01 | 0:30:50 | 1:05:11 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166031 |
|
2018-10-20 05:21:48 | 2018-10-29 19:37:26 | 2018-10-29 21:35:27 | 1:58:01 | 1:50:35 | 0:07:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:45:25.919380 mon.b mon.0 158.69.66.167:6789/0 422 : cluster [WRN] Health check failed: 41 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166032 |
|
2018-10-20 05:21:49 | 2018-10-29 19:41:58 | 2018-10-29 23:46:02 | 4:04:04 | 3:38:00 | 0:26:04 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/iozone.sh) on ovh041 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh' |
||||||||||||||
| dead | 3166033 |
|
2018-10-20 05:21:50 | 2018-10-29 19:42:18 | 2018-10-30 12:46:03 | 17:03:45 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3166034 |
|
2018-10-20 05:21:50 | 2018-10-29 19:59:48 | 2018-10-29 21:07:48 | 1:08:00 | 0:54:32 | 0:13:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:38:06.306298 mon.a mon.0 158.69.66.77:6789/0 162 : cluster [WRN] Health check failed: 74 slow requests are blocked > 32 sec. Implicated osds 0,3,4,7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166035 |
|
2018-10-20 05:21:51 | 2018-10-29 20:05:51 | 2018-10-29 21:13:51 | 1:08:00 | 0:53:34 | 0:14:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-29 20:52:27.994130 mon.a mon.0 158.69.66.29:6789/0 233 : cluster [WRN] Health check failed: 26 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166036 |
|
2018-10-20 05:21:52 | 2018-10-29 20:14:22 | 2018-10-29 21:42:23 | 1:28:01 | 0:24:10 | 1:03:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166037 |
|
2018-10-20 05:21:53 | 2018-10-29 20:18:51 | 2018-10-29 21:42:52 | 1:24:01 | 0:37:33 | 0:46:28 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 3166038 |
|
2018-10-20 05:21:54 | 2018-10-29 20:41:31 | 2018-10-30 00:45:35 | 4:04:04 | 3:39:17 | 0:24:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/fsx.sh) on ovh060 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| pass | 3166039 |
|
2018-10-20 05:21:54 | 2018-10-29 20:42:48 | 2018-10-29 21:58:49 | 1:16:01 | 0:37:26 | 0:38:35 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166040 |
|
2018-10-20 05:21:55 | 2018-10-29 20:44:27 | 2018-10-29 21:58:28 | 1:14:01 | 0:48:37 | 0:25:24 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 3166041 |
|
2018-10-20 05:21:56 | 2018-10-29 21:04:27 | 2018-10-29 21:36:27 | 0:32:00 | 0:22:34 | 0:09:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3166042 |
|
2018-10-20 05:21:57 | 2018-10-29 21:04:56 | 2018-10-29 22:30:57 | 1:26:01 | 0:42:27 | 0:43:34 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166043 |
|
2018-10-20 05:21:58 | 2018-10-29 21:08:04 | 2018-10-29 23:08:05 | 2:00:01 | 1:35:08 | 0:24:53 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-29 21:40:54.969374 mon.a mon.0 158.69.65.68:6789/0 153 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec. Implicated osds 0 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166044 |
|
2018-10-20 05:21:58 | 2018-10-29 21:09:38 | 2018-10-29 22:09:38 | 1:00:00 | 0:22:18 | 0:37:42 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3166045 |
|
2018-10-20 05:21:59 | 2018-10-29 21:13:54 | 2018-10-29 22:19:54 | 1:06:00 | 0:28:16 | 0:37:44 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166046 |
|
2018-10-20 05:22:00 | 2018-10-29 21:16:24 | 2018-10-29 21:54:24 | 0:38:00 | 0:19:47 | 0:18:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3166047 |
|
2018-10-20 05:22:01 | 2018-10-29 21:17:43 | 2018-10-29 22:21:43 | 1:04:00 | 0:26:55 | 0:37:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3166048 |
|
2018-10-20 05:22:02 | 2018-10-29 21:35:30 | 2018-10-29 23:29:32 | 1:54:02 | 1:40:11 | 0:13:51 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | ||
Failure Reason:
"2018-10-29 22:21:27.727573 mon.a mon.0 158.69.64.116:6789/0 166 : cluster [WRN] Health check failed: 204 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166049 |
|
2018-10-20 05:22:03 | 2018-10-29 21:36:35 | 2018-10-29 23:06:36 | 1:30:01 | 0:31:02 | 0:58:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166050 |
|
2018-10-20 05:22:04 | 2018-10-29 21:42:36 | 2018-10-30 00:24:38 | 2:42:02 | 2:18:24 | 0:23:38 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| pass | 3166051 |
|
2018-10-20 05:22:04 | 2018-10-29 21:42:53 | 2018-10-29 23:16:54 | 1:34:01 | 1:08:24 | 0:25:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
| dead | 3166052 |
|
2018-10-20 05:22:05 | 2018-10-29 21:52:49 | 2018-10-30 12:35:15 | 14:42:26 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| pass | 3166053 |
|
2018-10-20 05:22:06 | 2018-10-29 21:54:27 | 2018-10-30 00:02:28 | 2:08:01 | 1:39:51 | 0:28:10 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
| pass | 3166054 |
|
2018-10-20 05:22:07 | 2018-10-29 21:58:32 | 2018-10-29 23:10:32 | 1:12:00 | 0:31:15 | 0:40:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3166055 |
|
2018-10-20 05:22:08 | 2018-10-29 21:58:50 | 2018-10-29 23:26:51 | 1:28:01 | 0:25:27 | 1:02:34 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166056 |
|
2018-10-20 05:22:09 | 2018-10-29 22:09:53 | 2018-10-30 00:17:55 | 2:08:02 | 1:54:17 | 0:13:45 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||
Failure Reason:
"2018-10-29 23:12:21.028980 mon.b mon.0 158.69.66.234:6789/0 327 : cluster [WRN] Health check failed: 105 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166057 |
|
2018-10-20 05:22:09 | 2018-10-29 22:20:11 | 2018-10-29 23:36:11 | 1:16:00 | 1:08:00 | 0:08:00 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 3166058 |
|
2018-10-20 05:22:10 | 2018-10-29 22:21:46 | 2018-10-29 23:49:46 | 1:28:00 | 0:48:01 | 0:39:59 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166059 |
|
2018-10-20 05:22:11 | 2018-10-29 22:31:00 | 2018-10-30 00:13:01 | 1:42:01 | 0:55:34 | 0:46:27 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
| fail | 3166060 |
|
2018-10-20 05:22:12 | 2018-10-29 23:06:51 | 2018-10-30 00:40:52 | 1:34:01 | 1:15:38 | 0:18:23 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-29 23:29:33.415254 mon.a mon.0 158.69.65.48:6789/0 151 : cluster [WRN] Health check failed: 15 slow requests are blocked > 32 sec. Implicated osds 0,1,7 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166061 |
|
2018-10-20 05:22:13 | 2018-10-29 23:08:19 | 2018-10-30 00:42:20 | 1:34:01 | 0:25:23 | 1:08:38 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166062 |
|
2018-10-20 05:22:13 | 2018-10-29 23:10:35 | 2018-10-30 00:14:36 | 1:04:01 | 0:45:48 | 0:18:13 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-10-29 23:37:10.975380 mon.b mon.0 158.69.64.188:6789/0 145 : cluster [WRN] Health check failed: 107 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166063 |
|
2018-10-20 05:22:14 | 2018-10-29 23:16:58 | 2018-10-30 00:26:58 | 1:10:00 | 0:56:04 | 0:13:56 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| fail | 3166064 |
|
2018-10-20 05:22:15 | 2018-10-29 23:26:55 | 2018-10-30 00:00:55 | 0:34:00 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | ||||
Failure Reason:
[Errno None] Unable to connect to port 22 on 158.69.64.116 |
||||||||||||||
| fail | 3166065 |
|
2018-10-20 05:22:16 | 2018-10-29 23:29:47 | 2018-10-30 02:11:49 | 2:42:02 | 2:32:04 | 0:09:58 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-30 01:05:01.448954 mon.b mon.0 158.69.65.199:6789/0 41 : cluster [ERR] Health check failed: 1 stuck requests are blocked > 4096 sec. Implicated osds 0 (REQUEST_STUCK)" in cluster log |
||||||||||||||
| pass | 3166066 |
|
2018-10-20 05:22:17 | 2018-10-29 23:36:25 | 2018-10-30 00:08:25 | 0:32:00 | 0:21:00 | 0:11:00 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| fail | 3166067 |
|
2018-10-20 05:22:17 | 2018-10-29 23:46:18 | 2018-10-30 01:30:19 | 1:44:01 | 1:00:57 | 0:43:04 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | ||
Failure Reason:
"2018-10-30 00:49:06.788504 mon.b mon.0 158.69.64.116:6789/0 996 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166068 |
|
2018-10-20 05:22:18 | 2018-10-29 23:49:50 | 2018-10-30 01:37:51 | 1:48:01 | 1:29:24 | 0:18:37 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||
Failure Reason:
"2018-10-30 00:23:09.548890 mon.b mon.0 158.69.64.85:6789/0 239 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec. Implicated osds 1 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166069 |
|
2018-10-20 05:22:19 | 2018-10-30 00:01:03 | 2018-10-30 00:53:03 | 0:52:00 | 0:23:24 | 0:28:36 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3166070 |
|
2018-10-20 05:22:20 | 2018-10-30 00:02:42 | 2018-10-30 01:22:43 | 1:20:01 | 0:42:39 | 0:37:22 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166071 |
|
2018-10-20 05:22:21 | 2018-10-30 00:08:38 | 2018-10-30 00:42:38 | 0:34:00 | 0:20:02 | 0:13:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3166072 |
|
2018-10-20 05:22:21 | 2018-10-30 00:13:19 | 2018-10-30 00:45:18 | 0:31:59 | 0:22:54 | 0:09:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| fail | 3166073 |
|
2018-10-20 05:22:22 | 2018-10-30 00:14:49 | 2018-10-30 00:36:49 | 0:22:00 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | ||||
Failure Reason:
Command failed on ovh098 with status 1: 'sudo python -c \'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))\' /etc/rsyslog.d/80-cephtest.conf' |
||||||||||||||
| pass | 3166074 |
|
2018-10-20 05:22:23 | 2018-10-30 00:18:09 | 2018-10-30 01:48:10 | 1:30:01 | 0:25:39 | 1:04:22 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166075 |
|
2018-10-20 05:22:24 | 2018-10-30 00:24:55 | 2018-10-30 02:04:56 | 1:40:01 | 0:58:27 | 0:41:34 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 3166076 |
|
2018-10-20 05:22:25 | 2018-10-30 00:27:11 | 2018-10-30 02:03:12 | 1:36:01 | 1:08:22 | 0:27:39 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-30 00:59:59.890964 mon.a mon.0 158.69.64.223:6789/0 154 : cluster [WRN] Health check failed: 22 slow requests are blocked > 32 sec. Implicated osds 3 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166077 |
|
2018-10-20 05:22:25 | 2018-10-30 00:37:04 | 2018-10-30 01:31:04 | 0:54:00 | 0:24:09 | 0:29:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | ||
| dead | 3166078 |
|
2018-10-20 05:22:26 | 2018-10-30 00:40:57 | 2018-10-30 12:52:55 | 12:11:58 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||||
| pass | 3166079 |
|
2018-10-20 05:22:27 | 2018-10-30 00:42:35 | 2018-10-30 01:36:35 | 0:54:00 | 0:31:55 | 0:22:05 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
| pass | 3166080 |
|
2018-10-20 05:22:28 | 2018-10-30 00:42:39 | 2018-10-30 02:00:40 | 1:18:01 | 0:32:17 | 0:45:44 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | ||
| dead | 3166081 |
|
2018-10-20 05:22:29 | 2018-10-30 00:45:21 | 2018-10-30 12:47:56 | 12:02:35 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | ||||
| pass | 3166082 |
|
2018-10-20 05:22:29 | 2018-10-30 00:45:36 | 2018-10-30 02:45:38 | 2:00:02 | 1:27:56 | 0:32:06 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| dead | 3166083 |
|
2018-10-20 05:22:30 | 2018-10-30 00:53:14 | 2018-10-30 13:05:23 | 12:12:09 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3166084 |
|
2018-10-20 05:22:31 | 2018-10-30 01:22:59 | 2018-10-30 02:33:00 | 1:10:01 | 0:54:17 | 0:15:44 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-10-30 02:05:36.534275 mon.a mon.0 158.69.65.48:6789/0 150 : cluster [WRN] Health check failed: 29 slow requests are blocked > 32 sec. Implicated osds 4,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| fail | 3166085 |
|
2018-10-20 05:22:32 | 2018-10-30 01:30:36 | 2018-10-30 02:54:37 | 1:24:01 | 0:55:41 | 0:28:20 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-10-30 02:05:45.717857 mon.b mon.0 158.69.67.100:6789/0 138 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166086 |
|
2018-10-20 05:22:33 | 2018-10-30 01:31:06 | 2018-10-30 02:27:06 | 0:56:00 | 0:26:24 | 0:29:36 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166087 |
|
2018-10-20 05:22:34 | 2018-10-30 01:36:51 | 2018-10-30 03:02:52 | 1:26:01 | 0:44:52 | 0:41:09 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 3166088 |
|
2018-10-20 05:22:34 | 2018-10-30 01:38:07 | 2018-10-30 02:58:08 | 1:20:01 | 1:00:13 | 0:19:48 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | ||
| pass | 3166089 |
|
2018-10-20 05:22:35 | 2018-10-30 01:48:25 | 2018-10-30 03:04:25 | 1:16:00 | 0:35:36 | 0:40:24 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166090 |
|
2018-10-20 05:22:36 | 2018-10-30 02:00:55 | 2018-10-30 06:20:59 | 4:20:04 | 3:52:44 | 0:27:20 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on ovh032 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a4eed4eda9139ae3d9371f9569b2b3d0bdec2cae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 3166091 |
|
2018-10-20 05:22:37 | 2018-10-30 02:03:26 | 2018-10-30 03:19:27 | 1:16:01 | 0:22:14 | 0:53:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | ||
| pass | 3166092 |
|
2018-10-20 05:22:38 | 2018-10-30 02:04:59 | 2018-10-30 03:27:00 | 1:22:01 | 0:42:21 | 0:39:40 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | ||
| fail | 3166093 |
|
2018-10-20 05:22:39 | 2018-10-30 02:11:52 | 2018-10-30 02:17:51 | 0:05:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | ||||
Failure Reason:
[Errno None] Unable to connect to port 22 on 158.69.65.163 |
||||||||||||||
| pass | 3166094 |
|
2018-10-20 05:22:39 | 2018-10-30 02:17:54 | 2018-10-30 03:11:54 | 0:54:00 | 0:22:43 | 0:31:17 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | ||
| pass | 3166095 |
|
2018-10-20 05:22:40 | 2018-10-30 04:19:15 | 2018-10-30 14:11:26 | 9:52:11 | 0:28:44 | 9:23:27 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | ||
| pass | 3166096 |
|
2018-10-20 05:22:41 | 2018-10-30 12:37:32 | 2018-10-30 13:15:31 | 0:37:59 | 0:19:04 | 0:18:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | ||
| pass | 3166097 |
|
2018-10-20 05:22:42 | 2018-10-30 12:37:32 | 2018-10-30 13:17:31 | 0:39:59 | 0:22:04 | 0:17:55 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | ||
| dead | 3166098 |
|
2018-10-20 05:22:43 | 2018-10-30 07:59:49 | ovh | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | — | ||||||
Failure Reason:
reached maximum tries (60) after waiting for 600 seconds |
||||||||||||||
| dead | 3166099 |
|
2018-10-20 05:22:44 | 2018-10-30 10:18:17 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | ||||||
Failure Reason:
reached maximum tries (60) after waiting for 600 seconds |
||||||||||||||
| pass | 3166100 |
|
2018-10-20 05:22:44 | 2018-10-30 12:37:32 | 2018-10-30 14:51:32 | 2:14:00 | 1:59:36 | 0:14:24 | ovh | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | ||
| fail | 3166101 |
|
2018-10-20 05:22:45 | 2018-10-30 12:37:32 | 2018-10-30 14:27:32 | 1:50:00 | 1:37:01 | 0:12:59 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-10-30 13:08:47.004411 mon.b mon.0 158.69.64.219:6789/0 251 : cluster [WRN] Health check failed: 84 slow requests are blocked > 32 sec. Implicated osds 5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| dead | 3166102 |
|
2018-10-20 05:22:46 | 2018-10-30 21:25:34 | 2018-10-31 09:42:25 | 12:16:51 | ovh | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | 6 | ||||
| fail | 3166103 |
|
2018-10-20 05:22:47 | 2018-10-30 21:31:27 | 2018-10-30 23:17:28 | 1:46:01 | 1:31:35 | 0:14:26 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-10-30 22:07:56.278411 mon.a mon.0 158.69.65.199:6789/0 252 : cluster [WRN] Health check failed: 69 slow requests are blocked > 32 sec. Implicated osds 2,4 (REQUEST_SLOW)" in cluster log |
||||||||||||||
| pass | 3166104 |
|
2018-10-20 05:22:48 | 2018-10-30 21:37:01 | 2018-10-30 22:23:01 | 0:46:00 | 0:31:13 | 0:14:47 | ovh | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml ms-die-on-skipped.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | ||
Pulpito