User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2018-10-03 15:07:27 | 2018-10-03 17:42:37 | 2018-10-04 06:16:58 | 12:34:21 | kcephfs | wip-yuri-testing-2018-10-02-2105-luminous | smithi | f1f01e6 | 54 | 7 | 5 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 3098329 | 2018-10-03 15:07:32 | 2018-10-03 17:24:29 | 2018-10-03 17:44:29 | 0:20:00 | 0:08:17 | 0:11:43 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 3098330 | 2018-10-03 15:07:33 | 2018-10-03 17:26:34 | 2018-10-03 18:28:34 | 1:02:00 | 0:42:57 | 0:19:03 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
dead | 3098331 | 2018-10-03 15:07:34 | 2018-10-03 17:26:34 | 2018-10-04 05:28:49 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | — | |||||
fail | 3098332 | 2018-10-03 15:07:34 | 2018-10-03 17:28:34 | 2018-10-03 18:02:34 | 0:34:00 | 0:22:46 | 0:11:14 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-03 17:46:13.128570 mon.a mon.0 172.21.15.162:6789/0 417 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
pass | 3098333 | 2018-10-03 15:07:35 | 2018-10-03 17:28:34 | 2018-10-03 18:14:34 | 0:46:00 | 0:28:04 | 0:17:56 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
dead | 3098334 | 2018-10-03 15:07:36 | 2018-10-03 17:28:34 | 2018-10-04 05:30:49 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | |||||
pass | 3098335 | 2018-10-03 15:07:36 | 2018-10-03 17:28:34 | 2018-10-03 18:12:34 | 0:44:00 | 0:25:22 | 0:18:38 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 3098336 | 2018-10-03 15:07:37 | 2018-10-03 17:28:34 | 2018-10-04 02:14:44 | 8:46:10 | 0:10:18 | 8:35:52 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | |||
pass | 3098337 | 2018-10-03 15:07:38 | 2018-10-03 17:28:35 | 2018-10-03 18:48:36 | 1:20:01 | 0:25:37 | 0:54:24 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
pass | 3098338 | 2018-10-03 15:07:39 | 2018-10-03 17:28:43 | 2018-10-03 17:58:43 | 0:30:00 | 0:17:42 | 0:12:18 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
dead | 3098339 | 2018-10-03 15:07:39 | 2018-10-03 17:30:09 | 2018-10-04 05:32:23 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | — | |||||
pass | 3098340 | 2018-10-03 15:07:40 | 2018-10-03 17:30:21 | 2018-10-03 18:22:21 | 0:52:00 | 0:43:32 | 0:08:28 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
pass | 3098341 | 2018-10-03 15:07:41 | 2018-10-03 17:30:26 | 2018-10-04 03:34:37 | 10:04:11 | 0:10:56 | 9:53:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
pass | 3098342 | 2018-10-03 15:07:41 | 2018-10-03 17:30:32 | 2018-10-03 17:56:31 | 0:25:59 | 0:11:33 | 0:14:26 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 3098343 | 2018-10-03 15:07:42 | 2018-10-03 17:32:15 | 2018-10-03 18:32:15 | 1:00:00 | 0:38:43 | 0:21:17 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
pass | 3098344 | 2018-10-03 15:07:43 | 2018-10-03 17:32:20 | 2018-10-03 18:28:20 | 0:56:00 | 0:43:18 | 0:12:42 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 3098345 | 2018-10-03 15:07:44 | 2018-10-03 17:32:32 | 2018-10-04 02:16:42 | 8:44:10 | 0:12:55 | 8:31:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | |||
fail | 3098346 | 2018-10-03 15:07:44 | 2018-10-03 17:32:32 | 2018-10-03 18:48:33 | 1:16:01 | 1:02:35 | 0:13:26 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-03 17:52:39.698853 mon.b mon.0 172.21.15.100:6789/0 226 : cluster [WRN] Health check failed: 1177 slow requests are blocked > 32 sec. Implicated osds 2 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3098347 | 2018-10-03 15:07:45 | 2018-10-03 17:34:36 | 2018-10-04 02:26:46 | 8:52:10 | 0:24:25 | 8:27:45 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | |||
pass | 3098348 | 2018-10-03 15:07:46 | 2018-10-03 17:36:36 | 2018-10-03 17:54:35 | 0:17:59 | 0:08:32 | 0:09:27 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 3098349 | 2018-10-03 15:07:47 | 2018-10-03 17:36:36 | 2018-10-04 02:26:46 | 8:50:10 | 0:21:32 | 8:28:38 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | 6 | |||
pass | 3098350 | 2018-10-03 15:07:47 | 2018-10-03 17:36:36 | 2018-10-03 18:38:36 | 1:02:00 | 0:26:15 | 0:35:45 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
pass | 3098351 | 2018-10-03 15:07:48 | 2018-10-03 17:36:36 | 2018-10-03 18:04:36 | 0:28:00 | 0:15:08 | 0:12:52 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 3098352 | 2018-10-03 15:07:49 | 2018-10-03 17:38:29 | 2018-10-03 18:06:29 | 0:28:00 | 0:10:35 | 0:17:25 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml whitelist_health.yaml} | 6 | |||
pass | 3098353 | 2018-10-03 15:07:49 | 2018-10-03 17:38:29 | 2018-10-03 18:28:29 | 0:50:00 | 0:22:05 | 0:27:55 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
pass | 3098354 | 2018-10-03 15:07:50 | 2018-10-03 17:38:29 | 2018-10-03 17:58:28 | 0:19:59 | 0:08:47 | 0:11:12 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 3098355 | 2018-10-03 15:07:51 | 2018-10-03 17:38:32 | 2018-10-03 18:58:33 | 1:20:01 | 0:09:57 | 1:10:04 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml whitelist_health.yaml} | 6 | |||
pass | 3098356 | 2018-10-03 15:07:52 | 2018-10-03 17:38:32 | 2018-10-03 18:14:32 | 0:36:00 | 0:10:19 | 0:25:41 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 3098357 | 2018-10-03 15:07:52 | 2018-10-03 17:40:26 | 2018-10-03 18:38:26 | 0:58:00 | 0:36:34 | 0:21:26 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 3098358 | 2018-10-03 15:07:53 | 2018-10-03 17:40:36 | 2018-10-03 19:58:38 | 2:18:02 | 0:16:33 | 2:01:29 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml whitelist_health.yaml} | 6 | |||
pass | 3098359 | 2018-10-03 15:07:54 | 2018-10-03 17:42:37 | 2018-10-03 18:26:37 | 0:44:00 | 0:09:58 | 0:34:02 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
pass | 3098360 | 2018-10-03 15:07:54 | 2018-10-03 17:42:37 | 2018-10-04 04:42:50 | 11:00:13 | 0:38:42 | 10:21:31 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml whitelist_health.yaml} | 6 | |||
pass | 3098361 | 2018-10-03 15:07:55 | 2018-10-03 17:42:47 | 2018-10-03 18:06:47 | 0:24:00 | 0:07:57 | 0:16:03 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 | |||
pass | 3098362 | 2018-10-03 15:07:56 | 2018-10-03 17:44:29 | 2018-10-03 18:10:28 | 0:25:59 | 0:07:53 | 0:18:06 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 | |||
pass | 3098363 | 2018-10-03 15:07:56 | 2018-10-03 17:44:30 | 2018-10-03 19:08:30 | 1:24:00 | 0:30:13 | 0:53:47 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
fail | 3098364 | 2018-10-03 15:07:57 | 2018-10-03 17:44:41 | 2018-10-03 18:02:40 | 0:17:59 | 0:04:26 | 0:13:33 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml whitelist_health.yaml} | 6 | |||
Failure Reason:
Command failed on smithi116 with status 100: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph-mds=12.2.8-364-gf1f01e6-1xenial ceph=12.2.8-364-gf1f01e6-1xenial rbd-fuse=12.2.8-364-gf1f01e6-1xenial librbd1=12.2.8-364-gf1f01e6-1xenial python3-cephfs=12.2.8-364-gf1f01e6-1xenial ceph-fuse=12.2.8-364-gf1f01e6-1xenial python-ceph=12.2.8-364-gf1f01e6-1xenial ceph-mgr=12.2.8-364-gf1f01e6-1xenial ceph-common=12.2.8-364-gf1f01e6-1xenial python3-rados=12.2.8-364-gf1f01e6-1xenial libcephfs-dev=12.2.8-364-gf1f01e6-1xenial ceph-test=12.2.8-364-gf1f01e6-1xenial radosgw=12.2.8-364-gf1f01e6-1xenial librados2=12.2.8-364-gf1f01e6-1xenial libcephfs-java=12.2.8-364-gf1f01e6-1xenial libcephfs2=12.2.8-364-gf1f01e6-1xenial libcephfs-jni=12.2.8-364-gf1f01e6-1xenial' |
||||||||||||||
fail | 3098365 | 2018-10-03 15:07:58 | 2018-10-03 17:48:30 | 2018-10-03 18:22:29 | 0:33:59 | 0:16:39 | 0:17:20 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-10-03 18:11:36.357120 mon.b mon.0 172.21.15.61:6789/0 463 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
pass | 3098366 | 2018-10-03 15:07:59 | 2018-10-03 17:48:34 | 2018-10-03 18:40:34 | 0:52:00 | 0:29:01 | 0:22:59 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 | |||
pass | 3098367 | 2018-10-03 15:07:59 | 2018-10-03 17:50:32 | 2018-10-03 21:48:36 | 3:58:04 | 0:18:20 | 3:39:44 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml whitelist_health.yaml} | 6 | |||
pass | 3098368 | 2018-10-03 15:08:00 | 2018-10-03 17:50:32 | 2018-10-03 18:26:32 | 0:36:00 | 0:24:13 | 0:11:47 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 | |||
pass | 3098369 | 2018-10-03 15:08:01 | 2018-10-03 17:52:19 | 2018-10-03 19:32:20 | 1:40:01 | 0:22:30 | 1:17:31 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml whitelist_health.yaml} | 6 | |||
pass | 3098370 | 2018-10-03 15:08:01 | 2018-10-03 17:52:27 | 2018-10-03 18:48:27 | 0:56:00 | 0:39:56 | 0:16:04 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 3098371 | 2018-10-03 15:08:02 | 2018-10-03 17:52:43 | 2018-10-03 18:28:43 | 0:36:00 | 0:17:48 | 0:18:12 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 | |||
pass | 3098372 | 2018-10-03 15:08:03 | 2018-10-03 17:54:44 | 2018-10-03 20:22:46 | 2:28:02 | 0:13:53 | 2:14:09 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml whitelist_health.yaml} | 6 | |||
pass | 3098373 | 2018-10-03 15:08:03 | 2018-10-03 17:54:44 | 2018-10-03 18:40:44 | 0:46:00 | 0:34:41 | 0:11:19 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 | |||
pass | 3098374 | 2018-10-03 15:08:04 | 2018-10-03 17:56:08 | 2018-10-03 18:50:08 | 0:54:00 | 0:13:19 | 0:40:41 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml whitelist_health.yaml} | 6 | |||
fail | 3098375 | 2018-10-03 15:08:05 | 2018-10-03 17:56:17 | 2018-10-03 19:14:17 | 1:18:00 | 1:03:52 | 0:14:08 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-03 18:18:53.175784 mon.a mon.0 172.21.15.19:6789/0 195 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
pass | 3098376 | 2018-10-03 15:08:05 | 2018-10-03 17:56:31 | 2018-10-03 18:46:31 | 0:50:00 | 0:36:28 | 0:13:32 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 | |||
pass | 3098377 | 2018-10-03 15:08:06 | 2018-10-03 17:56:32 | 2018-10-03 18:36:32 | 0:40:00 | 0:30:21 | 0:09:39 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
dead | 3098378 | 2018-10-03 15:08:07 | 2018-10-03 17:58:38 | 2018-10-04 06:00:52 | 12:02:14 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml whitelist_health.yaml} | — | |||||
fail | 3098379 | 2018-10-03 15:08:08 | 2018-10-03 17:58:38 | 2018-10-03 19:18:39 | 1:20:01 | 1:05:40 | 0:14:21 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 | |||
Failure Reason:
"2018-10-03 18:18:55.249357 mon.b mon.0 172.21.15.5:6789/0 150 : cluster [WRN] Health check failed: 10730 slow requests are blocked > 32 sec. Implicated osds 0,2,4,5,6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3098380 | 2018-10-03 15:08:08 | 2018-10-03 17:58:44 | 2018-10-03 22:08:48 | 4:10:04 | 0:10:40 | 3:59:24 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml whitelist_health.yaml} | 6 | |||
pass | 3098381 | 2018-10-03 15:08:09 | 2018-10-03 18:02:45 | 2018-10-03 18:22:44 | 0:19:59 | 0:09:02 | 0:10:57 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 | |||
pass | 3098382 | 2018-10-03 15:08:10 | 2018-10-03 18:02:45 | 2018-10-04 02:54:55 | 8:52:10 | 0:29:05 | 8:23:05 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml whitelist_health.yaml} | 6 | |||
pass | 3098383 | 2018-10-03 15:08:10 | 2018-10-03 18:02:45 | 2018-10-03 19:10:45 | 1:08:00 | 0:39:29 | 0:28:31 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 | |||
pass | 3098384 | 2018-10-03 15:08:11 | 2018-10-03 18:02:45 | 2018-10-03 18:56:45 | 0:54:00 | 0:25:16 | 0:28:44 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 | |||
pass | 3098385 | 2018-10-03 15:08:12 | 2018-10-03 16:48:32 | 2018-10-03 22:30:38 | 5:42:06 | 0:10:28 | 5:31:38 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml whitelist_health.yaml} | 6 | |||
pass | 3098386 | 2018-10-03 15:08:13 | 2018-10-03 18:02:45 | 2018-10-03 18:32:45 | 0:30:00 | 0:11:00 | 0:19:00 | smithi | master | kcephfs/thrash/{clusters/1-mds-1-client.yaml conf.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 | |||
pass | 3098387 | 2018-10-03 15:08:13 | 2018-10-03 18:04:45 | 2018-10-03 18:28:44 | 0:23:59 | 0:08:32 | 0:15:27 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 | |||
pass | 3098388 | 2018-10-03 15:08:14 | 2018-10-03 18:06:30 | 2018-10-04 02:16:40 | 8:10:10 | 0:13:03 | 7:57:07 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml whitelist_health.yaml} | 6 | |||
fail | 3098389 | 2018-10-03 15:08:15 | 2018-10-03 18:06:48 | 2018-10-03 18:54:48 | 0:48:00 | 0:22:06 | 0:25:54 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 | |||
Failure Reason:
"2018-10-03 18:36:38.666610 mon.b mon.0 172.21.15.44:6789/0 235 : cluster [WRN] Health check failed: 15 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log |
||||||||||||||
pass | 3098390 | 2018-10-03 15:08:15 | 2018-10-03 18:10:30 | 2018-10-03 19:04:30 | 0:54:00 | 0:25:02 | 0:28:58 | smithi | master | kcephfs/mixed-clients/{clusters/1-mds-2-client.yaml conf.yaml objectstore-ec/filestore-xfs.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 | |||
pass | 3098391 | 2018-10-03 15:08:16 | 2018-10-03 18:12:33 | 2018-10-03 20:20:35 | 2:08:02 | 0:24:18 | 1:43:44 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml whitelist_health.yaml} | 6 | |||
pass | 3098392 | 2018-10-03 15:08:17 | 2018-10-03 18:12:35 | 2018-10-03 18:32:35 | 0:20:00 | 0:09:53 | 0:10:07 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 | |||
dead | 3098393 | 2018-10-03 15:08:18 | 2018-10-03 18:14:43 | 2018-10-04 06:16:58 | 12:02:15 | smithi | master | kcephfs/recovery/{clusters/1-mds-4-client.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml whitelist_health.yaml} | — | |||||
pass | 3098394 | 2018-10-03 15:08:18 | 2018-10-03 18:14:43 | 2018-10-03 18:36:43 | 0:22:00 | 0:07:38 | 0:14:22 | smithi | master | kcephfs/cephfs/{clusters/1-mds-1-client.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml overrides/{debug.yaml frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |