| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| pdonnell | 2018-04-06 22:40:34 | 2018-04-08 15:12:31 | 2018-04-09 01:03:12 | 9:50:41 | multimds | master | smithi | 2156fd0 | 120 | 478 | 2 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 2366060 |
|
2018-04-06 22:40:48 | 2018-04-08 15:12:31 | 2018-04-08 15:32:30 | 0:19:59 | 0:09:19 | 0:10:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366061 |
|
2018-04-06 22:40:49 | 2018-04-08 15:12:37 | 2018-04-08 16:08:37 | 0:56:00 | 0:09:18 | 0:46:42 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:05:52.594309 mon.b mon.0 172.21.15.156:6789/0 237 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 86 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366062 |
|
2018-04-06 22:40:49 | 2018-04-08 15:14:11 | 2018-04-08 16:16:12 | 1:02:01 | 0:42:14 | 0:19:47 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:51:14.529455 mon.a mon.0 172.21.15.47:6789/0 177 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 748 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366063 |
|
2018-04-06 22:40:50 | 2018-04-08 15:14:18 | 2018-04-08 15:52:16 | 0:37:58 | 0:20:00 | 0:17:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:48:43.564972 mds.b mds.1 172.21.15.109:6817/3347618994 1 : cluster [ERR] replayed stray Session close event for client.5434 172.21.15.48:0/2801371376 from time 2018-04-08 15:43:43.581727, ignoring" in cluster log |
||||||||||||||
| fail | 2366064 |
|
2018-04-06 22:40:51 | 2018-04-08 15:14:27 | 2018-04-08 16:32:27 | 1:18:00 | 1:05:53 | 0:12:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:49:24.803383 mon.a mon.0 172.21.15.5:6789/0 264 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 1074 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366065 |
|
2018-04-06 22:40:52 | 2018-04-08 15:14:30 | 2018-04-08 15:56:30 | 0:42:00 | 0:30:54 | 0:11:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:33:33.299820 mon.a mon.0 172.21.15.45:6789/0 198 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 116 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366066 |
|
2018-04-06 22:40:52 | 2018-04-08 15:14:31 | 2018-04-08 15:46:30 | 0:31:59 | 0:14:38 | 0:17:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366067 |
|
2018-04-06 22:40:53 | 2018-04-08 15:14:31 | 2018-04-08 15:58:31 | 0:44:00 | 0:24:33 | 0:19:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:49:57.461998 mon.a mon.0 172.21.15.173:6789/0 358 : cluster [WRN] Health check failed: 17 slow ops, oldest one blocked for 599 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366068 |
|
2018-04-06 22:40:54 | 2018-04-08 15:14:32 | 2018-04-08 15:42:32 | 0:28:00 | 0:10:55 | 0:17:05 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:38:54.201442 mon.a mon.0 172.21.15.15:6789/0 212 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 99 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366069 |
|
2018-04-06 22:40:55 | 2018-04-08 15:16:07 | 2018-04-08 16:24:08 | 1:08:01 | 0:47:09 | 0:20:52 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 16:14:56.395731 mon.b mon.0 172.21.15.104:6789/0 186 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366070 |
|
2018-04-06 22:40:55 | 2018-04-08 15:16:27 | 2018-04-08 16:08:29 | 0:52:02 | 0:39:05 | 0:12:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:47:02.573768 mon.a mon.0 172.21.15.8:6789/0 263 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 746 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366071 |
|
2018-04-06 22:40:56 | 2018-04-08 15:16:30 | 2018-04-08 16:46:31 | 1:30:01 | 0:56:21 | 0:33:40 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:55:57.690021 mon.b mon.0 172.21.15.28:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366072 |
|
2018-04-06 22:40:57 | 2018-04-08 15:16:30 | 2018-04-08 15:58:30 | 0:42:00 | 0:09:02 | 0:32:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366073 |
|
2018-04-06 22:40:58 | 2018-04-08 15:16:32 | 2018-04-08 15:48:32 | 0:32:00 | 0:15:29 | 0:16:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:45:53.960024 mon.a mon.0 172.21.15.37:6789/0 327 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 412 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366074 |
|
2018-04-06 22:40:59 | 2018-04-08 15:18:30 | 2018-04-08 16:24:31 | 1:06:01 | 0:10:07 | 0:55:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:21:19.845402 mon.a mon.0 172.21.15.41:6789/0 170 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 84 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366075 |
|
2018-04-06 22:40:59 | 2018-04-08 15:22:31 | 2018-04-08 15:50:31 | 0:28:00 | 0:09:32 | 0:18:28 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366076 |
|
2018-04-06 22:41:00 | 2018-04-08 15:22:36 | 2018-04-08 15:42:35 | 0:19:59 | 0:09:15 | 0:10:44 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:38:28.969890 mon.b mon.0 172.21.15.26:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366077 |
|
2018-04-06 22:41:01 | 2018-04-08 15:24:28 | 2018-04-08 17:46:32 | 2:22:04 | 0:42:37 | 1:39:27 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2366078 |
|
2018-04-06 22:41:01 | 2018-04-08 15:24:30 | 2018-04-08 15:56:30 | 0:32:00 | 0:21:52 | 0:10:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:43:54.759636 mds.a mds.1 172.21.15.118:6817/2690629090 1 : cluster [ERR] replayed stray Session close event for client.4656 172.21.15.195:0/3539743377 from time 2018-04-08 15:43:14.948329, ignoring" in cluster log |
||||||||||||||
| fail | 2366079 |
|
2018-04-06 22:41:02 | 2018-04-08 15:24:31 | 2018-04-08 16:20:31 | 0:56:00 | 0:39:18 | 0:16:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:07:27.418961 mon.b mon.0 172.21.15.44:6789/0 196 : cluster [WRN] Health check failed: 26 slow ops, oldest one blocked for 1297 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366080 |
|
2018-04-06 22:41:03 | 2018-04-08 15:24:33 | 2018-04-08 16:40:34 | 1:16:01 | 0:44:40 | 0:31:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366081 |
|
2018-04-06 22:41:04 | 2018-04-08 15:32:47 | 2018-04-08 15:54:46 | 0:21:59 | 0:11:18 | 0:10:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:50:53.546838 mon.a mon.0 172.21.15.56:6789/0 195 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 84 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366082 |
|
2018-04-06 22:41:04 | 2018-04-08 15:34:24 | 2018-04-08 16:12:24 | 0:38:00 | 0:20:04 | 0:17:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:56:56.000880 mon.a mon.0 172.21.15.67:6789/0 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366083 |
|
2018-04-06 22:41:05 | 2018-04-08 15:34:24 | 2018-04-08 16:12:24 | 0:38:00 | 0:11:09 | 0:26:51 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2366084 |
|
2018-04-06 22:41:06 | 2018-04-08 15:34:25 | 2018-04-08 16:34:25 | 1:00:00 | 0:44:31 | 0:15:29 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 2366085 |
|
2018-04-06 22:41:07 | 2018-04-08 15:34:30 | 2018-04-08 17:02:31 | 1:28:01 | 0:51:24 | 0:36:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:28:58.388464 mon.b mon.0 172.21.15.55:6789/0 176 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366086 |
|
2018-04-06 22:41:07 | 2018-04-08 15:34:31 | 2018-04-08 16:30:32 | 0:56:01 | 0:39:45 | 0:16:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:55:46.236704 mon.a mon.0 172.21.15.24:6789/0 242 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366087 |
|
2018-04-06 22:41:08 | 2018-04-08 15:34:35 | 2018-04-08 15:56:34 | 0:21:59 | 0:09:50 | 0:12:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:51:49.379889 mon.b mon.0 172.21.15.105:6789/0 171 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366088 |
|
2018-04-06 22:41:09 | 2018-04-08 15:36:14 | 2018-04-08 16:18:13 | 0:41:59 | 0:30:11 | 0:11:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:53:21.834845 mon.b mon.0 172.21.15.11:6789/0 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366089 |
|
2018-04-06 22:41:10 | 2018-04-08 15:36:21 | 2018-04-08 16:08:21 | 0:32:00 | 0:10:28 | 0:21:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:03:18.619245 mon.b mon.0 172.21.15.190:6789/0 167 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366090 |
|
2018-04-06 22:41:10 | 2018-04-08 15:36:31 | 2018-04-08 16:32:31 | 0:56:00 | 0:09:38 | 0:46:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2366091 |
|
2018-04-06 22:41:11 | 2018-04-08 15:38:20 | 2018-04-08 17:18:21 | 1:40:01 | 0:08:38 | 1:31:23 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366092 |
|
2018-04-06 22:41:12 | 2018-04-08 15:40:28 | 2018-04-08 16:28:28 | 0:48:00 | 0:37:42 | 0:10:18 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 15:56:04.489545 mon.a mon.0 172.21.15.95:6789/0 249 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366093 |
|
2018-04-06 22:41:13 | 2018-04-08 15:40:31 | 2018-04-08 16:14:31 | 0:34:00 | 0:21:15 | 0:12:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:10:06.444782 mds.h mds.1 172.21.15.15:6817/3965153490 1 : cluster [ERR] replayed stray Session close event for client.5417 172.21.15.83:0/3375661632 from time 2018-04-08 16:04:31.544135, ignoring" in cluster log |
||||||||||||||
| pass | 2366094 |
|
2018-04-06 22:41:13 | 2018-04-08 15:40:31 | 2018-04-08 16:52:32 | 1:12:01 | 1:00:38 | 0:11:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366095 |
|
2018-04-06 22:41:14 | 2018-04-08 15:40:32 | 2018-04-08 16:58:33 | 1:18:01 | 1:03:17 | 0:14:44 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:03:38.181291 mon.a mon.0 172.21.15.129:6789/0 333 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 138 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366096 |
|
2018-04-06 22:41:15 | 2018-04-08 15:40:41 | 2018-04-08 18:00:44 | 2:20:03 | 0:14:22 | 2:05:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366097 |
|
2018-04-06 22:41:16 | 2018-04-08 15:40:41 | 2018-04-08 17:10:43 | 1:30:02 | 0:30:33 | 0:59:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:47:05.420446 mon.a mon.0 172.21.15.37:6789/0 339 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 50 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366098 |
|
2018-04-06 22:41:16 | 2018-04-08 15:42:35 | 2018-04-08 16:08:35 | 0:26:00 | 0:11:00 | 0:15:00 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:04:30.276288 mon.a mon.0 172.21.15.37:6789/0 229 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366099 |
|
2018-04-06 22:41:17 | 2018-04-08 15:42:35 | 2018-04-08 16:56:36 | 1:14:01 | 0:45:44 | 0:28:17 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 16:43:38.411027 mon.b mon.0 172.21.15.58:6789/0 183 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366100 |
|
2018-04-06 22:41:18 | 2018-04-08 15:42:35 | 2018-04-08 17:28:37 | 1:46:02 | 0:39:28 | 1:06:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:05:45.614526 mon.b mon.0 172.21.15.140:6789/0 242 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 743 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366101 |
|
2018-04-06 22:41:18 | 2018-04-08 15:42:36 | 2018-04-08 16:20:36 | 0:38:00 | 0:21:19 | 0:16:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366102 |
|
2018-04-06 22:41:19 | 2018-04-08 15:44:18 | 2018-04-08 16:14:17 | 0:29:59 | 0:09:34 | 0:20:25 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:10:10.404532 mon.b mon.0 172.21.15.191:6789/0 149 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366103 |
|
2018-04-06 22:41:20 | 2018-04-08 15:44:30 | 2018-04-08 16:24:30 | 0:40:00 | 0:18:31 | 0:21:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:20:55.085341 mon.a mon.0 172.21.15.49:6789/0 205 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 518 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366104 |
|
2018-04-06 22:41:21 | 2018-04-08 15:44:31 | 2018-04-08 16:06:30 | 0:21:59 | 0:10:31 | 0:11:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:01:06.009550 mon.b mon.0 172.21.15.13:6789/0 243 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366105 |
|
2018-04-06 22:41:21 | 2018-04-08 15:44:42 | 2018-04-08 16:40:43 | 0:56:01 | 0:09:24 | 0:46:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:36:59.223946 mon.b mon.0 172.21.15.71:6789/0 270 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366106 |
|
2018-04-06 22:41:22 | 2018-04-08 15:46:18 | 2018-04-08 16:18:18 | 0:32:00 | 0:09:12 | 0:22:48 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:15:39.449309 mon.a mon.0 172.21.15.174:6789/0 175 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 74 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366107 |
|
2018-04-06 22:41:23 | 2018-04-08 15:46:31 | 2018-04-08 18:06:34 | 2:20:03 | 0:39:16 | 1:40:47 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:45:19.803185 mon.a mon.0 172.21.15.146:6789/0 263 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 738 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366108 |
|
2018-04-06 22:41:24 | 2018-04-08 15:48:23 | 2018-04-08 16:50:25 | 1:02:02 | 0:21:33 | 0:40:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:36:39.052825 mds.c mds.1 172.21.15.66:6817/620769405 1 : cluster [ERR] replayed stray Session close event for client.4597 172.21.15.93:0/2094354729 from time 2018-04-08 16:36:00.134805, ignoring" in cluster log |
||||||||||||||
| fail | 2366109 |
|
2018-04-06 22:41:24 | 2018-04-08 15:48:33 | 2018-04-08 17:42:35 | 1:54:02 | 0:35:21 | 1:18:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:27:31.242132 mon.a mon.0 172.21.15.49:6789/0 215 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 863 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366110 |
|
2018-04-06 22:41:25 | 2018-04-08 15:50:18 | 2018-04-08 16:38:19 | 0:48:01 | 0:38:54 | 0:09:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:05:41.465331 mon.b mon.0 172.21.15.140:6789/0 135 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366111 |
|
2018-04-06 22:41:26 | 2018-04-08 15:50:31 | 2018-04-08 16:32:31 | 0:42:00 | 0:11:05 | 0:30:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:27:50.079676 mon.a mon.0 172.21.15.109:6789/0 202 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366112 |
|
2018-04-06 22:41:26 | 2018-04-08 15:50:32 | 2018-04-08 17:28:34 | 1:38:02 | 0:18:05 | 1:19:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:15:33.333975 mon.a mon.0 172.21.15.71:6789/0 251 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 53 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366113 |
|
2018-04-06 22:41:27 | 2018-04-08 15:50:41 | 2018-04-08 16:12:40 | 0:21:59 | 0:10:44 | 0:11:15 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:07:52.645236 mon.b mon.0 172.21.15.86:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366114 |
|
2018-04-06 22:41:28 | 2018-04-08 15:52:20 | 2018-04-08 17:06:20 | 1:14:00 | 0:50:56 | 0:23:04 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 16:51:23.391427 mon.a mon.0 172.21.15.59:6789/0 193 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366115 |
|
2018-04-06 22:41:29 | 2018-04-08 15:52:36 | 2018-04-08 17:16:37 | 1:24:01 | 0:48:54 | 0:35:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:45:29.893152 mon.a mon.0 172.21.15.35:6789/0 332 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 802 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366116 |
|
2018-04-06 22:41:29 | 2018-04-08 15:52:36 | 2018-04-08 17:02:36 | 1:10:00 | 0:49:13 | 0:20:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366117 |
|
2018-04-06 22:41:30 | 2018-04-08 15:52:36 | 2018-04-08 16:44:36 | 0:52:00 | 0:10:36 | 0:41:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:40:23.161297 mon.a mon.0 172.21.15.17:6789/0 195 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 46 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366118 |
|
2018-04-06 22:41:31 | 2018-04-08 15:52:36 | 2018-04-08 16:46:36 | 0:54:00 | 0:29:29 | 0:24:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2366119 |
|
2018-04-06 22:41:32 | 2018-04-08 15:54:49 | 2018-04-08 16:16:49 | 0:22:00 | 0:10:07 | 0:11:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:11:49.586697 mon.b mon.0 172.21.15.105:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366120 |
|
2018-04-06 22:41:32 | 2018-04-08 15:56:33 | 2018-04-08 16:36:32 | 0:39:59 | 0:09:10 | 0:30:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:33:08.856426 mon.a mon.0 172.21.15.31:6789/0 362 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 41 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366121 |
|
2018-04-06 22:41:33 | 2018-04-08 15:56:33 | 2018-04-08 16:30:32 | 0:33:59 | 0:09:24 | 0:24:35 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:26:53.886538 mon.a mon.0 172.21.15.37:6789/0 242 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366122 |
|
2018-04-06 22:41:34 | 2018-04-08 15:56:33 | 2018-04-08 17:38:34 | 1:42:01 | 0:39:25 | 1:02:36 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2366123 |
|
2018-04-06 22:41:35 | 2018-04-08 15:56:35 | 2018-04-08 16:44:36 | 0:48:01 | 0:21:13 | 0:26:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:40:52.090950 mds.d mds.1 172.21.15.68:6817/3119363142 1 : cluster [ERR] replayed stray Session close event for client.5424 172.21.15.69:0/2772985655 from time 2018-04-08 16:35:09.077601, ignoring" in cluster log |
||||||||||||||
| fail | 2366124 |
|
2018-04-06 22:41:35 | 2018-04-08 15:58:23 | 2018-04-08 17:44:27 | 1:46:04 | 1:02:35 | 0:43:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:23:11.333839 mon.a mon.0 172.21.15.15:6789/0 260 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 2182 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366125 |
|
2018-04-06 22:41:36 | 2018-04-08 15:58:32 | 2018-04-08 16:46:32 | 0:48:00 | 0:33:33 | 0:14:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:22:32.110655 mon.b mon.0 172.21.15.27:6789/0 316 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 180 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366126 |
|
2018-04-06 22:41:37 | 2018-04-08 15:58:32 | 2018-04-08 16:30:32 | 0:32:00 | 0:13:13 | 0:18:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:25:20.668520 mon.b mon.0 172.21.15.190:6789/0 135 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 208 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366127 |
|
2018-04-06 22:41:37 | 2018-04-08 15:58:34 | 2018-04-08 17:52:36 | 1:54:02 | 0:31:07 | 1:22:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:39:53.280232 mon.b mon.0 172.21.15.64:6789/0 186 : cluster [WRN] Health check failed: 15 slow ops, oldest one blocked for 807 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366128 |
|
2018-04-06 22:41:38 | 2018-04-08 15:58:41 | 2018-04-08 16:26:41 | 0:28:00 | 0:10:48 | 0:17:12 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:23:27.702033 mon.b mon.0 172.21.15.4:6789/0 186 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366129 |
|
2018-04-06 22:41:39 | 2018-04-08 16:00:21 | 2018-04-08 17:06:21 | 1:06:00 | 0:48:33 | 0:17:27 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 16:51:29.509047 mon.a mon.0 172.21.15.131:6789/0 312 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 150 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366130 |
|
2018-04-06 22:41:40 | 2018-04-08 16:00:24 | 2018-04-08 17:04:26 | 1:04:02 | 0:42:22 | 0:21:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2366131 |
|
2018-04-06 22:41:40 | 2018-04-08 16:02:25 | 2018-04-08 17:38:27 | 1:36:02 | 0:21:16 | 1:14:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:30:29.370490 mon.a mon.0 172.21.15.31:6789/0 229 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 422 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366132 |
|
2018-04-06 22:41:41 | 2018-04-08 16:04:32 | 2018-04-08 16:52:33 | 0:48:01 | 0:09:09 | 0:38:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:49:27.287727 mon.b mon.0 172.21.15.64:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366133 |
|
2018-04-06 22:41:42 | 2018-04-08 16:04:32 | 2018-04-08 16:44:32 | 0:40:00 | 0:18:21 | 0:21:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:32:45.918183 mon.b mon.0 172.21.15.79:6789/0 307 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366134 |
|
2018-04-06 22:41:42 | 2018-04-07 15:59:54 | 2018-04-07 16:53:54 | 0:54:00 | 0:10:15 | 0:43:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-07 16:48:48.978343 mon.b mon.0 172.21.15.20:6789/0 132 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366135 |
|
2018-04-06 22:41:43 | 2018-04-08 16:06:04 | 2018-04-08 16:28:03 | 0:21:59 | 0:09:39 | 0:12:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366136 |
|
2018-04-06 22:41:44 | 2018-04-08 16:06:15 | 2018-04-08 16:40:15 | 0:34:00 | 0:09:07 | 0:24:53 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:36:25.661297 mon.b mon.0 172.21.15.11:6789/0 160 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366137 |
|
2018-04-06 22:41:45 | 2018-04-08 16:06:24 | 2018-04-08 17:14:26 | 1:08:02 | 0:09:04 | 0:58:58 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:11:25.704092 mon.a mon.0 172.21.15.51:6789/0 170 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366138 |
|
2018-04-06 22:41:45 | 2018-04-08 16:06:31 | 2018-04-08 16:42:31 | 0:36:00 | 0:21:50 | 0:14:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:30:05.884801 mds.c mds.1 172.21.15.9:6817/2526861913 1 : cluster [ERR] replayed stray Session close event for client.4605 172.21.15.186:0/3806745840 from time 2018-04-08 16:29:24.165941, ignoring" in cluster log |
||||||||||||||
| pass | 2366139 |
|
2018-04-06 22:41:46 | 2018-04-08 16:08:34 | 2018-04-08 18:04:36 | 1:56:02 | 0:26:29 | 1:29:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| pass | 2366140 |
|
2018-04-06 22:41:47 | 2018-04-08 16:08:34 | 2018-04-08 17:30:35 | 1:22:01 | 0:42:10 | 0:39:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366141 |
|
2018-04-06 22:41:47 | 2018-04-08 16:08:36 | 2018-04-08 17:08:37 | 1:00:01 | 0:10:32 | 0:49:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:04:44.462179 mon.a mon.0 172.21.15.102:6789/0 326 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 68 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366142 |
|
2018-04-06 22:41:48 | 2018-04-08 16:08:39 | 2018-04-08 16:40:38 | 0:31:59 | 0:18:45 | 0:13:14 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2366143 |
|
2018-04-06 22:41:49 | 2018-04-08 16:12:39 | 2018-04-08 16:42:38 | 0:29:59 | 0:10:10 | 0:19:49 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:38:20.751165 mon.b mon.0 172.21.15.45:6789/0 175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366144 |
|
2018-04-06 22:41:49 | 2018-04-08 16:12:39 | 2018-04-08 17:22:40 | 1:10:01 | 0:51:22 | 0:18:39 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 17:00:02.010873 mon.a mon.0 172.21.15.44:6789/0 192 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366145 |
|
2018-04-06 22:41:50 | 2018-04-08 16:12:39 | 2018-04-08 17:22:40 | 1:10:01 | 0:48:48 | 0:21:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:39:39.270252 mon.b mon.0 172.21.15.111:6789/0 309 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366146 |
|
2018-04-06 22:41:51 | 2018-04-08 16:12:42 | 2018-04-08 17:14:42 | 1:02:00 | 0:49:59 | 0:12:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:30:00.829535 mon.a mon.0 172.21.15.169:6789/0 163 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366147 |
|
2018-04-06 22:41:52 | 2018-04-08 16:13:53 | 2018-04-08 16:49:53 | 0:36:00 | 0:11:14 | 0:24:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366148 |
|
2018-04-06 22:41:52 | 2018-04-08 16:14:19 | 2018-04-08 17:10:20 | 0:56:01 | 0:19:25 | 0:36:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:57:04.889167 mon.a mon.0 172.21.15.139:6789/0 249 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 128 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366149 |
|
2018-04-06 22:41:53 | 2018-04-08 16:14:27 | 2018-04-08 18:08:30 | 1:54:03 | 0:10:18 | 1:43:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:06:19.615996 mon.a mon.0 172.21.15.103:6789/0 343 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 125 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366150 |
|
2018-04-06 22:41:54 | 2018-04-08 16:14:32 | 2018-04-08 16:36:31 | 0:21:59 | 0:09:06 | 0:12:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:33:58.570143 mon.a mon.0 172.21.15.157:6789/0 245 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366151 |
|
2018-04-06 22:41:54 | 2018-04-08 16:14:32 | 2018-04-08 16:32:32 | 0:18:00 | 0:08:58 | 0:09:02 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366152 |
|
2018-04-06 22:41:55 | 2018-04-08 16:16:22 | 2018-04-08 16:54:22 | 0:38:00 | 0:08:48 | 0:29:12 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:52:01.161857 mon.a mon.0 172.21.15.157:6789/0 164 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 53 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366153 |
|
2018-04-06 22:41:56 | 2018-04-08 16:16:23 | 2018-04-08 16:58:26 | 0:42:03 | 0:21:41 | 0:20:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:54:27.232939 mds.a mds.1 172.21.15.49:6817/1630334313 1 : cluster [ERR] replayed stray Session close event for client.5442 172.21.15.41:0/3491683820 from time 2018-04-08 16:48:34.669328, ignoring" in cluster log |
||||||||||||||
| pass | 2366154 |
|
2018-04-06 22:41:57 | 2018-04-08 16:16:28 | 2018-04-08 18:34:31 | 2:18:03 | 1:04:56 | 1:13:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366155 |
|
2018-04-06 22:41:57 | 2018-04-08 16:16:50 | 2018-04-08 17:44:51 | 1:28:01 | 0:52:20 | 0:35:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:59:13.497257 mon.b mon.0 172.21.15.45:6789/0 180 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 121 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366156 |
|
2018-04-06 22:41:58 | 2018-04-08 16:18:24 | 2018-04-08 16:42:25 | 0:24:01 | 0:13:51 | 0:10:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:34:37.480462 mon.b mon.0 172.21.15.52:6789/0 236 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366157 |
|
2018-04-06 22:41:59 | 2018-04-08 16:18:24 | 2018-04-08 16:58:26 | 0:40:02 | 0:28:21 | 0:11:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:49:27.283125 mon.a mon.0 172.21.15.23:6789/0 216 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366158 |
|
2018-04-06 22:41:59 | 2018-04-08 16:18:34 | 2018-04-08 16:38:34 | 0:20:00 | 0:10:16 | 0:09:44 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366159 |
|
2018-04-06 22:42:00 | 2018-04-08 16:20:20 | 2018-04-08 17:46:21 | 1:26:01 | 0:44:10 | 0:41:51 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 17:19:07.553609 mon.a mon.0 172.21.15.68:6789/0 311 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366160 |
|
2018-04-06 22:42:01 | 2018-04-08 16:20:20 | 2018-04-08 17:24:20 | 1:04:00 | 0:42:27 | 0:21:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:47:07.120396 mon.a mon.0 172.21.15.5:6789/0 160 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366161 |
|
2018-04-06 22:42:01 | 2018-04-08 16:20:24 | 2018-04-08 17:00:26 | 0:40:02 | 0:21:26 | 0:18:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:45:11.434806 mon.b mon.0 172.21.15.61:6789/0 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366162 |
|
2018-04-06 22:42:02 | 2018-04-08 16:20:32 | 2018-04-08 16:46:32 | 0:26:00 | 0:08:15 | 0:17:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:42:58.415808 mon.b mon.0 172.21.15.152:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366163 |
|
2018-04-06 22:42:03 | 2018-04-08 16:20:37 | 2018-04-08 17:08:38 | 0:48:01 | 0:24:19 | 0:23:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:50:57.944744 mon.a mon.0 172.21.15.31:6789/0 197 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366164 |
|
2018-04-06 22:42:04 | 2018-04-08 16:22:34 | 2018-04-08 16:48:34 | 0:26:00 | 0:09:52 | 0:16:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:45:17.221031 mon.a mon.0 172.21.15.62:6789/0 256 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366165 |
|
2018-04-06 22:42:04 | 2018-04-08 16:24:22 | 2018-04-08 17:00:22 | 0:36:00 | 0:09:37 | 0:26:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:57:38.656645 mon.b mon.0 172.21.15.52:6789/0 277 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366166 |
|
2018-04-06 22:42:05 | 2018-04-08 16:24:31 | 2018-04-08 17:00:31 | 0:36:00 | 0:10:25 | 0:25:35 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:55:33.082644 mon.b mon.0 172.21.15.71:6789/0 167 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366167 |
|
2018-04-06 22:42:06 | 2018-04-08 16:24:32 | 2018-04-08 16:46:32 | 0:22:00 | 0:08:49 | 0:13:11 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2366168 |
|
2018-04-06 22:42:06 | 2018-04-08 16:24:32 | 2018-04-08 17:20:33 | 0:56:01 | 0:22:12 | 0:33:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:06:11.000756 mds.b mds.1 172.21.15.138:6817/3584361485 1 : cluster [ERR] replayed stray Session close event for client.4614 172.21.15.4:0/4144193107 from time 2018-04-08 17:05:26.904319, ignoring" in cluster log |
||||||||||||||
| fail | 2366169 |
|
2018-04-06 22:42:07 | 2018-04-08 16:26:54 | 2018-04-08 17:34:55 | 1:08:01 | 0:39:41 | 0:28:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:02:57.931075 mon.a mon.0 172.21.15.38:6789/0 326 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366170 |
|
2018-04-06 22:42:08 | 2018-04-08 16:28:21 | 2018-04-08 17:20:20 | 0:51:59 | 0:40:11 | 0:11:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366171 |
|
2018-04-06 22:42:09 | 2018-04-08 16:28:30 | 2018-04-08 17:46:32 | 1:18:02 | 0:11:06 | 1:06:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:41:39.793859 mon.a mon.0 172.21.15.59:6789/0 196 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366172 |
|
2018-04-06 22:42:09 | 2018-04-08 16:28:33 | 2018-04-08 16:58:33 | 0:30:00 | 0:20:31 | 0:09:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:50:55.785320 mon.a mon.0 172.21.15.24:6789/0 180 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 469 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366173 |
|
2018-04-06 22:42:10 | 2018-04-08 16:28:35 | 2018-04-08 17:08:34 | 0:39:59 | 0:10:44 | 0:29:15 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:06:06.286824 mon.b mon.0 172.21.15.190:6789/0 306 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366174 |
|
2018-04-06 22:42:11 | 2018-04-08 16:30:37 | 2018-04-08 18:18:39 | 1:48:02 | 0:56:34 | 0:51:28 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 18:02:54.470451 mon.a mon.0 172.21.15.139:6789/0 215 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 256 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366175 |
|
2018-04-06 22:42:11 | 2018-04-08 16:30:37 | 2018-04-08 17:30:37 | 1:00:00 | 0:49:24 | 0:10:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:01:25.235139 mon.a mon.0 172.21.15.109:6789/0 202 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 828 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366176 |
|
2018-04-06 22:42:12 | 2018-04-08 16:30:37 | 2018-04-08 17:48:38 | 1:18:01 | 0:34:27 | 0:43:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:19:52.821009 mon.b mon.0 172.21.15.36:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366177 |
|
2018-04-06 22:42:13 | 2018-04-08 16:30:37 | 2018-04-08 17:28:37 | 0:58:00 | 0:11:21 | 0:46:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:24:59.779633 mon.b mon.0 172.21.15.156:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366178 |
|
2018-04-06 22:42:14 | 2018-04-08 16:32:30 | 2018-04-08 18:32:33 | 2:00:03 | 0:23:07 | 1:36:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:17:22.264037 mon.b mon.0 172.21.15.88:6789/0 132 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 107 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366179 |
|
2018-04-06 22:42:14 | 2018-04-08 16:32:32 | 2018-04-08 17:02:32 | 0:30:00 | 0:10:11 | 0:19:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 16:57:55.442938 mon.b mon.0 172.21.15.9:6789/0 301 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366180 |
|
2018-04-06 22:42:15 | 2018-04-08 16:32:33 | 2018-04-08 16:56:32 | 0:23:59 | 0:09:19 | 0:14:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366181 |
|
2018-04-06 22:42:16 | 2018-04-08 16:32:33 | 2018-04-08 17:04:33 | 0:32:00 | 0:09:34 | 0:22:26 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:00:44.232738 mon.a mon.0 172.21.15.8:6789/0 174 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366182 |
|
2018-04-06 22:42:16 | 2018-04-08 16:34:28 | 2018-04-08 17:12:27 | 0:37:59 | 0:08:50 | 0:29:09 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:08:31.079891 mon.b mon.0 172.21.15.64:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366183 |
|
2018-04-06 22:42:17 | 2018-04-08 16:36:44 | 2018-04-08 17:16:44 | 0:40:00 | 0:21:27 | 0:18:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:12:22.679555 mds.h mds.1 172.21.15.79:6817/3216780690 1 : cluster [ERR] replayed stray Session close event for client.15422 172.21.15.105:0/2640058396 from time 2018-04-08 17:06:14.017729, ignoring" in cluster log |
||||||||||||||
| pass | 2366184 |
|
2018-04-06 22:42:18 | 2018-04-08 16:36:44 | 2018-04-08 18:04:45 | 1:28:01 | 1:09:39 | 0:18:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366185 |
|
2018-04-06 22:42:19 | 2018-04-08 16:38:31 | 2018-04-08 18:44:34 | 2:06:03 | 1:09:41 | 0:56:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:41:29.346891 mon.b mon.0 172.21.15.26:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366186 |
|
2018-04-06 22:42:19 | 2018-04-08 16:38:35 | 2018-04-08 17:04:34 | 0:25:59 | 0:14:24 | 0:11:35 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366187 |
|
2018-04-06 22:42:20 | 2018-04-08 16:40:28 | 2018-04-08 17:18:27 | 0:37:59 | 0:22:52 | 0:15:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:01:34.080390 mon.b mon.0 172.21.15.28:6789/0 174 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366188 |
|
2018-04-06 22:42:21 | 2018-04-08 16:40:33 | 2018-04-08 17:00:32 | 0:19:59 | 0:10:17 | 0:09:42 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366189 |
|
2018-04-06 22:42:22 | 2018-04-08 16:40:35 | 2018-04-08 18:02:36 | 1:22:01 | 0:53:21 | 0:28:40 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 17:50:08.434134 mon.a mon.0 172.21.15.158:6789/0 217 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366190 |
|
2018-04-06 22:42:22 | 2018-04-08 16:40:40 | 2018-04-08 17:32:40 | 0:52:00 | 0:37:38 | 0:14:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:00:08.394374 mon.a mon.0 172.21.15.33:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366191 |
|
2018-04-06 22:42:23 | 2018-04-08 16:40:44 | 2018-04-08 17:58:45 | 1:18:01 | 1:03:52 | 0:14:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:13:05.070747 mon.b mon.0 172.21.15.27:6789/0 201 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 695 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366192 |
|
2018-04-06 22:42:24 | 2018-04-08 16:42:36 | 2018-04-08 17:08:36 | 0:26:00 | 0:08:43 | 0:17:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:05:21.246245 mon.b mon.0 172.21.15.26:6789/0 240 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366193 |
|
2018-04-06 22:42:25 | 2018-04-08 16:42:37 | 2018-04-08 17:18:36 | 0:35:59 | 0:24:51 | 0:11:08 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:11:55.194872 mon.a mon.0 172.21.15.17:6789/0 342 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 748 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366194 |
|
2018-04-06 22:42:25 | 2018-04-08 16:42:39 | 2018-04-08 17:34:40 | 0:52:01 | 0:10:05 | 0:41:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:29:29.982264 mon.b mon.0 172.21.15.58:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366195 |
|
2018-04-06 22:42:26 | 2018-04-08 16:44:42 | 2018-04-08 17:34:42 | 0:50:00 | 0:09:29 | 0:40:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2366196 |
|
2018-04-06 22:42:27 | 2018-04-08 16:44:42 | 2018-04-08 17:16:42 | 0:32:00 | 0:09:39 | 0:22:21 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366197 |
|
2018-04-06 22:42:28 | 2018-04-08 16:44:42 | 2018-04-08 17:14:41 | 0:29:59 | 0:08:41 | 0:21:18 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:10:54.490632 mon.b mon.0 172.21.15.58:6789/0 139 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 47 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366198 |
|
2018-04-06 22:42:28 | 2018-04-08 16:46:42 | 2018-04-08 18:20:44 | 1:34:02 | 0:22:01 | 1:12:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:08:20.852868 mds.b mds.1 172.21.15.36:6816/1158704808 1 : cluster [ERR] replayed stray Session close event for client.4671 172.21.15.65:0/2193581710 from time 2018-04-08 18:07:34.828348, ignoring" in cluster log |
||||||||||||||
| fail | 2366199 |
|
2018-04-06 22:42:29 | 2018-04-08 16:46:42 | 2018-04-08 18:26:44 | 1:40:02 | 0:37:03 | 1:02:59 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:56:05.957143 mon.a mon.0 172.21.15.23:6789/0 188 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366200 |
|
2018-04-06 22:42:30 | 2018-04-08 16:46:42 | 2018-04-08 18:38:44 | 1:52:02 | 0:40:09 | 1:11:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366201 |
|
2018-04-06 22:42:31 | 2018-04-08 16:46:42 | 2018-04-08 17:50:43 | 1:04:01 | 0:10:40 | 0:53:21 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:46:01.386288 mon.b mon.0 172.21.15.11:6789/0 298 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366202 |
|
2018-04-06 22:42:31 | 2018-04-08 16:46:42 | 2018-04-08 18:22:44 | 1:36:02 | 0:16:26 | 1:19:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2366203 |
|
2018-04-06 22:42:32 | 2018-04-08 16:46:42 | 2018-04-08 18:22:44 | 1:36:02 | 0:10:28 | 1:25:34 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:19:02.099591 mon.a mon.0 172.21.15.50:6789/0 180 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 38 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366204 |
|
2018-04-06 22:42:33 | 2018-04-08 16:48:24 | 2018-04-08 18:00:25 | 1:12:01 | 0:52:14 | 0:19:47 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 17:30:37.300005 mon.a mon.0 172.21.15.6:6789/0 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366205 |
|
2018-04-06 22:42:34 | 2018-04-08 16:48:33 | 2018-04-08 19:00:35 | 2:12:02 | 0:50:25 | 1:21:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:27:12.219300 mon.b mon.0 172.21.15.72:6789/0 180 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 749 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366206 |
|
2018-04-06 22:42:34 | 2018-04-08 16:48:35 | 2018-04-08 17:36:36 | 0:48:01 | 0:37:39 | 0:10:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366207 |
|
2018-04-06 22:42:35 | 2018-04-08 16:50:09 | 2018-04-08 17:26:08 | 0:35:59 | 0:11:47 | 0:24:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:22:27.753438 mon.a mon.0 172.21.15.59:6789/0 197 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366208 |
|
2018-04-06 22:42:36 | 2018-04-08 16:50:23 | 2018-04-08 18:04:23 | 1:14:00 | 0:22:46 | 0:51:14 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:59:37.928025 mon.a mon.0 172.21.15.109:6789/0 267 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 828 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366209 |
|
2018-04-06 22:42:36 | 2018-04-08 16:50:27 | 2018-04-08 17:22:26 | 0:31:59 | 0:09:55 | 0:22:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366210 |
|
2018-04-06 22:42:37 | 2018-04-08 16:50:33 | 2018-04-08 17:40:33 | 0:50:00 | 0:09:03 | 0:40:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:37:34.331168 mon.b mon.0 172.21.15.56:6789/0 212 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366211 |
|
2018-04-06 22:42:38 | 2018-04-08 16:52:35 | 2018-04-08 17:18:34 | 0:25:59 | 0:09:07 | 0:16:52 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:16:01.484666 mon.b mon.0 172.21.15.52:6789/0 143 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 35 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366212 |
|
2018-04-06 22:42:39 | 2018-04-08 16:52:35 | 2018-04-08 18:02:36 | 1:10:01 | 0:51:38 | 0:18:23 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 17:29:16.306210 mon.a mon.0 172.21.15.50:6789/0 159 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366213 |
|
2018-04-06 22:42:39 | 2018-04-08 18:06:55 | 2018-04-08 18:36:55 | 0:30:00 | 0:19:53 | 0:10:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:34:19.668738 mds.b mds.1 172.21.15.37:6817/3612390816 1 : cluster [ERR] replayed stray Session close event for client.5324 172.21.15.32:0/4000904984 from time 2018-04-08 18:29:27.046368, ignoring" in cluster log |
||||||||||||||
| fail | 2366214 |
|
2018-04-06 22:42:40 | 2018-04-08 18:08:32 | 2018-04-08 19:34:33 | 1:26:01 | 1:10:19 | 0:15:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:29:42.788683 mon.a mon.0 172.21.15.133:6789/0 255 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366215 |
|
2018-04-06 22:42:41 | 2018-04-08 18:08:32 | 2018-04-08 18:58:32 | 0:50:00 | 0:28:21 | 0:21:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:38:19.946662 mon.a mon.0 172.21.15.51:6789/0 336 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 112 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366216 |
|
2018-04-06 22:42:42 | 2018-04-08 18:08:33 | 2018-04-08 18:42:33 | 0:34:00 | 0:13:22 | 0:20:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:37:11.154389 mon.b mon.0 172.21.15.31:6789/0 140 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366217 |
|
2018-04-06 22:42:42 | 2018-04-08 18:08:37 | 2018-04-08 18:58:38 | 0:50:01 | 0:27:52 | 0:22:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:45:13.095764 mon.a mon.0 172.21.15.15:6789/0 217 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 469 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366218 |
|
2018-04-06 22:42:43 | 2018-04-08 18:08:40 | 2018-04-08 18:32:40 | 0:24:00 | 0:10:41 | 0:13:19 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:29:33.897382 mon.b mon.0 172.21.15.118:6789/0 218 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 93 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366219 |
|
2018-04-06 22:42:44 | 2018-04-08 18:08:45 | 2018-04-08 19:24:46 | 1:16:01 | 1:03:16 | 0:12:45 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 19:13:36.286870 mon.a mon.0 172.21.15.103:6789/0 194 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366220 |
|
2018-04-06 22:42:45 | 2018-04-08 18:10:34 | 2018-04-08 19:18:34 | 1:08:00 | 0:40:23 | 0:27:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:42:59.875435 mon.a mon.0 172.21.15.101:6789/0 163 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366221 |
|
2018-04-06 22:42:46 | 2018-04-08 18:10:34 | 2018-04-08 19:26:35 | 1:16:01 | 0:57:46 | 0:18:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:34:21.648466 mon.b mon.0 172.21.15.14:6789/0 175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366222 |
|
2018-04-06 22:42:46 | 2018-04-08 18:10:57 | 2018-04-08 18:36:56 | 0:25:59 | 0:08:33 | 0:17:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:33:17.931712 mon.a mon.0 172.21.15.117:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366223 |
|
2018-04-06 22:42:47 | 2018-04-08 18:10:57 | 2018-04-08 18:48:56 | 0:37:59 | 0:15:42 | 0:22:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:44:40.039492 mon.b mon.0 172.21.15.83:6789/0 169 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366224 |
|
2018-04-06 22:42:48 | 2018-04-08 18:12:56 | 2018-04-08 18:44:55 | 0:31:59 | 0:12:51 | 0:19:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2366225 |
|
2018-04-06 22:42:48 | 2018-04-08 18:12:56 | 2018-04-08 18:40:55 | 0:27:59 | 0:09:42 | 0:18:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2366226 |
|
2018-04-06 22:42:49 | 2018-04-08 18:12:55 | 2018-04-08 18:34:55 | 0:22:00 | 0:09:29 | 0:12:31 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366227 |
|
2018-04-06 22:42:50 | 2018-04-08 18:12:55 | 2018-04-08 19:22:56 | 1:10:01 | 0:51:21 | 0:18:40 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:49:11.547989 mon.b mon.0 172.21.15.39:6789/0 141 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 743 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366228 |
|
2018-04-06 22:42:51 | 2018-04-08 18:14:49 | 2018-04-08 19:20:50 | 1:06:01 | 0:21:37 | 0:44:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:08:08.361052 mds.b mds.1 172.21.15.62:6817/1139219190 1 : cluster [ERR] replayed stray Session close event for client.4658 172.21.15.158:0/940540229 from time 2018-04-08 19:07:25.426511, ignoring" in cluster log |
||||||||||||||
| fail | 2366229 |
|
2018-04-06 22:42:51 | 2018-04-08 18:14:49 | 2018-04-08 19:46:51 | 1:32:02 | 0:44:05 | 0:47:57 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:35:12.231926 mon.a mon.0 172.21.15.24:6789/0 217 : cluster [WRN] Health check failed: 19 slow ops, oldest one blocked for 1657 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366230 |
|
2018-04-06 22:42:52 | 2018-04-08 18:14:51 | 2018-04-08 19:14:51 | 1:00:00 | 0:42:12 | 0:17:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:39:27.464699 mon.b mon.0 172.21.15.36:6789/0 136 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 157 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366231 |
|
2018-04-06 22:42:53 | 2018-04-08 18:15:32 | 2018-04-08 18:39:31 | 0:23:59 | 0:11:37 | 0:12:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:34:21.270868 mon.b mon.0 172.21.15.71:6789/0 177 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 35 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366232 |
|
2018-04-06 22:42:54 | 2018-04-08 18:18:42 | 2018-04-08 19:20:42 | 1:02:00 | 0:17:46 | 0:44:14 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:08:10.686901 mon.a mon.0 172.21.15.175:6789/0 170 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 58 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366233 |
|
2018-04-06 22:42:54 | 2018-04-08 18:18:42 | 2018-04-08 18:58:42 | 0:40:00 | 0:10:40 | 0:29:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:54:21.118117 mon.b mon.0 172.21.15.74:6789/0 207 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366234 |
|
2018-04-06 22:42:55 | 2018-04-08 18:18:42 | 2018-04-08 19:36:43 | 1:18:01 | 0:56:07 | 0:21:54 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 2366235 |
|
2018-04-06 22:42:56 | 2018-04-08 18:18:43 | 2018-04-08 19:26:43 | 1:08:00 | 0:50:04 | 0:17:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:55:21.222999 mon.a mon.0 172.21.15.80:6789/0 220 : cluster [WRN] Health check failed: 15 slow ops, oldest one blocked for 848 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366236 |
|
2018-04-06 22:42:57 | 2018-04-08 18:18:51 | 2018-04-08 19:08:51 | 0:50:00 | 0:37:19 | 0:12:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:55:04.057399 mon.a mon.0 172.21.15.49:6789/0 161 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 1137 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366237 |
|
2018-04-06 22:42:57 | 2018-04-08 18:20:42 | 2018-04-08 18:42:41 | 0:21:59 | 0:10:05 | 0:11:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:39:24.383695 mon.b mon.0 172.21.15.61:6789/0 174 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 123 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366238 |
|
2018-04-06 22:42:58 | 2018-04-08 18:20:42 | 2018-04-08 19:30:43 | 1:10:01 | 0:28:53 | 0:41:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:07:30.882599 mon.b mon.0 172.21.15.8:6789/0 151 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366239 |
|
2018-04-06 22:42:59 | 2018-04-08 18:20:42 | 2018-04-08 19:02:42 | 0:42:00 | 0:09:53 | 0:32:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2366240 |
|
2018-04-06 22:43:00 | 2018-04-08 18:20:45 | 2018-04-08 18:40:45 | 0:20:00 | 0:09:19 | 0:10:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366241 |
|
2018-04-06 22:43:00 | 2018-04-08 18:20:46 | 2018-04-08 18:44:45 | 0:23:59 | 0:09:31 | 0:14:28 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:41:13.404763 mon.a mon.0 172.21.15.23:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366242 |
|
2018-04-06 22:43:01 | 2018-04-08 18:20:46 | 2018-04-08 19:34:47 | 1:14:01 | 0:47:51 | 0:26:10 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:04:45.045149 mon.a mon.0 172.21.15.73:6789/0 159 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 747 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366243 |
|
2018-04-06 22:43:02 | 2018-04-08 18:20:51 | 2018-04-08 19:00:51 | 0:40:00 | 0:21:46 | 0:18:14 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:56:45.899453 mds.e mds.1 172.21.15.28:6817/3341173500 1 : cluster [ERR] replayed stray Session close event for client.5443 172.21.15.151:0/2619414993 from time 2018-04-08 18:50:20.786424, ignoring" in cluster log |
||||||||||||||
| fail | 2366244 |
|
2018-04-06 22:43:03 | 2018-04-08 18:20:55 | 2018-04-08 19:36:56 | 1:16:01 | 1:03:26 | 0:12:35 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:39:45.776761 mon.a mon.0 172.21.15.84:6789/0 156 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366245 |
|
2018-04-06 22:43:03 | 2018-04-08 18:22:47 | 2018-04-08 20:22:49 | 2:00:02 | 0:35:20 | 1:24:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:53:38.578129 mon.a mon.0 172.21.15.68:6789/0 195 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366246 |
|
2018-04-06 22:43:04 | 2018-04-08 18:22:47 | 2018-04-08 19:14:47 | 0:52:00 | 0:13:39 | 0:38:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:07:34.155085 mon.b mon.0 172.21.15.135:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366247 |
|
2018-04-06 22:43:05 | 2018-04-08 18:22:47 | 2018-04-08 19:52:48 | 1:30:01 | 0:27:04 | 1:02:57 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:43:10.068304 mon.b mon.0 172.21.15.173:6789/0 322 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 684 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366248 |
|
2018-04-06 22:43:06 | 2018-04-08 18:22:47 | 2018-04-08 19:58:48 | 1:36:01 | 0:10:34 | 1:25:27 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:54:22.069554 mon.b mon.0 172.21.15.152:6789/0 182 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 80 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366249 |
|
2018-04-06 22:43:06 | 2018-04-08 18:22:47 | 2018-04-08 19:36:48 | 1:14:01 | 0:57:23 | 0:16:38 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 19:24:48.372286 mon.a mon.0 172.21.15.140:6789/0 214 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 82 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366250 |
|
2018-04-06 22:43:07 | 2018-04-08 18:22:48 | 2018-04-08 19:34:49 | 1:12:01 | 0:40:17 | 0:31:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:00:50.814198 mon.a mon.0 172.21.15.23:6789/0 267 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366251 |
|
2018-04-06 22:43:08 | 2018-04-08 18:22:49 | 2018-04-08 19:16:49 | 0:54:00 | 0:19:40 | 0:34:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366252 |
|
2018-04-06 22:43:09 | 2018-04-08 18:25:13 | 2018-04-08 19:57:14 | 1:32:01 | 0:09:19 | 1:22:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:53:24.024451 mon.b mon.0 172.21.15.4:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366253 |
|
2018-04-06 22:43:10 | 2018-04-08 18:26:48 | 2018-04-08 18:56:48 | 0:30:00 | 0:18:34 | 0:11:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:51:54.984121 mon.a mon.0 172.21.15.35:6789/0 203 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 521 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366254 |
|
2018-04-06 22:43:10 | 2018-04-08 18:26:48 | 2018-04-08 19:28:48 | 1:02:00 | 0:11:01 | 0:50:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366255 |
|
2018-04-06 22:43:11 | 2018-04-08 18:26:48 | 2018-04-08 19:18:48 | 0:52:00 | 0:09:58 | 0:42:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:16:04.051910 mon.a mon.0 172.21.15.68:6789/0 303 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366256 |
|
2018-04-06 22:43:12 | 2018-04-08 18:26:48 | 2018-04-08 19:20:48 | 0:54:00 | 0:09:59 | 0:44:01 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:16:56.468165 mon.a mon.0 172.21.15.77:6789/0 146 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366257 |
|
2018-04-06 22:43:12 | 2018-04-08 18:26:49 | 2018-04-08 19:32:49 | 1:06:00 | 0:49:02 | 0:16:58 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:00:01.052954 mon.b mon.0 172.21.15.118:6789/0 232 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366258 |
|
2018-04-06 22:43:13 | 2018-04-08 18:28:34 | 2018-04-08 19:00:34 | 0:32:00 | 0:21:15 | 0:10:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:47:01.675929 mds.c mds.1 172.21.15.162:6816/3766530365 1 : cluster [ERR] replayed stray Session close event for client.4637 172.21.15.5:0/3096059129 from time 2018-04-08 18:46:22.719947, ignoring" in cluster log |
||||||||||||||
| fail | 2366259 |
|
2018-04-06 22:43:14 | 2018-04-08 18:28:36 | 2018-04-08 19:26:36 | 0:58:00 | 0:43:02 | 0:14:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:13:01.220623 mon.a mon.0 172.21.15.40:6789/0 242 : cluster [WRN] Health check failed: 18 slow ops, oldest one blocked for 1439 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366260 |
|
2018-04-06 22:43:15 | 2018-04-08 18:28:38 | 2018-04-08 20:42:41 | 2:14:03 | 0:51:20 | 1:22:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:56:35.655375 mon.a mon.0 172.21.15.37:6789/0 245 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366261 |
|
2018-04-06 22:43:15 | 2018-04-08 18:28:40 | 2018-04-08 18:52:41 | 0:24:01 | 0:11:01 | 0:13:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:48:02.454502 mon.a mon.0 172.21.15.24:6789/0 331 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 89 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366262 |
|
2018-04-06 22:43:16 | 2018-04-08 18:30:25 | 2018-04-08 19:34:25 | 1:04:00 | 0:17:50 | 0:46:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:22:08.189947 mon.b mon.0 172.21.15.26:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366263 |
|
2018-04-06 22:43:17 | 2018-04-08 18:30:35 | 2018-04-08 19:56:36 | 1:26:01 | 0:10:35 | 1:15:26 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:52:04.813079 mon.a mon.0 172.21.15.6:6789/0 206 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366264 |
|
2018-04-06 22:43:18 | 2018-04-08 18:31:53 | 2018-04-08 19:41:53 | 1:10:00 | 0:51:37 | 0:18:23 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 2366265 |
|
2018-04-06 22:43:18 | 2018-04-08 18:32:34 | 2018-04-08 19:38:35 | 1:06:01 | 0:47:29 | 0:18:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:56:36.260056 mon.b mon.0 172.21.15.47:6789/0 175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366266 |
|
2018-04-06 22:43:19 | 2018-04-08 18:32:41 | 2018-04-08 19:38:42 | 1:06:01 | 0:45:07 | 0:20:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:59:32.121393 mon.b mon.0 172.21.15.4:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366267 |
|
2018-04-06 22:43:20 | 2018-04-08 18:32:43 | 2018-04-08 19:02:43 | 0:30:00 | 0:10:43 | 0:19:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:58:05.783248 mon.a mon.0 172.21.15.77:6789/0 327 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 82 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366268 |
|
2018-04-06 22:43:21 | 2018-04-08 18:32:46 | 2018-04-08 19:42:46 | 1:10:00 | 0:28:35 | 0:41:25 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:20:01.528482 mon.b mon.0 172.21.15.64:6789/0 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366269 |
|
2018-04-06 22:43:21 | 2018-04-08 18:34:41 | 2018-04-08 18:54:41 | 0:20:00 | 0:09:39 | 0:10:21 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test suites/pjd.sh) on smithi205 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=master TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh' |
||||||||||||||
| fail | 2366270 |
|
2018-04-06 22:43:22 | 2018-04-08 18:34:56 | 2018-04-08 19:38:56 | 1:04:00 | 0:08:51 | 0:55:09 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:34:23.806175 mon.a mon.0 172.21.15.68:6789/0 253 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366271 |
|
2018-04-06 22:43:23 | 2018-04-08 18:34:59 | 2018-04-08 19:59:00 | 1:24:01 | 0:10:03 | 1:13:58 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:53:34.623515 mon.b mon.0 172.21.15.5:6789/0 127 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366272 |
|
2018-04-06 22:43:24 | 2018-04-08 18:37:03 | 2018-04-08 19:37:04 | 1:00:01 | 0:47:19 | 0:12:42 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:55:26.117153 mon.a mon.0 172.21.15.6:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366273 |
|
2018-04-06 22:43:24 | 2018-04-08 18:37:03 | 2018-04-08 19:09:03 | 0:32:00 | 0:21:22 | 0:10:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:05:35.933707 mds.i mds.1 172.21.15.11:6816/1104901821 1 : cluster [ERR] replayed stray Session close event for client.5420 172.21.15.171:0/2676684985 from time 2018-04-08 19:00:12.678593, ignoring" in cluster log |
||||||||||||||
| fail | 2366274 |
|
2018-04-06 22:43:25 | 2018-04-08 18:38:48 | 2018-04-08 19:56:49 | 1:18:01 | 1:07:45 | 0:10:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:18:04.901104 mon.a mon.0 172.21.15.94:6789/0 172 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366275 |
|
2018-04-06 22:43:26 | 2018-04-08 18:38:48 | 2018-04-08 19:54:49 | 1:16:01 | 1:02:38 | 0:13:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:57:38.029832 mon.b mon.0 172.21.15.31:6789/0 313 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366276 |
|
2018-04-06 22:43:27 | 2018-04-08 18:39:32 | 2018-04-08 19:07:32 | 0:28:00 | 0:13:55 | 0:14:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 18:59:18.252731 mon.b mon.0 172.21.15.26:6789/0 243 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366277 |
|
2018-04-06 22:43:27 | 2018-04-08 18:40:56 | 2018-04-08 19:58:57 | 1:18:01 | 0:24:43 | 0:53:18 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:40:26.944172 mon.a mon.0 172.21.15.41:6789/0 198 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366278 |
|
2018-04-06 22:43:28 | 2018-04-08 18:40:56 | 2018-04-08 19:56:57 | 1:16:01 | 0:10:22 | 1:05:39 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:51:56.470563 mon.a mon.0 172.21.15.148:6789/0 223 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366279 |
|
2018-04-06 22:43:29 | 2018-04-08 18:40:56 | 2018-04-08 20:02:57 | 1:22:01 | 0:48:08 | 0:33:53 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| pass | 2366280 |
|
2018-04-06 22:43:30 | 2018-04-08 18:42:44 | 2018-04-08 19:50:46 | 1:08:02 | 0:43:45 | 0:24:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2366281 |
|
2018-04-06 22:43:30 | 2018-04-08 18:42:44 | 2018-04-08 19:28:44 | 0:46:00 | 0:20:43 | 0:25:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:13:48.601193 mon.b mon.0 172.21.15.50:6789/0 176 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366282 |
|
2018-04-06 22:43:31 | 2018-04-08 18:42:46 | 2018-04-08 19:04:46 | 0:22:00 | 0:08:44 | 0:13:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:01:47.214017 mon.b mon.0 172.21.15.64:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366283 |
|
2018-04-06 22:43:32 | 2018-04-08 18:44:40 | 2018-04-08 19:26:40 | 0:42:00 | 0:18:47 | 0:23:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:22:14.535966 mon.a mon.0 172.21.15.41:6789/0 198 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 542 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366284 |
|
2018-04-06 22:43:33 | 2018-04-08 18:44:40 | 2018-04-08 19:32:40 | 0:48:00 | 0:09:58 | 0:38:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:30:16.802857 mon.b mon.0 172.21.15.135:6789/0 139 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 152 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366285 |
|
2018-04-06 22:43:33 | 2018-04-08 18:44:46 | 2018-04-08 19:24:46 | 0:40:00 | 0:10:05 | 0:29:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:19:59.502851 mon.b mon.0 172.21.15.17:6789/0 449 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366286 |
|
2018-04-06 22:43:34 | 2018-04-08 18:44:56 | 2018-04-08 19:18:56 | 0:34:00 | 0:11:03 | 0:22:57 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:13:11.985856 mon.b mon.0 172.21.15.194:6789/0 235 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366287 |
|
2018-04-06 22:43:35 | 2018-04-08 18:46:37 | 2018-04-08 19:50:38 | 1:04:01 | 0:09:22 | 0:54:39 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:46:04.795566 mon.b mon.0 172.21.15.59:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366288 |
|
2018-04-06 22:43:36 | 2018-04-08 18:46:50 | 2018-04-08 20:20:51 | 1:34:01 | 0:22:05 | 1:11:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:07:00.805094 mds.a mds.1 172.21.15.8:6816/3201724840 1 : cluster [ERR] replayed stray Session close event for client.4673 172.21.15.169:0/2538718308 from time 2018-04-08 20:06:16.788272, ignoring" in cluster log |
||||||||||||||
| fail | 2366289 |
|
2018-04-06 22:43:37 | 2018-04-08 18:47:46 | 2018-04-08 19:49:47 | 1:02:01 | 0:42:30 | 0:19:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:35:36.431222 mon.a mon.0 172.21.15.60:6789/0 352 : cluster [WRN] Health check failed: 19 slow ops, oldest one blocked for 1324 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366290 |
|
2018-04-06 22:43:37 | 2018-04-08 18:48:59 | 2018-04-08 20:13:00 | 1:24:01 | 0:42:49 | 0:41:12 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:36:23.782478 mon.b mon.0 172.21.15.28:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366291 |
|
2018-04-06 22:43:38 | 2018-04-08 18:48:59 | 2018-04-08 19:38:59 | 0:50:00 | 0:10:27 | 0:39:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:35:09.483598 mon.a mon.0 172.21.15.175:6789/0 322 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 72 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366292 |
|
2018-04-06 22:43:39 | 2018-04-08 18:50:45 | 2018-04-08 19:32:45 | 0:42:00 | 0:19:26 | 0:22:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:25:39.776125 mon.a mon.0 172.21.15.2:6789/0 266 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366293 |
|
2018-04-06 22:43:40 | 2018-04-08 18:52:40 | 2018-04-08 19:38:40 | 0:46:00 | 0:10:51 | 0:35:09 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:32:52.136695 mon.b mon.0 172.21.15.16:6789/0 160 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366294 |
|
2018-04-06 22:43:40 | 2018-04-08 18:52:42 | 2018-04-08 20:08:43 | 1:16:01 | 0:45:04 | 0:30:57 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 19:50:35.583946 mon.b mon.0 172.21.15.112:6789/0 325 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 40 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366295 |
|
2018-04-06 22:43:41 | 2018-04-08 18:52:47 | 2018-04-08 21:18:50 | 2:26:03 | 0:51:20 | 1:34:43 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:33:42.415045 mon.b mon.0 172.21.15.33:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366296 |
|
2018-04-06 22:43:42 | 2018-04-08 18:52:50 | 2018-04-08 19:58:51 | 1:06:01 | 0:52:46 | 0:13:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:12:29.024838 mon.a mon.0 172.21.15.35:6789/0 158 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366297 |
|
2018-04-06 22:43:43 | 2018-04-08 18:54:49 | 2018-04-08 19:20:49 | 0:26:00 | 0:12:12 | 0:13:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:15:42.335641 mon.b mon.0 172.21.15.28:6789/0 182 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 57 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366298 |
|
2018-04-06 22:43:43 | 2018-04-08 18:54:49 | 2018-04-08 19:44:50 | 0:50:01 | 0:20:55 | 0:29:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:29:47.062653 mon.b mon.0 172.21.15.36:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366299 |
|
2018-04-06 22:43:44 | 2018-04-08 18:54:49 | 2018-04-08 19:18:49 | 0:24:00 | 0:09:57 | 0:14:03 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:14:46.784706 mon.a mon.0 172.21.15.67:6789/0 193 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366300 |
|
2018-04-06 22:43:45 | 2018-04-08 18:56:50 | 2018-04-08 19:18:50 | 0:22:00 | 0:09:28 | 0:12:32 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366301 |
|
2018-04-06 22:43:46 | 2018-04-08 18:58:25 | 2018-04-08 19:20:25 | 0:22:00 | 0:10:04 | 0:11:56 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:16:28.516497 mon.a mon.0 172.21.15.15:6789/0 215 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366302 |
|
2018-04-06 22:43:46 | 2018-04-08 18:58:25 | 2018-04-08 20:22:26 | 1:24:01 | 0:08:55 | 1:15:06 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:18:51.037087 mon.b mon.0 172.21.15.3:6789/0 137 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366303 |
|
2018-04-06 22:43:47 | 2018-04-08 18:58:33 | 2018-04-08 19:50:34 | 0:52:01 | 0:20:59 | 0:31:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:47:18.853880 mds.c mds.1 172.21.15.190:6817/1596179823 1 : cluster [ERR] replayed stray Session close event for client.5502 172.21.15.158:0/3794388839 from time 2018-04-08 19:42:05.093636, ignoring" in cluster log |
||||||||||||||
| dead | 2366304 |
|
2018-04-06 22:43:48 | 2018-04-08 18:58:34 | 2018-04-08 20:24:35 | 1:26:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | — | ||||
Failure Reason:
Timeout exceeded. <pexpect.pty_spawn.spawn object at 0x7f08bf756710> command: /usr/bin/ipmitool args: ['/usr/bin/ipmitool', '-H', 'smithi048.ipmi.sepia.ceph.com', '-I', 'lanplus', '-U', 'inktank', '-P', 'ApGNXcA7', 'power', 'off'] buffer (last 100 chars): '' before (last 100 chars): '' after: <class 'pexpect.exceptions.TIMEOUT'> match: None match_index: None exitstatus: None flag_eof: False pid: 26045 child_fd: 8 closed: False timeout: 30 delimiter: <class 'pexpect.exceptions.EOF'> logfile: None logfile_read: None logfile_send: None maxread: 2000 ignorecase: False searchwindowsize: None delaybeforesend: 0.05 delayafterclose: 0.1 delayafterterminate: 0.1 searcher: searcher_re: 0: re.compile("Chassis Power Control: Down/Off") 1: EOF |
||||||||||||||
| fail | 2366305 |
|
2018-04-06 22:43:49 | 2018-04-08 18:58:34 | 2018-04-08 20:18:35 | 1:20:01 | 0:27:22 | 0:52:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:57:28.912923 mon.b mon.0 172.21.15.70:6789/0 307 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366306 |
|
2018-04-06 22:43:50 | 2018-04-08 18:58:39 | 2018-04-08 20:02:40 | 1:04:01 | 0:14:48 | 0:49:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366307 |
|
2018-04-06 22:43:50 | 2018-04-08 18:58:43 | 2018-04-08 20:00:43 | 1:02:00 | 0:25:19 | 0:36:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:51:11.576446 mon.a mon.0 172.21.15.80:6789/0 344 : cluster [WRN] Health check failed: 15 slow ops, oldest one blocked for 633 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366308 |
|
2018-04-06 22:43:51 | 2018-04-08 18:58:59 | 2018-04-08 19:20:59 | 0:22:00 | 0:11:07 | 0:10:53 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:16:27.537691 mon.b mon.0 172.21.15.72:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366309 |
|
2018-04-06 22:43:52 | 2018-04-08 19:00:44 | 2018-04-08 20:22:46 | 1:22:02 | 0:51:05 | 0:30:57 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 19:58:21.228911 mon.b mon.0 172.21.15.141:6789/0 192 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366310 |
|
2018-04-06 22:43:53 | 2018-04-08 19:00:44 | 2018-04-08 20:14:46 | 1:14:02 | 0:43:40 | 0:30:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:49:36.898663 mon.b mon.0 172.21.15.39:6789/0 247 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366311 |
|
2018-04-06 22:43:53 | 2018-04-08 19:00:44 | 2018-04-08 21:20:48 | 2:20:04 | 0:21:08 | 1:58:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:05:00.205564 mon.b mon.0 172.21.15.19:6789/0 303 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366312 |
|
2018-04-06 22:43:54 | 2018-04-08 19:00:44 | 2018-04-08 19:46:46 | 0:46:02 | 0:08:15 | 0:37:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366313 |
|
2018-04-06 22:43:55 | 2018-04-08 19:00:44 | 2018-04-08 20:34:47 | 1:34:03 | 0:24:46 | 1:09:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:28:55.552892 mon.a mon.0 172.21.15.82:6789/0 201 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 734 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366314 |
|
2018-04-06 22:43:56 | 2018-04-08 19:00:52 | 2018-04-08 20:00:54 | 1:00:02 | 0:10:01 | 0:50:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2366315 |
|
2018-04-06 22:43:57 | 2018-04-08 19:02:44 | 2018-04-08 20:10:46 | 1:08:02 | 0:09:42 | 0:58:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2366316 |
|
2018-04-06 22:43:57 | 2018-04-08 19:02:44 | 2018-04-08 20:20:47 | 1:18:03 | 0:09:46 | 1:08:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2366317 |
|
2018-04-06 22:43:58 | 2018-04-08 19:02:47 | 2018-04-08 20:26:48 | 1:24:01 | 0:08:38 | 1:15:23 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2366318 |
|
2018-04-06 22:43:59 | 2018-04-08 19:04:44 | 2018-04-08 19:48:46 | 0:44:02 | 0:21:31 | 0:22:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:36:44.794988 mds.a mds.1 172.21.15.67:6817/196036152 1 : cluster [ERR] replayed stray Session close event for client.14629 172.21.15.101:0/840161021 from time 2018-04-08 19:36:00.375806, ignoring" in cluster log |
||||||||||||||
| fail | 2366319 |
|
2018-04-06 22:44:00 | 2018-04-08 19:04:47 | 2018-04-08 19:52:47 | 0:48:00 | 0:32:38 | 0:15:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:43:06.296687 mon.a mon.0 172.21.15.154:6789/0 219 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 1032 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366320 |
|
2018-04-06 22:44:00 | 2018-04-08 19:04:48 | 2018-04-08 20:12:48 | 1:08:00 | 0:55:47 | 0:12:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:23:19.767709 mon.a mon.0 172.21.15.49:6789/0 260 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366321 |
|
2018-04-06 22:44:01 | 2018-04-08 19:07:35 | 2018-04-08 20:09:35 | 1:02:00 | 0:10:37 | 0:51:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:04:14.950731 mon.a mon.0 172.21.15.83:6789/0 326 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366322 |
|
2018-04-06 22:44:02 | 2018-04-08 19:08:54 | 2018-04-08 19:42:54 | 0:34:00 | 0:19:36 | 0:14:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:28:31.192464 mon.b mon.0 172.21.15.9:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366323 |
|
2018-04-06 22:44:03 | 2018-04-08 19:09:05 | 2018-04-08 19:41:04 | 0:31:59 | 0:10:41 | 0:21:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:39:03.674789 mon.b mon.0 172.21.15.27:6789/0 317 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 140 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366324 |
|
2018-04-06 22:44:03 | 2018-04-08 19:10:58 | 2018-04-08 20:22:59 | 1:12:01 | 0:50:40 | 0:21:21 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 19:49:24.823288 mon.a mon.0 172.21.15.15:6789/0 190 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366325 |
|
2018-04-06 22:44:04 | 2018-04-08 19:12:51 | 2018-04-08 20:20:51 | 1:08:00 | 0:50:11 | 0:17:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:50:23.092246 mon.b mon.0 172.21.15.72:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366326 |
|
2018-04-06 22:44:05 | 2018-04-08 19:14:14 | 2018-04-08 20:02:14 | 0:48:00 | 0:34:34 | 0:13:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366327 |
|
2018-04-06 22:44:06 | 2018-04-08 19:14:33 | 2018-04-08 19:38:33 | 0:24:00 | 0:10:46 | 0:13:14 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:34:04.532595 mon.a mon.0 172.21.15.82:6789/0 194 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366328 |
|
2018-04-06 22:44:06 | 2018-04-08 19:14:48 | 2018-04-08 19:48:48 | 0:34:00 | 0:23:06 | 0:10:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:33:26.538113 mon.a mon.0 172.21.15.38:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366329 |
|
2018-04-06 22:44:07 | 2018-04-08 19:14:53 | 2018-04-08 19:48:53 | 0:34:00 | 0:10:10 | 0:23:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:46:25.630415 mon.b mon.0 172.21.15.8:6789/0 180 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 124 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366330 |
|
2018-04-06 22:44:08 | 2018-04-08 19:16:52 | 2018-04-08 20:08:54 | 0:52:02 | 0:08:55 | 0:43:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:04:37.447194 mon.b mon.0 172.21.15.88:6789/0 214 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366331 |
|
2018-04-06 22:44:09 | 2018-04-08 19:16:53 | 2018-04-08 19:42:53 | 0:26:00 | 0:10:28 | 0:15:32 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366332 |
|
2018-04-06 22:44:10 | 2018-04-08 19:18:45 | 2018-04-08 20:50:47 | 1:32:02 | 0:09:16 | 1:22:46 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:51.817796 mon.b mon.0 172.21.15.28:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366333 |
|
2018-04-06 22:44:10 | 2018-04-08 19:18:45 | 2018-04-08 20:04:46 | 0:46:01 | 0:20:50 | 0:25:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:01:15.118900 mds.g mds.1 172.21.15.23:6816/2352693932 1 : cluster [ERR] replayed stray Session close event for client.5325 172.21.15.188:0/1336561619 from time 2018-04-08 19:56:08.876097, ignoring" in cluster log |
||||||||||||||
| pass | 2366334 |
|
2018-04-06 22:44:11 | 2018-04-08 19:18:50 | 2018-04-08 20:40:51 | 1:22:01 | 1:07:03 | 0:14:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366335 |
|
2018-04-06 22:44:12 | 2018-04-08 19:18:51 | 2018-04-08 20:04:51 | 0:46:00 | 0:28:37 | 0:17:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:44:16.937575 mon.b mon.0 172.21.15.130:6789/0 177 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366336 |
|
2018-04-06 22:44:13 | 2018-04-08 19:18:52 | 2018-04-08 21:14:57 | 1:56:05 | 0:15:16 | 1:40:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:06:12.645398 mon.b mon.0 172.21.15.9:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366337 |
|
2018-04-06 22:44:13 | 2018-04-08 19:18:57 | 2018-04-08 20:14:57 | 0:56:00 | 0:28:08 | 0:27:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:04:15.328717 mon.a mon.0 172.21.15.79:6789/0 344 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 732 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366338 |
|
2018-04-06 22:44:14 | 2018-04-08 19:20:37 | 2018-04-08 20:44:38 | 1:24:01 | 0:11:01 | 1:13:00 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:41:21.321516 mon.b mon.0 172.21.15.44:6789/0 333 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366339 |
|
2018-04-06 22:44:15 | 2018-04-08 19:20:44 | 2018-04-08 20:28:44 | 1:08:00 | 0:49:22 | 0:18:38 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 20:07:03.967989 mon.a mon.0 172.21.15.102:6789/0 208 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 165 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366340 |
|
2018-04-06 22:44:16 | 2018-04-08 19:20:50 | 2018-04-08 20:18:50 | 0:58:00 | 0:37:16 | 0:20:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:58:37.623159 mon.a mon.0 172.21.15.172:6789/0 175 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 738 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366341 |
|
2018-04-06 22:44:16 | 2018-04-08 19:20:50 | 2018-04-08 20:48:51 | 1:28:01 | 1:06:34 | 0:21:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:00:26.432376 mon.b mon.0 172.21.15.1:6789/0 200 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 699 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366342 |
|
2018-04-06 22:44:17 | 2018-04-08 19:20:51 | 2018-04-08 19:44:51 | 0:24:00 | 0:09:11 | 0:14:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2366343 |
|
2018-04-06 22:44:18 | 2018-04-08 19:21:00 | 2018-04-08 20:09:00 | 0:48:00 | 0:23:44 | 0:24:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2366344 |
|
2018-04-06 22:44:19 | 2018-04-08 19:23:09 | 2018-04-08 20:25:10 | 1:02:01 | 0:10:22 | 0:51:39 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:20:24.705105 mon.a mon.0 172.21.15.64:6789/0 269 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 62 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366345 |
|
2018-04-06 22:44:19 | 2018-04-08 19:24:56 | 2018-04-08 19:50:56 | 0:26:00 | 0:09:24 | 0:16:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366346 |
|
2018-04-06 22:44:20 | 2018-04-08 19:24:56 | 2018-04-08 20:48:59 | 1:24:03 | 0:10:21 | 1:13:42 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:42.808211 mon.b mon.0 172.21.15.59:6789/0 196 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366347 |
|
2018-04-06 22:44:21 | 2018-04-08 19:26:46 | 2018-04-08 19:52:46 | 0:26:00 | 0:08:40 | 0:17:20 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2366348 |
|
2018-04-06 22:44:22 | 2018-04-08 19:26:46 | 2018-04-08 20:14:46 | 0:48:00 | 0:22:33 | 0:25:27 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:01:10.323480 mds.a mds.1 172.21.15.136:6817/2419946301 1 : cluster [ERR] replayed stray Session close event for client.4680 172.21.15.7:0/1856876146 from time 2018-04-08 20:00:23.579540, ignoring" in cluster log |
||||||||||||||
| fail | 2366349 |
|
2018-04-06 22:44:22 | 2018-04-08 19:26:46 | 2018-04-08 20:48:47 | 1:22:01 | 0:50:00 | 0:32:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:04:15.774505 mon.b mon.0 172.21.15.101:6789/0 169 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366350 |
|
2018-04-06 22:44:23 | 2018-04-08 19:26:46 | 2018-04-08 20:50:47 | 1:24:01 | 0:57:00 | 0:27:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:01:12.605618 mon.b mon.0 172.21.15.17:6789/0 236 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 165 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366351 |
|
2018-04-06 22:44:24 | 2018-04-08 19:28:46 | 2018-04-08 20:14:47 | 0:46:01 | 0:10:28 | 0:35:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:11:49.942615 mon.b mon.0 172.21.15.109:6789/0 305 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366352 |
|
2018-04-06 22:44:25 | 2018-04-08 19:28:50 | 2018-04-08 20:24:50 | 0:56:00 | 0:17:20 | 0:38:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:11:41.341709 mon.a mon.0 172.21.15.47:6789/0 160 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366353 |
|
2018-04-06 22:44:25 | 2018-04-08 19:30:58 | 2018-04-08 20:52:59 | 1:22:01 | 0:10:53 | 1:11:08 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:48:29.924877 mon.b mon.0 172.21.15.26:6789/0 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366354 |
|
2018-04-06 22:44:26 | 2018-04-08 19:30:58 | 2018-04-08 20:56:59 | 1:26:01 | 0:45:36 | 0:40:25 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 20:38:27.999098 mon.a mon.0 172.21.15.41:6789/0 319 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366355 |
|
2018-04-06 22:44:27 | 2018-04-08 19:32:43 | 2018-04-08 20:32:43 | 1:00:00 | 0:50:18 | 0:09:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:00:56.449545 mon.a mon.0 172.21.15.26:6789/0 214 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 743 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366356 |
|
2018-04-06 22:44:28 | 2018-04-08 19:32:47 | 2018-04-08 20:48:47 | 1:16:00 | 0:40:48 | 0:35:12 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:35:21.080234 mon.a mon.0 172.21.15.5:6789/0 251 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366357 |
|
2018-04-06 22:44:28 | 2018-04-08 19:32:51 | 2018-04-08 20:10:51 | 0:38:00 | 0:11:07 | 0:26:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:06:54.920288 mon.a mon.0 172.21.15.59:6789/0 338 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 129 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366358 |
|
2018-04-06 22:44:29 | 2018-04-08 19:34:39 | 2018-04-08 20:18:39 | 0:44:00 | 0:23:32 | 0:20:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:14:18.292205 mon.a mon.0 172.21.15.71:6789/0 253 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 822 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366359 |
|
2018-04-06 22:44:30 | 2018-04-08 19:34:39 | 2018-04-08 20:04:38 | 0:29:59 | 0:09:50 | 0:20:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:00:02.931000 mon.b mon.0 172.21.15.3:6789/0 173 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366360 |
|
2018-04-06 22:44:31 | 2018-04-08 19:34:48 | 2018-04-08 19:58:47 | 0:23:59 | 0:10:02 | 0:13:57 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:53:58.626953 mon.b mon.0 172.21.15.47:6789/0 452 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366361 |
|
2018-04-06 22:44:31 | 2018-04-08 19:34:50 | 2018-04-08 20:20:50 | 0:46:00 | 0:09:56 | 0:36:04 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:16:36.116351 mon.b mon.0 172.21.15.27:6789/0 284 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366362 |
|
2018-04-06 22:44:32 | 2018-04-08 19:36:53 | 2018-04-08 20:44:56 | 1:08:03 | 0:45:06 | 0:22:57 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:06:46.619442 mon.b mon.0 172.21.15.58:6789/0 306 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366363 |
|
2018-04-06 22:44:33 | 2018-04-08 19:36:53 | 2018-04-08 20:26:54 | 0:50:01 | 0:20:23 | 0:29:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:23:39.965382 mds.c mds.1 172.21.15.94:6817/2716305134 1 : cluster [ERR] replayed stray Session close event for client.5130 172.21.15.203:0/2856551718 from time 2018-04-08 20:18:19.481067, ignoring" in cluster log |
||||||||||||||
| fail | 2366364 |
|
2018-04-06 22:44:34 | 2018-04-08 19:36:58 | 2018-04-08 20:56:59 | 1:20:01 | 1:05:49 | 0:14:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:11:10.114804 mon.a mon.0 172.21.15.117:6789/0 213 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 850 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366365 |
|
2018-04-06 22:44:34 | 2018-04-08 19:37:05 | 2018-04-08 21:27:07 | 1:50:02 | 0:25:46 | 1:24:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:06:14.613297 mon.b mon.0 172.21.15.135:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366366 |
|
2018-04-06 22:44:35 | 2018-04-08 19:38:44 | 2018-04-08 21:10:45 | 1:32:01 | 0:14:28 | 1:17:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:05:57.824132 mon.b mon.0 172.21.15.22:6789/0 312 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 213 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366367 |
|
2018-04-06 22:44:36 | 2018-04-08 19:38:44 | 2018-04-08 20:16:44 | 0:38:00 | 0:21:02 | 0:16:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:00:30.848312 mon.b mon.0 172.21.15.65:6789/0 148 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366368 |
|
2018-04-06 22:44:37 | 2018-04-08 19:38:44 | 2018-04-08 20:34:44 | 0:56:00 | 0:10:19 | 0:45:41 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:30:00.833621 mon.b mon.0 172.21.15.79:6789/0 196 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366369 |
|
2018-04-06 22:44:37 | 2018-04-08 19:38:44 | 2018-04-08 20:36:44 | 0:58:00 | 0:32:32 | 0:25:28 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 20:17:12.111452 mon.a mon.0 172.21.15.60:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366370 |
|
2018-04-06 22:44:38 | 2018-04-08 19:38:57 | 2018-04-08 20:32:58 | 0:54:01 | 0:41:27 | 0:12:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:13:11.788979 mon.b mon.0 172.21.15.45:6789/0 181 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 222 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366371 |
|
2018-04-06 22:44:39 | 2018-04-08 19:39:00 | 2018-04-08 20:57:02 | 1:18:02 | 0:55:03 | 0:22:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366372 |
|
2018-04-06 22:44:40 | 2018-04-08 19:41:16 | 2018-04-08 20:01:16 | 0:20:00 | 0:09:44 | 0:10:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 19:58:17.220363 mon.b mon.0 172.21.15.64:6789/0 318 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366373 |
|
2018-04-06 22:44:41 | 2018-04-08 19:41:55 | 2018-04-08 20:45:55 | 1:04:00 | 0:15:36 | 0:48:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2366374 |
|
2018-04-06 22:44:41 | 2018-04-08 19:42:57 | 2018-04-08 21:43:01 | 2:00:04 | 0:11:37 | 1:48:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2366375 |
|
2018-04-06 22:44:42 | 2018-04-08 19:42:58 | 2018-04-08 21:27:00 | 1:44:02 | 0:09:08 | 1:34:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366376 |
|
2018-04-06 22:44:43 | 2018-04-08 19:42:58 | 2018-04-08 20:28:58 | 0:46:00 | 0:09:47 | 0:36:13 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:25:01.808741 mon.a mon.0 172.21.15.154:6789/0 343 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366377 |
|
2018-04-06 22:44:44 | 2018-04-08 19:44:19 | 2018-04-08 20:44:20 | 1:00:01 | 0:43:02 | 0:16:59 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:07:49.467245 mon.b mon.0 172.21.15.173:6789/0 298 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366378 |
|
2018-04-06 22:44:45 | 2018-04-08 19:44:29 | 2018-04-08 20:16:29 | 0:32:00 | 0:22:06 | 0:09:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:03:04.952229 mds.h mds.1 172.21.15.50:6816/2294709562 1 : cluster [ERR] replayed stray Session close event for client.4772 172.21.15.132:0/2438574388 from time 2018-04-08 20:02:24.885872, ignoring" in cluster log |
||||||||||||||
| pass | 2366379 |
|
2018-04-06 22:44:45 | 2018-04-08 19:44:43 | 2018-04-08 20:38:44 | 0:54:01 | 0:39:08 | 0:14:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366380 |
|
2018-04-06 22:44:46 | 2018-04-08 19:44:51 | 2018-04-08 20:52:51 | 1:08:00 | 0:57:48 | 0:10:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:03:19.562828 mon.a mon.0 172.21.15.24:6789/0 198 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366381 |
|
2018-04-06 22:44:47 | 2018-04-08 19:44:52 | 2018-04-08 20:18:52 | 0:34:00 | 0:11:07 | 0:22:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366382 |
|
2018-04-06 22:44:48 | 2018-04-08 19:46:49 | 2018-04-08 20:24:48 | 0:37:59 | 0:19:03 | 0:18:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:11:20.959731 mon.b mon.0 172.21.15.6:6789/0 178 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366383 |
|
2018-04-06 22:44:49 | 2018-04-08 19:46:49 | 2018-04-08 20:16:48 | 0:29:59 | 0:11:17 | 0:18:42 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366384 |
|
2018-04-06 22:44:49 | 2018-04-08 19:46:53 | 2018-04-08 20:40:52 | 0:53:59 | 0:31:57 | 0:22:02 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 20:28:44.167807 mon.a mon.0 172.21.15.148:6789/0 253 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 394 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366385 |
|
2018-04-06 22:44:50 | 2018-04-08 19:48:58 | 2018-04-08 21:23:00 | 1:34:02 | 0:49:35 | 0:44:27 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:37:58.711614 mon.a mon.0 172.21.15.47:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366386 |
|
2018-04-06 22:44:51 | 2018-04-08 19:48:58 | 2018-04-08 20:50:59 | 1:02:01 | 0:39:30 | 0:22:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366387 |
|
2018-04-06 22:44:52 | 2018-04-08 19:48:58 | 2018-04-08 20:10:57 | 0:21:59 | 0:08:09 | 0:13:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:07:19.195885 mon.a mon.0 172.21.15.154:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366388 |
|
2018-04-06 22:44:52 | 2018-04-08 19:49:48 | 2018-04-08 21:15:49 | 1:26:01 | 0:30:01 | 0:56:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:08:29.950207 mon.a mon.0 172.21.15.60:6789/0 346 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 979 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366389 |
|
2018-04-06 22:44:53 | 2018-04-08 19:50:45 | 2018-04-08 20:22:45 | 0:32:00 | 0:09:41 | 0:22:19 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:18:05.359741 mon.a mon.0 172.21.15.56:6789/0 164 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366390 |
|
2018-04-06 22:44:54 | 2018-04-08 19:50:45 | 2018-04-08 20:32:45 | 0:42:00 | 0:09:43 | 0:32:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366391 |
|
2018-04-06 22:44:55 | 2018-04-08 19:50:48 | 2018-04-08 20:52:49 | 1:02:01 | 0:09:50 | 0:52:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:48:15.843587 mon.b mon.0 172.21.15.135:6789/0 202 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366392 |
|
2018-04-06 22:44:55 | 2018-04-08 19:50:58 | 2018-04-08 20:50:59 | 1:00:01 | 0:40:04 | 0:19:57 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:32:23.235832 mon.b mon.0 172.21.15.16:6789/0 181 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 957 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366393 |
|
2018-04-06 22:44:56 | 2018-04-08 19:52:49 | 2018-04-08 20:48:49 | 0:56:00 | 0:20:03 | 0:35:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:11.938536 mds.c mds.1 172.21.15.169:6817/657883060 1 : cluster [ERR] replayed stray Session close event for client.5196 172.21.15.27:0/4184250417 from time 2018-04-08 20:39:46.946647, ignoring" in cluster log |
||||||||||||||
| fail | 2366394 |
|
2018-04-06 22:44:57 | 2018-04-08 19:52:49 | 2018-04-08 22:24:51 | 2:32:02 | 1:07:31 | 1:24:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:36:59.344550 mon.a mon.0 172.21.15.118:6789/0 336 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 827 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366395 |
|
2018-04-06 22:44:58 | 2018-04-08 19:52:49 | 2018-04-08 21:16:50 | 1:24:01 | 0:27:44 | 0:56:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366396 |
|
2018-04-06 22:44:58 | 2018-04-08 19:54:59 | 2018-04-08 21:45:04 | 1:50:05 | 0:15:04 | 1:35:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:35:22.686603 mon.b mon.0 172.21.15.69:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366397 |
|
2018-04-06 22:44:59 | 2018-04-08 19:56:46 | 2018-04-08 20:52:46 | 0:56:00 | 0:21:29 | 0:34:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:37:12.598514 mon.b mon.0 172.21.15.78:6789/0 150 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 69 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366398 |
|
2018-04-06 22:45:00 | 2018-04-08 19:56:50 | 2018-04-08 21:02:51 | 1:06:01 | 0:10:34 | 0:55:27 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366399 |
|
2018-04-06 22:45:01 | 2018-04-08 19:56:58 | 2018-04-08 22:03:01 | 2:06:03 | 0:42:19 | 1:23:44 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:34:20.267574 mon.a mon.0 172.21.15.154:6789/0 251 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366400 |
|
2018-04-06 22:45:02 | 2018-04-08 19:57:15 | 2018-04-08 20:59:16 | 1:02:01 | 0:40:23 | 0:21:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:23:55.134354 mon.b mon.0 172.21.15.95:6789/0 296 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366401 |
|
2018-04-06 22:45:02 | 2018-04-08 19:58:50 | 2018-04-08 20:58:51 | 1:00:01 | 0:19:55 | 0:40:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366402 |
|
2018-04-06 22:45:03 | 2018-04-08 19:58:50 | 2018-04-08 20:30:50 | 0:32:00 | 0:10:00 | 0:22:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:26:53.854164 mon.a mon.0 172.21.15.59:6789/0 343 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 73 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366403 |
|
2018-04-06 22:45:04 | 2018-04-08 19:58:52 | 2018-04-08 21:08:53 | 1:10:01 | 0:17:44 | 0:52:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2366404 |
|
2018-04-06 22:45:05 | 2018-04-08 19:59:07 | 2018-04-08 20:29:06 | 0:29:59 | 0:10:27 | 0:19:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:24:23.900007 mon.b mon.0 172.21.15.112:6789/0 306 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366405 |
|
2018-04-06 22:45:05 | 2018-04-08 19:59:07 | 2018-04-08 20:31:06 | 0:31:59 | 0:08:54 | 0:23:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366406 |
|
2018-04-06 22:45:06 | 2018-04-08 20:00:53 | 2018-04-08 20:36:53 | 0:36:00 | 0:09:42 | 0:26:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:34:03.329758 mon.a mon.0 172.21.15.104:6789/0 196 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366407 |
|
2018-04-06 22:45:07 | 2018-04-08 20:00:55 | 2018-04-08 20:54:56 | 0:54:01 | 0:41:16 | 0:12:45 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:35:02.521736 mon.a mon.0 172.21.15.23:6789/0 206 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366408 |
|
2018-04-06 22:45:08 | 2018-04-08 20:01:17 | 2018-04-08 20:41:18 | 0:40:01 | 0:22:00 | 0:18:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:27:54.498284 mds.a mds.1 172.21.15.165:6817/371813141 1 : cluster [ERR] replayed stray Session close event for client.4771 172.21.15.93:0/2299424938 from time 2018-04-08 20:27:15.965273, ignoring" in cluster log |
||||||||||||||
| pass | 2366409 |
|
2018-04-06 22:45:09 | 2018-04-08 20:02:26 | 2018-04-08 21:00:27 | 0:58:01 | 0:43:26 | 0:14:35 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366410 |
|
2018-04-06 22:45:09 | 2018-04-08 20:02:41 | 2018-04-08 21:20:42 | 1:18:01 | 0:44:05 | 0:33:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:42.348340 mon.b mon.0 172.21.15.83:6789/0 182 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 157 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366411 |
|
2018-04-06 22:45:10 | 2018-04-08 20:02:58 | 2018-04-08 20:52:59 | 0:50:01 | 0:11:10 | 0:38:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366412 |
|
2018-04-06 22:45:11 | 2018-04-08 20:04:49 | 2018-04-08 20:48:49 | 0:44:00 | 0:23:38 | 0:20:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:41:43.081699 mon.b mon.0 172.21.15.39:6789/0 179 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366413 |
|
2018-04-06 22:45:12 | 2018-04-08 20:04:50 | 2018-04-08 20:34:49 | 0:29:59 | 0:11:23 | 0:18:36 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:30:06.598736 mon.a mon.0 172.21.15.109:6789/0 263 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 60 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366414 |
|
2018-04-06 22:45:12 | 2018-04-08 20:04:52 | 2018-04-08 21:10:53 | 1:06:01 | 0:36:54 | 0:29:07 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 20:51:05.411994 mon.b mon.0 172.21.15.3:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366415 |
|
2018-04-06 22:45:13 | 2018-04-08 20:09:04 | 2018-04-08 21:15:05 | 1:06:01 | 0:46:48 | 0:19:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:44:14.700727 mon.a mon.0 172.21.15.14:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366416 |
|
2018-04-06 22:45:14 | 2018-04-08 20:09:04 | 2018-04-08 21:31:05 | 1:22:01 | 0:48:45 | 0:33:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:48:22.616186 mon.b mon.0 172.21.15.51:6789/0 169 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366417 |
|
2018-04-06 22:45:15 | 2018-04-08 20:09:36 | 2018-04-08 20:31:36 | 0:22:00 | 0:08:43 | 0:13:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:27:42.489059 mon.b mon.0 172.21.15.28:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366418 |
|
2018-04-06 22:45:16 | 2018-04-08 20:10:58 | 2018-04-08 21:27:00 | 1:16:02 | 0:28:54 | 0:47:08 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:19:23.093237 mon.a mon.0 172.21.15.160:6789/0 209 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 949 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366419 |
|
2018-04-06 22:45:16 | 2018-04-08 20:10:58 | 2018-04-08 20:38:59 | 0:28:01 | 0:09:51 | 0:18:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:35:11.696593 mon.a mon.0 172.21.15.36:6789/0 164 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 57 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366420 |
|
2018-04-06 22:45:17 | 2018-04-08 20:10:59 | 2018-04-08 20:40:59 | 0:30:00 | 0:09:25 | 0:20:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366421 |
|
2018-04-06 22:45:18 | 2018-04-08 20:13:00 | 2018-04-08 20:35:00 | 0:22:00 | 0:10:43 | 0:11:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:29:51.290216 mon.a mon.0 172.21.15.84:6789/0 219 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366422 |
|
2018-04-06 22:45:19 | 2018-04-08 20:13:01 | 2018-04-08 21:07:02 | 0:54:01 | 0:41:07 | 0:12:54 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:10.452971 mon.a mon.0 172.21.15.110:6789/0 335 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 171 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366423 |
|
2018-04-06 22:45:19 | 2018-04-08 20:14:49 | 2018-04-08 20:46:49 | 0:32:00 | 0:20:20 | 0:11:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:42:42.550561 mds.b mds.1 172.21.15.50:6817/2348420816 1 : cluster [ERR] replayed stray Session close event for client.5226 172.21.15.195:0/1945650320 from time 2018-04-08 20:37:03.591655, ignoring" in cluster log |
||||||||||||||
| fail | 2366424 |
|
2018-04-06 22:45:20 | 2018-04-08 20:14:49 | 2018-04-08 21:32:50 | 1:18:01 | 1:08:14 | 0:09:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:42:52.074863 mon.a mon.0 172.21.15.2:6789/0 323 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 731 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366425 |
|
2018-04-06 22:45:21 | 2018-04-08 20:14:49 | 2018-04-08 20:58:49 | 0:44:00 | 0:27:17 | 0:16:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:39:52.494836 mon.a mon.0 172.21.15.69:6789/0 170 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 128 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366426 |
|
2018-04-06 22:45:22 | 2018-04-08 20:15:00 | 2018-04-08 21:23:00 | 1:08:00 | 0:15:07 | 0:52:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:16:39.790607 mon.b mon.0 172.21.15.63:6789/0 188 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 246 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366427 |
|
2018-04-06 22:45:22 | 2018-04-08 20:16:40 | 2018-04-08 21:18:40 | 1:02:00 | 0:22:36 | 0:39:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:09:42.177516 mon.a mon.0 172.21.15.85:6789/0 165 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 607 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366428 |
|
2018-04-06 22:45:24 | 2018-04-08 20:16:45 | 2018-04-08 20:36:44 | 0:19:59 | 0:09:20 | 0:10:39 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366429 |
|
2018-04-06 22:45:25 | 2018-04-08 20:16:49 | 2018-04-08 21:18:50 | 1:02:01 | 0:31:14 | 0:30:47 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:04:43.755703 mon.b mon.0 172.21.15.35:6789/0 144 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366430 |
|
2018-04-06 22:45:26 | 2018-04-08 20:18:46 | 2018-04-08 21:32:47 | 1:14:01 | 0:42:23 | 0:31:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:07:36.710459 mon.a mon.0 172.21.15.56:6789/0 216 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 745 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366431 |
|
2018-04-06 22:45:27 | 2018-04-08 20:18:46 | 2018-04-08 21:06:46 | 0:48:00 | 0:19:12 | 0:28:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:00:14.389306 mon.a mon.0 172.21.15.118:6789/0 254 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366432 |
|
2018-04-06 22:45:27 | 2018-04-08 20:18:51 | 2018-04-08 21:12:51 | 0:54:00 | 0:09:43 | 0:44:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:09:00.114699 mon.a mon.0 172.21.15.92:6789/0 205 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 49 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366433 |
|
2018-04-06 22:45:28 | 2018-04-08 20:18:53 | 2018-04-08 20:48:53 | 0:30:00 | 0:17:22 | 0:12:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:36:23.091236 mon.b mon.0 172.21.15.141:6789/0 148 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366434 |
|
2018-04-06 22:45:29 | 2018-04-08 20:20:57 | 2018-04-08 21:00:59 | 0:40:02 | 0:10:17 | 0:29:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366435 |
|
2018-04-06 22:45:30 | 2018-04-08 20:20:57 | 2018-04-08 23:49:04 | 3:28:07 | 0:09:12 | 3:18:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:46:21.729058 mon.a mon.0 172.21.15.72:6789/0 352 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366436 |
|
2018-04-06 22:45:30 | 2018-04-08 20:20:58 | 2018-04-08 23:13:03 | 2:52:05 | 0:10:18 | 2:41:47 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:08:08.726776 mon.b mon.0 172.21.15.144:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366437 |
|
2018-04-06 22:45:31 | 2018-04-08 20:20:57 | 2018-04-08 21:16:59 | 0:56:02 | 0:10:02 | 0:46:00 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:13:44.813241 mon.b mon.0 172.21.15.165:6789/0 175 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366438 |
|
2018-04-06 22:45:32 | 2018-04-08 20:22:37 | 2018-04-08 20:58:37 | 0:36:00 | 0:22:18 | 0:13:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:45:05.138856 mds.h mds.1 172.21.15.170:6817/854997060 1 : cluster [ERR] replayed stray Session close event for client.4772 172.21.15.203:0/1539862323 from time 2018-04-08 20:44:23.638787, ignoring" in cluster log |
||||||||||||||
| fail | 2366439 |
|
2018-04-06 22:45:33 | 2018-04-08 20:22:46 | 2018-04-08 21:24:47 | 1:02:01 | 0:41:32 | 0:20:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:11:12.230752 mon.a mon.0 172.21.15.79:6789/0 265 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 1339 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366440 |
|
2018-04-06 22:45:33 | 2018-04-08 20:22:47 | 2018-04-09 00:08:52 | 3:46:05 | 0:41:35 | 3:04:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:36:13.068802 mon.a mon.0 172.21.15.60:6789/0 201 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 152 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366441 |
|
2018-04-06 22:45:34 | 2018-04-08 20:22:50 | 2018-04-08 20:46:49 | 0:23:59 | 0:09:57 | 0:14:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:43:50.899139 mon.a mon.0 172.21.15.112:6789/0 255 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 71 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366442 |
|
2018-04-06 22:45:35 | 2018-04-08 20:23:01 | 2018-04-08 21:29:02 | 1:06:01 | 0:19:29 | 0:46:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:15:12.205280 mon.b mon.0 172.21.15.143:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366443 |
|
2018-04-06 22:45:35 | 2018-04-08 20:24:46 | 2018-04-08 20:54:46 | 0:30:00 | 0:09:48 | 0:20:12 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:50:20.878349 mon.a mon.0 172.21.15.109:6789/0 236 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366444 |
|
2018-04-06 22:45:36 | 2018-04-08 20:24:49 | 2018-04-08 21:50:50 | 1:26:01 | 0:43:53 | 0:42:08 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:23:58.996826 mon.b mon.0 172.21.15.26:6789/0 156 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366445 |
|
2018-04-06 22:45:37 | 2018-04-08 20:24:51 | 2018-04-08 21:50:52 | 1:26:01 | 0:50:07 | 0:35:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2366446 |
|
2018-04-06 22:45:38 | 2018-04-08 20:25:11 | 2018-04-08 21:43:12 | 1:18:01 | 0:46:10 | 0:31:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:02:28.769535 mon.b mon.0 172.21.15.58:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366447 |
|
2018-04-06 22:45:38 | 2018-04-08 20:26:50 | 2018-04-08 21:00:50 | 0:34:00 | 0:09:22 | 0:24:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366448 |
|
2018-04-06 22:45:39 | 2018-04-08 20:26:56 | 2018-04-08 21:14:57 | 0:48:01 | 0:21:22 | 0:26:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:10:51.847828 mon.a mon.0 172.21.15.68:6789/0 209 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 716 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366449 |
|
2018-04-06 22:45:40 | 2018-04-08 20:28:55 | 2018-04-08 20:50:56 | 0:22:01 | 0:09:45 | 0:12:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:48:47.219207 mon.b mon.0 172.21.15.163:6789/0 146 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366450 |
|
2018-04-06 22:45:41 | 2018-04-08 20:28:59 | 2018-04-08 22:41:03 | 2:12:04 | 0:09:36 | 2:02:28 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366451 |
|
2018-04-06 22:45:41 | 2018-04-08 20:29:08 | 2018-04-08 21:09:07 | 0:39:59 | 0:10:35 | 0:29:24 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:05:09.503270 mon.b mon.0 172.21.15.8:6789/0 303 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 35 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366452 |
|
2018-04-06 22:45:42 | 2018-04-08 20:31:01 | 2018-04-08 21:05:02 | 0:34:01 | 0:09:51 | 0:24:10 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:01:54.860763 mon.a mon.0 172.21.15.50:6789/0 193 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366453 |
|
2018-04-06 22:45:43 | 2018-04-08 20:31:08 | 2018-04-08 21:41:08 | 1:10:00 | 0:20:29 | 0:49:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:37:25.809675 mds.b mds.1 172.21.15.81:6817/449659003 1 : cluster [ERR] replayed stray Session close event for client.5208 172.21.15.22:0/3598344049 from time 2018-04-08 21:31:53.835362, ignoring" in cluster log |
||||||||||||||
| fail | 2366454 |
|
2018-04-06 22:45:43 | 2018-04-08 20:31:37 | 2018-04-08 21:53:38 | 1:22:01 | 1:10:36 | 0:11:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:54:52.892185 mon.a mon.0 172.21.15.102:6789/0 346 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 372 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366455 |
|
2018-04-06 22:45:44 | 2018-04-08 20:32:09 | 2018-04-08 22:30:11 | 1:58:02 | 0:28:52 | 1:29:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:07:15.112086 mon.b mon.0 172.21.15.16:6789/0 133 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366456 |
|
2018-04-06 22:45:45 | 2018-04-08 20:32:44 | 2018-04-08 21:14:44 | 0:42:00 | 0:16:45 | 0:25:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:05:00.603544 mon.a mon.0 172.21.15.38:6789/0 324 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366457 |
|
2018-04-06 22:45:46 | 2018-04-08 20:32:47 | 2018-04-08 21:12:47 | 0:40:00 | 0:19:37 | 0:20:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2366458 |
|
2018-04-06 22:45:46 | 2018-04-08 20:32:59 | 2018-04-08 21:21:00 | 0:48:01 | 0:10:43 | 0:37:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:17:09.068350 mon.a mon.0 172.21.15.69:6789/0 179 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 128 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366459 |
|
2018-04-06 22:45:47 | 2018-04-08 20:34:55 | 2018-04-08 21:34:56 | 1:00:01 | 0:45:00 | 0:15:01 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:06:56.866729 mon.a mon.0 172.21.15.71:6789/0 156 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 177 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366460 |
|
2018-04-06 22:45:48 | 2018-04-08 20:34:55 | 2018-04-08 22:48:58 | 2:14:03 | 0:44:44 | 1:29:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:23:04.098336 mon.b mon.0 172.21.15.187:6789/0 186 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 749 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366461 |
|
2018-04-06 22:45:49 | 2018-04-08 20:34:55 | 2018-04-08 22:24:57 | 1:50:02 | 0:20:15 | 1:29:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:10:25.385405 mon.a mon.0 172.21.15.71:6789/0 160 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366462 |
|
2018-04-06 22:45:49 | 2018-04-08 20:35:01 | 2018-04-08 20:59:02 | 0:24:01 | 0:08:55 | 0:15:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 20:56:10.629040 mon.b mon.0 172.21.15.148:6789/0 299 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 38 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366463 |
|
2018-04-06 22:45:50 | 2018-04-08 20:36:56 | 2018-04-08 21:30:56 | 0:54:00 | 0:24:19 | 0:29:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:12:02.255178 mon.b mon.0 172.21.15.91:6789/0 151 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366464 |
|
2018-04-06 22:45:51 | 2018-04-08 20:36:56 | 2018-04-08 21:16:56 | 0:40:00 | 0:10:23 | 0:29:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:13:10.105960 mon.a mon.0 172.21.15.175:6789/0 192 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366465 |
|
2018-04-06 22:45:52 | 2018-04-08 20:36:56 | 2018-04-08 21:54:57 | 1:18:01 | 0:09:25 | 1:08:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366466 |
|
2018-04-06 22:45:52 | 2018-04-08 20:38:55 | 2018-04-08 21:46:55 | 1:08:00 | 0:14:01 | 0:53:59 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:41:11.258704 mon.a mon.0 172.21.15.23:6789/0 265 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 78 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366467 |
|
2018-04-06 22:45:53 | 2018-04-08 20:39:00 | 2018-04-08 21:17:00 | 0:38:00 | 0:09:28 | 0:28:32 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:13:00.133292 mon.b mon.0 172.21.15.144:6789/0 294 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366468 |
|
2018-04-06 22:45:54 | 2018-04-08 20:41:04 | 2018-04-08 21:25:02 | 0:43:58 | 0:22:04 | 0:21:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:12:32.393470 mds.h mds.1 172.21.15.129:6817/1851554463 1 : cluster [ERR] replayed stray Session close event for client.24745 172.21.15.181:0/4170837431 from time 2018-04-08 21:11:47.276817, ignoring" in cluster log |
||||||||||||||
| fail | 2366469 |
|
2018-04-06 22:45:55 | 2018-04-08 20:41:04 | 2018-04-08 21:39:04 | 0:58:00 | 0:38:41 | 0:19:19 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:29:19.092184 mon.a mon.0 172.21.15.74:6789/0 170 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 1422 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366470 |
|
2018-04-06 22:45:56 | 2018-04-08 20:41:04 | 2018-04-08 22:55:06 | 2:14:02 | 0:47:31 | 1:26:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:15:36.418158 mon.a mon.0 172.21.15.109:6789/0 343 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366471 |
|
2018-04-06 22:45:56 | 2018-04-08 20:41:20 | 2018-04-08 22:11:21 | 1:30:01 | 0:09:40 | 1:20:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:07:37.796580 mon.a mon.0 172.21.15.36:6789/0 158 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 73 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366472 |
|
2018-04-06 22:45:57 | 2018-04-08 20:42:53 | 2018-04-08 21:24:53 | 0:42:00 | 0:19:51 | 0:22:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:18:30.526721 mon.a mon.0 172.21.15.23:6789/0 355 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366473 |
|
2018-04-06 22:45:58 | 2018-04-08 20:44:31 | 2018-04-08 21:08:30 | 0:23:59 | 0:09:35 | 0:14:24 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:04:03.986797 mon.b mon.0 172.21.15.1:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366474 |
|
2018-04-06 22:45:59 | 2018-04-08 20:44:39 | 2018-04-08 22:00:40 | 1:16:01 | 0:48:36 | 0:27:25 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:25:40.936111 mon.a mon.0 172.21.15.37:6789/0 254 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366475 |
|
2018-04-06 22:45:59 | 2018-04-08 20:44:57 | 2018-04-08 22:32:59 | 1:48:02 | 0:48:39 | 0:59:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:49:27.298351 mon.b mon.0 172.21.15.171:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366476 |
|
2018-04-06 22:46:00 | 2018-04-08 20:46:09 | 2018-04-08 21:34:09 | 0:48:00 | 0:37:21 | 0:10:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:02:16.967000 mon.b mon.0 172.21.15.166:6789/0 169 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366477 |
|
2018-04-06 22:46:01 | 2018-04-08 20:46:50 | 2018-04-08 21:08:49 | 0:21:59 | 0:09:16 | 0:12:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:05:00.481640 mon.b mon.0 172.21.15.27:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366478 |
|
2018-04-06 22:46:02 | 2018-04-08 20:46:51 | 2018-04-08 21:22:50 | 0:35:59 | 0:25:07 | 0:10:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:17:47.125003 mon.a mon.0 172.21.15.5:6789/0 330 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 791 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366479 |
|
2018-04-06 22:46:02 | 2018-04-08 20:48:50 | 2018-04-08 21:16:50 | 0:28:00 | 0:09:20 | 0:18:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:13:29.574082 mon.a mon.0 172.21.15.95:6789/0 155 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366480 |
|
2018-04-06 22:46:03 | 2018-04-08 20:48:50 | 2018-04-08 22:00:51 | 1:12:01 | 0:10:08 | 1:01:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:57:23.398952 mon.b mon.0 172.21.15.58:6789/0 452 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366481 |
|
2018-04-06 22:46:04 | 2018-04-08 20:48:50 | 2018-04-08 23:00:52 | 2:12:02 | 0:09:46 | 2:02:16 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:56:54.703336 mon.b mon.0 172.21.15.17:6789/0 281 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366482 |
|
2018-04-06 22:46:04 | 2018-04-08 20:48:51 | 2018-04-08 22:52:53 | 2:04:02 | 0:09:41 | 1:54:21 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:50:03.533968 mon.a mon.0 172.21.15.103:6789/0 334 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366483 |
|
2018-04-06 22:46:05 | 2018-04-08 20:48:52 | 2018-04-08 21:48:53 | 1:00:01 | 0:19:55 | 0:40:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:44:51.674730 mds.c mds.1 172.21.15.164:6817/819802745 1 : cluster [ERR] replayed stray Session close event for client.5241 172.21.15.157:0/1351353332 from time 2018-04-08 21:39:41.544596, ignoring" in cluster log |
||||||||||||||
| fail | 2366484 |
|
2018-04-06 22:46:06 | 2018-04-08 20:48:54 | 2018-04-08 22:32:56 | 1:44:02 | 1:09:25 | 0:34:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:08:46.279759 mon.a mon.0 172.21.15.38:6789/0 356 : cluster [WRN] Health check failed: 28 slow ops, oldest one blocked for 2299 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366485 |
|
2018-04-06 22:46:07 | 2018-04-08 20:49:00 | 2018-04-08 22:21:02 | 1:32:02 | 0:25:38 | 1:06:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366486 |
|
2018-04-06 22:46:07 | 2018-04-08 20:50:50 | 2018-04-08 21:32:50 | 0:42:00 | 0:15:26 | 0:26:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:26:07.919182 mon.a mon.0 172.21.15.110:6789/0 217 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 224 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366487 |
|
2018-04-06 22:46:08 | 2018-04-08 20:50:50 | 2018-04-08 21:22:50 | 0:32:00 | 0:20:30 | 0:11:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2366488 |
|
2018-04-06 22:46:09 | 2018-04-08 20:50:57 | 2018-04-08 22:00:58 | 1:10:01 | 0:09:20 | 1:00:41 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:56:15.316764 mon.b mon.0 172.21.15.152:6789/0 213 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366489 |
|
2018-04-06 22:46:10 | 2018-04-08 20:51:09 | 2018-04-08 22:27:10 | 1:36:01 | 0:44:32 | 0:51:29 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:57:03.311812 mon.b mon.0 172.21.15.1:6789/0 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366490 |
|
2018-04-06 22:46:10 | 2018-04-08 20:51:09 | 2018-04-08 21:41:09 | 0:50:00 | 0:39:53 | 0:10:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| pass | 2366491 |
|
2018-04-06 22:46:11 | 2018-04-08 20:52:58 | 2018-04-08 22:46:59 | 1:54:01 | 0:59:05 | 0:54:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366492 |
|
2018-04-06 22:46:12 | 2018-04-08 20:52:58 | 2018-04-08 22:16:59 | 1:24:01 | 0:09:26 | 1:14:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:13:35.048384 mon.b mon.0 172.21.15.64:6789/0 306 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366493 |
|
2018-04-06 22:46:13 | 2018-04-08 20:52:58 | 2018-04-08 22:02:58 | 1:10:00 | 0:23:02 | 0:46:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2366494 |
|
2018-04-06 22:46:13 | 2018-04-08 20:53:00 | 2018-04-08 21:27:00 | 0:34:00 | 0:10:09 | 0:23:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366495 |
|
2018-04-06 22:46:14 | 2018-04-08 20:53:00 | 2018-04-08 21:29:00 | 0:36:00 | 0:08:54 | 0:27:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:26:16.414590 mon.b mon.0 172.21.15.6:6789/0 203 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366496 |
|
2018-04-06 22:46:15 | 2018-04-08 20:54:57 | 2018-04-08 21:40:57 | 0:46:00 | 0:09:43 | 0:36:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:36:46.701015 mon.b mon.0 172.21.15.33:6789/0 171 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366497 |
|
2018-04-06 22:46:15 | 2018-04-08 20:54:57 | 2018-04-08 21:34:57 | 0:40:00 | 0:09:43 | 0:30:17 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:32:12.506250 mon.b mon.0 172.21.15.162:6789/0 300 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 51 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366498 |
|
2018-04-06 22:46:16 | 2018-04-08 20:56:22 | 2018-04-08 23:28:25 | 2:32:03 | 0:22:24 | 2:09:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:15:27.438195 mds.e mds.1 172.21.15.26:6817/2540180194 1 : cluster [ERR] replayed stray Session close event for client.4731 172.21.15.166:0/2241985098 from time 2018-04-08 23:14:45.565031, ignoring" in cluster log |
||||||||||||||
| fail | 2366499 |
|
2018-04-06 22:46:17 | 2018-04-08 20:57:00 | 2018-04-08 21:43:01 | 0:46:01 | 0:35:46 | 0:10:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:33:16.753811 mon.a mon.0 172.21.15.15:6789/0 166 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366500 |
|
2018-04-06 22:46:18 | 2018-04-08 20:57:00 | 2018-04-08 22:21:02 | 1:24:02 | 1:06:09 | 0:17:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:23:15.781830 mon.a mon.0 172.21.15.11:6789/0 220 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 154 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366501 |
|
2018-04-06 22:46:18 | 2018-04-08 20:57:03 | 2018-04-08 21:37:04 | 0:40:01 | 0:10:50 | 0:29:11 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:32:27.390063 mon.a mon.0 172.21.15.60:6789/0 253 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 76 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366502 |
|
2018-04-06 22:46:19 | 2018-04-08 20:58:48 | 2018-04-08 21:48:49 | 0:50:01 | 0:19:54 | 0:30:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:35:11.032371 mon.b mon.0 172.21.15.19:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366503 |
|
2018-04-06 22:46:20 | 2018-04-08 20:58:50 | 2018-04-08 21:18:50 | 0:20:00 | 0:10:03 | 0:09:57 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366504 |
|
2018-04-06 22:46:21 | 2018-04-08 20:58:52 | 2018-04-08 22:54:54 | 1:56:02 | 0:43:07 | 1:12:55 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 22:25:01.065220 mon.b mon.0 172.21.15.81:6789/0 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366505 |
|
2018-04-06 22:46:22 | 2018-04-08 20:59:03 | 2018-04-08 22:39:05 | 1:40:02 | 0:49:13 | 0:50:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:07:05.722401 mon.a mon.0 172.21.15.17:6789/0 263 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366506 |
|
2018-04-06 22:46:22 | 2018-04-08 20:59:17 | 2018-04-08 21:59:20 | 1:00:03 | 0:38:17 | 0:21:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:27:15.152246 mon.b mon.0 172.21.15.167:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366507 |
|
2018-04-06 22:46:23 | 2018-04-08 21:00:38 | 2018-04-08 21:48:38 | 0:48:00 | 0:09:18 | 0:38:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:45:42.395985 mon.b mon.0 172.21.15.143:6789/0 149 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 50 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366508 |
|
2018-04-06 22:46:24 | 2018-04-08 21:00:51 | 2018-04-08 21:38:56 | 0:38:05 | 0:23:46 | 0:14:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:34:54.123161 mon.a mon.0 172.21.15.50:6789/0 343 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 792 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366509 |
|
2018-04-06 22:46:25 | 2018-04-08 21:01:00 | 2018-04-08 21:21:00 | 0:20:00 | 0:09:01 | 0:10:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:17:25.456063 mon.b mon.0 172.21.15.173:6789/0 138 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366510 |
|
2018-04-06 22:46:25 | 2018-04-08 21:03:02 | 2018-04-08 22:37:05 | 1:34:03 | 0:10:04 | 1:23:59 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366511 |
|
2018-04-06 22:46:26 | 2018-04-08 21:05:12 | 2018-04-08 22:07:13 | 1:02:01 | 0:13:56 | 0:48:05 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:03:58.599816 mon.a mon.0 172.21.15.41:6789/0 448 : cluster [WRN] Health check failed: 30 slow ops, oldest one blocked for 330 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366512 |
|
2018-04-06 22:46:27 | 2018-04-08 21:06:49 | 2018-04-08 22:56:51 | 1:50:02 | 0:52:33 | 0:57:29 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:11:04.690420 mon.b mon.0 172.21.15.62:6789/0 179 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366513 |
|
2018-04-06 22:46:28 | 2018-04-08 21:07:03 | 2018-04-08 21:59:04 | 0:52:01 | 0:21:10 | 0:30:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:55:17.738706 mds.b mds.1 172.21.15.132:6817/3419155987 1 : cluster [ERR] replayed stray Session close event for client.5161 172.21.15.106:0/2105920005 from time 2018-04-08 21:49:22.453264, ignoring" in cluster log |
||||||||||||||
| fail | 2366514 |
|
2018-04-06 22:46:28 | 2018-04-08 21:08:41 | 2018-04-08 22:36:42 | 1:28:01 | 1:10:44 | 0:17:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:47:41.962408 mon.b mon.0 172.21.15.85:6789/0 189 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 849 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366515 |
|
2018-04-06 22:46:29 | 2018-04-08 21:08:51 | 2018-04-08 21:48:51 | 0:40:00 | 0:29:06 | 0:10:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:27:28.654506 mon.b mon.0 172.21.15.3:6789/0 232 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366516 |
|
2018-04-06 22:46:30 | 2018-04-08 21:08:54 | 2018-04-08 23:46:57 | 2:38:03 | 0:14:33 | 2:23:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:42:09.590472 mon.a mon.0 172.21.15.154:6789/0 222 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 232 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366517 |
|
2018-04-06 22:46:31 | 2018-04-08 21:09:09 | 2018-04-08 21:57:09 | 0:48:00 | 0:22:03 | 0:25:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:40:13.231030 mon.b mon.0 172.21.15.79:6789/0 232 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366518 |
|
2018-04-06 22:46:31 | 2018-04-08 21:10:47 | 2018-04-08 21:38:47 | 0:28:00 | 0:13:14 | 0:14:46 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:30:48.667641 mon.a mon.0 172.21.15.80:6789/0 259 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366519 |
|
2018-04-06 22:46:32 | 2018-04-08 21:10:54 | 2018-04-08 22:08:55 | 0:58:01 | 0:41:23 | 0:16:38 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 21:57:41.791511 mon.b mon.0 172.21.15.14:6789/0 252 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366520 |
|
2018-04-06 22:46:33 | 2018-04-08 21:12:57 | 2018-04-08 22:04:57 | 0:52:00 | 0:40:41 | 0:11:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:47:31.337657 mon.b mon.0 172.21.15.13:6789/0 181 : cluster [WRN] Health check failed: 18 slow ops, oldest one blocked for 1066 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366521 |
|
2018-04-06 22:46:34 | 2018-04-07 16:00:01 | 2018-04-07 17:14:02 | 1:14:01 | 0:56:29 | 0:17:32 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2366522 |
|
2018-04-06 22:46:34 | 2018-04-08 21:12:57 | 2018-04-08 21:32:56 | 0:19:59 | 0:09:22 | 0:10:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366523 |
|
2018-04-06 22:46:35 | 2018-04-08 21:14:55 | 2018-04-08 23:06:57 | 1:52:02 | 0:15:56 | 1:36:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:56:25.886558 mon.a mon.0 172.21.15.3:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366524 |
|
2018-04-06 22:46:36 | 2018-04-08 21:14:58 | 2018-04-08 21:36:57 | 0:21:59 | 0:10:45 | 0:11:14 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:32:10.238808 mon.b mon.0 172.21.15.134:6789/0 183 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366525 |
|
2018-04-06 22:46:37 | 2018-04-08 21:14:58 | 2018-04-08 21:34:57 | 0:19:59 | 0:08:59 | 0:11:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366526 |
|
2018-04-06 22:46:37 | 2018-04-08 21:15:07 | 2018-04-08 21:37:06 | 0:21:59 | 0:11:03 | 0:10:56 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:32:10.093548 mon.a mon.0 172.21.15.95:6789/0 190 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 90 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366527 |
|
2018-04-06 22:46:38 | 2018-04-08 21:15:51 | 2018-04-08 22:31:51 | 1:16:00 | 0:49:39 | 0:26:21 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:59:32.163194 mon.a mon.0 172.21.15.56:6789/0 199 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366528 |
|
2018-04-06 22:46:39 | 2018-04-08 21:17:04 | 2018-04-08 21:51:04 | 0:34:00 | 0:22:30 | 0:11:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:37:32.768759 mds.a mds.1 172.21.15.178:6818/1069018314 1 : cluster [ERR] replayed stray Session close event for client.4787 172.21.15.87:0/1523911581 from time 2018-04-08 21:36:49.094753, ignoring" in cluster log |
||||||||||||||
| pass | 2366529 |
|
2018-04-06 22:46:40 | 2018-04-08 21:17:05 | 2018-04-08 22:43:05 | 1:26:00 | 1:00:08 | 0:25:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366530 |
|
2018-04-06 22:46:40 | 2018-04-08 21:17:04 | 2018-04-08 22:33:05 | 1:16:01 | 0:59:08 | 0:16:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:41:49.149043 mon.a mon.0 172.21.15.31:6789/0 212 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 157 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366531 |
|
2018-04-06 22:46:41 | 2018-04-08 21:17:05 | 2018-04-08 23:45:07 | 2:28:02 | 0:10:29 | 2:17:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:40:30.245465 mon.b mon.0 172.21.15.22:6789/0 237 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366532 |
|
2018-04-06 22:46:42 | 2018-04-08 21:17:04 | 2018-04-08 21:51:04 | 0:34:00 | 0:22:33 | 0:11:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:33:18.010353 mon.b mon.0 172.21.15.35:6789/0 167 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366533 |
|
2018-04-06 22:46:42 | 2018-04-08 21:18:52 | 2018-04-08 21:40:51 | 0:21:59 | 0:09:58 | 0:12:01 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:36:46.538139 mon.b mon.0 172.21.15.83:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366534 |
|
2018-04-06 22:46:43 | 2018-04-08 21:18:52 | 2018-04-08 22:32:52 | 1:14:00 | 0:41:55 | 0:32:05 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 2366535 |
|
2018-04-06 22:46:44 | 2018-04-08 21:18:53 | 2018-04-08 22:22:52 | 1:03:59 | 0:52:21 | 0:11:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:45:42.199498 mon.b mon.0 172.21.15.117:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366536 |
|
2018-04-06 22:46:45 | 2018-04-08 21:18:52 | 2018-04-08 22:12:52 | 0:54:00 | 0:41:55 | 0:12:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:37:52.715292 mon.b mon.0 172.21.15.188:6789/0 167 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366537 |
|
2018-04-06 22:46:46 | 2018-04-08 21:20:52 | 2018-04-08 21:40:51 | 0:19:59 | 0:08:25 | 0:11:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366538 |
|
2018-04-06 22:46:46 | 2018-04-08 21:20:52 | 2018-04-08 22:18:53 | 0:58:01 | 0:29:21 | 0:28:40 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:10:52.776720 mon.a mon.0 172.21.15.74:6789/0 347 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 954 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366539 |
|
2018-04-06 22:46:47 | 2018-04-08 21:21:01 | 2018-04-08 21:51:01 | 0:30:00 | 0:09:32 | 0:20:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:47:12.508315 mon.a mon.0 172.21.15.20:6789/0 148 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366540 |
|
2018-04-06 22:46:48 | 2018-04-08 21:21:01 | 2018-04-08 21:57:01 | 0:36:00 | 0:09:49 | 0:26:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:52:53.791630 mon.b mon.0 172.21.15.4:6789/0 275 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366541 |
|
2018-04-06 22:46:49 | 2018-04-08 21:23:01 | 2018-04-08 21:45:01 | 0:22:00 | 0:09:23 | 0:12:37 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:41:42.101237 mon.b mon.0 172.21.15.135:6789/0 176 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 38 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366542 |
|
2018-04-06 22:46:49 | 2018-04-08 21:23:01 | 2018-04-08 22:45:03 | 1:22:02 | 0:46:31 | 0:35:31 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:18:56.115275 mon.a mon.0 172.21.15.77:6789/0 343 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 942 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366543 |
|
2018-04-06 22:46:50 | 2018-04-08 21:23:01 | 2018-04-08 21:55:01 | 0:32:00 | 0:20:19 | 0:11:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:51:53.383278 mds.b mds.1 172.21.15.174:6817/3069710080 1 : cluster [ERR] replayed stray Session close event for client.5245 172.21.15.142:0/3386508979 from time 2018-04-08 21:46:17.188572, ignoring" in cluster log |
||||||||||||||
| fail | 2366544 |
|
2018-04-06 22:46:51 | 2018-04-08 21:23:01 | 2018-04-08 22:49:03 | 1:26:02 | 1:07:06 | 0:18:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:04:34.215768 mon.a mon.0 172.21.15.73:6789/0 341 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366545 |
|
2018-04-06 22:46:52 | 2018-04-08 21:24:58 | 2018-04-08 22:02:58 | 0:38:00 | 0:29:00 | 0:09:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:41:23.364487 mon.a mon.0 172.21.15.24:6789/0 165 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 63 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366546 |
|
2018-04-06 22:46:52 | 2018-04-08 21:24:58 | 2018-04-08 21:50:57 | 0:25:59 | 0:15:01 | 0:10:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:43:44.287732 mon.a mon.0 172.21.15.8:6789/0 205 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366547 |
|
2018-04-06 22:46:53 | 2018-04-08 21:25:03 | 2018-04-08 22:13:04 | 0:48:01 | 0:19:57 | 0:28:04 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2366548 |
|
2018-04-06 22:46:54 | 2018-04-08 21:27:15 | 2018-04-08 23:49:16 | 2:22:01 | 0:10:59 | 2:11:02 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:45:26.442902 mon.b mon.0 172.21.15.4:6789/0 179 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 71 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366549 |
|
2018-04-06 22:46:54 | 2018-04-08 21:27:15 | 2018-04-09 00:15:17 | 2:48:02 | 0:42:11 | 2:05:51 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-09 00:03:03.920865 mon.a mon.0 172.21.15.8:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366550 |
|
2018-04-06 22:46:55 | 2018-04-08 21:27:15 | 2018-04-08 22:39:14 | 1:11:59 | 0:41:04 | 0:30:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:28:43.318858 mon.a mon.0 172.21.15.49:6789/0 354 : cluster [WRN] Health check failed: 20 slow ops, oldest one blocked for 1468 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366551 |
|
2018-04-06 22:46:56 | 2018-04-08 21:27:15 | 2018-04-08 22:11:14 | 0:43:59 | 0:21:05 | 0:22:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366552 |
|
2018-04-06 22:46:57 | 2018-04-08 21:29:12 | 2018-04-08 22:01:12 | 0:32:00 | 0:09:45 | 0:22:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:57:02.736269 mon.b mon.0 172.21.15.81:6789/0 310 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 69 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366553 |
|
2018-04-06 22:46:58 | 2018-04-08 21:29:12 | 2018-04-08 21:59:12 | 0:30:00 | 0:17:59 | 0:12:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:55:28.990951 mon.b mon.0 172.21.15.51:6789/0 226 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366554 |
|
2018-04-06 22:46:58 | 2018-04-08 21:31:09 | 2018-04-08 21:55:08 | 0:23:59 | 0:10:30 | 0:13:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:51:29.129963 mon.b mon.0 172.21.15.71:6789/0 313 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366555 |
|
2018-04-06 22:46:59 | 2018-04-08 21:31:09 | 2018-04-08 21:53:08 | 0:21:59 | 0:09:16 | 0:12:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:48:50.764527 mon.b mon.0 172.21.15.36:6789/0 204 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 40 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366556 |
|
2018-04-06 22:47:00 | 2018-04-08 21:32:53 | 2018-04-08 21:58:52 | 0:25:59 | 0:11:00 | 0:14:59 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:53:12.583167 mon.b mon.0 172.21.15.64:6789/0 184 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366557 |
|
2018-04-06 22:47:01 | 2018-04-08 21:32:53 | 2018-04-08 22:36:53 | 1:04:00 | 0:50:17 | 0:13:43 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:06:46.069639 mon.a mon.0 172.21.15.97:6789/0 202 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366558 |
|
2018-04-06 22:47:01 | 2018-04-08 21:32:53 | 2018-04-08 22:08:53 | 0:36:00 | 0:21:57 | 0:14:03 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:56:02.807219 mds.f mds.1 172.21.15.150:6817/3590809924 1 : cluster [ERR] replayed stray Session close event for client.4735 172.21.15.10:0/275773003 from time 2018-04-08 21:55:22.857889, ignoring" in cluster log |
||||||||||||||
| fail | 2366559 |
|
2018-04-06 22:47:02 | 2018-04-08 21:32:54 | 2018-04-08 22:50:55 | 1:18:01 | 0:41:28 | 0:36:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:14:33.250795 mon.b mon.0 172.21.15.51:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366560 |
|
2018-04-06 22:47:03 | 2018-04-08 21:32:58 | 2018-04-08 22:52:59 | 1:20:01 | 1:02:56 | 0:17:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:59:00.144109 mon.b mon.0 172.21.15.50:6789/0 183 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 148 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366561 |
|
2018-04-06 22:47:04 | 2018-04-08 21:34:21 | 2018-04-08 21:56:20 | 0:21:59 | 0:10:46 | 0:11:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:51:04.311405 mon.b mon.0 172.21.15.62:6789/0 150 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366562 |
|
2018-04-06 22:47:04 | 2018-04-08 21:34:57 | 2018-04-08 23:41:00 | 2:06:03 | 0:19:10 | 1:46:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:28:27.517580 mon.b mon.0 172.21.15.144:6789/0 174 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366563 |
|
2018-04-06 22:47:05 | 2018-04-08 21:34:59 | 2018-04-08 22:10:59 | 0:36:00 | 0:10:37 | 0:25:23 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:05:10.291259 mon.b mon.0 172.21.15.18:6789/0 131 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366564 |
|
2018-04-06 22:47:06 | 2018-04-08 21:34:59 | 2018-04-08 22:32:59 | 0:58:00 | 0:42:55 | 0:15:05 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 22:05:42.740253 mon.a mon.0 172.21.15.95:6789/0 158 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366565 |
|
2018-04-06 22:47:07 | 2018-04-08 21:37:00 | 2018-04-08 23:05:01 | 1:28:01 | 0:47:58 | 0:40:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:45:53.170909 mon.b mon.0 172.21.15.41:6789/0 151 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366566 |
|
2018-04-06 22:47:07 | 2018-04-08 21:37:05 | 2018-04-08 22:55:06 | 1:18:01 | 0:45:51 | 0:32:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366567 |
|
2018-04-06 22:47:08 | 2018-04-08 21:37:07 | 2018-04-08 22:03:07 | 0:26:00 | 0:08:49 | 0:17:11 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:58:51.266136 mon.b mon.0 172.21.15.69:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366568 |
|
2018-04-06 22:47:09 | 2018-04-08 21:38:59 | 2018-04-08 22:18:59 | 0:40:00 | 0:29:29 | 0:10:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 21:57:15.982093 mon.a mon.0 172.21.15.5:6789/0 344 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 63 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366569 |
|
2018-04-06 22:47:10 | 2018-04-08 21:39:00 | 2018-04-08 22:09:00 | 0:30:00 | 0:09:52 | 0:20:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:03:55.207840 mon.b mon.0 172.21.15.19:6789/0 142 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366570 |
|
2018-04-06 22:47:10 | 2018-04-08 21:39:05 | 2018-04-08 22:09:05 | 0:30:00 | 0:10:30 | 0:19:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366571 |
|
2018-04-06 22:47:11 | 2018-04-08 21:41:02 | 2018-04-08 22:39:03 | 0:58:01 | 0:12:07 | 0:45:54 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:33:18.783445 mon.a mon.0 172.21.15.23:6789/0 182 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366572 |
|
2018-04-06 22:47:12 | 2018-04-08 21:41:02 | 2018-04-08 22:51:03 | 1:10:01 | 0:49:29 | 0:20:32 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:21:55.520393 mon.a mon.0 172.21.15.8:6789/0 212 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 362 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366573 |
|
2018-04-06 22:47:12 | 2018-04-08 21:41:02 | 2018-04-08 23:07:03 | 1:26:01 | 0:19:54 | 1:06:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:04:20.143417 mds.b mds.1 172.21.15.131:6816/1791659432 1 : cluster [ERR] replayed stray Session close event for client.35215 172.21.15.177:0/3331530764 from time 2018-04-08 22:59:16.004326, ignoring" in cluster log |
||||||||||||||
| fail | 2366574 |
|
2018-04-06 22:47:13 | 2018-04-08 21:41:10 | 2018-04-08 23:19:11 | 1:38:01 | 1:13:51 | 0:24:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:28:39.968368 mon.b mon.0 172.21.15.79:6789/0 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366575 |
|
2018-04-06 22:47:14 | 2018-04-08 21:41:11 | 2018-04-08 22:47:11 | 1:06:00 | 0:27:24 | 0:38:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:26:25.590021 mon.a mon.0 172.21.15.92:6789/0 257 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366576 |
|
2018-04-06 22:47:15 | 2018-04-08 21:43:12 | 2018-04-08 23:07:15 | 1:24:03 | 0:16:14 | 1:07:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:59:19.051146 mon.b mon.0 172.21.15.43:6789/0 172 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366577 |
|
2018-04-06 22:47:15 | 2018-04-08 21:43:12 | 2018-04-08 22:29:12 | 0:46:00 | 0:23:08 | 0:22:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:10:29.357388 mon.a mon.0 172.21.15.67:6789/0 252 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366578 |
|
2018-04-06 22:47:16 | 2018-04-08 21:43:13 | 2018-04-08 22:07:13 | 0:24:00 | 0:09:34 | 0:14:26 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366579 |
|
2018-04-06 22:47:17 | 2018-04-08 21:45:07 | 2018-04-08 22:59:09 | 1:14:02 | 0:40:48 | 0:33:14 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 22:33:02.989910 mon.b mon.0 172.21.15.94:6789/0 151 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366580 |
|
2018-04-06 22:47:18 | 2018-04-08 21:45:07 | 2018-04-08 22:55:09 | 1:10:02 | 0:42:57 | 0:27:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:19:15.690211 mon.b mon.0 172.21.15.181:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366581 |
|
2018-04-06 22:47:19 | 2018-04-08 21:47:08 | 2018-04-08 22:17:08 | 0:30:00 | 0:20:16 | 0:09:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366582 |
|
2018-04-06 22:47:20 | 2018-04-08 21:48:50 | 2018-04-08 22:10:49 | 0:21:59 | 0:09:43 | 0:12:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:07:26.887642 mon.a mon.0 172.21.15.20:6789/0 340 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366583 |
|
2018-04-06 22:47:20 | 2018-04-08 21:48:50 | 2018-04-08 22:24:50 | 0:36:00 | 0:16:51 | 0:19:09 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2366584 |
|
2018-04-06 22:47:21 | 2018-04-08 21:48:52 | 2018-04-08 22:50:52 | 1:02:00 | 0:10:11 | 0:51:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:46:20.429606 mon.a mon.0 172.21.15.61:6789/0 192 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366585 |
|
2018-04-06 22:47:22 | 2018-04-08 21:48:54 | 2018-04-08 22:10:54 | 0:22:00 | 0:09:36 | 0:12:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:07:17.104186 mon.a mon.0 172.21.15.92:6789/0 364 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366586 |
|
2018-04-06 22:47:23 | 2018-04-08 21:51:07 | 2018-04-09 01:03:12 | 3:12:05 | 2:51:26 | 0:20:39 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
SSH connection to smithi078 was lost: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0' |
||||||||||||||
| fail | 2366587 |
|
2018-04-06 22:47:24 | 2018-04-08 21:51:08 | 2018-04-08 22:31:08 | 0:40:00 | 0:11:15 | 0:28:45 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:27:21.830763 mon.a mon.0 172.21.15.18:6789/0 215 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 149 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366588 |
|
2018-04-06 22:47:24 | 2018-04-08 21:51:07 | 2018-04-08 22:33:08 | 0:42:01 | 0:22:22 | 0:19:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:20:42.240159 mds.a mds.1 172.21.15.154:6817/1008127222 1 : cluster [ERR] replayed stray Session close event for client.4681 172.21.15.113:0/2568035857 from time 2018-04-08 22:20:00.912548, ignoring" in cluster log |
||||||||||||||
| fail | 2366589 |
|
2018-04-06 22:47:25 | 2018-04-08 21:51:07 | 2018-04-08 22:59:09 | 1:08:02 | 0:49:49 | 0:18:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:46:22.997451 mon.a mon.0 172.21.15.37:6789/0 177 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 1915 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366590 |
|
2018-04-06 22:47:26 | 2018-04-08 21:51:08 | 2018-04-08 23:17:10 | 1:26:02 | 1:04:12 | 0:21:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:21:15.046797 mon.a mon.0 172.21.15.44:6789/0 213 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366591 |
|
2018-04-06 22:47:27 | 2018-04-08 21:51:07 | 2018-04-08 22:23:06 | 0:31:59 | 0:09:52 | 0:22:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:19:03.072430 mon.a mon.0 172.21.15.24:6789/0 256 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 68 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366592 |
|
2018-04-06 22:47:28 | 2018-04-08 21:53:15 | 2018-04-08 22:25:14 | 0:31:59 | 0:22:17 | 0:09:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:19:51.453767 mon.a mon.0 172.21.15.160:6789/0 226 : cluster [WRN] Health check failed: 18 slow ops, oldest one blocked for 644 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366593 |
|
2018-04-06 22:47:28 | 2018-04-08 21:53:39 | 2018-04-08 23:25:41 | 1:32:02 | 0:10:36 | 1:21:26 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:22:07.689638 mon.a mon.0 172.21.15.16:6789/0 264 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 88 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366594 |
|
2018-04-06 22:47:29 | 2018-04-08 21:55:09 | 2018-04-08 23:57:11 | 2:02:02 | 0:45:03 | 1:16:59 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 23:39:47.244994 mon.b mon.0 172.21.15.55:6789/0 251 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 64 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366595 |
|
2018-04-06 22:47:30 | 2018-04-08 21:55:09 | 2018-04-08 23:11:10 | 1:16:01 | 0:51:40 | 0:24:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:37:33.539390 mon.a mon.0 172.21.15.59:6789/0 166 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366596 |
|
2018-04-06 22:47:31 | 2018-04-08 21:55:09 | 2018-04-09 00:29:12 | 2:34:03 | 0:51:26 | 1:42:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366597 |
|
2018-04-06 22:47:31 | 2018-04-08 21:56:31 | 2018-04-08 22:50:31 | 0:54:00 | 0:08:36 | 0:45:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:48:12.081135 mon.a mon.0 172.21.15.70:6789/0 163 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 62 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366598 |
|
2018-04-06 22:47:32 | 2018-04-08 21:57:03 | 2018-04-08 22:29:02 | 0:31:59 | 0:21:07 | 0:10:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:25:18.558137 mon.a mon.0 172.21.15.148:6789/0 199 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366599 |
|
2018-04-06 22:47:33 | 2018-04-08 21:57:10 | 2018-04-08 23:33:12 | 1:36:02 | 0:09:26 | 1:26:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:30:05.624358 mon.a mon.0 172.21.15.2:6789/0 164 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 110 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| dead | 2366600 |
|
2018-04-06 22:47:34 | 2018-04-08 21:59:05 | 2018-04-08 22:23:05 | 0:24:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | — | ||||
Failure Reason:
reached maximum tries (60) after waiting for 900 seconds |
||||||||||||||
| fail | 2366601 |
|
2018-04-06 22:47:34 | 2018-04-08 21:59:05 | 2018-04-08 22:33:05 | 0:34:00 | 0:12:36 | 0:21:24 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:29:09.012207 mon.b mon.0 172.21.15.26:6789/0 227 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 84 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366602 |
|
2018-04-06 22:47:35 | 2018-04-08 21:59:13 | 2018-04-08 23:21:15 | 1:22:02 | 0:11:31 | 1:10:31 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:15:12.781171 mon.b mon.0 172.21.15.17:6789/0 172 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366603 |
|
2018-04-06 22:47:36 | 2018-04-08 21:59:21 | 2018-04-08 23:05:22 | 1:06:01 | 0:21:32 | 0:44:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:01:25.406154 mds.b mds.1 172.21.15.192:6817/3229976243 1 : cluster [ERR] replayed stray Session close event for client.5195 172.21.15.113:0/1581106527 from time 2018-04-08 22:54:46.415576, ignoring" in cluster log |
||||||||||||||
| fail | 2366604 |
|
2018-04-06 22:47:37 | 2018-04-08 22:00:45 | 2018-04-09 00:10:47 | 2:10:02 | 1:10:25 | 0:59:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:48:24.648816 mon.a mon.0 172.21.15.51:6789/0 251 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 2537 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366605 |
|
2018-04-06 22:47:37 | 2018-04-08 22:00:52 | 2018-04-08 22:44:52 | 0:44:00 | 0:26:27 | 0:17:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2366606 |
|
2018-04-06 22:47:38 | 2018-04-08 22:01:01 | 2018-04-08 23:37:02 | 1:36:01 | 0:16:01 | 1:20:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:31:07.717055 mon.a mon.0 172.21.15.136:6789/0 347 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 274 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366607 |
|
2018-04-06 22:47:39 | 2018-04-08 22:01:13 | 2018-04-08 22:49:14 | 0:48:01 | 0:21:17 | 0:26:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:33:54.519726 mon.a mon.0 172.21.15.47:6789/0 158 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366608 |
|
2018-04-06 22:47:40 | 2018-04-08 22:03:09 | 2018-04-08 22:45:09 | 0:42:00 | 0:09:48 | 0:32:12 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2366609 |
|
2018-04-06 22:47:41 | 2018-04-08 22:03:09 | 2018-04-08 23:43:11 | 1:40:02 | 0:43:53 | 0:56:09 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 23:25:16.097130 mon.a mon.0 172.21.15.92:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366610 |
|
2018-04-06 22:47:41 | 2018-04-08 22:03:09 | 2018-04-08 23:41:11 | 1:38:02 | 0:42:53 | 0:55:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:04:51.370216 mon.b mon.0 172.21.15.182:6789/0 314 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366611 |
|
2018-04-06 22:47:42 | 2018-04-08 22:03:10 | 2018-04-08 23:13:10 | 1:10:00 | 0:20:35 | 0:49:25 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2366612 |
|
2018-04-06 22:47:43 | 2018-04-08 22:05:10 | 2018-04-08 22:29:09 | 0:23:59 | 0:09:18 | 0:14:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:25:57.888834 mon.b mon.0 172.21.15.36:6789/0 174 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366613 |
|
2018-04-06 22:47:44 | 2018-04-08 22:07:24 | 2018-04-08 22:41:23 | 0:33:59 | 0:24:44 | 0:09:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:24:02.112979 mon.a mon.0 172.21.15.3:6789/0 250 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 99 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366614 |
|
2018-04-06 22:47:45 | 2018-04-08 22:07:24 | 2018-04-08 22:29:23 | 0:21:59 | 0:10:32 | 0:11:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:24:11.243941 mon.b mon.0 172.21.15.28:6789/0 178 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366615 |
|
2018-04-06 22:47:45 | 2018-04-08 22:09:07 | 2018-04-08 22:43:09 | 0:34:02 | 0:09:16 | 0:24:46 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:40:48.138695 mon.a mon.0 172.21.15.71:6789/0 256 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366616 |
|
2018-04-06 22:47:46 | 2018-04-08 22:09:07 | 2018-04-08 22:57:09 | 0:48:02 | 0:14:02 | 0:34:00 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:48:22.643651 mon.b mon.0 172.21.15.26:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366617 |
|
2018-04-06 22:47:47 | 2018-04-08 22:09:07 | 2018-04-08 22:41:09 | 0:32:02 | 0:10:34 | 0:21:28 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:37:10.788026 mon.a mon.0 172.21.15.55:6789/0 328 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366618 |
|
2018-04-06 22:47:48 | 2018-04-08 22:09:07 | 2018-04-08 23:05:09 | 0:56:02 | 0:23:13 | 0:32:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:51:31.870106 mds.i mds.1 172.21.15.193:6817/2030524270 1 : cluster [ERR] replayed stray Session close event for client.4751 172.21.15.31:0/755935619 from time 2018-04-08 22:50:47.093564, ignoring" in cluster log |
||||||||||||||
| pass | 2366619 |
|
2018-04-06 22:47:48 | 2018-04-08 22:11:00 | 2018-04-08 23:11:01 | 1:00:01 | 0:49:09 | 0:10:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2366620 |
|
2018-04-06 22:47:49 | 2018-04-08 22:11:00 | 2018-04-08 23:13:01 | 1:02:01 | 0:51:45 | 0:10:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:29:48.327086 mon.b mon.0 172.21.15.14:6789/0 191 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366621 |
|
2018-04-06 22:47:50 | 2018-04-08 22:11:00 | 2018-04-08 22:45:00 | 0:34:00 | 0:09:58 | 0:24:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2366622 |
|
2018-04-06 22:47:51 | 2018-04-08 22:11:15 | 2018-04-08 22:47:15 | 0:36:00 | 0:20:10 | 0:15:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:32:48.673923 mon.b mon.0 172.21.15.188:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366623 |
|
2018-04-06 22:47:52 | 2018-04-08 22:11:22 | 2018-04-08 23:43:23 | 1:32:01 | 0:10:00 | 1:22:01 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:38:29.353588 mon.b mon.0 172.21.15.43:6789/0 217 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366624 |
|
2018-04-06 22:47:52 | 2018-04-08 22:12:54 | 2018-04-08 23:24:55 | 1:12:01 | 0:44:03 | 0:27:58 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
| pass | 2366625 |
|
2018-04-06 22:47:53 | 2018-04-08 22:13:05 | 2018-04-08 23:27:06 | 1:14:01 | 0:49:24 | 0:24:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2366626 |
|
2018-04-06 22:47:54 | 2018-04-08 22:17:09 | 2018-04-08 23:17:10 | 1:00:01 | 0:35:11 | 0:24:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:06:15.212155 mon.a mon.0 172.21.15.60:6789/0 203 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 1092 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366627 |
|
2018-04-06 22:47:55 | 2018-04-08 22:17:10 | 2018-04-08 22:39:09 | 0:21:59 | 0:09:29 | 0:12:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:35:09.401743 mon.a mon.0 172.21.15.5:6789/0 259 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366628 |
|
2018-04-06 22:47:56 | 2018-04-08 22:19:06 | 2018-04-08 23:05:06 | 0:46:00 | 0:24:09 | 0:21:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:49:43.485756 mon.a mon.0 172.21.15.56:6789/0 330 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 96 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366629 |
|
2018-04-06 22:47:57 | 2018-04-08 22:19:06 | 2018-04-08 22:41:06 | 0:22:00 | 0:09:15 | 0:12:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:38:26.221651 mon.b mon.0 172.21.15.117:6789/0 148 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 74 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366630 |
|
2018-04-06 22:47:58 | 2018-04-08 22:21:13 | 2018-04-08 23:07:15 | 0:46:02 | 0:10:01 | 0:36:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366631 |
|
2018-04-06 22:47:58 | 2018-04-08 22:21:13 | 2018-04-08 23:11:15 | 0:50:02 | 0:11:51 | 0:38:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:08:08.552849 mon.a mon.0 172.21.15.136:6789/0 271 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 174 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366632 |
|
2018-04-06 22:47:59 | 2018-04-08 22:22:54 | 2018-04-08 22:56:54 | 0:34:00 | 0:10:24 | 0:23:36 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:52:20.056035 mon.b mon.0 172.21.15.149:6789/0 168 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366633 |
|
2018-04-06 22:48:00 | 2018-04-08 22:23:06 | 2018-04-08 22:55:06 | 0:32:00 | 0:20:30 | 0:11:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:50:51.905307 mds.b mds.1 172.21.15.140:6817/3283567712 1 : cluster [ERR] replayed stray Session close event for client.15181 172.21.15.93:0/3653786500 from time 2018-04-08 22:45:19.310918, ignoring" in cluster log |
||||||||||||||
| fail | 2366634 |
|
2018-04-06 22:48:01 | 2018-04-08 22:23:07 | 2018-04-08 23:57:11 | 1:34:04 | 1:17:11 | 0:16:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:46:14.503222 mon.b mon.0 172.21.15.101:6789/0 176 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366635 |
|
2018-04-06 22:48:02 | 2018-04-08 22:25:01 | 2018-04-08 23:03:01 | 0:38:00 | 0:26:47 | 0:11:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:42:52.591835 mon.b mon.0 172.21.15.1:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366636 |
|
2018-04-06 22:48:03 | 2018-04-08 22:25:01 | 2018-04-08 22:57:01 | 0:32:00 | 0:16:12 | 0:15:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:48:04.223328 mon.b mon.0 172.21.15.102:6789/0 179 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366637 |
|
2018-04-06 22:48:03 | 2018-04-08 22:25:01 | 2018-04-08 23:07:02 | 0:42:01 | 0:27:23 | 0:14:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:44:39.945037 mon.b mon.0 172.21.15.16:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366638 |
|
2018-04-06 22:48:04 | 2018-04-08 22:25:15 | 2018-04-08 22:47:15 | 0:22:00 | 0:10:05 | 0:11:55 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:43:55.122599 mon.a mon.0 172.21.15.148:6789/0 269 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366639 |
|
2018-04-06 22:48:05 | 2018-04-08 22:27:21 | 2018-04-08 23:41:22 | 1:14:01 | 0:50:19 | 0:23:42 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-08 23:17:53.461256 mon.b mon.0 172.21.15.23:6789/0 162 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 36 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366640 |
|
2018-04-06 22:48:06 | 2018-04-08 22:29:13 | 2018-04-08 23:25:15 | 0:56:02 | 0:38:27 | 0:17:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:05:07.530817 mon.a mon.0 172.21.15.88:6789/0 328 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 746 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366641 |
|
2018-04-06 22:48:07 | 2018-04-08 22:29:14 | 2018-04-08 23:59:16 | 1:30:02 | 0:59:05 | 0:30:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:16:02.459072 mon.b mon.0 172.21.15.70:6789/0 140 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366642 |
|
2018-04-06 22:48:07 | 2018-04-08 22:29:13 | 2018-04-08 23:03:15 | 0:34:02 | 0:10:12 | 0:23:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:59:34.575732 mon.a mon.0 172.21.15.11:6789/0 208 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 77 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366643 |
|
2018-04-06 22:48:08 | 2018-04-08 22:29:24 | 2018-04-09 00:07:26 | 1:38:02 | 0:23:36 | 1:14:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2366644 |
|
2018-04-06 22:48:09 | 2018-04-08 22:30:21 | 2018-04-08 23:04:21 | 0:34:00 | 0:10:37 | 0:23:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:59:10.245360 mon.b mon.0 172.21.15.159:6789/0 178 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366645 |
|
2018-04-06 22:48:10 | 2018-04-08 22:31:10 | 2018-04-08 22:51:09 | 0:19:59 | 0:08:57 | 0:11:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2366646 |
|
2018-04-06 22:48:10 | 2018-04-08 22:32:02 | 2018-04-08 23:00:02 | 0:28:00 | 0:12:49 | 0:15:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:53:47.298414 mon.a mon.0 172.21.15.33:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366647 |
|
2018-04-06 22:48:11 | 2018-04-08 22:32:53 | 2018-04-08 23:06:53 | 0:34:00 | 0:09:09 | 0:24:51 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:03:17.714123 mon.a mon.0 172.21.15.73:6789/0 191 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366648 |
|
2018-04-06 22:48:12 | 2018-04-08 22:32:57 | 2018-04-08 23:08:57 | 0:36:00 | 0:22:49 | 0:13:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-08 22:55:43.996462 mds.c mds.1 172.21.15.97:6816/3634658677 1 : cluster [ERR] replayed stray Session close event for client.4744 172.21.15.99:0/1339769397 from time 2018-04-08 22:54:58.343013, ignoring" in cluster log |
||||||||||||||
| fail | 2366649 |
|
2018-04-06 22:48:13 | 2018-04-08 22:33:00 | 2018-04-08 23:49:01 | 1:16:01 | 0:51:23 | 0:24:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:38:57.018114 mon.a mon.0 172.21.15.148:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366650 |
|
2018-04-06 22:48:14 | 2018-04-08 22:33:00 | 2018-04-09 00:15:02 | 1:42:02 | 1:21:58 | 0:20:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:00:51.634356 mon.b mon.0 172.21.15.9:6789/0 186 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366651 |
|
2018-04-06 22:48:15 | 2018-04-08 22:33:16 | 2018-04-08 23:15:16 | 0:42:00 | 0:10:20 | 0:31:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:09:22.795075 mon.b mon.0 172.21.15.50:6789/0 237 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366652 |
|
2018-04-06 22:48:15 | 2018-04-08 22:33:16 | 2018-04-08 23:21:16 | 0:48:00 | 0:17:21 | 0:30:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:15:28.948710 mon.b mon.0 172.21.15.109:6789/0 190 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 368 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366653 |
|
2018-04-06 22:48:16 | 2018-04-08 22:33:16 | 2018-04-08 23:43:17 | 1:10:01 | 0:10:14 | 0:59:47 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:40:36.909913 mon.a mon.0 172.21.15.3:6789/0 203 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 158 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366654 |
|
2018-04-06 22:48:17 | 2018-04-08 22:36:55 | 2018-04-09 00:16:57 | 1:40:02 | 0:45:30 | 0:54:32 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
| fail | 2366655 |
|
2018-04-06 22:48:18 | 2018-04-08 22:36:55 | 2018-04-09 00:30:57 | 1:54:02 | 0:52:29 | 1:01:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:43:14.611004 mon.a mon.0 172.21.15.97:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2366656 |
|
2018-04-06 22:48:18 | 2018-04-08 22:37:08 | 2018-04-08 23:33:07 | 0:55:59 | 0:38:35 | 0:17:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2366657 |
|
2018-04-06 22:48:19 | 2018-04-08 22:39:14 | 2018-04-08 22:59:14 | 0:20:00 | 0:10:16 | 0:09:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2366658 |
|
2018-04-06 22:48:20 | 2018-04-08 22:39:14 | 2018-04-08 23:13:15 | 0:34:01 | 0:23:57 | 0:10:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:08:47.178472 mon.a mon.0 172.21.15.24:6789/0 339 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 786 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2366659 |
|
2018-04-06 22:48:21 | 2018-04-08 22:39:14 | 2018-04-08 23:15:15 | 0:36:01 | 0:09:31 | 0:26:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-08 23:11:33.680155 mon.a mon.0 172.21.15.40:6789/0 163 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 126 sec (SLOW_OPS)" in cluster log |
||||||||||||||
Pulpito