| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| pdonnell | 2018-04-10 20:33:24 | 2018-04-11 01:25:21 | 2018-04-11 04:39:19 | 3:13:58 | multimds | wip-pdonnell-testing-20180410.183536 | smithi | 24cbaef | 25 | 95 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 2381516 |
|
2018-04-10 20:33:28 | 2018-04-11 01:25:11 | 2018-04-11 01:53:10 | 0:27:59 | 0:13:10 | 0:14:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:47:49.675404 mon.a mon.0 172.21.15.26:6789/0 257 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 182 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381517 |
|
2018-04-10 20:33:29 | 2018-04-11 01:25:12 | 2018-04-11 01:53:12 | 0:28:00 | 0:15:52 | 0:12:08 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:42:19.817180 mon.b mon.0 172.21.15.16:6789/0 167 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381518 |
|
2018-04-10 20:33:29 | 2018-04-11 01:25:21 | 2018-04-11 03:21:24 | 1:56:03 | 1:46:12 | 0:09:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:43:24.389201 mon.a mon.0 172.21.15.136:6789/0 165 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 151 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381519 |
|
2018-04-10 20:33:30 | 2018-04-11 01:25:28 | 2018-04-11 02:35:29 | 1:10:01 | 0:10:39 | 0:59:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:31:23.791763 mon.b mon.0 172.21.15.8:6789/0 167 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 56 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381520 |
|
2018-04-10 20:33:31 | 2018-04-11 01:27:08 | 2018-04-11 02:01:07 | 0:33:59 | 0:09:06 | 0:24:53 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2381521 |
|
2018-04-10 20:33:32 | 2018-04-11 01:27:08 | 2018-04-11 02:45:09 | 1:18:01 | 0:38:35 | 0:39:26 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2381522 |
|
2018-04-10 20:33:32 | 2018-04-11 01:27:08 | 2018-04-11 02:45:09 | 1:18:01 | 1:06:06 | 0:11:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:49:18.911425 mon.b mon.0 172.21.15.93:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381523 |
|
2018-04-10 20:33:33 | 2018-04-11 01:27:08 | 2018-04-11 02:27:08 | 1:00:00 | 0:19:59 | 0:40:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:20:30.073697 mon.a mon.0 172.21.15.104:6789/0 327 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 532 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381524 |
|
2018-04-10 20:33:34 | 2018-04-11 01:27:08 | 2018-04-11 02:15:08 | 0:48:00 | 0:21:03 | 0:26:57 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:03:06.815398 mds.a mds.1 172.21.15.97:6817/1237056740 1 : cluster [ERR] replayed stray Session close event for client.4649 172.21.15.79:0/3008196710 from time 2018-04-11 02:02:27.412056, ignoring" in cluster log |
||||||||||||||
| fail | 2381525 |
|
2018-04-10 20:33:35 | 2018-04-11 01:27:08 | 2018-04-11 02:41:09 | 1:14:01 | 0:50:10 | 0:23:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:09:07.237849 mon.b mon.0 172.21.15.48:6789/0 177 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 791 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381526 |
|
2018-04-10 20:33:35 | 2018-04-11 01:27:08 | 2018-04-11 02:03:08 | 0:36:00 | 0:09:27 | 0:26:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:59:18.165756 mon.b mon.0 172.21.15.63:6789/0 205 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381527 |
|
2018-04-10 20:33:36 | 2018-04-11 01:27:12 | 2018-04-11 02:13:12 | 0:46:00 | 0:26:51 | 0:19:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:51:18.610465 mon.b mon.0 172.21.15.111:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381528 |
|
2018-04-10 20:33:37 | 2018-04-11 01:29:15 | 2018-04-11 01:49:15 | 0:20:00 | 0:10:37 | 0:09:23 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:45:22.789383 mon.a mon.0 172.21.15.56:6789/0 221 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 78 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381529 |
|
2018-04-10 20:33:38 | 2018-04-11 01:29:15 | 2018-04-11 02:27:16 | 0:58:01 | 0:40:51 | 0:17:10 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 02:01:17.112376 mon.b mon.0 172.21.15.61:6789/0 303 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381530 |
|
2018-04-10 20:33:38 | 2018-04-11 01:31:02 | 2018-04-11 01:57:01 | 0:25:59 | 0:09:55 | 0:16:04 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:53:47.448659 mon.a mon.0 172.21.15.117:6789/0 258 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 81 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381531 |
|
2018-04-10 20:33:39 | 2018-04-11 01:31:06 | 2018-04-11 01:53:06 | 0:22:00 | 0:10:30 | 0:11:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:49:46.391158 mon.a mon.0 172.21.15.24:6789/0 207 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381532 |
|
2018-04-10 20:33:40 | 2018-04-11 01:31:09 | 2018-04-11 02:31:09 | 1:00:00 | 0:21:18 | 0:38:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:18:33.126850 mon.b mon.0 172.21.15.78:6789/0 134 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 132 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381533 |
|
2018-04-10 20:33:41 | 2018-04-11 01:31:11 | 2018-04-11 02:57:13 | 1:26:02 | 1:00:09 | 0:25:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:05:53.579468 mon.a mon.0 172.21.15.41:6789/0 340 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 156 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381534 |
|
2018-04-10 20:33:41 | 2018-04-11 01:31:13 | 2018-04-11 01:53:12 | 0:21:59 | 0:09:59 | 0:12:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:50:10.292982 mon.b mon.0 172.21.15.57:6789/0 132 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 56 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381535 |
|
2018-04-10 20:33:42 | 2018-04-11 01:32:55 | 2018-04-11 01:52:55 | 0:20:00 | 0:09:24 | 0:10:36 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2381536 |
|
2018-04-10 20:33:43 | 2018-04-11 01:33:07 | 2018-04-11 01:55:06 | 0:21:59 | 0:08:56 | 0:13:03 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:51:17.623994 mon.a mon.0 172.21.15.80:6789/0 163 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 41 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381537 |
|
2018-04-10 20:33:44 | 2018-04-11 01:33:07 | 2018-04-11 02:21:07 | 0:48:00 | 0:30:35 | 0:17:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:59:45.130937 mon.a mon.0 172.21.15.67:6789/0 327 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381538 |
|
2018-04-10 20:33:44 | 2018-04-11 01:33:11 | 2018-04-11 03:07:13 | 1:34:02 | 0:36:17 | 0:57:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2381539 |
|
2018-04-10 20:33:45 | 2018-04-11 01:33:12 | 2018-04-11 02:35:12 | 1:02:00 | 0:20:49 | 0:41:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:30:37.665024 mds.e mds.1 172.21.15.63:6816/948607364 1 : cluster [ERR] replayed stray Session close event for client.5412 172.21.15.142:0/779958997 from time 2018-04-11 02:25:28.549084, ignoring" in cluster log |
||||||||||||||
| pass | 2381540 |
|
2018-04-10 20:33:46 | 2018-04-11 01:33:12 | 2018-04-11 02:29:12 | 0:56:00 | 0:39:24 | 0:16:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| pass | 2381541 |
|
2018-04-10 20:33:47 | 2018-04-11 01:34:58 | 2018-04-11 01:56:58 | 0:22:00 | 0:09:48 | 0:12:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2381542 |
|
2018-04-10 20:33:48 | 2018-04-11 01:35:13 | 2018-04-11 02:03:12 | 0:27:59 | 0:16:42 | 0:11:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:51:22.523324 mon.a mon.0 172.21.15.92:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381543 |
|
2018-04-10 20:33:48 | 2018-04-11 01:36:58 | 2018-04-11 02:02:58 | 0:26:00 | 0:10:52 | 0:15:08 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:58:03.590778 mon.a mon.0 172.21.15.23:6789/0 189 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381544 |
|
2018-04-10 20:33:49 | 2018-04-11 01:37:01 | 2018-04-11 03:39:06 | 2:02:05 | 0:49:50 | 1:12:15 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 03:05:40.986826 mon.a mon.0 172.21.15.95:6789/0 197 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 84 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381545 |
|
2018-04-10 20:33:50 | 2018-04-11 01:37:08 | 2018-04-11 01:59:08 | 0:22:00 | 0:09:47 | 0:12:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:56:33.419237 mon.b mon.0 172.21.15.6:6789/0 171 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 82 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381546 |
|
2018-04-10 20:33:51 | 2018-04-11 01:37:08 | 2018-04-11 02:05:08 | 0:28:00 | 0:14:48 | 0:13:12 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:56:51.632503 mon.b mon.0 172.21.15.3:6789/0 133 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381547 |
|
2018-04-10 20:33:51 | 2018-04-11 01:37:11 | 2018-04-11 02:05:11 | 0:28:00 | 0:15:33 | 0:12:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:54:48.723175 mon.b mon.0 172.21.15.77:6789/0 163 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381548 |
|
2018-04-10 20:33:52 | 2018-04-11 01:37:14 | 2018-04-11 02:53:16 | 1:16:02 | 1:02:00 | 0:14:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
| fail | 2381549 |
|
2018-04-10 20:33:53 | 2018-04-11 01:39:19 | 2018-04-11 02:03:19 | 0:24:00 | 0:09:56 | 0:14:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:59:51.749266 mon.b mon.0 172.21.15.193:6789/0 173 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381550 |
|
2018-04-10 20:33:54 | 2018-04-11 01:39:19 | 2018-04-11 01:59:19 | 0:20:00 | 0:09:13 | 0:10:47 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2381551 |
|
2018-04-10 20:33:55 | 2018-04-11 01:39:20 | 2018-04-11 02:43:20 | 1:04:00 | 0:49:57 | 0:14:03 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
| pass | 2381552 |
|
2018-04-10 20:33:55 | 2018-04-11 01:39:20 | 2018-04-11 03:15:22 | 1:36:02 | 1:14:15 | 0:21:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| pass | 2381553 |
|
2018-04-10 20:33:56 | 2018-04-11 01:39:20 | 2018-04-11 02:25:20 | 0:46:00 | 0:23:55 | 0:22:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2381554 |
|
2018-04-10 20:33:57 | 2018-04-11 01:41:12 | 2018-04-11 02:57:13 | 1:16:01 | 0:21:37 | 0:54:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:43:48.566026 mds.c mds.1 172.21.15.31:6817/4101689543 1 : cluster [ERR] replayed stray Session close event for client.4654 172.21.15.98:0/4037608898 from time 2018-04-11 02:43:04.748949, ignoring" in cluster log |
||||||||||||||
| fail | 2381555 |
|
2018-04-10 20:33:58 | 2018-04-11 01:41:12 | 2018-04-11 02:51:13 | 1:10:01 | 0:50:01 | 0:20:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:06:08.780917 mon.b mon.0 172.21.15.16:6789/0 163 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381556 |
|
2018-04-10 20:33:59 | 2018-04-11 01:41:12 | 2018-04-11 02:45:12 | 1:04:00 | 0:10:17 | 0:53:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2381557 |
|
2018-04-10 20:33:59 | 2018-04-11 01:41:13 | 2018-04-11 03:17:15 | 1:36:02 | 0:27:31 | 1:08:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:56:13.156218 mon.a mon.0 172.21.15.14:6789/0 198 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381558 |
|
2018-04-10 20:34:00 | 2018-04-11 01:41:12 | 2018-04-11 02:31:12 | 0:50:00 | 0:12:44 | 0:37:16 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:24:18.710743 mon.a mon.0 172.21.15.62:6789/0 186 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381559 |
|
2018-04-10 20:34:01 | 2018-04-11 01:41:12 | 2018-04-11 03:15:13 | 1:34:01 | 0:49:22 | 0:44:39 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 02:42:04.260041 mon.b mon.0 172.21.15.65:6789/0 180 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 58 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381560 |
|
2018-04-10 20:34:02 | 2018-04-11 01:41:13 | 2018-04-11 02:13:12 | 0:31:59 | 0:10:22 | 0:21:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2381561 |
|
2018-04-10 20:34:02 | 2018-04-11 01:41:13 | 2018-04-11 02:15:13 | 0:34:00 | 0:11:06 | 0:22:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:10:13.313672 mon.b mon.0 172.21.15.8:6789/0 171 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381562 |
|
2018-04-10 20:34:03 | 2018-04-11 01:41:13 | 2018-04-11 02:45:14 | 1:04:01 | 0:20:32 | 0:43:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2381563 |
|
2018-04-10 20:34:04 | 2018-04-11 01:42:58 | 2018-04-11 02:20:58 | 0:38:00 | 0:26:09 | 0:11:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:02:54.501295 mon.a mon.0 172.21.15.37:6789/0 322 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381564 |
|
2018-04-10 20:34:05 | 2018-04-11 01:42:58 | 2018-04-11 02:06:58 | 0:24:00 | 0:08:44 | 0:15:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:03:54.796315 mon.a mon.0 172.21.15.72:6789/0 169 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 42 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381565 |
|
2018-04-10 20:34:06 | 2018-04-11 01:43:02 | 2018-04-11 02:41:02 | 0:58:00 | 0:10:24 | 0:47:36 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:37:28.981794 mon.a mon.0 172.21.15.67:6789/0 180 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 143 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381566 |
|
2018-04-10 20:34:06 | 2018-04-11 01:43:04 | 2018-04-11 02:07:03 | 0:23:59 | 0:09:06 | 0:14:53 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2381567 |
|
2018-04-10 20:34:07 | 2018-04-11 01:43:05 | 2018-04-11 02:27:06 | 0:44:01 | 0:33:12 | 0:10:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 01:59:36.733704 mon.a mon.0 172.21.15.71:6789/0 314 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381568 |
|
2018-04-10 20:34:08 | 2018-04-11 01:43:11 | 2018-04-11 02:45:12 | 1:02:01 | 0:36:24 | 0:25:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:36:45.943469 mon.a mon.0 172.21.15.162:6789/0 168 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 1362 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381569 |
|
2018-04-10 20:34:09 | 2018-04-11 01:43:47 | 2018-04-11 02:21:47 | 0:38:00 | 0:22:30 | 0:15:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:18:10.003968 mds.f mds.1 172.21.15.135:6817/4215561634 1 : cluster [ERR] replayed stray Session close event for client.5431 172.21.15.196:0/3175581877 from time 2018-04-11 02:12:02.438852, ignoring" in cluster log |
||||||||||||||
| pass | 2381570 |
|
2018-04-10 20:34:09 | 2018-04-11 01:44:59 | 2018-04-11 02:38:59 | 0:54:00 | 0:38:32 | 0:15:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2381571 |
|
2018-04-10 20:34:10 | 2018-04-11 01:45:06 | 2018-04-11 02:07:06 | 0:22:00 | 0:10:11 | 0:11:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:04:06.799434 mon.b mon.0 172.21.15.13:6789/0 264 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381572 |
|
2018-04-10 20:34:11 | 2018-04-11 01:45:06 | 2018-04-11 02:15:06 | 0:30:00 | 0:18:10 | 0:11:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:03:45.823779 mon.a mon.0 172.21.15.56:6789/0 260 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 61 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381573 |
|
2018-04-10 20:34:12 | 2018-04-11 01:45:12 | 2018-04-11 02:35:12 | 0:50:00 | 0:10:32 | 0:39:28 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:32:15.370045 mon.b mon.0 172.21.15.97:6789/0 298 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381574 |
|
2018-04-10 20:34:12 | 2018-04-11 01:45:27 | 2018-04-11 03:03:29 | 1:18:02 | 0:44:41 | 0:33:21 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 02:33:49.160396 mon.a mon.0 172.21.15.74:6789/0 195 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381575 |
|
2018-04-10 20:34:13 | 2018-04-11 01:47:10 | 2018-04-11 02:13:09 | 0:25:59 | 0:10:01 | 0:15:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:08:22.805173 mon.a mon.0 172.21.15.24:6789/0 195 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381576 |
|
2018-04-10 20:34:14 | 2018-04-11 01:47:10 | 2018-04-11 02:17:10 | 0:30:00 | 0:14:54 | 0:15:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:09:39.800949 mon.a mon.0 172.21.15.95:6789/0 212 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 107 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381577 |
|
2018-04-10 20:34:15 | 2018-04-11 01:47:13 | 2018-04-11 02:25:13 | 0:38:00 | 0:15:15 | 0:22:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:14:34.249673 mon.a mon.0 172.21.15.68:6789/0 241 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381578 |
|
2018-04-10 20:34:16 | 2018-04-11 01:47:14 | 2018-04-11 03:37:17 | 1:50:03 | 1:24:34 | 0:25:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:20:33.555500 mon.a mon.0 172.21.15.23:6789/0 216 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 147 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381579 |
|
2018-04-10 20:34:16 | 2018-04-11 01:49:05 | 2018-04-11 02:09:05 | 0:20:00 | 0:10:17 | 0:09:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:04:41.150475 mon.a mon.0 172.21.15.62:6789/0 163 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 61 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381580 |
|
2018-04-10 20:34:17 | 2018-04-11 01:49:06 | 2018-04-11 02:37:06 | 0:48:00 | 0:09:31 | 0:38:29 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:33:19.569045 mon.b mon.0 172.21.15.5:6789/0 305 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381581 |
|
2018-04-10 20:34:18 | 2018-04-11 01:49:12 | 2018-04-11 02:47:12 | 0:58:00 | 0:38:39 | 0:19:21 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:13:55.185035 mon.b mon.0 172.21.15.6:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381582 |
|
2018-04-10 20:34:19 | 2018-04-11 01:49:16 | 2018-04-11 03:35:19 | 1:46:03 | 1:06:13 | 0:39:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:51:17.802183 mon.a mon.0 172.21.15.15:6789/0 362 : cluster [WRN] Health check failed: 30 slow ops, oldest one blocked for 976 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381583 |
|
2018-04-10 20:34:19 | 2018-04-11 01:49:19 | 2018-04-11 02:21:18 | 0:31:59 | 0:21:08 | 0:10:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:06:19.670096 mon.b mon.0 172.21.15.64:6789/0 144 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381584 |
|
2018-04-10 20:34:20 | 2018-04-11 01:51:18 | 2018-04-11 04:23:21 | 2:32:03 | 0:22:18 | 2:09:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 04:09:48.065267 mds.i mds.1 172.21.15.159:6817/1415565518 1 : cluster [ERR] replayed stray Session close event for client.4719 172.21.15.205:0/3869889922 from time 2018-04-11 04:09:08.208252, ignoring" in cluster log |
||||||||||||||
| fail | 2381585 |
|
2018-04-10 20:34:21 | 2018-04-11 01:51:18 | 2018-04-11 02:57:19 | 1:06:01 | 0:49:45 | 0:16:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:12:33.383520 mon.a mon.0 172.21.15.139:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381586 |
|
2018-04-10 20:34:22 | 2018-04-11 01:51:18 | 2018-04-11 03:17:20 | 1:26:02 | 0:09:32 | 1:16:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2381587 |
|
2018-04-10 20:34:23 | 2018-04-11 01:53:04 | 2018-04-11 02:51:05 | 0:58:01 | 0:22:03 | 0:35:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| pass | 2381588 |
|
2018-04-10 20:34:23 | 2018-04-11 01:53:05 | 2018-04-11 02:37:05 | 0:44:00 | 0:12:17 | 0:31:43 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2381589 |
|
2018-04-10 20:34:24 | 2018-04-11 01:53:07 | 2018-04-11 03:25:10 | 1:32:03 | 0:38:09 | 0:53:54 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 03:04:57.180629 mon.b mon.0 172.21.15.63:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381590 |
|
2018-04-10 20:34:25 | 2018-04-11 01:53:12 | 2018-04-11 02:13:11 | 0:19:59 | 0:09:56 | 0:10:03 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:09:31.409877 mon.b mon.0 172.21.15.65:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381591 |
|
2018-04-10 20:34:26 | 2018-04-11 01:53:13 | 2018-04-11 02:23:12 | 0:29:59 | 0:09:42 | 0:20:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:18:39.965036 mon.b mon.0 172.21.15.158:6789/0 239 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381592 |
|
2018-04-10 20:34:27 | 2018-04-11 01:53:14 | 2018-04-11 02:49:14 | 0:56:00 | 0:21:16 | 0:34:44 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:45:52.928524 mon.a mon.0 172.21.15.92:6789/0 214 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381593 |
|
2018-04-10 20:34:27 | 2018-04-11 01:53:14 | 2018-04-11 02:53:15 | 1:00:01 | 0:36:43 | 0:23:18 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:23:06.715349 mon.a mon.0 172.21.15.72:6789/0 174 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 123 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381594 |
|
2018-04-10 20:34:28 | 2018-04-11 01:55:16 | 2018-04-11 02:21:16 | 0:26:00 | 0:09:15 | 0:16:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:17:24.628425 mon.a mon.0 172.21.15.92:6789/0 208 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 52 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381595 |
|
2018-04-10 20:34:29 | 2018-04-11 01:55:16 | 2018-04-11 02:15:16 | 0:20:00 | 0:09:42 | 0:10:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:12:17.628333 mon.a mon.0 172.21.15.117:6789/0 307 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 58 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381596 |
|
2018-04-10 20:34:30 | 2018-04-11 01:57:07 | 2018-04-11 02:59:09 | 1:02:02 | 0:09:18 | 0:52:44 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:56:18.339306 mon.b mon.0 172.21.15.111:6789/0 171 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 46 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381597 |
|
2018-04-10 20:34:30 | 2018-04-11 01:57:07 | 2018-04-11 02:57:08 | 1:00:01 | 0:39:30 | 0:20:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:29:59.428838 mon.b mon.0 172.21.15.13:6789/0 146 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381598 |
|
2018-04-10 20:34:31 | 2018-04-11 01:57:09 | 2018-04-11 04:21:13 | 2:24:04 | 0:37:38 | 1:46:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:49:02.148278 mon.b mon.0 172.21.15.167:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381599 |
|
2018-04-10 20:34:32 | 2018-04-11 01:59:08 | 2018-04-11 02:41:07 | 0:41:59 | 0:19:05 | 0:22:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:37:02.515172 mds.c mds.1 172.21.15.111:6816/3800763928 1 : cluster [ERR] replayed stray Session close event for client.5249 172.21.15.52:0/762985956 from time 2018-04-11 02:32:12.001125, ignoring" in cluster log |
||||||||||||||
| fail | 2381600 |
|
2018-04-10 20:34:33 | 2018-04-11 01:59:09 | 2018-04-11 03:17:12 | 1:18:03 | 0:37:59 | 0:40:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:43:47.848121 mon.b mon.0 172.21.15.77:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381601 |
|
2018-04-10 20:34:34 | 2018-04-11 01:59:13 | 2018-04-11 02:21:12 | 0:21:59 | 0:09:31 | 0:12:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:16:34.240253 mon.a mon.0 172.21.15.59:6789/0 240 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381602 |
|
2018-04-10 20:34:34 | 2018-04-11 01:59:20 | 2018-04-11 02:53:22 | 0:54:02 | 0:20:00 | 0:34:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:42:55.471256 mon.b mon.0 172.21.15.3:6789/0 175 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 186 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381603 |
|
2018-04-10 20:34:35 | 2018-04-11 02:01:20 | 2018-04-11 02:21:19 | 0:19:59 | 0:09:41 | 0:10:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2381604 |
|
2018-04-10 20:34:36 | 2018-04-11 02:01:20 | 2018-04-11 03:09:22 | 1:08:02 | 0:44:25 | 0:23:37 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 02:39:15.971685 mon.b mon.0 172.21.15.17:6789/0 144 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381605 |
|
2018-04-10 20:34:37 | 2018-04-11 02:01:42 | 2018-04-11 02:23:41 | 0:21:59 | 0:09:38 | 0:12:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2381606 |
|
2018-04-10 20:34:38 | 2018-04-11 02:02:01 | 2018-04-11 02:28:01 | 0:26:00 | 0:14:44 | 0:11:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:19:57.343942 mon.b mon.0 172.21.15.77:6789/0 306 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381607 |
|
2018-04-10 20:34:38 | 2018-04-11 02:03:08 | 2018-04-11 02:45:08 | 0:42:00 | 0:15:10 | 0:26:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:42:24.661958 mon.a mon.0 172.21.15.88:6789/0 253 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 418 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381608 |
|
2018-04-10 20:34:39 | 2018-04-11 02:03:09 | 2018-04-11 04:39:19 | 2:36:10 | 1:23:05 | 1:13:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:23:40.878183 mon.a mon.0 172.21.15.19:6789/0 218 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 146 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381609 |
|
2018-04-10 20:34:40 | 2018-04-11 02:03:13 | 2018-04-11 02:25:13 | 0:22:00 | 0:09:06 | 0:12:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2381610 |
|
2018-04-10 20:34:41 | 2018-04-11 02:03:20 | 2018-04-11 02:45:20 | 0:42:00 | 0:09:11 | 0:32:49 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:41:41.265448 mon.a mon.0 172.21.15.104:6789/0 189 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381611 |
|
2018-04-10 20:34:41 | 2018-04-11 02:05:07 | 2018-04-11 03:21:10 | 1:16:03 | 0:49:40 | 0:26:23 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:36:16.048440 mon.b mon.0 172.21.15.33:6789/0 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381612 |
|
2018-04-10 20:34:42 | 2018-04-11 02:05:09 | 2018-04-11 04:09:13 | 2:04:04 | 1:10:26 | 0:53:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:05:04.254437 mon.b mon.0 172.21.15.70:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381613 |
|
2018-04-10 20:34:43 | 2018-04-11 02:05:12 | 2018-04-11 02:41:12 | 0:36:00 | 0:20:08 | 0:15:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:27:32.986644 mon.a mon.0 172.21.15.26:6789/0 162 : cluster [WRN] Health check failed: 483 slow ops, oldest one blocked for 71 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381614 |
|
2018-04-10 20:34:43 | 2018-04-11 02:07:10 | 2018-04-11 02:51:11 | 0:44:01 | 0:22:31 | 0:21:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:37:38.908499 mds.a mds.1 172.21.15.59:6817/3553652390 1 : cluster [ERR] replayed stray Session close event for client.4746 172.21.15.4:0/3216892220 from time 2018-04-11 02:36:59.859558, ignoring" in cluster log |
||||||||||||||
| fail | 2381615 |
|
2018-04-10 20:34:44 | 2018-04-11 02:07:10 | 2018-04-11 03:15:12 | 1:08:02 | 0:49:11 | 0:18:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:54:03.475483 mon.a mon.0 172.21.15.56:6789/0 160 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 1466 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381616 |
|
2018-04-10 20:34:45 | 2018-04-11 02:07:11 | 2018-04-11 02:31:09 | 0:23:58 | 0:09:15 | 0:14:43 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2381617 |
|
2018-04-10 20:34:46 | 2018-04-11 02:07:20 | 2018-04-11 03:23:22 | 1:16:02 | 0:24:12 | 0:51:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:05:25.555482 mon.a mon.0 172.21.15.59:6789/0 165 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 56 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381618 |
|
2018-04-10 20:34:46 | 2018-04-11 02:09:18 | 2018-04-11 02:43:18 | 0:34:00 | 0:11:54 | 0:22:06 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:38:36.309321 mon.a mon.0 172.21.15.37:6789/0 219 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381619 |
|
2018-04-10 20:34:47 | 2018-04-11 02:13:10 | 2018-04-11 03:43:12 | 1:30:02 | 0:48:03 | 0:41:59 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 03:10:09.913948 mon.a mon.0 172.21.15.68:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381620 |
|
2018-04-10 20:34:48 | 2018-04-11 02:13:11 | 2018-04-11 03:25:12 | 1:12:01 | 0:12:18 | 0:59:43 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:18:26.548223 mon.b mon.0 172.21.15.81:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381621 |
|
2018-04-10 20:34:49 | 2018-04-11 02:13:13 | 2018-04-11 02:43:12 | 0:29:59 | 0:09:40 | 0:20:19 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2381622 |
|
2018-04-10 20:34:49 | 2018-04-11 02:13:13 | 2018-04-11 03:17:16 | 1:04:03 | 0:21:39 | 0:42:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:01:34.743512 mon.b mon.0 172.21.15.93:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381623 |
|
2018-04-10 20:34:50 | 2018-04-11 02:13:13 | 2018-04-11 03:31:16 | 1:18:03 | 0:25:53 | 0:52:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:11:52.667776 mon.a mon.0 172.21.15.71:6789/0 246 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 102 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381624 |
|
2018-04-10 20:34:51 | 2018-04-11 02:13:14 | 2018-04-11 02:55:14 | 0:42:00 | 0:09:15 | 0:32:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:51:57.188290 mon.a mon.0 172.21.15.129:6789/0 208 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 51 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381625 |
|
2018-04-10 20:34:52 | 2018-04-11 02:15:14 | 2018-04-11 03:05:16 | 0:50:02 | 0:13:04 | 0:36:58 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:58:26.551507 mon.b mon.0 172.21.15.19:6789/0 177 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381626 |
|
2018-04-10 20:34:53 | 2018-04-11 02:15:14 | 2018-04-11 03:35:17 | 1:20:03 | 0:12:53 | 1:07:10 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:28:58.565190 mon.a mon.0 172.21.15.2:6789/0 330 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 56 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2381627 |
|
2018-04-10 20:34:53 | 2018-04-11 02:15:14 | 2018-04-11 03:41:17 | 1:26:03 | 0:45:55 | 0:40:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2381628 |
|
2018-04-10 20:34:54 | 2018-04-11 02:15:14 | 2018-04-11 03:11:16 | 0:56:02 | 0:39:04 | 0:16:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:58:54.471622 mon.b mon.0 172.21.15.64:6789/0 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381629 |
|
2018-04-10 20:34:55 | 2018-04-11 02:15:17 | 2018-04-11 03:01:18 | 0:46:01 | 0:20:07 | 0:25:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:57:22.314514 mds.b mds.1 172.21.15.78:6816/2481524976 1 : cluster [ERR] replayed stray Session close event for client.5203 172.21.15.186:0/607350188 from time 2018-04-11 02:52:00.080847, ignoring" in cluster log |
||||||||||||||
| fail | 2381630 |
|
2018-04-10 20:34:56 | 2018-04-11 02:17:08 | 2018-04-11 03:31:10 | 1:14:02 | 0:39:01 | 0:35:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:59:55.356931 mon.b mon.0 172.21.15.48:6789/0 172 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 146 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381631 |
|
2018-04-10 20:34:56 | 2018-04-11 02:17:11 | 2018-04-11 03:05:12 | 0:48:01 | 0:11:06 | 0:36:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:00:23.843825 mon.b mon.0 172.21.15.57:6789/0 325 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381632 |
|
2018-04-10 20:34:57 | 2018-04-11 02:21:09 | 2018-04-11 03:13:11 | 0:52:02 | 0:17:57 | 0:34:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:05:13.886292 mon.a mon.0 172.21.15.88:6789/0 216 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 203 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381633 |
|
2018-04-10 20:34:58 | 2018-04-11 02:21:09 | 2018-04-11 02:49:09 | 0:28:00 | 0:10:08 | 0:17:52 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 02:44:52.739185 mon.a mon.0 172.21.15.24:6789/0 181 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 53 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381634 |
|
2018-04-10 20:34:59 | 2018-04-11 02:21:09 | 2018-04-11 03:43:12 | 1:22:03 | 0:44:07 | 0:37:56 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-04-11 03:14:04.421485 mon.a mon.0 172.21.15.60:6789/0 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2381635 |
|
2018-04-10 20:34:59 | 2018-04-11 02:21:11 | 2018-04-11 03:33:13 | 1:12:02 | 0:09:15 | 1:02:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-04-11 03:28:55.106762 mon.a mon.0 172.21.15.94:6789/0 244 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 52 sec (SLOW_OPS)" in cluster log |
||||||||||||||
Pulpito