| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| pdonnell | 2018-03-30 21:45:07 | 2018-03-31 11:44:21 | 2018-03-31 20:10:51 | 8:26:30 | multimds | wip-pdonnell-testing-20180329.211514 | smithi | 8fefb51 | 136 | 424 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 2338530 |
|
2018-03-30 21:45:19 | 2018-03-31 11:42:14 | 2018-03-31 12:58:15 | 1:16:01 | 0:09:35 | 1:06:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:53:30.240668 mon.b mon.0 172.21.15.98:6789/0 213 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338531 |
|
2018-03-30 21:45:20 | 2018-03-31 11:42:14 | 2018-03-31 12:28:14 | 0:46:00 | 0:09:09 | 0:36:51 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:24:16.089750 mon.b mon.0 172.21.15.64:6789/0 210 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338532 |
|
2018-03-30 21:45:20 | 2018-03-31 11:42:16 | 2018-03-31 12:54:17 | 1:12:01 | 0:42:04 | 0:29:57 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:17:34.170948 mon.a mon.0 172.21.15.6:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338533 |
|
2018-03-30 21:45:21 | 2018-03-31 11:44:21 | 2018-03-31 12:48:21 | 1:04:00 | 0:47:31 | 0:16:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338534 |
|
2018-03-30 21:45:22 | 2018-03-31 11:44:21 | 2018-03-31 12:40:22 | 0:56:01 | 0:43:33 | 0:12:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338535 |
|
2018-03-30 21:45:23 | 2018-03-31 11:48:17 | 2018-03-31 12:14:17 | 0:26:00 | 0:10:43 | 0:15:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:10:11.954217 mon.a mon.0 172.21.15.164:6789/0 325 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338536 |
|
2018-03-30 21:45:23 | 2018-03-31 11:48:20 | 2018-03-31 13:16:21 | 1:28:01 | 0:18:07 | 1:09:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:04:22.713177 mon.b mon.0 172.21.15.72:6789/0 232 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338537 |
|
2018-03-30 21:45:24 | 2018-03-31 11:48:22 | 2018-03-31 14:02:25 | 2:14:03 | 0:50:47 | 1:23:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:17:29.050749 mon.a mon.0 172.21.15.2:6789/0 195 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338538 |
|
2018-03-30 21:45:25 | 2018-03-31 11:50:25 | 2018-03-31 12:40:25 | 0:50:00 | 0:11:22 | 0:38:38 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:36:57.079438 mon.a mon.0 172.21.15.158:6789/0 226 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 149 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338539 |
|
2018-03-30 21:45:26 | 2018-03-31 11:50:45 | 2018-03-31 13:36:46 | 1:46:01 | 0:44:09 | 1:01:52 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 13:27:50.028374 mon.a mon.0 172.21.15.60:6789/0 191 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 233 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338540 |
|
2018-03-30 21:45:26 | 2018-03-31 11:52:14 | 2018-03-31 12:42:14 | 0:50:00 | 0:37:42 | 0:12:18 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338541 |
|
2018-03-30 21:45:27 | 2018-03-31 11:52:14 | 2018-03-31 12:54:15 | 1:02:01 | 0:10:35 | 0:51:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:49:04.176763 mon.b mon.0 172.21.15.50:6789/0 188 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338542 |
|
2018-03-30 21:45:28 | 2018-03-31 11:52:19 | 2018-03-31 12:46:20 | 0:54:01 | 0:23:56 | 0:30:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2338543 |
|
2018-03-30 21:45:29 | 2018-03-31 11:54:15 | 2018-03-31 12:16:15 | 0:22:00 | 0:09:35 | 0:12:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338544 |
|
2018-03-30 21:45:29 | 2018-03-31 11:56:18 | 2018-03-31 12:28:18 | 0:32:00 | 0:08:48 | 0:23:12 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2338545 |
|
2018-03-30 21:45:30 | 2018-03-31 11:56:18 | 2018-03-31 12:42:19 | 0:46:01 | 0:09:21 | 0:36:40 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338546 |
|
2018-03-30 21:45:31 | 2018-03-31 11:56:18 | 2018-03-31 13:06:19 | 1:10:01 | 0:42:36 | 0:27:25 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:29:22.763957 mon.a mon.0 172.21.15.164:6789/0 259 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338547 |
|
2018-03-30 21:45:32 | 2018-03-31 11:58:05 | 2018-03-31 13:38:07 | 1:40:02 | 0:43:16 | 0:56:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:23:31.580659 mon.b mon.0 172.21.15.17:6789/0 201 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 1349 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338548 |
|
2018-03-30 21:45:32 | 2018-03-31 11:58:10 | 2018-03-31 13:04:11 | 1:06:01 | 0:43:39 | 0:22:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi149 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338549 |
|
2018-03-30 21:45:33 | 2018-03-31 11:58:11 | 2018-03-31 12:22:10 | 0:23:59 | 0:11:07 | 0:12:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:16:51.399806 mon.b mon.0 172.21.15.61:6789/0 313 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338550 |
|
2018-03-30 21:45:34 | 2018-03-31 12:00:22 | 2018-03-31 12:50:22 | 0:50:00 | 0:18:18 | 0:31:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338551 |
|
2018-03-30 21:45:35 | 2018-03-31 12:00:22 | 2018-03-31 13:46:24 | 1:46:02 | 0:47:31 | 0:58:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:18:43.563385 mon.b mon.0 172.21.15.61:6789/0 182 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 853 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338552 |
|
2018-03-30 21:45:35 | 2018-03-31 12:00:22 | 2018-03-31 13:08:23 | 1:08:01 | 0:10:31 | 0:57:30 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:04:35.407439 mon.a mon.0 172.21.15.134:6789/0 186 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338553 |
|
2018-03-30 21:45:36 | 2018-03-31 12:02:10 | 2018-03-31 13:02:11 | 1:00:01 | 0:42:56 | 0:17:05 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| pass | 2338554 |
|
2018-03-30 21:45:37 | 2018-03-31 12:02:12 | 2018-03-31 14:08:14 | 2:06:02 | 0:49:17 | 1:16:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338555 |
|
2018-03-30 21:45:38 | 2018-03-31 12:02:13 | 2018-03-31 12:48:13 | 0:46:00 | 0:11:12 | 0:34:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:45:25.040528 mon.b mon.0 172.21.15.64:6789/0 187 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 147 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338556 |
|
2018-03-30 21:45:38 | 2018-03-31 12:04:20 | 2018-03-31 12:56:20 | 0:52:00 | 0:28:38 | 0:23:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:49:47.110201 mon.a mon.0 172.21.15.5:6789/0 168 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 1005 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338557 |
|
2018-03-30 21:45:39 | 2018-03-31 12:04:20 | 2018-03-31 14:14:22 | 2:10:02 | 0:10:01 | 2:00:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:10:33.536795 mon.a mon.0 172.21.15.158:6789/0 329 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338558 |
|
2018-03-30 21:45:40 | 2018-03-31 12:06:18 | 2018-03-31 12:32:19 | 0:26:01 | 0:09:38 | 0:16:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:29:32.135480 mon.a mon.0 172.21.15.49:6789/0 248 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 42 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338559 |
|
2018-03-30 21:45:40 | 2018-03-31 12:06:18 | 2018-03-31 12:32:19 | 0:26:01 | 0:09:29 | 0:16:32 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:27:59.737880 mon.a mon.0 172.21.15.51:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338560 |
|
2018-03-30 21:45:41 | 2018-03-31 12:08:11 | 2018-03-31 13:30:12 | 1:22:01 | 0:37:49 | 0:44:12 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:09:41.008680 mon.a mon.0 172.21.15.71:6789/0 174 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 737 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338561 |
|
2018-03-30 21:45:42 | 2018-03-31 12:08:17 | 2018-03-31 13:08:17 | 1:00:00 | 0:29:50 | 0:30:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:43:51.018188 mon.b mon.0 172.21.15.40:6789/0 296 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338562 |
|
2018-03-30 21:45:43 | 2018-03-31 12:10:07 | 2018-03-31 13:24:08 | 1:14:01 | 0:48:30 | 0:25:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338563 |
|
2018-03-30 21:45:43 | 2018-03-31 12:10:11 | 2018-03-31 12:46:10 | 0:35:59 | 0:11:39 | 0:24:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:41:30.466442 mon.b mon.0 172.21.15.61:6789/0 191 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338564 |
|
2018-03-30 21:45:44 | 2018-03-31 12:10:15 | 2018-03-31 12:44:15 | 0:34:00 | 0:18:57 | 0:15:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:36:49.201236 mon.b mon.0 172.21.15.22:6789/0 240 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338565 |
|
2018-03-30 21:45:45 | 2018-03-31 12:12:16 | 2018-03-31 13:28:16 | 1:16:00 | 0:48:25 | 0:27:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:58:54.352595 mon.a mon.0 172.21.15.154:6789/0 334 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 844 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338566 |
|
2018-03-30 21:45:46 | 2018-03-31 12:12:16 | 2018-03-31 13:08:16 | 0:56:00 | 0:10:55 | 0:45:05 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:03:15.173589 mon.b mon.0 172.21.15.38:6789/0 286 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338567 |
|
2018-03-30 21:45:46 | 2018-03-31 12:12:17 | 2018-03-31 13:20:18 | 1:08:01 | 0:52:26 | 0:15:35 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 13:04:20.056622 mon.b mon.0 172.21.15.33:6789/0 319 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 40 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338568 |
|
2018-03-30 21:45:47 | 2018-03-31 12:14:18 | 2018-03-31 13:14:18 | 1:00:00 | 0:34:28 | 0:25:32 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:08:42.171083 mon.a mon.0 172.21.15.18:6789/0 169 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 1397 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338569 |
|
2018-03-30 21:45:48 | 2018-03-31 12:14:18 | 2018-03-31 13:08:18 | 0:54:00 | 0:11:10 | 0:42:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:03:11.883329 mon.b mon.0 172.21.15.78:6789/0 176 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 105 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338570 |
|
2018-03-30 21:45:49 | 2018-03-31 12:14:18 | 2018-03-31 13:52:20 | 1:38:02 | 0:22:33 | 1:15:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:34:16.297559 mon.b mon.0 172.21.15.50:6789/0 232 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338571 |
|
2018-03-30 21:45:49 | 2018-03-31 12:16:21 | 2018-03-31 13:12:21 | 0:56:00 | 0:09:57 | 0:46:03 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338572 |
|
2018-03-30 21:45:50 | 2018-03-31 12:16:21 | 2018-03-31 12:38:21 | 0:22:00 | 0:09:33 | 0:12:27 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:34:56.291531 mon.a mon.0 172.21.15.101:6789/0 255 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 44 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338573 |
|
2018-03-30 21:45:51 | 2018-03-31 12:16:21 | 2018-03-31 12:56:21 | 0:40:00 | 0:08:48 | 0:31:12 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:53:25.307575 mon.b mon.0 172.21.15.62:6789/0 121 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338574 |
|
2018-03-30 21:45:51 | 2018-03-31 12:16:21 | 2018-03-31 13:14:21 | 0:58:00 | 0:39:00 | 0:19:00 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:41:05.159017 mon.b mon.0 172.21.15.170:6789/0 238 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338575 |
|
2018-03-30 21:45:52 | 2018-03-31 12:18:21 | 2018-03-31 13:18:21 | 1:00:00 | 0:27:34 | 0:32:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:06:31.114888 mon.b mon.0 172.21.15.59:6789/0 191 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 586 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338576 |
|
2018-03-30 21:45:53 | 2018-03-31 12:18:21 | 2018-03-31 13:12:21 | 0:54:00 | 0:39:13 | 0:14:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi065 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338577 |
|
2018-03-30 21:45:54 | 2018-03-31 12:18:21 | 2018-03-31 13:54:22 | 1:36:01 | 0:11:19 | 1:24:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:49:04.722800 mon.b mon.0 172.21.15.105:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338578 |
|
2018-03-30 21:45:54 | 2018-03-31 12:20:02 | 2018-03-31 13:20:03 | 1:00:01 | 0:17:09 | 0:42:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338579 |
|
2018-03-30 21:45:55 | 2018-03-31 12:20:07 | 2018-03-31 13:30:07 | 1:10:00 | 0:51:39 | 0:18:21 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:43:57.830619 mon.b mon.0 172.21.15.15:6789/0 310 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338580 |
|
2018-03-30 21:45:56 | 2018-03-31 12:22:16 | 2018-03-31 12:58:16 | 0:36:00 | 0:10:47 | 0:25:13 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:53:50.105595 mon.b mon.0 172.21.15.144:6789/0 229 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338581 |
|
2018-03-30 21:45:57 | 2018-03-31 12:22:16 | 2018-03-31 13:30:17 | 1:08:01 | 0:47:58 | 0:20:03 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 2338582 |
|
2018-03-30 21:45:57 | 2018-03-31 12:22:16 | 2018-03-31 13:20:17 | 0:58:01 | 0:39:51 | 0:18:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:07:02.025689 mon.a mon.0 172.21.15.129:6789/0 258 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 1283 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338583 |
|
2018-03-30 21:45:58 | 2018-03-31 12:24:24 | 2018-03-31 14:02:26 | 1:38:02 | 0:10:09 | 1:27:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:58:37.041315 mon.b mon.0 172.21.15.52:6789/0 180 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 77 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338584 |
|
2018-03-30 21:45:59 | 2018-03-31 12:25:06 | 2018-03-31 15:33:10 | 3:08:04 | 0:28:58 | 2:39:06 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338585 |
|
2018-03-30 21:46:00 | 2018-03-31 12:26:17 | 2018-03-31 12:48:17 | 0:22:00 | 0:09:55 | 0:12:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:46:11.890830 mon.a mon.0 172.21.15.134:6789/0 206 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338586 |
|
2018-03-30 21:46:00 | 2018-03-31 12:26:18 | 2018-03-31 14:28:20 | 2:02:02 | 0:09:21 | 1:52:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2338587 |
|
2018-03-30 21:46:01 | 2018-03-31 12:28:18 | 2018-03-31 13:24:18 | 0:56:00 | 0:08:53 | 0:47:07 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338588 |
|
2018-03-30 21:46:02 | 2018-03-31 12:28:18 | 2018-03-31 15:08:21 | 2:40:03 | 0:39:43 | 2:00:20 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:46:25.729790 mon.a mon.0 172.21.15.3:6789/0 252 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 741 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338589 |
|
2018-03-30 21:46:02 | 2018-03-31 12:28:18 | 2018-03-31 13:48:19 | 1:20:01 | 0:31:08 | 0:48:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:33:55.987672 mon.a mon.0 172.21.15.67:6789/0 336 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338590 |
|
2018-03-30 21:46:03 | 2018-03-31 12:28:19 | 2018-03-31 14:26:21 | 1:58:02 | 0:39:08 | 1:18:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338591 |
|
2018-03-30 21:46:04 | 2018-03-31 12:28:28 | 2018-03-31 13:48:29 | 1:20:01 | 0:09:54 | 1:10:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:44:45.216031 mon.a mon.0 172.21.15.82:6789/0 325 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338592 |
|
2018-03-30 21:46:05 | 2018-03-31 12:30:04 | 2018-03-31 13:10:04 | 0:40:00 | 0:20:31 | 0:19:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338593 |
|
2018-03-30 21:46:06 | 2018-03-31 12:30:12 | 2018-03-31 13:38:13 | 1:08:01 | 0:49:32 | 0:18:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:08:14.006409 mon.a mon.0 172.21.15.101:6789/0 337 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 857 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338594 |
|
2018-03-30 21:46:06 | 2018-03-31 12:31:36 | 2018-03-31 14:25:38 | 1:54:02 | 0:11:34 | 1:42:28 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:20:34.050746 mon.a mon.0 172.21.15.40:6789/0 292 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338595 |
|
2018-03-30 21:46:07 | 2018-03-31 12:32:11 | 2018-03-31 13:36:12 | 1:04:01 | 0:49:30 | 0:14:31 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 13:20:11.077913 mon.b mon.0 172.21.15.49:6789/0 307 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 113 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338596 |
|
2018-03-30 21:46:08 | 2018-03-31 12:32:20 | 2018-03-31 13:36:20 | 1:04:00 | 0:48:38 | 0:15:22 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:53:56.901825 mon.b mon.0 172.21.15.44:6789/0 236 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338597 |
|
2018-03-30 21:46:08 | 2018-03-31 12:32:20 | 2018-03-31 13:16:20 | 0:44:00 | 0:10:04 | 0:33:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:12:52.932010 mon.b mon.0 172.21.15.45:6789/0 170 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 107 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338598 |
|
2018-03-30 21:46:09 | 2018-03-31 12:34:29 | 2018-03-31 13:04:29 | 0:30:00 | 0:20:23 | 0:09:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:50:02.270640 mon.a mon.0 172.21.15.83:6789/0 156 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338599 |
|
2018-03-30 21:46:10 | 2018-03-31 12:36:24 | 2018-03-31 13:44:25 | 1:08:01 | 0:11:53 | 0:56:08 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:39:54.601221 mon.b mon.0 172.21.15.57:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338600 |
|
2018-03-30 21:46:11 | 2018-03-31 12:36:24 | 2018-03-31 13:34:24 | 0:58:00 | 0:08:56 | 0:49:04 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:30:15.770967 mon.b mon.0 172.21.15.86:6789/0 205 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338601 |
|
2018-03-30 21:46:11 | 2018-03-31 12:38:21 | 2018-03-31 13:22:21 | 0:44:00 | 0:09:05 | 0:34:55 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:19:41.763206 mon.b mon.0 172.21.15.13:6789/0 210 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338602 |
|
2018-03-30 21:46:12 | 2018-03-31 12:38:21 | 2018-03-31 13:04:21 | 0:26:00 | 0:09:07 | 0:16:53 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:01:37.905373 mon.a mon.0 172.21.15.67:6789/0 269 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338603 |
|
2018-03-30 21:46:13 | 2018-03-31 12:38:22 | 2018-03-31 14:50:24 | 2:12:02 | 1:00:15 | 1:11:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi048 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338604 |
|
2018-03-30 21:46:14 | 2018-03-31 12:38:26 | 2018-03-31 13:52:26 | 1:14:00 | 0:45:19 | 0:28:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338605 |
|
2018-03-30 21:46:14 | 2018-03-31 12:40:15 | 2018-03-31 13:54:16 | 1:14:01 | 0:17:01 | 0:57:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:44:56.289981 mon.a mon.0 172.21.15.38:6789/0 336 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338606 |
|
2018-03-30 21:46:15 | 2018-03-31 12:40:23 | 2018-03-31 13:16:23 | 0:36:00 | 0:21:19 | 0:14:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:00:50.472479 mon.a mon.0 172.21.15.39:6789/0 149 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338607 |
|
2018-03-30 21:46:16 | 2018-03-31 12:40:26 | 2018-03-31 13:38:27 | 0:58:01 | 0:45:06 | 0:12:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 12:59:21.975079 mon.b mon.0 172.21.15.96:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338608 |
|
2018-03-30 21:46:16 | 2018-03-31 12:42:22 | 2018-03-31 13:06:22 | 0:24:00 | 0:10:36 | 0:13:24 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:01:52.501502 mon.b mon.0 172.21.15.117:6789/0 304 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 78 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338609 |
|
2018-03-30 21:46:17 | 2018-03-31 12:42:22 | 2018-03-31 14:20:24 | 1:38:02 | 1:02:36 | 0:35:26 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 13:44:15.919684 mon.b mon.0 172.21.15.70:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338610 |
|
2018-03-30 21:46:18 | 2018-03-31 12:42:22 | 2018-03-31 14:42:24 | 2:00:02 | 0:19:27 | 1:40:35 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338611 |
|
2018-03-30 21:46:19 | 2018-03-31 12:44:24 | 2018-03-31 13:10:24 | 0:26:00 | 0:09:56 | 0:16:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:07:07.332642 mon.a mon.0 172.21.15.47:6789/0 352 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 75 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338612 |
|
2018-03-30 21:46:19 | 2018-03-31 12:44:24 | 2018-03-31 13:26:25 | 0:42:01 | 0:18:02 | 0:23:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338613 |
|
2018-03-30 21:46:20 | 2018-03-31 12:46:08 | 2018-03-31 14:22:09 | 1:36:01 | 0:10:20 | 1:25:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:20:10.599873 mon.a mon.0 172.21.15.68:6789/0 202 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 142 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338614 |
|
2018-03-30 21:46:21 | 2018-03-31 12:46:09 | 2018-03-31 14:12:10 | 1:26:01 | 0:08:41 | 1:17:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338615 |
|
2018-03-30 21:46:22 | 2018-03-31 12:46:12 | 2018-03-31 13:38:12 | 0:52:00 | 0:09:49 | 0:42:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:34:01.862839 mon.a mon.0 172.21.15.165:6789/0 193 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338616 |
|
2018-03-30 21:46:22 | 2018-03-31 12:46:13 | 2018-03-31 13:18:13 | 0:32:00 | 0:08:42 | 0:23:18 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:14:18.776524 mon.a mon.0 172.21.15.5:6789/0 163 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338617 |
|
2018-03-30 21:46:23 | 2018-03-31 12:46:22 | 2018-03-31 14:20:23 | 1:34:01 | 0:59:27 | 0:34:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi087 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338618 |
|
2018-03-30 21:46:24 | 2018-03-31 12:48:24 | 2018-03-31 13:28:24 | 0:40:00 | 0:25:20 | 0:14:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338619 |
|
2018-03-30 21:46:25 | 2018-03-31 12:48:24 | 2018-03-31 13:56:25 | 1:08:01 | 0:15:44 | 0:52:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:49:55.198501 mon.a mon.0 172.21.15.71:6789/0 349 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 284 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338620 |
|
2018-03-30 21:46:25 | 2018-03-31 12:48:24 | 2018-03-31 14:38:26 | 1:50:02 | 0:22:18 | 1:27:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338621 |
|
2018-03-30 21:46:26 | 2018-03-31 12:48:24 | 2018-03-31 14:04:24 | 1:16:00 | 0:38:48 | 0:37:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:30:20.701021 mon.b mon.0 172.21.15.45:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338622 |
|
2018-03-30 21:46:27 | 2018-03-31 12:49:20 | 2018-03-31 13:19:19 | 0:29:59 | 0:10:22 | 0:19:37 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:13:35.972301 mon.b mon.0 172.21.15.175:6789/0 285 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338623 |
|
2018-03-30 21:46:27 | 2018-03-31 12:50:13 | 2018-03-31 14:38:15 | 1:48:02 | 0:45:14 | 1:02:48 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 14:18:37.200084 mon.a mon.0 172.21.15.99:6789/0 193 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 745 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338624 |
|
2018-03-30 21:46:28 | 2018-03-31 12:50:16 | 2018-03-31 14:20:17 | 1:30:01 | 0:59:08 | 0:30:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338625 |
|
2018-03-30 21:46:29 | 2018-03-31 12:50:23 | 2018-03-31 13:20:23 | 0:30:00 | 0:09:22 | 0:20:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:16:28.937971 mon.a mon.0 172.21.15.24:6789/0 208 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 47 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338626 |
|
2018-03-30 21:46:30 | 2018-03-31 12:52:32 | 2018-03-31 13:46:33 | 0:54:01 | 0:23:38 | 0:30:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2338627 |
|
2018-03-30 21:46:30 | 2018-03-31 12:54:27 | 2018-03-31 14:08:28 | 1:14:01 | 0:11:34 | 1:02:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338628 |
|
2018-03-30 21:46:31 | 2018-03-31 12:54:27 | 2018-03-31 13:14:27 | 0:20:00 | 0:09:17 | 0:10:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:11:45.847705 mon.a mon.0 172.21.15.99:6789/0 245 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338629 |
|
2018-03-30 21:46:32 | 2018-03-31 12:55:52 | 2018-03-31 13:25:51 | 0:29:59 | 0:09:43 | 0:20:16 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:23:08.073087 mon.a mon.0 172.21.15.38:6789/0 261 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338630 |
|
2018-03-30 21:46:32 | 2018-03-31 12:56:21 | 2018-03-31 13:32:21 | 0:36:00 | 0:09:02 | 0:26:58 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338631 |
|
2018-03-30 21:46:33 | 2018-03-31 12:56:22 | 2018-03-31 14:24:23 | 1:28:01 | 1:00:59 | 0:27:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi009 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338632 |
|
2018-03-30 21:46:34 | 2018-03-31 12:58:21 | 2018-03-31 13:46:21 | 0:48:00 | 0:29:35 | 0:18:25 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338633 |
|
2018-03-30 21:46:35 | 2018-03-31 12:58:21 | 2018-03-31 13:32:21 | 0:34:00 | 0:15:42 | 0:18:18 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:23:40.022468 mon.b mon.0 172.21.15.95:6789/0 175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338634 |
|
2018-03-30 21:46:36 | 2018-03-31 12:58:21 | 2018-03-31 14:16:22 | 1:18:01 | 0:19:53 | 0:58:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:02:11.943763 mon.b mon.0 172.21.15.69:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338635 |
|
2018-03-30 21:46:36 | 2018-03-31 12:58:21 | 2018-03-31 14:34:22 | 1:36:01 | 0:40:26 | 0:55:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:12:07.996899 mon.b mon.0 172.21.15.8:6789/0 177 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338636 |
|
2018-03-30 21:46:37 | 2018-03-31 13:00:16 | 2018-03-31 13:30:16 | 0:30:00 | 0:09:29 | 0:20:31 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338637 |
|
2018-03-30 21:46:38 | 2018-03-31 13:02:12 | 2018-03-31 16:00:16 | 2:58:04 | 0:51:22 | 2:06:42 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:25:07.518050 mon.b mon.0 172.21.15.28:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338638 |
|
2018-03-30 21:46:38 | 2018-03-31 13:04:20 | 2018-03-31 14:26:21 | 1:22:01 | 0:20:01 | 1:02:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338639 |
|
2018-03-30 21:46:39 | 2018-03-31 13:04:22 | 2018-03-31 15:02:24 | 1:58:02 | 0:09:38 | 1:48:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:59:07.893900 mon.b mon.0 172.21.15.36:6789/0 184 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338640 |
|
2018-03-30 21:46:40 | 2018-03-31 13:04:30 | 2018-03-31 13:50:31 | 0:46:01 | 0:17:32 | 0:28:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:46:33.261288 mon.a mon.0 172.21.15.117:6789/0 166 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 518 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338641 |
|
2018-03-30 21:46:41 | 2018-03-31 13:06:28 | 2018-03-31 13:54:28 | 0:48:00 | 0:10:13 | 0:37:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:49:24.807513 mon.b mon.0 172.21.15.86:6789/0 310 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338642 |
|
2018-03-30 21:46:41 | 2018-03-31 13:06:28 | 2018-03-31 13:42:28 | 0:36:00 | 0:09:22 | 0:26:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:39:51.106191 mon.a mon.0 172.21.15.24:6789/0 350 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338643 |
|
2018-03-30 21:46:42 | 2018-03-31 13:08:25 | 2018-03-31 13:40:25 | 0:32:00 | 0:10:12 | 0:21:48 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338644 |
|
2018-03-30 21:46:43 | 2018-03-31 13:08:25 | 2018-03-31 13:52:26 | 0:44:01 | 0:08:45 | 0:35:16 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:48:20.473659 mon.b mon.0 172.21.15.95:6789/0 134 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338645 |
|
2018-03-30 21:46:44 | 2018-03-31 13:08:25 | 2018-03-31 14:28:26 | 1:20:01 | 1:00:08 | 0:19:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi065 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338646 |
|
2018-03-30 21:46:44 | 2018-03-31 13:08:26 | 2018-03-31 14:12:26 | 1:04:00 | 0:30:20 | 0:33:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338647 |
|
2018-03-30 21:46:45 | 2018-03-31 13:10:13 | 2018-03-31 13:44:13 | 0:34:00 | 0:16:06 | 0:17:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:38:20.031804 mon.a mon.0 172.21.15.85:6789/0 336 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 274 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338648 |
|
2018-03-30 21:46:46 | 2018-03-31 13:10:28 | 2018-03-31 14:12:28 | 1:02:00 | 0:24:30 | 0:37:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:53:39.418749 mon.b mon.0 172.21.15.101:6789/0 142 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338649 |
|
2018-03-30 21:46:46 | 2018-03-31 13:10:35 | 2018-03-31 14:30:36 | 1:20:01 | 0:43:31 | 0:36:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:53:40.789869 mon.a mon.0 172.21.15.44:6789/0 202 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338650 |
|
2018-03-30 21:46:47 | 2018-03-31 13:12:32 | 2018-03-31 13:38:31 | 0:25:59 | 0:10:58 | 0:15:01 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:32:17.976585 mon.b mon.0 172.21.15.72:6789/0 279 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338651 |
|
2018-03-30 21:46:48 | 2018-03-31 13:12:32 | 2018-03-31 14:36:33 | 1:24:01 | 0:46:28 | 0:37:33 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 14:05:07.993985 mon.b mon.0 172.21.15.39:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338652 |
|
2018-03-30 21:46:49 | 2018-03-31 13:14:19 | 2018-03-31 14:50:21 | 1:36:02 | 0:20:15 | 1:15:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:41:57.865585 mon.a mon.0 172.21.15.47:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338653 |
|
2018-03-30 21:46:49 | 2018-03-31 13:14:19 | 2018-03-31 14:06:20 | 0:52:01 | 0:09:25 | 0:42:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:02:56.328239 mon.a mon.0 172.21.15.27:6789/0 213 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 57 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338654 |
|
2018-03-30 21:46:50 | 2018-03-31 13:14:22 | 2018-03-31 15:06:25 | 1:52:03 | 0:23:29 | 1:28:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:48:45.534211 mon.b mon.0 172.21.15.81:6789/0 148 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 64 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338655 |
|
2018-03-30 21:46:51 | 2018-03-31 13:14:28 | 2018-03-31 14:06:28 | 0:52:00 | 0:11:51 | 0:40:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:00:01.053696 mon.b mon.0 172.21.15.5:6789/0 178 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338656 |
|
2018-03-30 21:46:51 | 2018-03-31 13:16:31 | 2018-03-31 13:38:30 | 0:21:59 | 0:09:20 | 0:12:39 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338657 |
|
2018-03-30 21:46:52 | 2018-03-31 13:16:31 | 2018-03-31 13:48:30 | 0:31:59 | 0:09:10 | 0:22:49 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:44:56.434653 mon.a mon.0 172.21.15.118:6789/0 146 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338658 |
|
2018-03-30 21:46:53 | 2018-03-31 13:16:31 | 2018-03-31 13:48:30 | 0:31:59 | 0:09:03 | 0:22:56 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:45:19.485118 mon.a mon.0 172.21.15.15:6789/0 162 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 47 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338659 |
|
2018-03-30 21:46:54 | 2018-03-31 13:18:22 | 2018-03-31 15:54:25 | 2:36:03 | 1:08:58 | 1:27:05 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi029 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338660 |
|
2018-03-30 21:46:54 | 2018-03-31 13:18:23 | 2018-03-31 14:12:23 | 0:54:00 | 0:25:11 | 0:28:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi185 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338661 |
|
2018-03-30 21:46:55 | 2018-03-31 13:18:25 | 2018-03-31 13:42:25 | 0:24:00 | 0:14:13 | 0:09:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:38:11.136878 mon.a mon.0 172.21.15.59:6789/0 337 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 222 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338662 |
|
2018-03-30 21:46:56 | 2018-03-31 13:19:21 | 2018-03-31 14:57:22 | 1:38:01 | 0:23:09 | 1:14:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:39:59.448509 mon.a mon.0 172.21.15.2:6789/0 163 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 59 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338663 |
|
2018-03-30 21:46:56 | 2018-03-31 13:20:13 | 2018-03-31 15:22:16 | 2:02:03 | 0:41:07 | 1:20:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:57:57.549921 mon.a mon.0 172.21.15.154:6789/0 212 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 743 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338664 |
|
2018-03-30 21:46:57 | 2018-03-31 13:20:18 | 2018-03-31 13:58:18 | 0:38:00 | 0:09:31 | 0:28:29 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:53:36.220289 mon.b mon.0 172.21.15.1:6789/0 284 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338665 |
|
2018-03-30 21:46:58 | 2018-03-31 13:20:19 | 2018-03-31 15:00:21 | 1:40:02 | 0:48:17 | 0:51:45 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 14:37:10.263061 mon.a mon.0 172.21.15.37:6789/0 198 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338666 |
|
2018-03-30 21:46:58 | 2018-03-31 13:20:24 | 2018-03-31 14:40:25 | 1:20:01 | 0:54:35 | 0:25:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:50:24.251644 mon.a mon.0 172.21.15.49:6789/0 161 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338667 |
|
2018-03-30 21:46:59 | 2018-03-31 13:22:32 | 2018-03-31 13:46:31 | 0:23:59 | 0:10:24 | 0:13:35 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338668 |
|
2018-03-30 21:47:00 | 2018-03-31 13:24:18 | 2018-03-31 14:10:18 | 0:46:00 | 0:14:40 | 0:31:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:01:08.077659 mon.b mon.0 172.21.15.63:6789/0 135 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338669 |
|
2018-03-30 21:47:00 | 2018-03-31 13:24:19 | 2018-03-31 13:50:19 | 0:26:00 | 0:10:37 | 0:15:23 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:48:31.506942 mon.b mon.0 172.21.15.144:6789/0 176 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 89 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338670 |
|
2018-03-30 21:47:01 | 2018-03-31 13:24:23 | 2018-03-31 14:08:23 | 0:44:00 | 0:09:01 | 0:34:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:05:27.664748 mon.b mon.0 172.21.15.141:6789/0 333 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338671 |
|
2018-03-30 21:47:02 | 2018-03-31 13:26:01 | 2018-03-31 13:48:01 | 0:22:00 | 0:09:01 | 0:12:59 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338672 |
|
2018-03-30 21:47:02 | 2018-03-31 13:26:27 | 2018-03-31 14:28:26 | 1:01:59 | 0:51:23 | 0:10:36 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:43:07.036980 mon.b mon.0 172.21.15.16:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338673 |
|
2018-03-30 21:47:03 | 2018-03-31 13:28:27 | 2018-03-31 14:34:27 | 1:06:00 | 0:34:36 | 0:31:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:23:16.402243 mon.a mon.0 172.21.15.117:6789/0 349 : cluster [WRN] Health check failed: 19 slow ops, oldest one blocked for 1038 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338674 |
|
2018-03-30 21:47:04 | 2018-03-31 13:28:27 | 2018-03-31 14:38:28 | 1:10:01 | 0:46:07 | 0:23:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338675 |
|
2018-03-30 21:47:05 | 2018-03-31 13:29:40 | 2018-03-31 14:09:40 | 0:40:00 | 0:10:43 | 0:29:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:04:02.043872 mon.a mon.0 172.21.15.67:6789/0 188 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338676 |
|
2018-03-30 21:47:05 | 2018-03-31 13:30:08 | 2018-03-31 14:42:09 | 1:12:01 | 0:18:27 | 0:53:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:30:16.114248 mon.a mon.0 172.21.15.38:6789/0 257 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338677 |
|
2018-03-30 21:47:06 | 2018-03-31 13:30:13 | 2018-03-31 14:46:14 | 1:16:01 | 0:51:04 | 0:24:57 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:00:03.617528 mon.b mon.0 172.21.15.83:6789/0 184 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338678 |
|
2018-03-30 21:47:07 | 2018-03-31 13:30:17 | 2018-03-31 14:06:17 | 0:36:00 | 0:11:56 | 0:24:04 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:02:59.218048 mon.b mon.0 172.21.15.57:6789/0 300 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 152 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338679 |
|
2018-03-30 21:47:07 | 2018-03-31 13:30:18 | 2018-03-31 15:02:19 | 1:32:01 | 0:50:24 | 0:41:37 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 2338680 |
|
2018-03-30 21:47:08 | 2018-03-31 13:32:27 | 2018-03-31 16:16:30 | 2:44:03 | 0:39:55 | 2:04:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:42:14.611085 mon.b mon.0 172.21.15.95:6789/0 134 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338681 |
|
2018-03-30 21:47:09 | 2018-03-31 13:32:27 | 2018-03-31 16:16:30 | 2:44:03 | 0:10:38 | 2:33:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:13:04.974938 mon.a mon.0 172.21.15.51:6789/0 201 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 119 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338682 |
|
2018-03-30 21:47:10 | 2018-03-31 13:32:27 | 2018-03-31 15:14:29 | 1:42:02 | 0:23:29 | 1:18:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:10:44.713694 mon.a mon.0 172.21.15.38:6789/0 173 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 787 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338683 |
|
2018-03-30 21:47:11 | 2018-03-31 13:34:28 | 2018-03-31 14:14:28 | 0:40:00 | 0:10:23 | 0:29:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:10:38.365882 mon.a mon.0 172.21.15.38:6789/0 322 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338684 |
|
2018-03-30 21:47:11 | 2018-03-31 13:34:28 | 2018-03-31 14:06:28 | 0:32:00 | 0:10:18 | 0:21:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338685 |
|
2018-03-30 21:47:12 | 2018-03-31 13:36:21 | 2018-03-31 13:56:20 | 0:19:59 | 0:09:08 | 0:10:51 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 13:52:24.885009 mds.c mds.0 172.21.15.156:6814/3587280541 2 : cluster [WRN] open_snap_parents has:" in cluster log |
||||||||||||||
| fail | 2338686 |
|
2018-03-30 21:47:13 | 2018-03-31 13:36:21 | 2018-03-31 14:50:22 | 1:14:01 | 0:49:56 | 0:24:05 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:05:45.479193 mon.b mon.0 172.21.15.62:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338687 |
|
2018-03-30 21:47:14 | 2018-03-31 13:36:47 | 2018-03-31 14:24:47 | 0:48:00 | 0:37:26 | 0:10:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:11:26.515162 mon.b mon.0 172.21.15.56:6789/0 210 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338688 |
|
2018-03-30 21:47:14 | 2018-03-31 13:38:16 | 2018-03-31 15:56:18 | 2:18:02 | 0:44:02 | 1:34:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi146 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338689 |
|
2018-03-30 21:47:15 | 2018-03-31 13:38:16 | 2018-03-31 15:54:18 | 2:16:02 | 0:11:41 | 2:04:21 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:49:45.977612 mon.a mon.0 172.21.15.49:6789/0 209 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 74 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338690 |
|
2018-03-30 21:47:16 | 2018-03-31 13:38:16 | 2018-03-31 15:26:18 | 1:48:02 | 0:19:08 | 1:28:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:19:45.904019 mon.b mon.0 172.21.15.39:6789/0 147 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 413 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338691 |
|
2018-03-30 21:47:17 | 2018-03-31 13:38:28 | 2018-03-31 15:56:30 | 2:18:02 | 0:47:02 | 1:31:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:27:57.076866 mon.a mon.0 172.21.15.88:6789/0 201 : cluster [WRN] Health check failed: 12 slow ops, oldest one blocked for 858 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338692 |
|
2018-03-30 21:47:17 | 2018-03-31 13:38:31 | 2018-03-31 14:08:31 | 0:30:00 | 0:10:04 | 0:19:56 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338693 |
|
2018-03-30 21:47:18 | 2018-03-31 13:38:33 | 2018-03-31 15:46:35 | 2:08:02 | 0:53:08 | 1:14:54 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:35:42.332156 mon.b mon.0 172.21.15.70:6789/0 322 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 401 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338694 |
|
2018-03-30 21:47:19 | 2018-03-31 13:40:27 | 2018-03-31 15:08:28 | 1:28:01 | 0:45:31 | 0:42:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338695 |
|
2018-03-30 21:47:20 | 2018-03-31 13:42:36 | 2018-03-31 14:40:36 | 0:58:00 | 0:11:13 | 0:46:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:35:50.987385 mon.b mon.0 172.21.15.187:6789/0 179 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338696 |
|
2018-03-30 21:47:20 | 2018-03-31 13:42:37 | 2018-03-31 15:50:38 | 2:08:01 | 0:28:07 | 1:39:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338697 |
|
2018-03-30 21:47:21 | 2018-03-31 13:44:23 | 2018-03-31 14:22:23 | 0:38:00 | 0:11:03 | 0:26:57 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:18:36.289953 mon.b mon.0 172.21.15.36:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338698 |
|
2018-03-30 21:47:22 | 2018-03-31 13:44:24 | 2018-03-31 14:30:24 | 0:46:00 | 0:08:56 | 0:37:04 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338699 |
|
2018-03-30 21:47:23 | 2018-03-31 13:44:24 | 2018-03-31 14:04:24 | 0:20:00 | 0:09:25 | 0:10:35 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:00:17.527158 mon.b mon.0 172.21.15.36:6789/0 224 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338700 |
|
2018-03-30 21:47:24 | 2018-03-31 13:44:26 | 2018-03-31 14:54:27 | 1:10:01 | 0:46:40 | 0:23:21 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:23:46.233322 mon.a mon.0 172.21.15.1:6789/0 248 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 747 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338701 |
|
2018-03-30 21:47:24 | 2018-03-31 13:46:24 | 2018-03-31 15:22:25 | 1:36:01 | 0:29:43 | 1:06:18 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:58:58.842457 mon.a mon.0 172.21.15.20:6789/0 189 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338702 |
|
2018-03-30 21:47:25 | 2018-03-31 13:46:24 | 2018-03-31 15:28:26 | 1:42:02 | 0:50:11 | 0:51:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi091 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338703 |
|
2018-03-30 21:47:26 | 2018-03-31 13:46:25 | 2018-03-31 14:40:25 | 0:54:00 | 0:11:10 | 0:42:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:35:48.120940 mon.b mon.0 172.21.15.70:6789/0 298 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338704 |
|
2018-03-30 21:47:27 | 2018-03-31 13:46:33 | 2018-03-31 14:28:33 | 0:42:00 | 0:18:12 | 0:23:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338705 |
|
2018-03-30 21:47:27 | 2018-03-31 13:46:34 | 2018-03-31 14:52:35 | 1:06:01 | 0:49:48 | 0:16:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:08:20.660871 mon.a mon.0 172.21.15.86:6789/0 183 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338706 |
|
2018-03-30 21:47:28 | 2018-03-31 13:48:11 | 2018-03-31 14:54:11 | 1:06:00 | 0:11:43 | 0:54:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:51:52.887661 mon.a mon.0 172.21.15.77:6789/0 358 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 150 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338707 |
|
2018-03-30 21:47:29 | 2018-03-31 13:48:20 | 2018-03-31 15:06:21 | 1:18:01 | 0:52:18 | 0:25:43 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 14:52:31.870740 mon.a mon.0 172.21.15.95:6789/0 323 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338708 |
|
2018-03-30 21:47:30 | 2018-03-31 13:48:30 | 2018-03-31 14:34:30 | 0:46:00 | 0:34:24 | 0:11:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:27:28.593027 mon.a mon.0 172.21.15.15:6789/0 168 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 1412 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338709 |
|
2018-03-30 21:47:30 | 2018-03-31 13:48:32 | 2018-03-31 14:36:32 | 0:48:00 | 0:10:34 | 0:37:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:34:00.847405 mon.a mon.0 172.21.15.61:6789/0 192 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 123 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338710 |
|
2018-03-30 21:47:31 | 2018-03-31 13:48:32 | 2018-03-31 14:24:32 | 0:36:00 | 0:23:09 | 0:12:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:09:21.051006 mon.b mon.0 172.21.15.11:6789/0 134 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338711 |
|
2018-03-30 21:47:32 | 2018-03-31 13:50:28 | 2018-03-31 14:24:28 | 0:34:00 | 0:10:18 | 0:23:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:21:50.862413 mon.b mon.0 172.21.15.2:6789/0 189 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 143 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338712 |
|
2018-03-30 21:47:33 | 2018-03-31 13:50:32 | 2018-03-31 14:28:32 | 0:38:00 | 0:09:33 | 0:28:27 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| pass | 2338713 |
|
2018-03-30 21:47:33 | 2018-03-31 13:52:29 | 2018-03-31 14:20:29 | 0:28:00 | 0:08:40 | 0:19:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338714 |
|
2018-03-30 21:47:34 | 2018-03-31 13:52:29 | 2018-03-31 16:44:32 | 2:52:03 | 0:48:30 | 2:03:33 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:25:24.222797 mon.b mon.0 172.21.15.77:6789/0 144 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 1466 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338715 |
|
2018-03-30 21:47:35 | 2018-03-31 13:52:29 | 2018-03-31 15:30:31 | 1:38:02 | 0:32:01 | 1:06:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:19:44.348672 mon.a mon.0 172.21.15.47:6789/0 340 : cluster [WRN] Health check failed: 17 slow ops, oldest one blocked for 896 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338716 |
|
2018-03-30 21:47:36 | 2018-03-31 13:54:25 | 2018-03-31 14:58:26 | 1:04:01 | 0:38:40 | 0:25:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338717 |
|
2018-03-30 21:47:37 | 2018-03-31 13:54:25 | 2018-03-31 15:04:26 | 1:10:01 | 0:11:24 | 0:58:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:59:13.239263 mon.a mon.0 172.21.15.101:6789/0 337 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 74 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338718 |
|
2018-03-30 21:47:37 | 2018-03-31 13:54:29 | 2018-03-31 14:40:30 | 0:46:01 | 0:17:32 | 0:28:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:28:02.678933 mon.b mon.0 172.21.15.132:6789/0 135 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338719 |
|
2018-03-30 21:47:38 | 2018-03-31 13:56:30 | 2018-03-31 16:26:33 | 2:30:03 | 0:50:47 | 1:39:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:51:41.000421 mon.b mon.0 172.21.15.96:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338720 |
|
2018-03-30 21:47:39 | 2018-03-31 13:56:30 | 2018-03-31 14:48:30 | 0:52:00 | 0:10:35 | 0:41:25 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:45:47.474973 mon.a mon.0 172.21.15.134:6789/0 258 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 151 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338721 |
|
2018-03-30 21:47:39 | 2018-03-31 13:56:30 | 2018-03-31 15:42:31 | 1:46:01 | 0:48:07 | 0:57:54 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:30:24.669924 mon.b mon.0 172.21.15.74:6789/0 190 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338722 |
|
2018-03-30 21:47:40 | 2018-03-31 13:58:27 | 2018-03-31 15:04:28 | 1:06:01 | 0:40:09 | 0:25:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338723 |
|
2018-03-30 21:47:41 | 2018-03-31 14:02:34 | 2018-03-31 14:44:34 | 0:42:00 | 0:09:47 | 0:32:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:40:19.632230 mon.a mon.0 172.21.15.131:6789/0 324 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338724 |
|
2018-03-30 21:47:42 | 2018-03-31 14:02:34 | 2018-03-31 15:10:35 | 1:08:01 | 0:29:27 | 0:38:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338725 |
|
2018-03-30 21:47:42 | 2018-03-31 14:04:33 | 2018-03-31 14:42:33 | 0:38:00 | 0:10:02 | 0:27:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:40:24.708941 mon.b mon.0 172.21.15.36:6789/0 166 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 133 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338726 |
|
2018-03-30 21:47:43 | 2018-03-31 14:04:33 | 2018-03-31 14:24:33 | 0:20:00 | 0:09:06 | 0:10:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:20:25.039443 mon.b mon.0 172.21.15.5:6789/0 214 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338727 |
|
2018-03-30 21:47:44 | 2018-03-31 14:06:26 | 2018-03-31 14:26:26 | 0:20:00 | 0:08:49 | 0:11:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338728 |
|
2018-03-30 21:47:44 | 2018-03-31 14:06:26 | 2018-03-31 15:24:27 | 1:18:01 | 0:49:40 | 0:28:21 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:03:32.093646 mon.a mon.0 172.21.15.24:6789/0 154 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 1457 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338729 |
|
2018-03-30 21:47:45 | 2018-03-31 14:06:29 | 2018-03-31 15:28:30 | 1:22:01 | 0:45:55 | 0:36:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:48:53.754275 mon.b mon.0 172.21.15.108:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338730 |
|
2018-03-30 21:47:46 | 2018-03-31 14:06:29 | 2018-03-31 15:34:30 | 1:28:01 | 0:53:01 | 0:35:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338731 |
|
2018-03-30 21:47:47 | 2018-03-31 14:08:24 | 2018-03-31 16:22:27 | 2:14:03 | 0:11:03 | 2:03:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:17:12.914282 mon.a mon.0 172.21.15.57:6789/0 187 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338732 |
|
2018-03-30 21:47:47 | 2018-03-31 14:08:24 | 2018-03-31 15:44:26 | 1:36:02 | 0:20:12 | 1:15:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338733 |
|
2018-03-30 21:47:48 | 2018-03-31 14:08:29 | 2018-03-31 15:50:31 | 1:42:02 | 0:48:15 | 0:53:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:20:19.140083 mon.a mon.0 172.21.15.6:6789/0 202 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338734 |
|
2018-03-30 21:47:49 | 2018-03-31 14:08:32 | 2018-03-31 14:56:32 | 0:48:00 | 0:11:38 | 0:36:22 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:51:52.561277 mon.a mon.0 172.21.15.39:6789/0 339 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338735 |
|
2018-03-30 21:47:49 | 2018-03-31 14:09:50 | 2018-03-31 15:21:50 | 1:12:00 | 0:49:28 | 0:22:32 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:10:40.011755 mon.b mon.0 172.21.15.96:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338736 |
|
2018-03-30 21:47:50 | 2018-03-31 14:10:20 | 2018-03-31 16:02:23 | 1:52:03 | 0:49:09 | 1:02:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2338737 |
|
2018-03-30 21:47:51 | 2018-03-31 14:12:20 | 2018-03-31 14:50:20 | 0:38:00 | 0:10:40 | 0:27:20 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2338738 |
|
2018-03-30 21:47:52 | 2018-03-31 14:12:24 | 2018-03-31 14:54:24 | 0:42:00 | 0:20:57 | 0:21:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338739 |
|
2018-03-30 21:47:52 | 2018-03-31 14:12:27 | 2018-03-31 15:06:28 | 0:54:01 | 0:10:13 | 0:43:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:01:54.361444 mon.a mon.0 172.21.15.156:6789/0 329 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338740 |
|
2018-03-30 21:47:53 | 2018-03-31 14:12:30 | 2018-03-31 15:10:30 | 0:58:00 | 0:08:53 | 0:49:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:06:56.953410 mon.a mon.0 172.21.15.86:6789/0 355 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338741 |
|
2018-03-30 21:47:54 | 2018-03-31 14:14:32 | 2018-03-31 15:04:32 | 0:50:00 | 0:10:43 | 0:39:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:58:15.576690 mon.b mon.0 172.21.15.19:6789/0 207 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338742 |
|
2018-03-30 21:47:55 | 2018-03-31 14:14:32 | 2018-03-31 15:46:33 | 1:32:01 | 0:10:29 | 1:21:32 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:42:28.327827 mon.b mon.0 172.21.15.39:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338743 |
|
2018-03-30 21:47:55 | 2018-03-31 14:16:31 | 2018-03-31 15:36:32 | 1:20:01 | 1:05:29 | 0:14:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:36:22.078474 mon.b mon.0 172.21.15.22:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338744 |
|
2018-03-30 21:47:56 | 2018-03-31 14:20:16 | 2018-03-31 15:04:16 | 0:44:00 | 0:32:04 | 0:11:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338745 |
|
2018-03-30 21:47:57 | 2018-03-31 14:20:18 | 2018-03-31 14:48:17 | 0:27:59 | 0:15:10 | 0:12:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:39:17.469966 mon.b mon.0 172.21.15.5:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338746 |
|
2018-03-30 21:47:57 | 2018-03-31 14:20:24 | 2018-03-31 15:00:25 | 0:40:01 | 0:21:06 | 0:18:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:43:56.317181 mon.a mon.0 172.21.15.67:6789/0 245 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 61 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338747 |
|
2018-03-30 21:47:58 | 2018-03-31 14:20:25 | 2018-03-31 15:56:26 | 1:36:01 | 0:43:50 | 0:52:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:30:11.302491 mon.a mon.0 172.21.15.51:6789/0 206 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 745 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338748 |
|
2018-03-30 21:47:59 | 2018-03-31 14:20:30 | 2018-03-31 14:48:30 | 0:28:00 | 0:11:12 | 0:16:48 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:45:54.504471 mon.a mon.0 172.21.15.56:6789/0 383 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 148 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338749 |
|
2018-03-30 21:48:00 | 2018-03-31 14:22:20 | 2018-03-31 15:24:20 | 1:02:00 | 0:45:20 | 0:16:40 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:18:44.659083 mon.b mon.0 172.21.15.57:6789/0 199 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 825 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338750 |
|
2018-03-30 21:48:00 | 2018-03-31 14:22:25 | 2018-03-31 14:54:24 | 0:31:59 | 0:19:33 | 0:12:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338751 |
|
2018-03-30 21:48:01 | 2018-03-31 14:24:32 | 2018-03-31 15:12:33 | 0:48:01 | 0:10:23 | 0:37:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:09:56.776273 mon.a mon.0 172.21.15.130:6789/0 211 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 69 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338752 |
|
2018-03-30 21:48:02 | 2018-03-31 14:24:32 | 2018-03-31 15:52:34 | 1:28:02 | 0:17:10 | 1:10:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:41:12.489265 mon.a mon.0 172.21.15.24:6789/0 164 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 63 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338753 |
|
2018-03-30 21:48:02 | 2018-03-31 14:24:33 | 2018-03-31 14:48:33 | 0:24:00 | 0:09:51 | 0:14:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338754 |
|
2018-03-30 21:48:03 | 2018-03-31 14:24:34 | 2018-03-31 16:00:35 | 1:36:01 | 0:09:15 | 1:26:46 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338755 |
|
2018-03-30 21:48:04 | 2018-03-31 14:24:49 | 2018-03-31 14:46:48 | 0:21:59 | 0:10:38 | 0:11:21 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:41:30.538671 mon.b mon.0 172.21.15.156:6789/0 210 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338756 |
|
2018-03-30 21:48:05 | 2018-03-31 14:25:48 | 2018-03-31 14:55:47 | 0:29:59 | 0:09:40 | 0:20:19 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:52:52.432055 mon.b mon.0 172.21.15.69:6789/0 143 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338757 |
|
2018-03-30 21:48:05 | 2018-03-31 14:26:22 | 2018-03-31 16:42:25 | 2:16:03 | 1:08:45 | 1:07:18 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:18:41.091553 mon.a mon.0 172.21.15.85:6789/0 388 : cluster [WRN] Health check failed: 36 slow ops, oldest one blocked for 2374 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338758 |
|
2018-03-30 21:48:06 | 2018-03-31 14:26:23 | 2018-03-31 15:16:23 | 0:50:00 | 0:28:12 | 0:21:48 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338759 |
|
2018-03-30 21:48:07 | 2018-03-31 14:26:27 | 2018-03-31 14:56:26 | 0:29:59 | 0:15:33 | 0:14:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:47:04.859643 mon.b mon.0 172.21.15.82:6789/0 171 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338760 |
|
2018-03-30 21:48:07 | 2018-03-31 14:28:28 | 2018-03-31 15:04:28 | 0:36:00 | 0:20:28 | 0:15:32 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:49:50.914770 mon.b mon.0 172.21.15.13:6789/0 136 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338761 |
|
2018-03-30 21:48:08 | 2018-03-31 14:28:28 | 2018-03-31 15:26:29 | 0:58:01 | 0:39:07 | 0:18:54 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:05:30.400115 mon.a mon.0 172.21.15.59:6789/0 328 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338762 |
|
2018-03-30 21:48:09 | 2018-03-31 14:28:28 | 2018-03-31 14:58:28 | 0:30:00 | 0:10:38 | 0:19:22 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338763 |
|
2018-03-30 21:48:10 | 2018-03-31 14:28:33 | 2018-03-31 16:08:35 | 1:40:02 | 0:44:39 | 0:55:23 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:37:53.692208 mon.b mon.0 172.21.15.63:6789/0 172 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338764 |
|
2018-03-30 21:48:10 | 2018-03-31 14:28:34 | 2018-03-31 16:08:36 | 1:40:02 | 0:58:00 | 0:42:02 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338765 |
|
2018-03-30 21:48:11 | 2018-03-31 14:30:34 | 2018-03-31 16:08:36 | 1:38:02 | 0:09:15 | 1:28:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:05:03.539605 mon.a mon.0 172.21.15.6:6789/0 205 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338766 |
|
2018-03-30 21:48:12 | 2018-03-31 14:30:37 | 2018-03-31 16:36:39 | 2:06:02 | 0:24:20 | 1:41:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 2338767 |
|
2018-03-30 21:48:13 | 2018-03-31 14:32:16 | 2018-03-31 16:06:17 | 1:34:01 | 0:10:32 | 1:23:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:02:34.794432 mon.a mon.0 172.21.15.110:6789/0 204 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338768 |
|
2018-03-30 21:48:13 | 2018-03-31 14:34:16 | 2018-03-31 15:18:16 | 0:44:00 | 0:09:11 | 0:34:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:14:27.245907 mon.a mon.0 172.21.15.2:6789/0 240 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 44 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338769 |
|
2018-03-30 21:48:14 | 2018-03-31 14:34:16 | 2018-03-31 15:56:17 | 1:22:01 | 0:10:25 | 1:11:36 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:51:53.275482 mon.b mon.0 172.21.15.111:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338770 |
|
2018-03-30 21:48:15 | 2018-03-31 14:34:16 | 2018-03-31 15:06:15 | 0:31:59 | 0:08:50 | 0:23:09 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338771 |
|
2018-03-30 21:48:16 | 2018-03-31 14:34:25 | 2018-03-31 18:56:29 | 4:22:04 | 1:10:36 | 3:11:28 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:51:51.645744 mon.b mon.0 172.21.15.152:6789/0 164 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338772 |
|
2018-03-30 21:48:16 | 2018-03-31 14:34:29 | 2018-03-31 15:18:29 | 0:44:00 | 0:31:29 | 0:12:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi061 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338773 |
|
2018-03-30 21:48:17 | 2018-03-31 14:34:32 | 2018-03-31 15:06:31 | 0:31:59 | 0:15:50 | 0:16:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:00:01.053288 mon.a mon.0 172.21.15.49:6789/0 343 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 256 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338774 |
|
2018-03-30 21:48:18 | 2018-03-31 14:36:42 | 2018-03-31 15:12:42 | 0:36:00 | 0:22:45 | 0:13:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 14:55:56.417579 mon.b mon.0 172.21.15.132:6789/0 233 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338775 |
|
2018-03-30 21:48:19 | 2018-03-31 14:36:42 | 2018-03-31 15:38:43 | 1:02:01 | 0:41:51 | 0:20:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:13:39.733264 mon.a mon.0 172.21.15.165:6789/0 205 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338776 |
|
2018-03-30 21:48:19 | 2018-03-31 14:38:19 | 2018-03-31 15:12:19 | 0:34:00 | 0:11:41 | 0:22:19 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:08:16.336174 mon.b mon.0 172.21.15.48:6789/0 312 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338777 |
|
2018-03-30 21:48:20 | 2018-03-31 14:38:27 | 2018-03-31 16:02:28 | 1:24:01 | 0:52:45 | 0:31:16 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:52:01.528775 mon.b mon.0 172.21.15.17:6789/0 214 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 802 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338778 |
|
2018-03-30 21:48:21 | 2018-03-31 14:38:29 | 2018-03-31 15:16:29 | 0:38:00 | 0:21:05 | 0:16:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338779 |
|
2018-03-30 21:48:21 | 2018-03-31 14:40:36 | 2018-03-31 16:18:38 | 1:38:02 | 0:10:21 | 1:27:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:15:19.381357 mon.b mon.0 172.21.15.36:6789/0 171 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338780 |
|
2018-03-30 21:48:22 | 2018-03-31 14:40:36 | 2018-03-31 17:46:40 | 3:06:04 | 0:17:59 | 2:48:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:33:31.108044 mon.b mon.0 172.21.15.35:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338781 |
|
2018-03-30 21:48:23 | 2018-03-31 14:40:36 | 2018-03-31 15:06:36 | 0:26:00 | 0:10:24 | 0:15:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338782 |
|
2018-03-30 21:48:23 | 2018-03-31 14:40:39 | 2018-03-31 15:02:37 | 0:21:58 | 0:09:22 | 0:12:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338783 |
|
2018-03-30 21:48:24 | 2018-03-31 14:42:20 | 2018-03-31 15:28:20 | 0:46:00 | 0:10:28 | 0:35:32 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:23:51.623078 mon.b mon.0 172.21.15.10:6789/0 152 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 135 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338784 |
|
2018-03-30 21:48:25 | 2018-03-31 14:42:26 | 2018-03-31 15:24:26 | 0:42:00 | 0:09:20 | 0:32:40 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338785 |
|
2018-03-30 21:48:26 | 2018-03-31 14:42:34 | 2018-03-31 16:34:36 | 1:52:02 | 1:07:32 | 0:44:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:11:51.646908 mon.b mon.0 172.21.15.78:6789/0 215 : cluster [WRN] Health check failed: 19 slow ops, oldest one blocked for 1703 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338786 |
|
2018-03-30 21:48:26 | 2018-03-31 14:44:44 | 2018-03-31 15:22:44 | 0:38:00 | 0:24:00 | 0:14:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338787 |
|
2018-03-30 21:48:27 | 2018-03-31 14:46:23 | 2018-03-31 15:14:23 | 0:28:00 | 0:14:50 | 0:13:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:05:58.975969 mon.b mon.0 172.21.15.62:6789/0 172 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338788 |
|
2018-03-30 21:48:28 | 2018-03-31 14:46:24 | 2018-03-31 15:20:23 | 0:33:59 | 0:22:39 | 0:11:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 2338789 |
|
2018-03-30 21:48:29 | 2018-03-31 14:46:49 | 2018-03-31 15:46:50 | 1:00:01 | 0:42:46 | 0:17:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:10:06.462902 mon.b mon.0 172.21.15.77:6789/0 177 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338790 |
|
2018-03-30 21:48:29 | 2018-03-31 14:48:27 | 2018-03-31 15:42:27 | 0:54:00 | 0:10:40 | 0:43:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:38:40.317326 mon.a mon.0 172.21.15.101:6789/0 238 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 135 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338791 |
|
2018-03-30 21:48:30 | 2018-03-31 14:48:31 | 2018-03-31 16:18:32 | 1:30:01 | 0:45:16 | 0:44:45 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 16:13:31.858184 mon.a mon.0 172.21.15.154:6789/0 352 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 832 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338792 |
|
2018-03-30 21:48:31 | 2018-03-31 14:48:31 | 2018-03-31 16:46:33 | 1:58:02 | 0:19:55 | 1:38:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338793 |
|
2018-03-30 21:48:31 | 2018-03-31 14:48:34 | 2018-03-31 15:08:33 | 0:19:59 | 0:08:47 | 0:11:12 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:05:22.591638 mon.b mon.0 172.21.15.44:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338794 |
|
2018-03-30 21:48:32 | 2018-03-31 14:50:29 | 2018-03-31 15:54:30 | 1:04:01 | 0:24:45 | 0:39:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2338795 |
|
2018-03-30 21:48:33 | 2018-03-31 14:50:29 | 2018-03-31 15:24:29 | 0:34:00 | 0:10:30 | 0:23:30 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338796 |
|
2018-03-30 21:48:34 | 2018-03-31 14:50:29 | 2018-03-31 15:28:29 | 0:38:00 | 0:09:14 | 0:28:46 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338797 |
|
2018-03-30 21:48:34 | 2018-03-31 14:50:29 | 2018-03-31 15:26:29 | 0:36:00 | 0:09:40 | 0:26:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:23:50.984500 mon.a mon.0 172.21.15.183:6789/0 219 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338798 |
|
2018-03-30 21:48:35 | 2018-03-31 14:52:49 | 2018-03-31 16:04:49 | 1:12:00 | 0:08:35 | 1:03:25 | smithi | master | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338799 |
|
2018-03-30 21:48:36 | 2018-03-31 14:54:24 | 2018-03-31 16:14:25 | 1:20:01 | 1:07:19 | 0:12:42 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:12:23.132586 mon.b mon.0 172.21.15.58:6789/0 181 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338800 |
|
2018-03-30 21:48:37 | 2018-03-31 14:54:26 | 2018-03-31 15:32:26 | 0:38:00 | 0:26:52 | 0:11:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338801 |
|
2018-03-30 21:48:37 | 2018-03-31 14:54:26 | 2018-03-31 15:28:26 | 0:34:00 | 0:14:31 | 0:19:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:22:26.768961 mon.a mon.0 172.21.15.19:6789/0 342 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 231 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338802 |
|
2018-03-30 21:48:38 | 2018-03-31 14:54:28 | 2018-03-31 18:28:33 | 3:34:05 | 0:21:07 | 3:12:58 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:13:41.472025 mon.a mon.0 172.21.15.19:6789/0 165 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 68 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338803 |
|
2018-03-30 21:48:39 | 2018-03-31 14:55:59 | 2018-03-31 16:50:01 | 1:54:02 | 0:40:34 | 1:13:28 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:26:52.854760 mon.a mon.0 172.21.15.37:6789/0 203 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338804 |
|
2018-03-30 21:48:39 | 2018-03-31 14:56:28 | 2018-03-31 15:36:27 | 0:39:59 | 0:12:10 | 0:27:49 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:30:52.403225 mon.a mon.0 172.21.15.38:6789/0 321 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338805 |
|
2018-03-30 21:48:40 | 2018-03-31 14:56:34 | 2018-03-31 15:58:34 | 1:02:00 | 0:46:19 | 0:15:41 | smithi | master | centos | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:29:16.673548 mon.a mon.0 172.21.15.37:6789/0 199 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338806 |
|
2018-03-30 21:48:41 | 2018-03-31 14:57:31 | 2018-03-31 16:09:33 | 1:12:02 | 0:54:19 | 0:17:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:21:34.227928 mon.b mon.0 172.21.15.81:6789/0 149 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338807 |
|
2018-03-30 21:48:42 | 2018-03-31 14:58:27 | 2018-03-31 15:22:27 | 0:24:00 | 0:09:23 | 0:14:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:19:05.122643 mon.a mon.0 172.21.15.101:6789/0 205 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 56 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338808 |
|
2018-03-30 21:48:42 | 2018-03-31 14:58:30 | 2018-03-31 15:52:30 | 0:54:00 | 0:15:23 | 0:38:37 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2338809 |
|
2018-03-30 21:48:43 | 2018-03-31 15:00:32 | 2018-03-31 15:26:31 | 0:25:59 | 0:10:50 | 0:15:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338810 |
|
2018-03-30 21:48:44 | 2018-03-31 15:00:32 | 2018-03-31 15:24:31 | 0:23:59 | 0:10:11 | 0:13:48 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338811 |
|
2018-03-30 21:48:44 | 2018-03-31 15:02:29 | 2018-03-31 17:28:32 | 2:26:03 | 0:10:02 | 2:16:01 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:24:11.031202 mon.a mon.0 172.21.15.118:6789/0 207 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 51 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338812 |
|
2018-03-30 21:48:45 | 2018-03-31 15:02:29 | 2018-03-31 17:00:31 | 1:58:02 | 0:44:16 | 1:13:46 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338813 |
|
2018-03-30 21:48:46 | 2018-03-31 15:02:38 | 2018-03-31 16:10:39 | 1:08:01 | 0:42:07 | 0:25:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:00:18.543881 mon.a mon.0 172.21.15.73:6789/0 251 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 1582 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338814 |
|
2018-03-30 21:48:47 | 2018-03-31 15:04:27 | 2018-03-31 16:18:28 | 1:14:01 | 1:02:32 | 0:11:29 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338815 |
|
2018-03-30 21:48:47 | 2018-03-31 15:04:27 | 2018-03-31 15:26:27 | 0:22:00 | 0:09:49 | 0:12:11 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:21:41.390009 mon.a mon.0 172.21.15.156:6789/0 157 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338816 |
|
2018-03-30 21:48:48 | 2018-03-31 15:04:29 | 2018-03-31 15:34:29 | 0:30:00 | 0:18:42 | 0:11:18 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:27:31.688982 mon.a mon.0 172.21.15.49:6789/0 340 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 443 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338817 |
|
2018-03-30 21:48:49 | 2018-03-31 15:04:29 | 2018-03-31 16:46:31 | 1:42:02 | 0:50:48 | 0:51:14 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2338818 |
|
2018-03-30 21:48:49 | 2018-03-31 15:04:33 | 2018-03-31 16:02:33 | 0:58:00 | 0:10:17 | 0:47:43 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:57:58.267409 mon.a mon.0 172.21.15.20:6789/0 258 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 88 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338819 |
|
2018-03-30 21:48:50 | 2018-03-31 15:06:25 | 2018-03-31 16:08:26 | 1:02:01 | 0:34:25 | 0:27:36 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 16:01:29.171053 mon.b mon.0 172.21.15.4:6789/0 150 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338820 |
|
2018-03-30 21:48:51 | 2018-03-31 15:06:25 | 2018-03-31 17:14:28 | 2:08:03 | 0:37:39 | 1:30:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:05:10.796518 mon.a mon.0 172.21.15.190:6789/0 332 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 1393 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338821 |
|
2018-03-30 21:48:51 | 2018-03-31 15:06:26 | 2018-03-31 15:30:26 | 0:24:00 | 0:09:11 | 0:14:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338822 |
|
2018-03-30 21:48:52 | 2018-03-31 15:06:29 | 2018-03-31 15:58:29 | 0:52:00 | 0:23:35 | 0:28:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:55:10.501937 mon.a mon.0 172.21.15.59:6789/0 203 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 782 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338823 |
|
2018-03-30 21:48:53 | 2018-03-31 15:06:32 | 2018-03-31 15:32:32 | 0:26:00 | 0:09:08 | 0:16:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338824 |
|
2018-03-30 21:48:54 | 2018-03-31 15:06:37 | 2018-03-31 15:36:37 | 0:30:00 | 0:09:17 | 0:20:43 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338825 |
|
2018-03-30 21:48:54 | 2018-03-31 15:08:30 | 2018-03-31 16:16:31 | 1:08:01 | 0:10:43 | 0:57:18 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:11:34.835936 mon.a mon.0 172.21.15.5:6789/0 218 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 55 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338826 |
|
2018-03-30 21:48:55 | 2018-03-31 15:08:30 | 2018-03-31 17:36:33 | 2:28:03 | 0:42:44 | 1:45:19 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:13:32.920277 mon.a mon.0 172.21.15.136:6789/0 347 : cluster [WRN] Health check failed: 17 slow ops, oldest one blocked for 838 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338827 |
|
2018-03-30 21:48:56 | 2018-03-31 15:08:34 | 2018-03-31 15:54:35 | 0:46:01 | 0:34:51 | 0:11:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338828 |
|
2018-03-30 21:48:57 | 2018-03-31 15:10:40 | 2018-03-31 16:44:41 | 1:34:01 | 0:50:39 | 0:43:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi113 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338829 |
|
2018-03-30 21:48:57 | 2018-03-31 15:10:40 | 2018-03-31 16:12:40 | 1:02:00 | 0:11:13 | 0:50:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:07:22.860530 mon.b mon.0 172.21.15.182:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338830 |
|
2018-03-30 21:48:58 | 2018-03-31 15:12:30 | 2018-03-31 15:42:30 | 0:30:00 | 0:20:02 | 0:09:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:28:24.335550 mon.a mon.0 172.21.15.113:6789/0 192 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338831 |
|
2018-03-30 21:48:59 | 2018-03-31 15:12:34 | 2018-03-31 16:42:35 | 1:30:01 | 0:50:10 | 0:39:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:20:35.068820 mon.b mon.0 172.21.15.179:6789/0 143 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 1467 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338832 |
|
2018-03-30 21:49:00 | 2018-03-31 15:12:43 | 2018-03-31 15:52:43 | 0:40:00 | 0:10:40 | 0:29:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:48:12.461340 mon.a mon.0 172.21.15.60:6789/0 259 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 88 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338833 |
|
2018-03-30 21:49:00 | 2018-03-31 15:14:34 | 2018-03-31 16:12:34 | 0:58:00 | 0:32:32 | 0:25:28 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 15:54:03.304794 mon.b mon.0 172.21.15.19:6789/0 149 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338834 |
|
2018-03-30 21:49:01 | 2018-03-31 15:14:34 | 2018-03-31 16:26:35 | 1:12:01 | 0:47:42 | 0:24:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:09:54.969278 mon.b mon.0 172.21.15.80:6789/0 180 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 1553 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338835 |
|
2018-03-30 21:49:02 | 2018-03-31 15:16:33 | 2018-03-31 15:40:33 | 0:24:00 | 0:09:36 | 0:14:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338836 |
|
2018-03-30 21:49:03 | 2018-03-31 15:16:34 | 2018-03-31 16:04:34 | 0:48:00 | 0:28:08 | 0:19:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:42:36.901820 mon.a mon.0 172.21.15.82:6789/0 336 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338837 |
|
2018-03-30 21:49:03 | 2018-03-31 15:18:27 | 2018-03-31 15:42:25 | 0:23:58 | 0:10:02 | 0:13:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:39:35.414970 mon.b mon.0 172.21.15.57:6789/0 139 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 68 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338838 |
|
2018-03-30 21:49:04 | 2018-03-31 15:18:30 | 2018-03-31 15:46:30 | 0:28:00 | 0:09:59 | 0:18:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338839 |
|
2018-03-30 21:49:05 | 2018-03-31 15:20:34 | 2018-03-31 15:42:33 | 0:21:59 | 0:10:14 | 0:11:45 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:38:48.585100 mon.a mon.0 172.21.15.20:6789/0 197 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 83 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338840 |
|
2018-03-30 21:49:05 | 2018-03-31 15:22:00 | 2018-03-31 16:14:00 | 0:52:00 | 0:39:17 | 0:12:43 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:52:43.497582 mon.b mon.0 172.21.15.52:6789/0 168 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338841 |
|
2018-03-30 21:49:06 | 2018-03-31 15:22:17 | 2018-03-31 16:44:18 | 1:22:01 | 0:40:44 | 0:41:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338842 |
|
2018-03-30 21:49:07 | 2018-03-31 15:22:27 | 2018-03-31 16:30:28 | 1:08:01 | 0:44:34 | 0:23:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338843 |
|
2018-03-30 21:49:08 | 2018-03-31 15:22:28 | 2018-03-31 15:44:28 | 0:22:00 | 0:10:36 | 0:11:24 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:38:47.116631 mon.a mon.0 172.21.15.110:6789/0 248 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338844 |
|
2018-03-30 21:49:08 | 2018-03-31 15:22:45 | 2018-03-31 15:52:45 | 0:30:00 | 0:19:04 | 0:10:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:46:55.060742 mon.a mon.0 172.21.15.89:6789/0 352 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338845 |
|
2018-03-30 21:49:09 | 2018-03-31 15:24:32 | 2018-03-31 16:44:32 | 1:20:00 | 0:51:11 | 0:28:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:58:29.179651 mon.b mon.0 172.21.15.26:6789/0 144 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338846 |
|
2018-03-30 21:49:10 | 2018-03-31 15:24:32 | 2018-03-31 16:54:33 | 1:30:01 | 0:09:50 | 1:20:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:50:21.172278 mon.b mon.0 172.21.15.47:6789/0 126 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338847 |
|
2018-03-30 21:49:10 | 2018-03-31 15:24:32 | 2018-03-31 17:48:34 | 2:24:02 | 0:36:48 | 1:47:14 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:25:26.774960 mon.a mon.0 172.21.15.6:6789/0 156 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338848 |
|
2018-03-30 21:49:11 | 2018-03-31 15:24:32 | 2018-03-31 16:40:32 | 1:16:00 | 0:35:10 | 0:40:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338849 |
|
2018-03-30 21:49:12 | 2018-03-31 15:24:33 | 2018-03-31 17:00:34 | 1:36:01 | 0:09:27 | 1:26:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:58:36.943529 mon.b mon.0 172.21.15.109:6789/0 149 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 83 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338850 |
|
2018-03-30 21:49:13 | 2018-03-31 15:26:31 | 2018-03-31 16:04:31 | 0:38:00 | 0:23:29 | 0:14:31 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:47:33.162726 mon.b mon.0 172.21.15.86:6789/0 307 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338851 |
|
2018-03-30 21:49:13 | 2018-03-31 15:26:31 | 2018-03-31 16:00:31 | 0:34:00 | 0:10:17 | 0:23:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338852 |
|
2018-03-30 21:49:14 | 2018-03-31 15:26:31 | 2018-03-31 15:50:30 | 0:23:59 | 0:09:43 | 0:14:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:47:27.938224 mon.b mon.0 172.21.15.97:6789/0 459 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 41 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338853 |
|
2018-03-30 21:49:15 | 2018-03-31 15:26:31 | 2018-03-31 15:52:31 | 0:26:00 | 0:10:16 | 0:15:44 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:49:10.175576 mon.b mon.0 172.21.15.144:6789/0 188 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338854 |
|
2018-03-30 21:49:16 | 2018-03-31 15:26:32 | 2018-03-31 17:22:34 | 1:56:02 | 0:41:13 | 1:14:49 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:10:36.209683 mon.a mon.0 172.21.15.2:6789/0 357 : cluster [WRN] Health check failed: 20 slow ops, oldest one blocked for 1457 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338855 |
|
2018-03-30 21:49:16 | 2018-03-31 15:28:21 | 2018-03-31 17:04:25 | 1:36:04 | 0:46:46 | 0:49:18 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338856 |
|
2018-03-30 21:49:17 | 2018-03-31 15:28:27 | 2018-03-31 17:02:28 | 1:34:01 | 1:08:08 | 0:25:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2338857 |
|
2018-03-30 21:49:18 | 2018-03-31 15:28:27 | 2018-03-31 16:14:27 | 0:46:00 | 0:10:46 | 0:35:14 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2338858 |
|
2018-03-30 21:49:19 | 2018-03-31 15:28:30 | 2018-03-31 16:00:30 | 0:32:00 | 0:18:24 | 0:13:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:47:39.429045 mon.a mon.0 172.21.15.47:6789/0 193 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338859 |
|
2018-03-30 21:49:19 | 2018-03-31 15:28:32 | 2018-03-31 16:38:32 | 1:10:00 | 0:52:59 | 0:17:01 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:51:06.273213 mon.b mon.0 172.21.15.22:6789/0 150 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338860 |
|
2018-03-30 21:49:20 | 2018-03-31 15:30:27 | 2018-03-31 16:12:27 | 0:42:00 | 0:10:21 | 0:31:39 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:08:46.567688 mon.a mon.0 172.21.15.15:6789/0 180 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 80 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338861 |
|
2018-03-30 21:49:21 | 2018-03-31 15:30:32 | 2018-03-31 16:24:32 | 0:54:00 | 0:35:37 | 0:18:23 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 16:13:01.791708 mon.b mon.0 172.21.15.31:6789/0 150 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338862 |
|
2018-03-30 21:49:21 | 2018-03-31 15:32:37 | 2018-03-31 16:40:38 | 1:08:01 | 0:37:27 | 0:30:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338863 |
|
2018-03-30 21:49:22 | 2018-03-31 15:32:37 | 2018-03-31 16:26:42 | 0:54:05 | 0:08:27 | 0:45:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:23:19.827400 mon.b mon.0 172.21.15.4:6789/0 135 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338864 |
|
2018-03-30 21:49:23 | 2018-03-31 15:33:11 | 2018-03-31 16:21:11 | 0:48:00 | 0:28:52 | 0:19:08 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:14:50.739579 mon.b mon.0 172.21.15.163:6789/0 183 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338865 |
|
2018-03-30 21:49:23 | 2018-03-31 15:34:40 | 2018-03-31 16:00:39 | 0:25:59 | 0:09:43 | 0:16:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338866 |
|
2018-03-30 21:49:24 | 2018-03-31 15:34:40 | 2018-03-31 15:56:39 | 0:21:59 | 0:09:33 | 0:12:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 15:52:37.755815 mon.a mon.0 172.21.15.150:6789/0 491 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338867 |
|
2018-03-30 21:49:25 | 2018-03-31 15:36:38 | 2018-03-31 16:12:38 | 0:36:00 | 0:10:09 | 0:25:51 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:08:24.028272 mon.a mon.0 172.21.15.172:6789/0 215 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 69 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338868 |
|
2018-03-30 21:49:26 | 2018-03-31 15:36:39 | 2018-03-31 17:02:40 | 1:26:01 | 0:41:32 | 0:44:29 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:38:39.326691 mon.a mon.0 172.21.15.60:6789/0 200 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338869 |
|
2018-03-30 21:49:26 | 2018-03-31 15:36:38 | 2018-03-31 17:20:40 | 1:44:02 | 0:46:24 | 0:57:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338870 |
|
2018-03-30 21:49:27 | 2018-03-31 15:38:52 | 2018-03-31 16:56:53 | 1:18:01 | 1:00:24 | 0:17:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi152 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338871 |
|
2018-03-30 21:49:28 | 2018-03-31 15:40:34 | 2018-03-31 16:36:35 | 0:56:01 | 0:09:54 | 0:46:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:32:06.201527 mon.b mon.0 172.21.15.35:6789/0 138 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338872 |
|
2018-03-30 21:49:28 | 2018-03-31 15:42:36 | 2018-03-31 16:48:36 | 1:06:00 | 0:18:59 | 0:47:01 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:41:52.308681 mon.a mon.0 172.21.15.101:6789/0 219 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 464 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338873 |
|
2018-03-30 21:49:29 | 2018-03-31 15:42:36 | 2018-03-31 16:54:36 | 1:12:00 | 0:49:05 | 0:22:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| pass | 2338874 |
|
2018-03-30 21:49:30 | 2018-03-31 15:42:36 | 2018-03-31 16:10:36 | 0:28:00 | 0:10:03 | 0:17:57 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338875 |
|
2018-03-30 21:49:31 | 2018-03-31 15:42:36 | 2018-03-31 17:06:37 | 1:24:01 | 0:37:11 | 0:46:50 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 16:43:27.571510 mon.a mon.0 172.21.15.51:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338876 |
|
2018-03-30 21:49:31 | 2018-03-31 15:42:36 | 2018-03-31 16:52:37 | 1:10:01 | 0:52:52 | 0:17:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338877 |
|
2018-03-30 21:49:32 | 2018-03-31 15:44:27 | 2018-03-31 16:28:27 | 0:44:00 | 0:09:01 | 0:34:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:25:32.792875 mon.b mon.0 172.21.15.63:6789/0 144 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338878 |
|
2018-03-30 21:49:33 | 2018-03-31 15:44:27 | 2018-03-31 17:18:28 | 1:34:01 | 0:21:05 | 1:12:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:03:09.090727 mon.b mon.0 172.21.15.50:6789/0 168 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338879 |
|
2018-03-30 21:49:33 | 2018-03-31 15:44:29 | 2018-03-31 16:36:29 | 0:52:00 | 0:09:10 | 0:42:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338880 |
|
2018-03-30 21:49:34 | 2018-03-31 15:46:41 | 2018-03-31 16:32:41 | 0:46:00 | 0:09:51 | 0:36:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338881 |
|
2018-03-30 21:49:35 | 2018-03-31 15:46:41 | 2018-03-31 16:40:41 | 0:54:00 | 0:10:05 | 0:43:55 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:35:52.678776 mon.b mon.0 172.21.15.36:6789/0 285 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338882 |
|
2018-03-30 21:49:36 | 2018-03-31 15:46:41 | 2018-03-31 16:34:41 | 0:48:00 | 0:09:49 | 0:38:11 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:31:40.564521 mon.a mon.0 172.21.15.5:6789/0 211 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 58 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338883 |
|
2018-03-30 21:49:36 | 2018-03-31 15:46:51 | 2018-03-31 17:10:52 | 1:24:01 | 0:58:11 | 0:25:50 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi170 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338884 |
|
2018-03-30 21:49:37 | 2018-03-31 15:50:42 | 2018-03-31 17:10:43 | 1:20:01 | 1:08:12 | 0:11:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338885 |
|
2018-03-30 21:49:38 | 2018-03-31 15:50:43 | 2018-03-31 17:04:43 | 1:14:00 | 0:13:50 | 1:00:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:59:13.207812 mon.a mon.0 172.21.15.5:6789/0 178 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338886 |
|
2018-03-30 21:49:38 | 2018-03-31 15:50:43 | 2018-03-31 17:18:44 | 1:28:01 | 0:30:37 | 0:57:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:07:49.046976 mon.a mon.0 172.21.15.23:6789/0 222 : cluster [WRN] Health check failed: 16 slow ops, oldest one blocked for 896 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338887 |
|
2018-03-30 21:49:39 | 2018-03-31 15:52:43 | 2018-03-31 16:58:43 | 1:06:00 | 0:41:48 | 0:24:12 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:23:21.284209 mon.a mon.0 172.21.15.6:6789/0 267 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338888 |
|
2018-03-30 21:49:40 | 2018-03-31 15:52:43 | 2018-03-31 16:18:42 | 0:25:59 | 0:09:48 | 0:16:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338889 |
|
2018-03-30 21:49:41 | 2018-03-31 15:52:43 | 2018-03-31 16:52:43 | 1:00:00 | 0:43:22 | 0:16:38 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 16:33:47.176787 mon.b mon.0 172.21.15.94:6789/0 149 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338890 |
|
2018-03-30 21:49:41 | 2018-03-31 15:52:45 | 2018-03-31 16:24:44 | 0:31:59 | 0:20:23 | 0:11:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:10:56.263045 mon.a mon.0 172.21.15.8:6789/0 308 : cluster [WRN] Health check failed: 16930 slow ops, oldest one blocked for 72 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338891 |
|
2018-03-30 21:49:42 | 2018-03-31 15:52:47 | 2018-03-31 17:02:47 | 1:10:00 | 0:09:08 | 1:00:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338892 |
|
2018-03-30 21:49:43 | 2018-03-31 15:54:28 | 2018-03-31 17:16:29 | 1:22:01 | 0:17:42 | 1:04:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:12:11.016618 mon.a mon.0 172.21.15.169:6789/0 184 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 492 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338893 |
|
2018-03-30 21:49:43 | 2018-03-31 15:54:28 | 2018-03-31 16:20:27 | 0:25:59 | 0:09:59 | 0:16:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:16:30.801227 mon.a mon.0 172.21.15.101:6789/0 262 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 126 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338894 |
|
2018-03-30 21:49:44 | 2018-03-31 15:54:31 | 2018-03-31 16:40:31 | 0:46:00 | 0:09:04 | 0:36:56 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338895 |
|
2018-03-30 21:49:45 | 2018-03-31 15:54:36 | 2018-03-31 16:50:36 | 0:56:00 | 0:10:23 | 0:45:37 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:47:14.152168 mon.b mon.0 172.21.15.56:6789/0 265 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338896 |
|
2018-03-30 21:49:46 | 2018-03-31 15:56:26 | 2018-03-31 16:28:26 | 0:32:00 | 0:10:04 | 0:21:56 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
| fail | 2338897 |
|
2018-03-30 21:49:46 | 2018-03-31 15:56:26 | 2018-03-31 17:06:28 | 1:10:02 | 0:57:42 | 0:12:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi142 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338898 |
|
2018-03-30 21:49:47 | 2018-03-31 15:56:27 | 2018-03-31 18:28:30 | 2:32:03 | 0:28:05 | 2:03:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi202 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338899 |
|
2018-03-30 21:49:48 | 2018-03-31 15:56:31 | 2018-03-31 16:54:32 | 0:58:01 | 0:14:17 | 0:43:44 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:45:04.290124 mon.b mon.0 172.21.15.63:6789/0 234 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338900 |
|
2018-03-30 21:49:48 | 2018-03-31 15:58:31 | 2018-03-31 16:42:31 | 0:44:00 | 0:29:08 | 0:14:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:19:23.488915 mon.b mon.0 172.21.15.71:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338901 |
|
2018-03-30 21:49:49 | 2018-03-31 15:58:35 | 2018-03-31 16:48:36 | 0:50:01 | 0:38:18 | 0:11:43 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2338902 |
|
2018-03-30 21:49:50 | 2018-03-31 16:00:27 | 2018-03-31 16:22:26 | 0:21:59 | 0:09:32 | 0:12:27 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:19:02.941454 mon.b mon.0 172.21.15.33:6789/0 239 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338903 |
|
2018-03-30 21:49:51 | 2018-03-31 16:00:32 | 2018-03-31 17:14:32 | 1:14:00 | 0:44:33 | 0:29:27 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:10:09.180074 mon.a mon.0 172.21.15.95:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338904 |
|
2018-03-30 21:49:51 | 2018-03-31 16:00:32 | 2018-03-31 17:12:33 | 1:12:01 | 0:59:16 | 0:12:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338905 |
|
2018-03-30 21:49:52 | 2018-03-31 16:00:36 | 2018-03-31 16:28:36 | 0:28:00 | 0:08:56 | 0:19:04 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:25:20.978540 mon.a mon.0 172.21.15.73:6789/0 254 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338906 |
|
2018-03-30 21:49:53 | 2018-03-31 16:00:41 | 2018-03-31 17:44:42 | 1:44:01 | 0:47:34 | 0:56:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:13:44.628624 mon.a mon.0 172.21.15.101:6789/0 463 : cluster [ERR] Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED)" in cluster log |
||||||||||||||
| pass | 2338907 |
|
2018-03-30 21:49:53 | 2018-03-31 16:02:34 | 2018-03-31 17:34:36 | 1:32:02 | 0:10:11 | 1:21:51 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338908 |
|
2018-03-30 21:49:54 | 2018-03-31 16:02:35 | 2018-03-31 17:00:35 | 0:58:00 | 0:09:35 | 0:48:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338909 |
|
2018-03-30 21:49:55 | 2018-03-31 16:02:35 | 2018-03-31 16:32:35 | 0:30:00 | 0:09:26 | 0:20:34 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:28:07.131510 mon.b mon.0 172.21.15.56:6789/0 236 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338910 |
|
2018-03-30 21:49:56 | 2018-03-31 16:04:42 | 2018-03-31 16:46:42 | 0:42:00 | 0:09:09 | 0:32:51 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:43:32.023572 mon.a mon.0 172.21.15.73:6789/0 206 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 51 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338911 |
|
2018-03-30 21:49:56 | 2018-03-31 16:04:42 | 2018-03-31 17:58:44 | 1:54:02 | 0:58:27 | 0:55:35 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi008 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338912 |
|
2018-03-30 21:49:57 | 2018-03-31 16:04:51 | 2018-03-31 16:52:51 | 0:48:00 | 0:30:58 | 0:17:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338913 |
|
2018-03-30 21:49:58 | 2018-03-31 16:06:25 | 2018-03-31 17:08:26 | 1:02:01 | 0:14:07 | 0:47:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:59:48.198174 mon.b mon.0 172.21.15.49:6789/0 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338914 |
|
2018-03-30 21:49:59 | 2018-03-31 16:08:38 | 2018-03-31 17:12:39 | 1:04:01 | 0:26:06 | 0:37:55 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:02:29.145130 mon.a mon.0 172.21.15.68:6789/0 345 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338915 |
|
2018-03-30 21:49:59 | 2018-03-31 16:08:38 | 2018-03-31 17:00:39 | 0:52:01 | 0:38:56 | 0:13:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:26:58.621113 mon.a mon.0 172.21.15.175:6789/0 248 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338916 |
|
2018-03-30 21:50:00 | 2018-03-31 16:08:38 | 2018-03-31 17:56:41 | 1:48:03 | 0:11:10 | 1:36:53 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:51:02.997859 mon.a mon.0 172.21.15.51:6789/0 157 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 55 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338917 |
|
2018-03-30 21:50:01 | 2018-03-31 16:08:38 | 2018-03-31 17:48:41 | 1:40:03 | 0:50:44 | 0:49:19 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:13:36.654397 mon.b mon.0 172.21.15.26:6789/0 243 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338918 |
|
2018-03-30 21:50:01 | 2018-03-31 16:09:34 | 2018-03-31 16:51:34 | 0:42:00 | 0:19:53 | 0:22:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:45:54.919811 mon.a mon.0 172.21.15.154:6789/0 205 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 551 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338919 |
|
2018-03-30 21:50:02 | 2018-03-31 16:10:48 | 2018-03-31 16:32:47 | 0:21:59 | 0:09:05 | 0:12:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:28:43.521650 mon.b mon.0 172.21.15.52:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338920 |
|
2018-03-30 21:50:03 | 2018-03-31 16:10:48 | 2018-03-31 16:40:47 | 0:29:59 | 0:18:26 | 0:11:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:28:44.954279 mon.b mon.0 172.21.15.24:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338921 |
|
2018-03-30 21:50:03 | 2018-03-31 16:12:35 | 2018-03-31 16:40:34 | 0:27:59 | 0:10:31 | 0:17:28 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:36:35.582044 mon.b mon.0 172.21.15.57:6789/0 142 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338922 |
|
2018-03-30 21:50:04 | 2018-03-31 16:12:35 | 2018-03-31 16:58:36 | 0:46:01 | 0:09:37 | 0:36:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338923 |
|
2018-03-30 21:50:05 | 2018-03-31 16:12:39 | 2018-03-31 17:30:40 | 1:18:01 | 0:09:25 | 1:08:36 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:27:45.618069 mon.b mon.0 172.21.15.47:6789/0 277 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 43 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338924 |
|
2018-03-30 21:50:06 | 2018-03-31 16:12:41 | 2018-03-31 16:32:41 | 0:20:00 | 0:09:37 | 0:10:23 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:30:16.090022 mon.a mon.0 172.21.15.3:6789/0 322 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 42 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338925 |
|
2018-03-30 21:50:06 | 2018-03-31 16:14:09 | 2018-03-31 18:14:12 | 2:00:03 | 0:58:30 | 1:01:33 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi133 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338926 |
|
2018-03-30 21:50:07 | 2018-03-31 16:14:26 | 2018-03-31 17:10:27 | 0:56:01 | 0:28:54 | 0:27:07 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338927 |
|
2018-03-30 21:50:08 | 2018-03-31 16:14:28 | 2018-03-31 16:50:28 | 0:36:00 | 0:14:15 | 0:21:45 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:40:53.443805 mon.a mon.0 172.21.15.80:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338928 |
|
2018-03-30 21:50:08 | 2018-03-31 16:16:40 | 2018-03-31 17:20:40 | 1:04:00 | 0:23:35 | 0:40:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:10:33.385701 mon.a mon.0 172.21.15.73:6789/0 209 : cluster [WRN] Health check failed: 18 slow ops, oldest one blocked for 537 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338929 |
|
2018-03-30 21:50:09 | 2018-03-31 16:16:40 | 2018-03-31 18:28:42 | 2:12:02 | 0:42:36 | 1:29:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:04:29.230193 mon.a mon.0 172.21.15.136:6789/0 277 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338930 |
|
2018-03-30 21:50:10 | 2018-03-31 16:16:40 | 2018-03-31 18:32:42 | 2:16:02 | 0:09:52 | 2:06:10 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:27:55.442497 mon.a mon.0 172.21.15.20:6789/0 159 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338931 |
|
2018-03-30 21:50:11 | 2018-03-31 16:18:39 | 2018-03-31 17:42:40 | 1:24:01 | 0:49:07 | 0:34:54 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:13:43.940270 mon.b mon.0 172.21.15.36:6789/0 248 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338932 |
|
2018-03-30 21:50:11 | 2018-03-31 16:18:39 | 2018-03-31 17:22:40 | 1:04:01 | 0:19:29 | 0:44:32 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2338933 |
|
2018-03-30 21:50:12 | 2018-03-31 16:18:39 | 2018-03-31 17:00:39 | 0:42:00 | 0:08:18 | 0:33:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2338934 |
|
2018-03-30 21:50:13 | 2018-03-31 16:18:43 | 2018-03-31 17:00:43 | 0:42:00 | 0:25:24 | 0:16:36 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:41:11.914897 mon.b mon.0 172.21.15.4:6789/0 180 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338935 |
|
2018-03-30 21:50:13 | 2018-03-31 16:20:38 | 2018-03-31 16:46:38 | 0:26:00 | 0:09:40 | 0:16:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2338936 |
|
2018-03-30 21:50:14 | 2018-03-31 16:21:13 | 2018-03-31 16:45:12 | 0:23:59 | 0:09:46 | 0:14:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2338937 |
|
2018-03-30 21:50:15 | 2018-03-31 16:22:37 | 2018-03-31 17:00:38 | 0:38:01 | 0:09:50 | 0:28:11 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:58:14.837464 mon.a mon.0 172.21.15.24:6789/0 192 : cluster [WRN] Health check failed: 15 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338938 |
|
2018-03-30 21:50:16 | 2018-03-31 16:22:37 | 2018-03-31 17:00:38 | 0:38:01 | 0:09:58 | 0:28:03 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:56:30.280429 mon.a mon.0 172.21.15.88:6789/0 204 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 36 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338939 |
|
2018-03-30 21:50:16 | 2018-03-31 16:24:42 | 2018-03-31 18:00:43 | 1:36:01 | 1:01:50 | 0:34:11 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test kernel_untar_build.sh) on smithi011 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' |
||||||||||||||
| fail | 2338940 |
|
2018-03-30 21:50:17 | 2018-03-31 16:24:46 | 2018-03-31 17:56:47 | 1:32:01 | 0:27:37 | 1:04:24 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338941 |
|
2018-03-30 21:50:18 | 2018-03-31 16:26:42 | 2018-03-31 18:50:45 | 2:24:03 | 0:13:32 | 2:10:31 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:42:57.250939 mon.a mon.0 172.21.15.19:6789/0 159 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338942 |
|
2018-03-30 21:50:18 | 2018-03-31 16:26:42 | 2018-03-31 19:14:46 | 2:48:04 | 0:30:14 | 2:17:50 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 19:01:38.472977 mon.b mon.0 172.21.15.26:6789/0 208 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338943 |
|
2018-03-30 21:50:19 | 2018-03-31 16:26:43 | 2018-03-31 17:16:44 | 0:50:01 | 0:38:41 | 0:11:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:56:19.175635 mon.a mon.0 172.21.15.20:6789/0 166 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 747 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338944 |
|
2018-03-30 21:50:20 | 2018-03-31 16:28:36 | 2018-03-31 16:50:35 | 0:21:59 | 0:10:49 | 0:11:10 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338945 |
|
2018-03-30 21:50:20 | 2018-03-31 16:28:36 | 2018-03-31 17:40:37 | 1:12:01 | 0:47:24 | 0:24:37 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:11:53.224573 mon.b mon.0 172.21.15.104:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338946 |
|
2018-03-30 21:50:21 | 2018-03-31 16:28:37 | 2018-03-31 17:40:38 | 1:12:01 | 0:57:42 | 0:14:19 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:49:25.536659 mon.b mon.0 172.21.15.78:6789/0 179 : cluster [WRN] Health check failed: 25362 slow ops, oldest one blocked for 79 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338947 |
|
2018-03-30 21:50:22 | 2018-03-31 16:30:38 | 2018-03-31 16:50:38 | 0:20:00 | 0:09:30 | 0:10:30 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:47:22.437150 mon.a mon.0 172.21.15.19:6789/0 160 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 52 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338948 |
|
2018-03-30 21:50:22 | 2018-03-31 16:30:42 | 2018-03-31 17:32:42 | 1:02:00 | 0:16:07 | 0:45:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:27:59.945723 mon.a mon.0 172.21.15.51:6789/0 202 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338949 |
|
2018-03-30 21:50:23 | 2018-03-31 16:32:45 | 2018-03-31 17:06:45 | 0:34:00 | 0:10:19 | 0:23:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338950 |
|
2018-03-30 21:50:24 | 2018-03-31 16:32:45 | 2018-03-31 16:54:44 | 0:21:59 | 0:09:46 | 0:12:13 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:51:32.786204 mon.a mon.0 172.21.15.58:6789/0 313 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338951 |
|
2018-03-30 21:50:24 | 2018-03-31 16:32:45 | 2018-03-31 17:08:45 | 0:36:00 | 0:11:18 | 0:24:42 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:02:40.194440 mon.a mon.0 172.21.15.131:6789/0 189 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 45 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338952 |
|
2018-03-30 21:50:25 | 2018-03-31 16:32:48 | 2018-03-31 17:32:48 | 1:00:00 | 0:50:04 | 0:09:56 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:02:45.323861 mon.a mon.0 172.21.15.3:6789/0 213 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 878 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338953 |
|
2018-03-30 21:50:26 | 2018-03-31 16:34:43 | 2018-03-31 18:32:45 | 1:58:02 | 1:12:59 | 0:45:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:25:59.610101 mon.a mon.0 172.21.15.172:6789/0 246 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 73 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338954 |
|
2018-03-30 21:50:26 | 2018-03-31 16:34:43 | 2018-03-31 18:58:46 | 2:24:03 | 1:34:05 | 0:49:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi151 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2338955 |
|
2018-03-30 21:50:27 | 2018-03-31 16:36:40 | 2018-03-31 17:18:40 | 0:42:00 | 0:10:13 | 0:31:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2338956 |
|
2018-03-30 21:50:28 | 2018-03-31 16:36:40 | 2018-03-31 17:10:40 | 0:34:00 | 0:18:11 | 0:15:49 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:04:07.593867 mon.b mon.0 172.21.15.57:6789/0 182 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338957 |
|
2018-03-30 21:50:28 | 2018-03-31 16:36:42 | 2018-03-31 18:32:43 | 1:56:01 | 0:51:32 | 1:04:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2338958 |
|
2018-03-30 21:50:29 | 2018-03-31 16:38:44 | 2018-03-31 17:10:44 | 0:32:00 | 0:09:55 | 0:22:05 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:07:43.610552 mon.a mon.0 172.21.15.56:6789/0 182 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 108 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338959 |
|
2018-03-30 21:50:30 | 2018-03-31 16:40:47 | 2018-03-31 17:44:47 | 1:04:00 | 0:41:16 | 0:22:44 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:17:57.053736 mon.a mon.0 172.21.15.38:6789/0 248 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338960 |
|
2018-03-30 21:50:30 | 2018-03-31 16:40:47 | 2018-03-31 17:38:47 | 0:58:00 | 0:37:56 | 0:20:04 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338961 |
|
2018-03-30 21:50:31 | 2018-03-31 16:40:47 | 2018-03-31 17:06:47 | 0:26:00 | 0:09:19 | 0:16:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:03:44.309086 mon.b mon.0 172.21.15.161:6789/0 139 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338962 |
|
2018-03-30 21:50:32 | 2018-03-31 16:40:47 | 2018-03-31 17:26:47 | 0:46:00 | 0:24:01 | 0:21:59 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:08:20.806604 mon.b mon.0 172.21.15.97:6789/0 307 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338963 |
|
2018-03-30 21:50:32 | 2018-03-31 16:40:47 | 2018-03-31 17:10:47 | 0:30:00 | 0:09:06 | 0:20:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:06:14.289573 mon.b mon.0 172.21.15.94:6789/0 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338964 |
|
2018-03-30 21:50:33 | 2018-03-31 16:40:48 | 2018-03-31 17:22:48 | 0:42:00 | 0:09:33 | 0:32:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:18:04.893860 mon.b mon.0 172.21.15.27:6789/0 455 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338965 |
|
2018-03-30 21:50:34 | 2018-03-31 16:42:37 | 2018-03-31 17:14:36 | 0:31:59 | 0:11:42 | 0:20:17 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:12:03.558040 mon.a mon.0 172.21.15.44:6789/0 247 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 191 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338966 |
|
2018-03-30 21:50:35 | 2018-03-31 16:42:37 | 2018-03-31 18:42:39 | 2:00:02 | 0:50:14 | 1:09:48 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:57:48.292278 mon.b mon.0 172.21.15.104:6789/0 171 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338967 |
|
2018-03-30 21:50:35 | 2018-03-31 16:42:37 | 2018-03-31 17:52:37 | 1:10:00 | 0:36:40 | 0:33:20 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338968 |
|
2018-03-30 21:50:36 | 2018-03-31 16:44:28 | 2018-03-31 19:20:31 | 2:36:03 | 1:07:01 | 1:29:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338969 |
|
2018-03-30 21:50:37 | 2018-03-31 16:44:34 | 2018-03-31 17:18:33 | 0:33:59 | 0:10:44 | 0:23:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:13:56.627283 mon.b mon.0 172.21.15.45:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338970 |
|
2018-03-30 21:50:37 | 2018-03-31 16:44:34 | 2018-03-31 17:20:34 | 0:36:00 | 0:17:50 | 0:18:10 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:14:49.153735 mon.b mon.0 172.21.15.150:6789/0 183 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 367 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338971 |
|
2018-03-30 21:50:38 | 2018-03-31 16:44:42 | 2018-03-31 18:12:43 | 1:28:01 | 0:47:34 | 0:40:27 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| pass | 2338972 |
|
2018-03-30 21:50:39 | 2018-03-31 16:45:13 | 2018-03-31 17:21:13 | 0:36:00 | 0:10:09 | 0:25:51 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338973 |
|
2018-03-30 21:50:39 | 2018-03-31 16:46:41 | 2018-03-31 17:58:42 | 1:12:01 | 0:41:25 | 0:30:36 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:46:33.270153 mon.b mon.0 172.21.15.16:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338974 |
|
2018-03-30 21:50:40 | 2018-03-31 16:46:41 | 2018-03-31 18:00:42 | 1:14:01 | 0:49:36 | 0:24:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:42:59.593258 mon.a mon.0 172.21.15.110:6789/0 335 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 1584 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338975 |
|
2018-03-30 21:50:41 | 2018-03-31 16:46:41 | 2018-03-31 17:14:41 | 0:28:00 | 0:08:47 | 0:19:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| pass | 2338976 |
|
2018-03-30 21:50:41 | 2018-03-31 16:46:43 | 2018-03-31 17:50:44 | 1:04:01 | 0:28:36 | 0:35:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| pass | 2338977 |
|
2018-03-30 21:50:42 | 2018-03-31 16:48:41 | 2018-03-31 17:14:41 | 0:26:00 | 0:09:24 | 0:16:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2338978 |
|
2018-03-30 21:50:43 | 2018-03-31 16:48:41 | 2018-03-31 17:12:41 | 0:24:00 | 0:10:02 | 0:13:58 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:09:45.578597 mon.b mon.0 172.21.15.47:6789/0 274 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338979 |
|
2018-03-30 21:50:44 | 2018-03-31 16:50:12 | 2018-03-31 17:20:12 | 0:30:00 | 0:10:32 | 0:19:28 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:17:26.108660 mon.b mon.0 172.21.15.74:6789/0 322 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 113 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338980 |
|
2018-03-30 21:50:44 | 2018-03-31 16:50:30 | 2018-03-31 18:16:31 | 1:26:01 | 0:47:21 | 0:38:40 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:35:11.225187 mon.b mon.0 172.21.15.71:6789/0 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338981 |
|
2018-03-30 21:50:45 | 2018-03-31 16:50:37 | 2018-03-31 17:56:37 | 1:06:00 | 0:46:05 | 0:19:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2338982 |
|
2018-03-30 21:50:46 | 2018-03-31 16:50:38 | 2018-03-31 18:22:39 | 1:32:01 | 1:20:34 | 0:11:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338983 |
|
2018-03-30 21:50:46 | 2018-03-31 16:50:39 | 2018-03-31 17:30:39 | 0:40:00 | 0:10:14 | 0:29:46 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:26:53.562698 mon.a mon.0 172.21.15.162:6789/0 155 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 67 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338984 |
|
2018-03-30 21:50:47 | 2018-03-31 16:51:36 | 2018-03-31 17:43:36 | 0:52:00 | 0:19:26 | 0:32:34 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:31:03.856486 mon.b mon.0 172.21.15.169:6789/0 300 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338985 |
|
2018-03-30 21:50:48 | 2018-03-31 16:52:48 | 2018-03-31 18:00:48 | 1:08:00 | 0:50:04 | 0:17:56 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2338986 |
|
2018-03-30 21:50:49 | 2018-03-31 16:52:48 | 2018-03-31 17:18:47 | 0:25:59 | 0:10:40 | 0:15:19 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:14:11.258430 mon.b mon.0 172.21.15.166:6789/0 206 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338987 |
|
2018-03-30 21:50:49 | 2018-03-31 16:52:52 | 2018-03-31 17:54:53 | 1:02:01 | 0:40:30 | 0:21:31 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 17:45:01.348301 mon.a mon.0 172.21.15.60:6789/0 264 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2338988 |
|
2018-03-30 21:50:50 | 2018-03-31 16:54:42 | 2018-03-31 17:52:42 | 0:58:00 | 0:35:08 | 0:22:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| fail | 2338989 |
|
2018-03-30 21:50:51 | 2018-03-31 16:54:42 | 2018-03-31 17:26:42 | 0:32:00 | 0:09:14 | 0:22:46 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:23:15.773957 mon.b mon.0 172.21.15.70:6789/0 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338990 |
|
2018-03-30 21:50:51 | 2018-03-31 16:54:42 | 2018-03-31 17:42:42 | 0:48:00 | 0:24:14 | 0:23:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:26:38.282368 mon.b mon.0 172.21.15.94:6789/0 181 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 57 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338991 |
|
2018-03-30 21:50:52 | 2018-03-31 16:54:46 | 2018-03-31 18:46:47 | 1:52:01 | 0:09:21 | 1:42:40 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:42:34.916697 mon.a mon.0 172.21.15.109:6789/0 246 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338992 |
|
2018-03-30 21:50:53 | 2018-03-31 16:56:55 | 2018-03-31 18:46:57 | 1:50:02 | 0:10:25 | 1:39:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:42:04.059343 mon.b mon.0 172.21.15.50:6789/0 284 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338993 |
|
2018-03-30 21:50:54 | 2018-03-31 16:58:37 | 2018-03-31 18:26:38 | 1:28:01 | 0:10:52 | 1:17:09 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:20:51.780415 mon.a mon.0 172.21.15.56:6789/0 299 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338994 |
|
2018-03-30 21:50:54 | 2018-03-31 16:58:44 | 2018-03-31 18:00:45 | 1:02:01 | 0:50:55 | 0:11:06 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:15:14.331079 mon.b mon.0 172.21.15.69:6789/0 162 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338995 |
|
2018-03-30 21:50:55 | 2018-03-31 17:00:40 | 2018-03-31 18:14:41 | 1:14:01 | 0:55:48 | 0:18:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:03:05.642636 mon.b mon.0 172.21.15.17:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338996 |
|
2018-03-30 21:50:56 | 2018-03-31 17:00:41 | 2018-03-31 18:38:42 | 1:38:01 | 0:58:39 | 0:39:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2338997 |
|
2018-03-30 21:50:56 | 2018-03-31 17:00:41 | 2018-03-31 17:30:40 | 0:29:59 | 0:11:43 | 0:18:16 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:26:17.746728 mon.a mon.0 172.21.15.57:6789/0 260 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338998 |
|
2018-03-30 21:50:57 | 2018-03-31 17:00:40 | 2018-03-31 17:44:41 | 0:44:01 | 0:20:02 | 0:23:59 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:37:35.422407 mon.a mon.0 172.21.15.95:6789/0 345 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 507 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2338999 |
|
2018-03-30 21:50:58 | 2018-03-31 17:00:41 | 2018-03-31 18:16:42 | 1:16:01 | 0:51:36 | 0:24:25 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:54:08.100878 mon.a mon.0 172.21.15.44:6789/0 259 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 1468 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339000 |
|
2018-03-30 21:50:58 | 2018-03-31 17:00:41 | 2018-03-31 17:40:41 | 0:40:00 | 0:10:11 | 0:29:49 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:35:03.945741 mon.b mon.0 172.21.15.31:6789/0 182 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339001 |
|
2018-03-30 21:50:59 | 2018-03-31 17:00:41 | 2018-03-31 18:46:42 | 1:46:01 | 0:39:54 | 1:06:07 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 18:22:35.541737 mon.a mon.0 172.21.15.24:6789/0 153 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339002 |
|
2018-03-30 21:51:00 | 2018-03-31 17:00:44 | 2018-03-31 18:12:45 | 1:12:01 | 0:37:20 | 0:34:41 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:04:54.394110 mon.b mon.0 172.21.15.70:6789/0 185 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339003 |
|
2018-03-30 21:51:01 | 2018-03-31 17:02:41 | 2018-03-31 17:44:41 | 0:42:00 | 0:09:05 | 0:32:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2339004 |
|
2018-03-30 21:51:01 | 2018-03-31 17:02:41 | 2018-03-31 18:32:43 | 1:30:02 | 0:29:37 | 1:00:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:24:56.315477 mon.b mon.0 172.21.15.49:6789/0 189 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 854 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339005 |
|
2018-03-30 21:51:02 | 2018-03-31 17:02:50 | 2018-03-31 17:24:49 | 0:21:59 | 0:09:42 | 0:12:17 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:21:04.978823 mon.a mon.0 172.21.15.59:6789/0 152 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339006 |
|
2018-03-30 21:51:03 | 2018-03-31 17:04:35 | 2018-03-31 17:48:35 | 0:44:00 | 0:09:45 | 0:34:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:45:50.582820 mon.a mon.0 172.21.15.24:6789/0 504 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339007 |
|
2018-03-30 21:51:03 | 2018-03-31 17:04:44 | 2018-03-31 17:28:44 | 0:24:00 | 0:10:53 | 0:13:07 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:23:18.337850 mon.a mon.0 172.21.15.24:6789/0 191 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 53 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339008 |
|
2018-03-30 21:51:04 | 2018-03-31 17:06:38 | 2018-03-31 18:20:39 | 1:14:01 | 0:48:13 | 0:25:48 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:51:43.356900 mon.a mon.0 172.21.15.15:6789/0 211 : cluster [WRN] Health check failed: 17 slow ops, oldest one blocked for 887 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339009 |
|
2018-03-30 21:51:05 | 2018-03-31 17:06:38 | 2018-03-31 18:26:39 | 1:20:01 | 0:59:54 | 0:20:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:31:41.956649 mon.b mon.0 172.21.15.50:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339010 |
|
2018-03-30 21:51:05 | 2018-03-31 17:06:46 | 2018-03-31 18:30:47 | 1:24:01 | 1:01:23 | 0:22:38 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2339011 |
|
2018-03-30 21:51:06 | 2018-03-31 17:06:49 | 2018-03-31 17:30:49 | 0:24:00 | 0:09:50 | 0:14:10 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:27:13.856138 mon.b mon.0 172.21.15.56:6789/0 223 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339012 |
|
2018-03-30 21:51:07 | 2018-03-31 17:08:36 | 2018-03-31 18:12:38 | 1:04:02 | 0:19:16 | 0:44:46 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:05:30.577014 mon.a mon.0 172.21.15.95:6789/0 363 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 428 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339013 |
|
2018-03-30 21:51:07 | 2018-03-31 17:08:46 | 2018-03-31 18:32:47 | 1:24:01 | 0:51:23 | 0:32:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:46:54.069451 mon.a mon.0 172.21.15.57:6789/0 242 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339014 |
|
2018-03-30 21:51:08 | 2018-03-31 17:10:40 | 2018-03-31 17:30:38 | 0:19:58 | 0:09:50 | 0:10:08 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:27:16.707511 mon.a mon.0 172.21.15.41:6789/0 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339015 |
|
2018-03-30 21:51:09 | 2018-03-31 17:10:42 | 2018-03-31 18:10:42 | 1:00:00 | 0:37:34 | 0:22:26 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 18:00:53.042716 mon.a mon.0 172.21.15.65:6789/0 156 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339016 |
|
2018-03-30 21:51:09 | 2018-03-31 17:10:45 | 2018-03-31 18:56:46 | 1:46:01 | 0:48:16 | 0:57:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:37:16.986859 mon.a mon.0 172.21.15.80:6789/0 219 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 1434 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339017 |
|
2018-03-30 21:51:10 | 2018-03-31 17:10:45 | 2018-03-31 18:20:46 | 1:10:01 | 0:09:25 | 1:00:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:17:38.958599 mon.b mon.0 172.21.15.94:6789/0 139 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 92 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339018 |
|
2018-03-30 21:51:11 | 2018-03-31 17:10:48 | 2018-03-31 17:52:48 | 0:42:00 | 0:20:23 | 0:21:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:47:57.026385 mon.a mon.0 172.21.15.2:6789/0 336 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 637 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339019 |
|
2018-03-30 21:51:12 | 2018-03-31 17:10:54 | 2018-03-31 17:44:53 | 0:33:59 | 0:09:25 | 0:24:34 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2339020 |
|
2018-03-30 21:51:12 | 2018-03-31 17:12:44 | 2018-03-31 17:58:44 | 0:46:00 | 0:09:49 | 0:36:11 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2339021 |
|
2018-03-30 21:51:13 | 2018-03-31 17:12:44 | 2018-03-31 18:18:45 | 1:06:01 | 0:11:38 | 0:54:23 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:14:53.521182 mon.b mon.0 172.21.15.130:6789/0 249 : cluster [WRN] Health check failed: 11 slow ops, oldest one blocked for 200 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339022 |
|
2018-03-30 21:51:14 | 2018-03-31 17:12:44 | 2018-03-31 18:06:45 | 0:54:01 | 0:13:40 | 0:40:21 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:03:30.600126 mon.b mon.0 172.21.15.36:6789/0 196 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 248 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339023 |
|
2018-03-30 21:51:14 | 2018-03-31 17:14:38 | 2018-03-31 18:54:40 | 1:40:02 | 1:06:07 | 0:33:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:53:48.293390 mon.b mon.0 172.21.15.31:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339024 |
|
2018-03-30 21:51:15 | 2018-03-31 17:14:38 | 2018-03-31 18:20:39 | 1:06:01 | 0:30:45 | 0:35:16 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| fail | 2339025 |
|
2018-03-30 21:51:16 | 2018-03-31 17:14:39 | 2018-03-31 18:40:40 | 1:26:01 | 0:13:08 | 1:12:53 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:33:05.915018 mon.a mon.0 172.21.15.60:6789/0 166 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339026 |
|
2018-03-30 21:51:16 | 2018-03-31 17:14:42 | 2018-03-31 17:52:42 | 0:38:00 | 0:26:20 | 0:11:40 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:33:24.895291 mon.b mon.0 172.21.15.20:6789/0 175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339027 |
|
2018-03-30 21:51:17 | 2018-03-31 17:14:42 | 2018-03-31 18:10:43 | 0:56:01 | 0:42:14 | 0:13:47 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:33:03.958402 mon.b mon.0 172.21.15.45:6789/0 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339028 |
|
2018-03-30 21:51:18 | 2018-03-31 17:16:44 | 2018-03-31 17:38:43 | 0:21:59 | 0:10:30 | 0:11:29 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2339029 |
|
2018-03-30 21:51:18 | 2018-03-31 17:16:45 | 2018-03-31 18:28:46 | 1:12:01 | 0:44:47 | 0:27:14 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
| pass | 2339030 |
|
2018-03-30 21:51:19 | 2018-03-31 17:18:41 | 2018-03-31 18:46:42 | 1:28:01 | 0:19:55 | 1:08:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2339031 |
|
2018-03-30 21:51:20 | 2018-03-31 17:18:41 | 2018-03-31 17:38:40 | 0:19:59 | 0:08:44 | 0:11:15 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2339032 |
|
2018-03-30 21:51:21 | 2018-03-31 17:18:41 | 2018-03-31 17:56:41 | 0:38:00 | 0:18:34 | 0:19:26 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:44:36.229181 mon.b mon.0 172.21.15.47:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339033 |
|
2018-03-30 21:51:21 | 2018-03-31 17:18:45 | 2018-03-31 18:02:45 | 0:44:00 | 0:09:19 | 0:34:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| pass | 2339034 |
|
2018-03-30 21:51:22 | 2018-03-31 17:18:49 | 2018-03-31 18:12:49 | 0:54:00 | 0:09:23 | 0:44:37 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2339035 |
|
2018-03-30 21:51:23 | 2018-03-31 17:20:24 | 2018-03-31 18:38:24 | 1:18:00 | 0:16:31 | 1:01:29 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:27:36.716934 mon.b mon.0 172.21.15.58:6789/0 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339036 |
|
2018-03-30 21:51:23 | 2018-03-31 17:20:35 | 2018-03-31 17:56:35 | 0:36:00 | 0:09:19 | 0:26:41 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:53:58.266616 mon.a mon.0 172.21.15.28:6789/0 207 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 54 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339037 |
|
2018-03-30 21:51:24 | 2018-03-31 17:20:42 | 2018-03-31 19:54:44 | 2:34:02 | 1:07:54 | 1:26:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:53:24.662141 mon.b mon.0 172.21.15.69:6789/0 151 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339038 |
|
2018-03-30 21:51:25 | 2018-03-31 17:20:42 | 2018-03-31 18:04:42 | 0:44:00 | 0:28:35 | 0:15:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2339039 |
|
2018-03-30 21:51:26 | 2018-03-31 17:21:15 | 2018-03-31 17:47:14 | 0:25:59 | 0:13:21 | 0:12:38 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2339040 |
|
2018-03-30 21:51:26 | 2018-03-31 17:22:46 | 2018-03-31 18:22:46 | 1:00:00 | 0:26:20 | 0:33:40 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:14:33.303850 mon.a mon.0 172.21.15.59:6789/0 215 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 702 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339041 |
|
2018-03-30 21:51:27 | 2018-03-31 17:22:46 | 2018-03-31 18:34:46 | 1:12:00 | 0:37:57 | 0:34:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| fail | 2339042 |
|
2018-03-30 21:51:28 | 2018-03-31 17:22:50 | 2018-03-31 18:32:50 | 1:10:00 | 0:11:06 | 0:58:54 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:28:25.703983 mon.a mon.0 172.21.15.95:6789/0 173 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 68 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339043 |
|
2018-03-30 21:51:29 | 2018-03-31 17:25:00 | 2018-03-31 18:53:02 | 1:28:02 | 0:44:03 | 0:43:59 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 18:47:35.119328 mon.b mon.0 172.21.15.47:6789/0 157 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 1475 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339044 |
|
2018-03-30 21:51:29 | 2018-03-31 17:26:52 | 2018-03-31 19:42:55 | 2:16:03 | 0:58:46 | 1:17:17 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:58:42.186122 mon.a mon.0 172.21.15.110:6789/0 240 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 600 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339045 |
|
2018-03-30 21:51:30 | 2018-03-31 17:26:52 | 2018-03-31 18:52:54 | 1:26:02 | 0:09:21 | 1:16:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2339046 |
|
2018-03-30 21:51:31 | 2018-03-31 17:28:45 | 2018-03-31 18:06:45 | 0:38:00 | 0:24:09 | 0:13:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:59:49.266740 mon.a mon.0 172.21.15.56:6789/0 210 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 749 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339047 |
|
2018-03-30 21:51:31 | 2018-03-31 17:28:46 | 2018-03-31 18:04:45 | 0:35:59 | 0:10:05 | 0:25:54 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:59:27.220347 mon.a mon.0 172.21.15.101:6789/0 249 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339048 |
|
2018-03-30 21:51:32 | 2018-03-31 17:30:40 | 2018-03-31 18:00:40 | 0:30:00 | 0:09:46 | 0:20:14 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:56:15.793979 mon.b mon.0 172.21.15.78:6789/0 275 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339049 |
|
2018-03-30 21:51:33 | 2018-03-31 17:30:40 | 2018-03-31 18:16:40 | 0:46:00 | 0:12:55 | 0:33:05 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:10:23.755996 mon.a mon.0 172.21.15.23:6789/0 276 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339050 |
|
2018-03-30 21:51:33 | 2018-03-31 17:30:41 | 2018-03-31 18:44:42 | 1:14:01 | 0:10:52 | 1:03:09 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:40:57.945431 mon.b mon.0 172.21.15.79:6789/0 177 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 192 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339051 |
|
2018-03-30 21:51:34 | 2018-03-31 17:30:42 | 2018-03-31 18:54:43 | 1:24:01 | 1:00:58 | 0:23:03 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
| fail | 2339052 |
|
2018-03-30 21:51:35 | 2018-03-31 17:30:50 | 2018-03-31 18:48:52 | 1:18:02 | 0:29:37 | 0:48:25 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi168 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2339053 |
|
2018-03-30 21:51:35 | 2018-03-31 17:32:53 | 2018-03-31 18:12:53 | 0:40:00 | 0:13:42 | 0:26:18 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2339054 |
|
2018-03-30 21:51:36 | 2018-03-31 17:32:53 | 2018-03-31 19:22:55 | 1:50:02 | 0:30:23 | 1:19:39 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 19:12:25.924792 mon.b mon.0 172.21.15.59:6789/0 209 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 39 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339055 |
|
2018-03-30 21:51:37 | 2018-03-31 17:34:45 | 2018-03-31 18:32:46 | 0:58:01 | 0:39:06 | 0:18:55 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:11:37.810240 mon.a mon.0 172.21.15.118:6789/0 163 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 742 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339056 |
|
2018-03-30 21:51:37 | 2018-03-31 17:36:42 | 2018-03-31 18:52:43 | 1:16:01 | 0:10:33 | 1:05:28 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:50:02.222262 mon.a mon.0 172.21.15.95:6789/0 189 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 125 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339057 |
|
2018-03-30 21:51:38 | 2018-03-31 17:38:50 | 2018-03-31 19:10:51 | 1:32:01 | 0:44:33 | 0:47:28 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 19:05:02.742788 mon.b mon.0 172.21.15.70:6789/0 165 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 1544 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339058 |
|
2018-03-30 21:51:39 | 2018-03-31 17:38:50 | 2018-03-31 18:36:50 | 0:58:00 | 0:20:58 | 0:37:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:30:56.052765 mon.b mon.0 172.21.15.132:6789/0 179 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 608 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339059 |
|
2018-03-30 21:51:39 | 2018-03-31 17:38:50 | 2018-03-31 18:14:50 | 0:36:00 | 0:09:11 | 0:26:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:11:20.887588 mon.b mon.0 172.21.15.4:6789/0 244 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339060 |
|
2018-03-30 21:51:40 | 2018-03-31 15:56:40 | 2018-03-31 16:30:40 | 0:34:00 | 0:18:51 | 0:15:09 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 16:26:04.418370 mon.a mon.0 172.21.15.20:6789/0 197 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 553 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339061 |
|
2018-03-30 21:51:41 | 2018-03-31 17:40:46 | 2018-03-31 18:16:46 | 0:36:00 | 0:11:00 | 0:25:00 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:13:08.047899 mon.b mon.0 172.21.15.28:6789/0 137 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339062 |
|
2018-03-30 21:51:41 | 2018-03-31 17:40:46 | 2018-03-31 18:04:46 | 0:24:00 | 0:10:07 | 0:13:53 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
| fail | 2339063 |
|
2018-03-30 21:51:42 | 2018-03-31 17:40:46 | 2018-03-31 18:20:46 | 0:40:00 | 0:11:07 | 0:28:53 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:16:06.003546 mon.a mon.0 172.21.15.88:6789/0 323 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 98 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339064 |
|
2018-03-30 21:51:43 | 2018-03-31 17:42:50 | 2018-03-31 18:06:50 | 0:24:00 | 0:12:10 | 0:11:50 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:00:11.814052 mon.a mon.0 172.21.15.35:6789/0 190 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339065 |
|
2018-03-30 21:51:43 | 2018-03-31 17:42:50 | 2018-03-31 19:38:52 | 1:56:02 | 1:46:03 | 0:09:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 17:59:34.997432 mon.b mon.0 172.21.15.81:6789/0 140 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339066 |
|
2018-03-30 21:51:44 | 2018-03-31 17:43:37 | 2018-03-31 18:27:37 | 0:44:00 | 0:26:58 | 0:17:02 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2339067 |
|
2018-03-30 21:51:45 | 2018-03-31 17:44:52 | 2018-03-31 18:18:51 | 0:33:59 | 0:13:10 | 0:20:49 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2339068 |
|
2018-03-30 21:51:45 | 2018-03-31 17:44:52 | 2018-03-31 18:38:52 | 0:54:00 | 0:27:09 | 0:26:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:28:25.892500 mon.a mon.0 172.21.15.37:6789/0 223 : cluster [WRN] Health check failed: 28 slow ops, oldest one blocked for 726 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339069 |
|
2018-03-30 21:51:46 | 2018-03-31 17:44:52 | 2018-03-31 18:52:52 | 1:08:00 | 0:43:34 | 0:24:26 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:27:08.418881 mon.a mon.0 172.21.15.8:6789/0 252 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 744 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339070 |
|
2018-03-30 21:51:47 | 2018-03-31 17:44:52 | 2018-03-31 18:38:52 | 0:54:00 | 0:11:15 | 0:42:45 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:33:09.029110 mon.b mon.0 172.21.15.28:6789/0 132 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339071 |
|
2018-03-30 21:51:48 | 2018-03-31 17:44:55 | 2018-03-31 19:26:56 | 1:42:01 | 0:44:54 | 0:57:07 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 18:56:06.740956 mon.b mon.0 172.21.15.41:6789/0 158 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339072 |
|
2018-03-30 21:51:48 | 2018-03-31 17:46:50 | 2018-03-31 18:32:50 | 0:46:00 | 0:21:16 | 0:24:44 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:18:05.565618 mon.a mon.0 172.21.15.110:6789/0 197 : cluster [WRN] Health check failed: 437 slow ops, oldest one blocked for 62 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339073 |
|
2018-03-30 21:51:49 | 2018-03-31 17:47:15 | 2018-03-31 18:55:16 | 1:08:01 | 0:08:25 | 0:59:36 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:52:37.306526 mon.a mon.0 172.21.15.37:6789/0 242 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339074 |
|
2018-03-30 21:51:50 | 2018-03-31 17:48:44 | 2018-03-31 19:14:46 | 1:26:02 | 0:25:11 | 1:00:51 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 19:07:18.736711 mon.a mon.0 172.21.15.60:6789/0 209 : cluster [WRN] Health check failed: 9 slow ops, oldest one blocked for 743 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339075 |
|
2018-03-30 21:51:50 | 2018-03-31 17:48:44 | 2018-03-31 18:48:45 | 1:00:01 | 0:09:40 | 0:50:21 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:44:19.129476 mon.a mon.0 172.21.15.5:6789/0 258 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339076 |
|
2018-03-30 21:51:51 | 2018-03-31 17:48:44 | 2018-03-31 19:18:47 | 1:30:03 | 0:09:48 | 1:20:15 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml} | 3 | ||
Failure Reason:
"2018-03-31 19:15:37.183650 mon.a mon.0 172.21.15.49:6789/0 313 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339077 |
|
2018-03-30 21:51:52 | 2018-03-31 17:50:53 | 2018-03-31 18:18:53 | 0:28:00 | 0:12:40 | 0:15:20 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/9-mds-3-standby.yaml mount/kclient.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:14:55.770527 mon.a mon.0 172.21.15.60:6789/0 292 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339078 |
|
2018-03-30 21:51:52 | 2018-03-31 17:52:48 | 2018-03-31 18:44:49 | 0:52:01 | 0:11:48 | 0:40:13 | smithi | master | multimds/verify/{begin.yaml clusters/9-mds.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:38:41.038815 mon.b mon.0 172.21.15.9:6789/0 168 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 42 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339079 |
|
2018-03-30 21:51:53 | 2018-03-31 17:52:48 | 2018-03-31 20:10:51 | 2:18:03 | 1:07:40 | 1:10:23 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml} | 3 | ||
Failure Reason:
"2018-03-31 19:25:56.686946 mon.a mon.0 172.21.15.103:6789/0 173 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 2339080 |
|
2018-03-30 21:51:54 | 2018-03-31 17:52:48 | 2018-03-31 19:30:50 | 1:38:02 | 0:28:17 | 1:09:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 | ||
Failure Reason:
Command failed (workunit test fs/misc/rstats.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-pdonnell-testing-20180329.211514 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh' |
||||||||||||||
| pass | 2339081 |
|
2018-03-30 21:51:55 | 2018-03-31 17:52:49 | 2018-03-31 18:22:49 | 0:30:00 | 0:12:52 | 0:17:08 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml} | 3 | ||
| fail | 2339082 |
|
2018-03-30 21:51:55 | 2018-03-31 17:55:08 | 2018-03-31 18:43:09 | 0:48:01 | 0:25:55 | 0:22:06 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:32:44.811309 mon.b mon.0 172.21.15.36:6789/0 195 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 633 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339083 |
|
2018-03-30 21:51:56 | 2018-03-31 17:56:46 | 2018-03-31 18:48:46 | 0:52:00 | 0:39:01 | 0:12:59 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml} | 3 | ||
| pass | 2339084 |
|
2018-03-30 21:51:57 | 2018-03-31 17:56:46 | 2018-03-31 18:56:47 | 1:00:01 | 0:09:53 | 0:50:08 | smithi | master | multimds/thrash/{begin.yaml ceph-thrash/default.yaml clusters/3-mds-2-standby.yaml mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
| fail | 2339085 |
|
2018-03-30 21:51:57 | 2018-03-31 17:56:47 | 2018-03-31 19:58:49 | 2:02:02 | 0:43:53 | 1:18:09 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{debug.yaml frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
"2018-03-31 19:54:33.914987 mon.a mon.0 172.21.15.38:6789/0 176 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339086 |
|
2018-03-30 21:51:58 | 2018-03-31 17:56:47 | 2018-03-31 19:48:48 | 1:52:01 | 0:57:39 | 0:54:22 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 | ||
| pass | 2339087 |
|
2018-03-30 21:51:59 | 2018-03-31 17:56:48 | 2018-03-31 18:36:48 | 0:40:00 | 0:08:53 | 0:31:07 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml} | 3 | ||
| fail | 2339088 |
|
2018-03-30 21:52:00 | 2018-03-31 17:58:43 | 2018-03-31 18:30:43 | 0:32:00 | 0:15:33 | 0:16:27 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml inline/yes.yaml mount/kclient.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
Failure Reason:
"2018-03-31 18:26:55.837320 mon.a mon.0 172.21.15.103:6789/0 208 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 2339089 |
|
2018-03-30 21:52:00 | 2018-03-31 17:58:45 | 2018-03-31 18:34:45 | 0:36:00 | 0:10:19 | 0:25:41 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{debug.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml} | 3 | ||
Pulpito