Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1558267 2017-08-24 05:20:16 2017-08-26 13:46:46 2017-08-26 14:16:44 0:29:58 0:16:03 0:13:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1558268 2017-08-24 05:20:17 2017-08-26 13:46:58 2017-08-26 15:12:58 1:26:00 1:06:22 0:19:38 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

"2017-08-26 14:10:35.384482 mon.b mon.0 172.21.15.63:6789/0 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1558269 2017-08-24 05:20:18 2017-08-26 13:47:27 2017-08-26 19:51:08 6:03:41 0:13:58 5:49:43 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-08-26 19:43:03.133209 mon.a mon.0 172.21.15.26:6789/0 201 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558270 2017-08-24 05:20:18 2017-08-26 13:47:02 2017-08-26 15:41:03 1:54:01 1:04:13 0:49:48 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 14:40:28.469796 mon.b mon.0 172.21.15.17:6789/0 165 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 1558271 2017-08-24 05:20:19 2017-08-26 13:47:26 2017-08-26 14:53:26 1:06:00 0:49:00 0:17:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-08-26 14:06:18.747495 mon.b mon.0 172.21.15.92:6789/0 121 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

dead 1558272 2017-08-24 05:20:20 2017-08-26 13:47:57 2017-08-27 01:54:22 12:06:25 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml} 4
pass 1558273 2017-08-24 05:20:20 2017-08-26 13:48:02 2017-08-26 14:50:02 1:02:00 0:44:24 0:17:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1558274 2017-08-24 05:20:21 2017-08-26 13:48:21 2017-08-26 15:10:17 1:21:56 0:24:58 0:56:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1558275 2017-08-24 05:20:22 2017-08-26 13:48:29 2017-08-26 14:28:29 0:40:00 0:21:18 0:18:42 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-08-26 14:13:39.071460 mon.a mon.0 172.21.15.97:6789/0 223 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558276 2017-08-24 05:20:22 2017-08-26 13:49:08 2017-08-26 15:35:09 1:46:01 1:29:50 0:16:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-08-26 14:18:51.327213 mon.b mon.0 172.21.15.134:6789/0 400 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1558277 2017-08-24 05:20:23 2017-08-26 13:48:35 2017-08-26 15:14:35 1:26:00 0:56:09 0:29:51 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 14:45:11.946501 mon.b mon.0 172.21.15.1:6789/0 182 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

dead 1558278 2017-08-24 05:20:24 2017-08-26 13:48:58 2017-08-27 01:55:40 12:06:42 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml} 4
pass 1558279 2017-08-24 05:20:25 2017-08-26 13:49:13 2017-08-26 14:51:04 1:01:51 0:52:21 0:09:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1558280 2017-08-24 05:20:25 2017-08-26 13:50:38 2017-08-26 15:04:34 1:13:56 0:45:22 0:28:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 14:25:23.637606 mon.b mon.1 172.21.15.193:6789/0 31 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1558281 2017-08-24 05:20:26 2017-08-26 13:51:02 2017-08-26 14:40:58 0:49:56 0:15:15 0:34:41 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml} 4
Failure Reason:

"2017-08-26 14:29:48.687564 mon.a mon.0 172.21.15.46:6789/0 204 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558282 2017-08-24 05:20:27 2017-08-26 13:52:27 2017-08-26 14:14:25 0:21:58 0:12:06 0:09:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1558283 2017-08-24 05:20:27 2017-08-26 13:52:45 2017-08-26 14:28:43 0:35:58 0:23:44 0:12:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1558284 2017-08-24 05:20:28 2017-08-26 13:52:51 2017-08-26 14:56:51 1:04:00 0:39:40 0:24:20 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-08-26 14:32:09.488370 mon.a mon.0 172.21.15.149:6789/0 379 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1558285 2017-08-24 05:20:29 2017-08-26 13:53:39 2017-08-26 14:53:37 0:59:58 0:47:04 0:12:54 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1558286 2017-08-24 05:20:30 2017-08-26 13:53:42 2017-08-26 14:21:41 0:27:59 0:11:32 0:16:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1558287 2017-08-24 05:20:30 2017-08-26 13:54:33 2017-08-26 15:08:33 1:14:00 0:34:21 0:39:39 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1558288 2017-08-24 05:20:31 2017-08-26 13:56:38 2017-08-26 14:26:35 0:29:57 0:11:48 0:18:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1558289 2017-08-24 05:20:31 2017-08-26 13:56:52 2017-08-26 16:00:38 2:03:46 1:29:36 0:34:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1558290 2017-08-24 05:20:32 2017-08-26 13:56:36 2017-08-26 14:46:36 0:50:00 0:31:36 0:18:24 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml} 4
Failure Reason:

"2017-08-26 14:15:35.236703 mon.a mon.0 172.21.15.100:6789/0 215 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558291 2017-08-24 05:20:33 2017-08-26 13:57:27 2017-08-26 14:23:23 0:25:56 0:11:47 0:14:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1558292 2017-08-24 05:20:33 2017-08-26 13:57:27 2017-08-26 14:25:26 0:27:59 0:11:04 0:16:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1558293 2017-08-24 05:20:34 2017-08-26 13:58:19 2017-08-26 16:52:16 2:53:57 0:53:29 2:00:28 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
Failure Reason:

"2017-08-26 16:04:28.380379 mon.b mon.0 172.21.15.9:6789/0 157 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1558294 2017-08-24 05:20:35 2017-08-26 13:58:11 2017-08-26 14:42:10 0:43:59 0:28:24 0:15:35 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-08-26 14:21:35.692921 mon.a mon.0 172.21.15.45:6789/0 467 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1558295 2017-08-24 05:20:35 2017-08-26 13:59:11 2017-08-26 14:41:09 0:41:58 0:27:34 0:14:24 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 14:14:49.493808 mon.b mon.0 172.21.15.118:6789/0 157 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 1558296 2017-08-24 05:20:36 2017-08-26 13:59:37 2017-08-26 15:43:26 1:43:49 1:22:06 0:21:43 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1558297 2017-08-24 05:20:37 2017-08-26 13:59:39 2017-08-26 15:33:40 1:34:01 0:20:46 1:13:15 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-08-26 15:18:12.404901 mon.a mon.0 172.21.15.162:6789/0 390 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

pass 1558298 2017-08-24 05:20:37 2017-08-26 14:00:07 2017-08-26 14:42:08 0:42:01 0:35:05 0:06:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1558299 2017-08-24 05:20:38 2017-08-26 14:00:22 2017-08-26 14:52:21 0:51:59 0:20:18 0:31:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1558300 2017-08-24 05:20:39 2017-08-26 14:00:21 2017-08-26 14:38:20 0:37:59 0:12:48 0:25:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml} 4
Failure Reason:

"2017-08-26 14:29:19.493047 mon.a mon.0 172.21.15.200:6789/0 199 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558301 2017-08-24 05:20:39 2017-08-26 14:00:36 2017-08-26 18:32:40 4:32:04 3:57:44 0:34:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi008 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 1558302 2017-08-24 05:20:40 2017-08-26 14:00:40 2017-08-26 15:32:41 1:32:01 0:49:35 0:42:26 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 14:49:30.627491 mon.a mon.0 172.21.15.169:6789/0 274 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558303 2017-08-24 05:20:41 2017-08-26 14:00:49 2017-08-26 14:30:48 0:29:59 0:08:20 0:21:39 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml} 4
Failure Reason:

Command failed on smithi083 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp78WrYk'

pass 1558304 2017-08-24 05:20:41 2017-08-26 14:01:42 2017-08-26 15:27:40 1:25:58 0:55:20 0:30:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1558305 2017-08-24 05:20:42 2017-08-26 14:01:43 2017-08-26 14:59:43 0:58:00 0:27:56 0:30:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 14:35:19.935178 mon.b mon.0 172.21.15.117:6789/0 191 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1558306 2017-08-24 05:20:43 2017-08-26 14:01:52 2017-08-26 15:01:52 1:00:00 0:12:55 0:47:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml} 4
Failure Reason:

"2017-08-26 14:50:20.731954 mon.a mon.0 172.21.15.89:6789/0 202 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558307 2017-08-24 05:20:43 2017-08-26 14:02:27 2017-08-26 14:24:38 0:22:11 0:14:20 0:07:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1558308 2017-08-24 05:20:44 2017-08-26 14:02:21 2017-08-26 14:42:21 0:40:00 0:20:23 0:19:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1558309 2017-08-24 05:20:45 2017-08-26 14:02:57 2017-08-26 16:18:59 2:16:02 0:17:00 1:59:02 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml} 4
Failure Reason:

"2017-08-26 16:06:04.718802 mon.a mon.0 172.21.15.157:6789/0 199 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558310 2017-08-24 05:20:45 2017-08-26 14:03:22 2017-08-26 15:37:23 1:34:01 0:29:56 1:04:05 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 15:11:19.783058 mon.a mon.0 172.21.15.29:6789/0 4 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1558311 2017-08-24 05:20:46 2017-08-26 14:03:36 2017-08-26 14:39:35 0:35:59 0:13:55 0:22:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1558312 2017-08-24 05:20:47 2017-08-26 14:03:55 2017-08-26 15:35:57 1:32:02 0:20:01 1:12:01 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

fail 1558313 2017-08-24 05:20:48 2017-08-26 14:04:59 2017-08-26 15:00:56 0:55:57 0:31:53 0:24:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 14:32:09.874172 mon.b mon.0 172.21.15.139:6789/0 145 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 1558314 2017-08-24 05:20:48 2017-08-26 14:07:23 2017-08-26 15:59:19 1:51:56 1:45:33 0:06:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1558315 2017-08-24 05:20:49 2017-08-26 14:07:30 2017-08-26 15:35:18 1:27:48 0:31:16 0:56:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml} 4
Failure Reason:

"2017-08-26 15:07:41.685942 mon.a mon.0 172.21.15.12:6789/0 216 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558316 2017-08-24 05:20:50 2017-08-26 14:08:54 2017-08-26 14:30:52 0:21:58 0:09:54 0:12:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1558317 2017-08-24 05:20:50 2017-08-26 14:09:35 2017-08-26 14:43:34 0:33:59 0:18:49 0:15:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1558318 2017-08-24 05:20:51 2017-08-26 14:10:28 2017-08-26 15:54:21 1:43:53 0:45:52 0:58:01 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

"2017-08-26 15:23:31.252725 mon.b mon.0 172.21.15.72:6789/0 201 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

fail 1558319 2017-08-24 05:20:52 2017-08-26 14:10:22 2017-08-26 16:56:25 2:46:03 0:17:04 2:28:59 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-08-26 16:44:04.310659 mon.a mon.0 172.21.15.17:6789/0 209 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558320 2017-08-24 05:20:53 2017-08-26 14:11:24 2017-08-26 15:45:25 1:34:01 0:31:27 1:02:34 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 15:14:31.775271 mon.a mon.0 172.21.15.75:6789/0 183 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 1558321 2017-08-24 05:20:53 2017-08-26 14:12:10 2017-08-26 15:18:03 1:05:53 0:55:43 0:10:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1558322 2017-08-24 05:20:54 2017-08-26 14:12:06 2017-08-26 14:40:03 0:27:57 0:13:39 0:14:18 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml} 4
Failure Reason:

"2017-08-26 14:30:27.116237 mon.a mon.0 172.21.15.78:6789/0 207 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558323 2017-08-24 05:20:55 2017-08-26 14:12:07 2017-08-26 14:54:08 0:42:01 0:35:36 0:06:25 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1558324 2017-08-24 05:20:55 2017-08-26 14:13:02 2017-08-26 14:57:01 0:43:59 0:21:18 0:22:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1558325 2017-08-24 05:20:56 2017-08-26 14:13:09 2017-08-26 15:03:02 0:49:53 0:22:26 0:27:27 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-08-26 14:46:22.440603 mon.a mon.0 172.21.15.43:6789/0 193 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558326 2017-08-24 05:20:57 2017-08-26 14:13:29 2017-08-26 16:51:27 2:37:58 1:52:17 0:45:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-08-26 15:41:37.090716 mon.b mon.0 172.21.15.24:6789/0 744 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1558327 2017-08-24 05:20:57 2017-08-26 14:13:37 2017-08-26 15:03:36 0:49:59 0:16:33 0:33:26 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 14:51:56.732278 mon.a mon.0 172.21.15.40:6789/0 191 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

dead 1558328 2017-08-24 05:20:58 2017-08-26 14:14:38 2017-08-27 02:21:57 12:07:19 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml} 4
pass 1558329 2017-08-24 05:20:59 2017-08-26 14:15:54 2017-08-26 15:41:57 1:26:03 0:45:17 0:40:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1558330 2017-08-24 05:21:00 2017-08-26 14:15:54 2017-08-26 15:47:54 1:32:00 0:44:04 0:47:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 15:16:13.598446 mon.b mon.0 172.21.15.18:6789/0 344 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

fail 1558331 2017-08-24 05:21:00 2017-08-26 14:16:00 2017-08-26 14:41:59 0:25:59 0:13:39 0:12:20 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml} 4
Failure Reason:

"2017-08-26 14:32:51.568035 mon.a mon.0 172.21.15.70:6789/0 214 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558332 2017-08-24 05:21:01 2017-08-26 14:16:09 2017-08-26 15:06:11 0:50:02 0:13:51 0:36:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1558333 2017-08-24 05:21:02 2017-08-26 14:16:13 2017-08-26 15:06:14 0:50:01 0:23:41 0:26:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1558334 2017-08-24 05:21:02 2017-08-26 14:16:45 2017-08-26 15:04:42 0:47:57 0:27:33 0:20:24 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-08-26 14:42:22.485784 mon.a mon.0 172.21.15.20:6789/0 392 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1558335 2017-08-24 05:21:03 2017-08-26 14:16:46 2017-08-26 15:08:46 0:52:00 0:31:49 0:20:11 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 14:41:06.907130 mon.a mon.0 172.21.15.37:6789/0 185 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1558336 2017-08-24 05:21:04 2017-08-26 14:16:52 2017-08-26 14:38:51 0:21:59 0:13:09 0:08:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1558337 2017-08-24 05:21:05 2017-08-26 14:17:15 2017-08-26 15:15:15 0:58:00 0:38:28 0:19:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1558338 2017-08-24 05:21:05 2017-08-26 14:22:38 2017-08-26 14:52:44 0:30:06 0:15:08 0:14:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1558339 2017-08-24 05:21:06 2017-08-26 14:22:50 2017-08-26 16:00:48 1:37:58 1:20:45 0:17:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1558340 2017-08-24 05:21:07 2017-08-26 14:23:14 2017-08-26 15:25:09 1:01:55 0:27:35 0:34:20 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml} 4
Failure Reason:

"2017-08-26 14:59:19.289178 mon.a mon.0 172.21.15.99:6789/0 205 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558341 2017-08-24 05:21:07 2017-08-26 14:23:40 2017-08-26 14:55:34 0:31:54 0:12:33 0:19:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1558342 2017-08-24 05:21:08 2017-08-26 14:23:56 2017-08-26 14:43:56 0:20:00 0:15:21 0:04:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1558343 2017-08-24 05:21:09 2017-08-26 14:24:11 2017-08-26 15:54:12 1:30:01 1:02:21 0:27:40 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
Failure Reason:

"2017-08-26 14:55:17.547655 mon.b mon.1 172.21.15.65:6789/0 41 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1558344 2017-08-24 05:21:10 2017-08-26 14:24:26 2017-08-26 16:00:26 1:36:00 0:20:32 1:15:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-08-26 15:47:48.525258 mon.a mon.0 172.21.15.133:6789/0 454 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1558345 2017-08-24 05:21:10 2017-08-26 14:24:54 2017-08-26 15:06:53 0:41:59 0:21:27 0:20:32 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 14:50:58.980722 mon.b mon.0 172.21.15.45:6789/0 176 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 1558346 2017-08-24 05:21:11 2017-08-26 14:24:59 2017-08-26 15:48:54 1:23:55 1:14:17 0:09:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1558347 2017-08-24 05:21:12 2017-08-26 14:25:43 2017-08-26 16:05:49 1:40:06 0:31:40 1:08:26 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-08-26 15:38:09.554767 mon.a mon.0 172.21.15.150:6789/0 396 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

pass 1558348 2017-08-24 05:21:12 2017-08-26 14:26:05 2017-08-26 15:56:07 1:30:02 1:15:22 0:14:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1558349 2017-08-24 05:21:13 2017-08-26 14:26:45 2017-08-26 15:50:37 1:23:52 0:44:17 0:39:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1558350 2017-08-24 05:21:14 2017-08-26 14:26:51 2017-08-26 17:20:53 2:54:02 0:10:11 2:43:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml} 4
Failure Reason:

"2017-08-26 17:10:59.506179 mon.a mon.0 172.21.15.67:6789/0 203 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558351 2017-08-24 05:21:15 2017-08-26 14:27:52 2017-08-26 18:56:05 4:28:13 3:52:39 0:35:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi070 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=luminous TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 1558352 2017-08-24 05:21:15 2017-08-26 14:28:33 2017-08-26 15:34:31 1:05:58 0:28:17 0:37:41 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-26 15:08:00.032921 mon.b mon.0 172.21.15.77:6789/0 176 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558353 2017-08-24 05:21:16 2017-08-26 14:28:55 2017-08-26 15:18:54 0:49:59 0:08:40 0:41:19 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml} 4
Failure Reason:

Command failed on smithi102 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp84sgA6'

pass 1558354 2017-08-24 05:21:17 2017-08-26 14:30:27 2017-08-26 15:46:28 1:16:01 0:53:32 0:22:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1558355 2017-08-24 05:21:17 2017-08-26 14:30:43 2017-08-26 15:34:28 1:03:45 0:28:21 0:35:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1558356 2017-08-24 05:21:18 2017-08-26 14:30:50 2017-08-26 15:40:51 1:10:01 0:13:55 0:56:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml} 4
Failure Reason:

"2017-08-26 15:30:30.439317 mon.a mon.0 172.21.15.39:6789/0 217 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558357 2017-08-24 05:21:19 2017-08-26 14:30:54 2017-08-26 15:06:53 0:35:59 0:20:41 0:15:18 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1558358 2017-08-24 05:21:19 2017-08-26 14:33:43 2017-08-26 15:09:39 0:35:56 0:16:15 0:19:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1558359 2017-08-24 05:21:20 2017-08-26 14:36:11 2017-08-26 18:12:13 3:36:02 0:17:13 3:18:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml} 4
Failure Reason:

"2017-08-26 17:59:03.045652 mon.a mon.0 172.21.15.12:6789/0 197 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1558360 2017-08-24 05:21:21 2017-08-26 14:38:14 2017-08-26 15:36:09 0:57:55 0:16:22 0:41:33 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-26 15:23:48.934553 mon.a mon.0 172.21.15.45:6789/0 137 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1558361 2017-08-24 05:21:22 2017-08-26 14:38:22 2017-08-26 14:56:21 0:17:59 0:12:33 0:05:26 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1558362 2017-08-24 05:21:22 2017-08-26 14:38:55 2017-08-26 18:54:57 4:16:02 0:34:50 3:41:12 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 1558363 2017-08-24 05:21:23 2017-08-26 14:39:46 2017-08-26 15:09:45 0:29:59 0:27:04 0:02:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1558364 2017-08-24 05:21:24 2017-08-26 14:39:46 2017-08-26 16:03:47 1:24:01 1:15:58 0:08:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1558365 2017-08-24 05:21:24 2017-08-26 14:40:23 2017-08-26 17:18:26 2:38:03 0:26:14 2:11:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml} 4
Failure Reason:

"2017-08-26 16:57:47.815349 mon.a mon.0 172.21.15.103:6789/0 205 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1558366 2017-08-24 05:21:25 2017-08-26 14:41:12 2017-08-26 15:17:12 0:36:00 0:10:52 0:25:08 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3