Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1540882 2017-08-19 03:25:18 2017-08-19 19:04:02 2017-08-19 19:22:00 0:17:58 0:17:22 0:00:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1540883 2017-08-19 03:25:18 2017-08-19 19:04:39 2017-08-19 20:40:38 1:35:59 1:08:23 0:27:36 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

"2017-08-19 19:37:51.474451 mon.b mon.0 172.21.15.9:6789/0 165 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1540884 2017-08-19 03:25:19 2017-08-19 19:04:57 2017-08-19 22:06:53 3:01:56 0:12:05 2:49:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-08-19 21:56:39.612959 mon.a mon.0 172.21.15.173:6789/0 211 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540885 2017-08-19 03:25:20 2017-08-19 19:05:35 2017-08-19 20:05:37 1:00:02 0:49:43 0:10:19 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 19:15:29.710095 mon.b mon.0 172.21.15.53:6789/0 127 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

fail 1540886 2017-08-19 03:25:20 2017-08-19 19:06:22 2017-08-19 20:48:23 1:42:01 1:22:22 0:19:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-08-19 19:30:00.049016 mon.b mon.1 172.21.15.116:6789/0 31 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1540887 2017-08-19 03:25:21 2017-08-19 19:08:24 2017-08-19 19:48:46 0:40:22 0:09:39 0:30:43 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml} 4
Failure Reason:

"2017-08-19 19:40:49.007216 mon.a mon.0 172.21.15.73:6789/0 204 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540888 2017-08-19 03:25:22 2017-08-19 19:07:54 2017-08-19 20:21:54 1:14:00 0:52:21 0:21:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1540889 2017-08-19 03:25:22 2017-08-19 19:08:07 2017-08-19 19:54:07 0:46:00 0:20:33 0:25:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1540890 2017-08-19 03:25:23 2017-08-19 19:08:14 2017-08-19 20:30:14 1:22:00 0:18:13 1:03:47 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-08-19 20:17:22.726696 mon.a mon.0 172.21.15.135:6789/0 204 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540891 2017-08-19 03:25:24 2017-08-19 19:10:21 2017-08-19 23:22:35 4:12:14 3:52:50 0:19:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi199 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=master TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 1540892 2017-08-19 03:25:24 2017-08-19 19:11:52 2017-08-19 20:11:55 1:00:03 0:40:01 0:20:02 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 19:39:46.139089 mon.a mon.0 172.21.15.55:6789/0 236 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

dead 1540893 2017-08-19 03:25:25 2017-08-19 19:11:40 2017-08-20 07:18:29 12:06:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml} 4
fail 1540894 2017-08-19 03:25:26 2017-08-19 19:12:14 2017-08-19 20:40:12 1:27:58 1:01:17 0:26:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

"2017-08-19 20:14:21.734689 mon.b mon.1 172.21.15.163:6789/0 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1540895 2017-08-19 03:25:27 2017-08-19 19:12:43 2017-08-19 20:38:44 1:26:01 0:44:02 0:41:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1540896 2017-08-19 03:25:27 2017-08-19 19:13:11 2017-08-19 21:51:14 2:38:03 0:13:31 2:24:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml} 4
Failure Reason:

"2017-08-19 21:42:31.886850 mon.a mon.0 172.21.15.1:6789/0 199 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540897 2017-08-19 03:25:28 2017-08-19 19:13:41 2017-08-19 19:27:35 0:13:54 0:11:55 0:01:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1540898 2017-08-19 03:25:29 2017-08-19 19:15:25 2017-08-19 20:07:31 0:52:06 0:25:39 0:26:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1540900 2017-08-19 03:25:29 2017-08-19 19:15:30 2017-08-19 20:49:31 1:34:01 0:30:58 1:03:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-08-19 20:25:18.857347 mon.a mon.0 172.21.15.37:6789/0 373 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1540903 2017-08-19 03:25:30 2017-08-19 19:17:27 2017-08-19 20:17:27 1:00:00 0:48:43 0:11:17 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 19:33:30.488777 mon.b mon.0 172.21.15.168:6789/0 194 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1540906 2017-08-19 03:25:31 2017-08-19 19:18:08 2017-08-19 19:34:07 0:15:59 0:09:38 0:06:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1540909 2017-08-19 03:25:31 2017-08-19 19:18:52 2017-08-19 21:26:36 2:07:44 0:54:18 1:13:26 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1540912 2017-08-19 03:25:32 2017-08-19 19:23:50 2017-08-19 19:53:49 0:29:59 0:16:12 0:13:47 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1540914 2017-08-19 03:25:33 2017-08-19 19:25:00 2017-08-19 22:01:03 2:36:03 2:12:41 0:23:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1540917 2017-08-19 03:25:33 2017-08-19 19:27:41 2017-08-19 20:35:39 1:07:58 0:37:05 0:30:53 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml} 4
Failure Reason:

"2017-08-19 20:05:30.955208 mon.a mon.0 172.21.15.140:6789/0 219 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540920 2017-08-19 03:25:34 2017-08-19 19:30:04 2017-08-19 20:04:00 0:33:56 0:10:45 0:23:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1540922 2017-08-19 03:25:35 2017-08-19 19:30:52 2017-08-19 19:50:51 0:19:59 0:10:00 0:09:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1540926 2017-08-19 03:25:36 2017-08-19 19:32:01 2017-08-19 23:04:04 3:32:03 0:58:14 2:33:49 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
Failure Reason:

"2017-08-19 22:17:45.857910 mon.b mon.1 172.21.15.198:6789/0 106 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1540928 2017-08-19 03:25:36 2017-08-19 19:34:16 2017-08-19 21:36:17 2:02:01 0:31:33 1:30:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-08-19 20:32:03.887209 mon.a mon.0 172.21.15.11:6789/0 454 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1540931 2017-08-19 03:25:37 2017-08-19 19:36:52 2017-08-19 20:10:50 0:33:58 0:29:16 0:04:42 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 19:45:25.988220 mon.a mon.0 172.21.15.11:6789/0 164 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 1540934 2017-08-19 03:25:38 2017-08-19 19:38:39 2017-08-19 20:50:38 1:11:59 1:00:43 0:11:16 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1540937 2017-08-19 03:25:38 2017-08-19 19:40:43 2017-08-19 20:26:43 0:46:00 0:22:02 0:23:58 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-08-19 20:09:20.386817 mon.a mon.0 172.21.15.169:6789/0 389 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

pass 1540940 2017-08-19 03:25:39 2017-08-19 19:43:27 2017-08-19 20:23:26 0:39:59 0:36:37 0:03:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1540943 2017-08-19 03:25:40 2017-08-19 19:48:04 2017-08-19 20:18:04 0:30:00 0:20:45 0:09:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1540946 2017-08-19 03:25:40 2017-08-19 19:51:04 2017-08-19 22:29:06 2:38:02 0:11:56 2:26:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml} 4
Failure Reason:

"2017-08-19 22:19:39.944472 mon.a mon.0 172.21.15.64:6789/0 215 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540949 2017-08-19 03:25:41 2017-08-19 19:52:51 2017-08-19 21:22:42 1:29:51 1:17:00 0:12:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-08-19 20:21:43.187143 mon.b mon.0 172.21.15.174:6789/0 672 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1540951 2017-08-19 03:25:42 2017-08-19 19:54:00 2017-08-19 20:54:00 1:00:00 0:46:33 0:13:27 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 20:14:24.403134 mon.a mon.0 172.21.15.2:6789/0 222 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540952 2017-08-19 03:25:42 2017-08-19 19:54:04 2017-08-19 21:36:05 1:42:01 0:08:56 1:33:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml} 4
Failure Reason:

Command failed on smithi194 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpEjdbKg'

fail 1540953 2017-08-19 03:25:43 2017-08-19 19:54:09 2017-08-19 21:22:09 1:28:00 0:56:15 0:31:45 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

"2017-08-19 20:32:04.613913 mon.b mon.0 172.21.15.53:6789/0 150 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1540954 2017-08-19 03:25:43 2017-08-19 19:54:33 2017-08-19 21:04:33 1:10:00 0:26:48 0:43:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1540955 2017-08-19 03:25:44 2017-08-19 19:54:40 2017-08-19 20:54:39 0:59:59 0:14:34 0:45:25 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml} 4
Failure Reason:

"2017-08-19 20:45:49.148369 mon.a mon.0 172.21.15.136:6789/0 222 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540956 2017-08-19 03:25:45 2017-08-19 19:55:20 2017-08-19 20:27:15 0:31:55 0:14:01 0:17:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1540957 2017-08-19 03:25:45 2017-08-19 19:56:40 2017-08-19 20:20:39 0:23:59 0:18:05 0:05:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1540958 2017-08-19 03:25:46 2017-08-19 19:56:48 2017-08-19 21:34:50 1:38:02 0:19:53 1:18:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml} 4
Failure Reason:

"2017-08-19 21:19:32.566030 mon.a mon.0 172.21.15.1:6789/0 215 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540959 2017-08-19 03:25:46 2017-08-19 19:58:30 2017-08-19 20:34:31 0:36:01 0:26:42 0:09:19 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 20:11:05.580601 mon.a mon.1 172.21.15.73:6789/0 100 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1540960 2017-08-19 03:25:47 2017-08-19 19:58:32 2017-08-19 20:16:32 0:18:00 0:10:40 0:07:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1540961 2017-08-19 03:25:48 2017-08-19 20:02:04 2017-08-19 22:00:04 1:58:00 0:19:45 1:38:15 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 1540962 2017-08-19 03:25:48 2017-08-19 20:03:28 2017-08-19 20:39:28 0:36:00 0:30:07 0:05:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1540963 2017-08-19 03:25:49 2017-08-19 20:03:31 2017-08-19 21:07:31 1:04:00 0:37:20 0:26:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1540964 2017-08-19 03:25:50 2017-08-19 20:03:49 2017-08-19 21:33:44 1:29:55 0:22:19 1:07:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml} 4
Failure Reason:

"2017-08-19 21:13:54.833585 mon.a mon.0 172.21.15.64:6789/0 196 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540965 2017-08-19 03:25:50 2017-08-19 20:03:55 2017-08-19 20:25:53 0:21:58 0:08:59 0:12:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1540966 2017-08-19 03:25:51 2017-08-19 20:04:07 2017-08-19 20:26:04 0:21:57 0:13:53 0:08:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1540967 2017-08-19 03:25:51 2017-08-19 20:05:13 2017-08-19 21:03:12 0:57:59 0:47:29 0:10:30 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

"2017-08-19 20:34:50.569798 mon.b mon.0 172.21.15.12:6789/0 145 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

fail 1540968 2017-08-19 03:25:52 2017-08-19 20:05:39 2017-08-19 21:23:40 1:18:01 0:11:53 1:06:08 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-08-19 21:14:58.780060 mon.a mon.0 172.21.15.158:6789/0 203 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540969 2017-08-19 03:25:53 2017-08-19 20:07:42 2017-08-19 20:49:43 0:42:01 0:30:48 0:11:13 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 20:20:17.804308 mon.b mon.0 172.21.15.93:6789/0 167 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 1540970 2017-08-19 03:25:53 2017-08-19 20:07:42 2017-08-19 20:55:42 0:48:00 0:46:06 0:01:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1540971 2017-08-19 03:25:54 2017-08-19 20:08:00 2017-08-20 00:30:05 4:22:05 0:10:44 4:11:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml} 4
Failure Reason:

"2017-08-20 00:21:26.859517 mon.a mon.0 172.21.15.55:6789/0 201 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540972 2017-08-19 03:25:55 2017-08-19 20:08:55 2017-08-19 20:45:00 0:36:05 0:35:18 0:00:47 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1540973 2017-08-19 03:25:55 2017-08-19 20:09:00 2017-08-19 20:38:58 0:29:58 0:20:29 0:09:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1540974 2017-08-19 03:25:56 2017-08-19 20:10:07 2017-08-19 21:15:59 1:05:52 0:18:21 0:47:31 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-08-19 21:02:36.008966 mon.a mon.0 172.21.15.28:6789/0 198 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1540975 2017-08-19 03:25:57 2017-08-19 20:09:56 2017-08-19 23:30:00 3:20:04 2:51:58 0:28:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-08-19 20:39:48.080018 mon.b mon.0 172.21.15.135:6789/0 221 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1540976 2017-08-19 03:25:57 2017-08-19 20:11:02 2017-08-19 20:37:00 0:25:58 0:12:29 0:13:29 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 20:26:09.849795 mon.b mon.0 172.21.15.65:6789/0 105 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

dead 1540977 2017-08-19 03:25:58 2017-08-19 20:11:42 2017-08-20 08:18:49 12:07:07 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml} 4
pass 1540978 2017-08-19 03:25:59 2017-08-19 20:12:04 2017-08-19 21:21:58 1:09:54 0:46:39 0:23:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1540979 2017-08-19 03:25:59 2017-08-19 20:12:14 2017-08-19 21:24:14 1:12:00 0:47:06 0:24:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1540980 2017-08-19 03:26:00 2017-08-19 20:12:38 2017-08-19 20:38:37 0:25:59 0:13:50 0:12:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml} 4
Failure Reason:

"2017-08-19 20:27:40.863443 mon.a mon.0 172.21.15.172:6789/0 204 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540981 2017-08-19 03:26:01 2017-08-19 20:13:55 2017-08-19 20:29:54 0:15:59 0:12:09 0:03:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1540982 2017-08-19 03:26:01 2017-08-19 20:14:16 2017-08-19 20:36:15 0:21:59 0:21:17 0:00:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1540983 2017-08-19 03:26:02 2017-08-19 20:15:45 2017-08-19 21:03:44 0:47:59 0:25:49 0:22:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-08-19 20:41:12.628940 mon.a mon.0 172.21.15.84:6789/0 385 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1540984 2017-08-19 03:26:02 2017-08-19 20:16:34 2017-08-19 21:18:34 1:02:00 0:31:20 0:30:40 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 20:43:13.528974 mon.a mon.0 172.21.15.17:6789/0 4 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1540985 2017-08-19 03:26:03 2017-08-19 20:17:40 2017-08-19 20:33:39 0:15:59 0:11:10 0:04:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1540986 2017-08-19 03:26:04 2017-08-19 20:18:14 2017-08-19 21:36:07 1:17:53 0:37:28 0:40:25 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

fail 1540987 2017-08-19 03:26:05 2017-08-19 20:18:48 2017-08-19 21:00:47 0:41:59 0:28:52 0:13:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 20:42:00.886754 mon.b mon.0 172.21.15.52:6789/0 123 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1540988 2017-08-19 03:26:05 2017-08-19 20:20:10 2017-08-19 21:56:10 1:36:00 1:32:36 0:03:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1540989 2017-08-19 03:26:06 2017-08-19 20:20:43 2017-08-19 22:04:43 1:44:00 0:44:07 0:59:53 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml} 4
Failure Reason:

"2017-08-19 21:25:24.930517 mon.a mon.0 172.21.15.28:6789/0 197 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1540990 2017-08-19 03:26:07 2017-08-19 20:22:06 2017-08-19 20:36:04 0:13:58 0:09:23 0:04:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1540991 2017-08-19 03:26:07 2017-08-19 20:23:47 2017-08-19 20:49:49 0:26:02 0:18:31 0:07:31 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1540992 2017-08-19 03:26:08 2017-08-19 20:24:33 2017-08-19 22:02:34 1:38:01 1:04:44 0:33:17 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
Failure Reason:

"2017-08-19 21:02:35.519283 mon.b mon.1 172.21.15.36:6789/0 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 1540993 2017-08-19 03:26:08 2017-08-19 20:25:48 2017-08-19 21:47:47 1:21:59 0:47:50 0:34:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-08-19 21:07:31.443139 mon.a mon.0 172.21.15.54:6789/0 464 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1540994 2017-08-19 03:26:09 2017-08-19 20:25:13 2017-08-19 20:49:08 0:23:55 0:14:36 0:09:19 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 20:37:35.939037 mon.a mon.0 172.21.15.100:6789/0 327 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

pass 1540995 2017-08-19 03:26:10 2017-08-19 20:25:40 2017-08-19 21:35:40 1:10:00 0:54:21 0:15:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1540996 2017-08-19 03:26:10 2017-08-19 20:25:57 2017-08-19 21:19:54 0:53:57 0:26:24 0:27:33 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-08-19 20:57:13.214711 mon.a mon.0 172.21.15.188:6789/0 399 : cluster [ERR] Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE)" in cluster log

fail 1540997 2017-08-19 03:26:11 2017-08-19 20:26:38 2017-08-19 21:18:43 0:52:05 0:38:16 0:13:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
Failure Reason:

"2017-08-19 20:44:47.668690 mon.b mon.1 172.21.15.146:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1540998 2017-08-19 03:26:12 2017-08-19 20:26:54 2017-08-19 21:25:04 0:58:10 0:20:39 0:37:31 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1540999 2017-08-19 03:26:12 2017-08-19 20:26:32 2017-08-19 21:26:32 1:00:00 0:12:09 0:47:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml} 4
Failure Reason:

"2017-08-19 21:18:34.137974 mon.a mon.0 172.21.15.17:6789/0 202 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1541000 2017-08-19 03:26:13 2017-08-19 20:26:47 2017-08-20 00:36:49 4:10:02 3:58:09 0:11:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi190 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=master TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 1541001 2017-08-19 03:26:14 2017-08-19 20:27:17 2017-08-19 21:11:16 0:43:59 0:29:49 0:14:10 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-08-19 20:42:12.859860 mon.a mon.0 172.21.15.18:6789/0 185 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1541002 2017-08-19 03:26:14 2017-08-19 20:28:18 2017-08-19 20:52:17 0:23:59 0:08:19 0:15:40 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml} 4
Failure Reason:

Command failed on smithi172 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmppYp01n'

fail 1541003 2017-08-19 03:26:15 2017-08-19 20:30:06 2017-08-19 21:56:06 1:26:00 0:59:33 0:26:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

"2017-08-19 21:08:28.550783 mon.b mon.0 172.21.15.13:6789/0 224 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1541004 2017-08-19 03:26:16 2017-08-19 20:30:16 2017-08-19 21:10:15 0:39:59 0:30:07 0:09:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1541005 2017-08-19 03:26:16 2017-08-19 20:33:54 2017-08-19 22:19:53 1:45:59 0:11:15 1:34:44 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml} 4
Failure Reason:

"2017-08-19 22:09:33.082342 mon.a mon.0 172.21.15.194:6789/0 196 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1541006 2017-08-19 03:26:17 2017-08-19 20:34:34 2017-08-19 20:54:33 0:19:59 0:13:33 0:06:26 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1541007 2017-08-19 03:26:18 2017-08-19 20:35:00 2017-08-19 21:36:49 1:01:49 0:39:36 0:22:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1541008 2017-08-19 03:26:19 2017-08-19 20:35:57 2017-08-20 01:09:56 4:33:59 0:19:39 4:14:20 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml} 4
Failure Reason:

"2017-08-20 00:59:03.888675 mon.a mon.0 172.21.15.83:6789/0 198 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

fail 1541009 2017-08-19 03:26:19 2017-08-19 20:36:07 2017-08-19 20:58:05 0:21:58 0:14:29 0:07:29 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-08-19 20:45:58.484723 mon.b mon.0 172.21.15.113:6789/0 121 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1541010 2017-08-19 03:26:20 2017-08-19 20:36:16 2017-08-19 20:48:15 0:11:59 0:09:38 0:02:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1541011 2017-08-19 03:26:21 2017-08-19 20:37:16 2017-08-19 21:09:14 0:31:58 0:23:54 0:08:04 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml} 4
Failure Reason:

Test failure: test_migration_on_shutdown (tasks.cephfs.test_strays.TestStrays)

pass 1541012 2017-08-19 03:26:21 2017-08-19 20:38:51 2017-08-19 21:14:49 0:35:58 0:25:36 0:10:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1541013 2017-08-19 03:26:22 2017-08-19 20:38:49 2017-08-19 21:54:49 1:16:00 1:03:04 0:12:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1541014 2017-08-19 03:26:23 2017-08-19 20:39:00 2017-08-19 22:09:00 1:30:00 0:20:43 1:09:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml} 4
Failure Reason:

"2017-08-19 21:49:32.163625 mon.a mon.0 172.21.15.189:6789/0 209 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED)" in cluster log

pass 1541015 2017-08-19 03:26:23 2017-08-19 20:39:31 2017-08-19 21:01:29 0:21:58 0:10:03 0:11:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3