Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1045271 2017-04-19 17:56:54 2017-04-19 18:51:51 2017-04-19 19:03:50 0:11:59 0:07:10 0:04:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1045272 2017-04-19 17:56:54 2017-04-19 18:51:52 2017-04-19 19:55:53 1:04:01 0:48:19 0:15:42 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
fail 1045273 2017-04-19 17:56:55 2017-04-19 18:51:59 2017-04-19 19:11:59 0:20:00 0:10:43 0:09:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-04-19 19:06:38.235408 mon.0 172.21.15.135:6789/0 498 : cluster [WRN] MDS health message (mds.0): MDS in read-only mode" in cluster log

fail 1045274 2017-04-19 17:56:56 2017-04-19 18:52:10 2017-04-19 19:12:09 0:19:59 0:11:51 0:08:08 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

Command failed on smithi134 with status 110: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.108:6789,172.21.15.168:6790,172.21.15.168:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 1045275 2017-04-19 17:56:56 2017-04-19 18:52:23 2017-04-19 19:24:22 0:31:59 0:22:20 0:09:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1045276 2017-04-19 17:56:57 2017-04-19 18:52:22 2017-04-19 19:22:22 0:30:00 0:11:41 0:18:19 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml} 4
pass 1045277 2017-04-19 17:56:57 2017-04-19 18:52:23 2017-04-19 19:30:23 0:38:00 0:31:13 0:06:47 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1045278 2017-04-19 17:56:58 2017-04-19 18:52:31 2017-04-19 19:16:31 0:24:00 0:18:31 0:05:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1045279 2017-04-19 17:56:59 2017-04-19 18:52:32 2017-04-19 19:20:32 0:28:00 0:13:44 0:14:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-04-19 19:10:54.123736 mon.0 172.21.15.92:6789/0 632 : cluster [WRN] MDS health message (mds.0): Too many inodes in cache (162/100), 202 inodes in use by clients, 0 stray files" in cluster log

pass 1045280 2017-04-19 17:56:59 2017-04-19 18:52:42 2017-04-19 20:10:43 1:18:01 0:41:46 0:36:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
fail 1045281 2017-04-19 17:57:00 2017-04-19 18:53:39 2017-04-19 19:23:39 0:30:00 0:22:03 0:07:57 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-04-19 19:08:29.805426 osd.2 172.21.15.192:6800/12414 163 : cluster [WRN] map e11 wrongly marked me down at e10" in cluster log

pass 1045282 2017-04-19 17:57:00 2017-04-19 18:53:57 2017-04-19 20:23:59 1:30:02 0:29:37 1:00:25 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml} 4
pass 1045283 2017-04-19 17:57:01 2017-04-19 18:54:28 2017-04-19 19:42:28 0:48:00 0:35:29 0:12:31 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1045284 2017-04-19 17:57:02 2017-04-19 18:54:34 2017-04-19 19:26:34 0:32:00 0:23:48 0:08:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1045285 2017-04-19 17:57:02 2017-04-19 18:54:36 2017-04-19 19:32:36 0:38:00 0:09:41 0:28:19 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml} 4
pass 1045286 2017-04-19 17:57:03 2017-04-19 18:54:51 2017-04-19 19:10:51 0:16:00 0:09:41 0:06:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1045287 2017-04-19 17:57:03 2017-04-19 18:55:14 2017-04-19 19:21:14 0:26:00 0:18:46 0:07:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1045288 2017-04-19 17:57:04 2017-04-19 18:55:51 2017-04-19 23:01:57 4:06:06 0:16:09 3:49:57 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-04-19 22:46:42.799684 mon.0 172.21.15.64:6789/0 358 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

pass 1045289 2017-04-19 17:57:05 2017-04-19 18:56:06 2017-04-19 19:30:06 0:34:00 0:26:01 0:07:59 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1045290 2017-04-19 17:57:05 2017-04-19 18:56:06 2017-04-19 19:10:05 0:13:59 0:09:09 0:04:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1045291 2017-04-19 17:57:06 2017-04-19 18:56:25 2017-04-19 19:32:24 0:35:59 0:24:05 0:11:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1045292 2017-04-19 17:57:06 2017-04-19 18:57:59 2017-04-19 19:21:59 0:24:00 0:10:14 0:13:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1045293 2017-04-19 17:57:07 2017-04-19 18:57:59 2017-04-19 19:23:59 0:26:00 0:10:05 0:15:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1045294 2017-04-19 17:57:08 2017-04-19 18:58:33 2017-04-19 20:38:34 1:40:01 0:14:42 1:25:19 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml} 4
pass 1045295 2017-04-19 17:57:08 2017-04-19 18:58:42 2017-04-19 19:44:42 0:46:00 0:05:45 0:40:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1045296 2017-04-19 17:57:09 2017-04-19 18:58:45 2017-04-19 19:18:45 0:20:00 0:10:10 0:09:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1045297 2017-04-19 17:57:09 2017-04-19 18:59:35 2017-04-19 19:35:35 0:36:00 0:29:31 0:06:29 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
fail 1045298 2017-04-19 17:57:10 2017-04-19 18:59:35 2017-04-19 19:53:35 0:54:00 0:11:37 0:42:23 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-04-19 19:45:16.766535 mon.0 172.21.15.117:6789/0 442 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

dead 1045299 2017-04-19 17:57:11 2017-04-19 18:59:52 2017-04-20 07:05:29 12:05:37 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1045300 2017-04-19 17:57:11 2017-04-19 18:59:55 2017-04-19 19:29:55 0:30:00 0:24:16 0:05:44 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1045301 2017-04-19 17:57:12 2017-04-19 18:59:58 2017-04-19 19:31:57 0:31:59 0:21:11 0:10:48 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-04-19 19:14:11.674523 mon.0 172.21.15.73:6789/0 371 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

pass 1045302 2017-04-19 17:57:12 2017-04-19 19:00:27 2017-04-19 19:34:27 0:34:00 0:25:47 0:08:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1045303 2017-04-19 17:57:13 2017-04-19 19:02:01 2017-04-19 19:36:01 0:34:00 0:19:02 0:14:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1045304 2017-04-19 17:57:14 2017-04-19 19:02:01 2017-04-19 19:58:01 0:56:00 0:10:32 0:45:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml} 4
pass 1045305 2017-04-19 17:57:14 2017-04-19 19:02:01 2017-04-19 19:56:01 0:54:00 0:36:45 0:17:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1045306 2017-04-19 17:57:15 2017-04-19 19:02:12 2017-04-19 19:28:12 0:26:00 0:20:14 0:05:46 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1045307 2017-04-19 17:57:15 2017-04-19 19:02:15 2017-04-19 19:42:15 0:40:00 0:11:15 0:28:45 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml} 4
Failure Reason:

Test failure: test_full_different_file (tasks.cephfs.test_full.TestClusterFull)

pass 1045308 2017-04-19 17:57:16 2017-04-19 19:02:18 2017-04-19 19:46:18 0:44:00 0:37:52 0:06:08 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1045309 2017-04-19 17:57:16 2017-04-19 19:02:18 2017-04-19 19:30:18 0:28:00 0:21:40 0:06:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1045310 2017-04-19 17:57:17 2017-04-19 19:02:28 2017-04-19 20:30:29 1:28:01 0:07:03 1:20:58 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml} 4
pass 1045311 2017-04-19 17:57:18 2017-04-19 19:03:22 2017-04-19 19:43:22 0:40:00 0:09:19 0:30:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1045312 2017-04-19 17:57:18 2017-04-19 19:03:38 2017-04-19 19:21:38 0:18:00 0:11:20 0:06:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1045313 2017-04-19 17:57:19 2017-04-19 19:03:52 2017-04-19 19:37:51 0:33:59 0:14:25 0:19:34 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml} 4
pass 1045314 2017-04-19 17:57:20 2017-04-19 19:03:56 2017-04-19 19:35:56 0:32:00 0:19:35 0:12:25 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1045315 2017-04-19 17:57:20 2017-04-19 19:04:01 2017-04-19 19:20:00 0:15:59 0:09:45 0:06:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1045316 2017-04-19 17:57:21 2017-04-19 19:04:30 2017-04-19 20:38:32 1:34:02 0:24:06 1:09:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml} 4
pass 1045317 2017-04-19 17:57:21 2017-04-19 19:06:07 2017-04-19 19:36:07 0:30:00 0:21:08 0:08:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1045318 2017-04-19 17:57:22 2017-04-19 19:06:07 2017-04-19 19:22:07 0:16:00 0:09:50 0:06:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1045319 2017-04-19 17:57:23 2017-04-19 19:06:07 2017-04-19 19:38:07 0:32:00 0:17:22 0:14:38 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml} 4
pass 1045320 2017-04-19 17:57:23 2017-04-19 19:06:18 2017-04-19 19:30:18 0:24:00 0:08:18 0:15:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1045321 2017-04-19 17:57:24 2017-04-19 19:06:35 2017-04-19 19:24:34 0:17:59 0:08:50 0:09:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1045322 2017-04-19 17:57:24 2017-04-19 19:07:21 2017-04-19 20:11:21 1:04:00 0:43:29 0:20:31 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

Command failed on smithi037 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

fail 1045323 2017-04-19 17:57:25 2017-04-19 19:07:41 2017-04-19 19:37:41 0:30:00 0:07:23 0:22:37 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml} 4
Failure Reason:

"2017-04-19 19:32:34.549285 mon.0 172.21.15.82:6789/0 487 : cluster [WRN] MDS health message (mds.0): MDS in read-only mode" in cluster log

pass 1045324 2017-04-19 17:57:26 2017-04-19 19:08:33 2017-04-19 20:00:34 0:52:01 0:21:38 0:30:23 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1045325 2017-04-19 17:57:26 2017-04-19 19:10:15 2017-04-19 19:44:15 0:34:00 0:19:12 0:14:48 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1045326 2017-04-19 17:57:27 2017-04-19 19:10:52 2017-04-19 20:16:52 1:06:00 0:06:39 0:59:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml} 4
pass 1045327 2017-04-19 17:57:27 2017-04-19 19:11:34 2017-04-19 20:09:34 0:58:00 0:27:15 0:30:45 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1045328 2017-04-19 17:57:28 2017-04-19 19:12:00 2017-04-19 19:41:59 0:29:59 0:18:53 0:11:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1045329 2017-04-19 17:57:29 2017-04-19 19:12:10 2017-04-19 20:38:11 1:26:01 0:14:01 1:12:00 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml} 4
Failure Reason:

"2017-04-19 20:28:11.825503 mon.0 172.21.15.158:6789/0 617 : cluster [WRN] MDS health message (mds.0): Too many inodes in cache (162/100), 202 inodes in use by clients, 0 stray files" in cluster log

pass 1045330 2017-04-19 17:57:29 2017-04-19 19:12:24 2017-04-19 20:22:25 1:10:01 0:41:14 0:28:47 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1045331 2017-04-19 17:57:30 2017-04-19 19:12:26 2017-04-19 19:32:25 0:19:59 0:10:10 0:09:49 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1045332 2017-04-19 17:57:30 2017-04-19 19:14:07 2017-04-19 20:46:08 1:32:01 1:08:03 0:23:58 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml} 4
pass 1045333 2017-04-19 17:57:31 2017-04-19 19:14:07 2017-04-19 19:54:07 0:40:00 0:36:24 0:03:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1045334 2017-04-19 17:57:32 2017-04-19 19:15:49 2017-04-19 19:43:49 0:28:00 0:23:14 0:04:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1045335 2017-04-19 17:57:32 2017-04-19 19:15:49 2017-04-19 19:33:48 0:17:59 0:11:20 0:06:39 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml} 4
pass 1045336 2017-04-19 17:57:33 2017-04-19 19:15:55 2017-04-19 19:27:55 0:12:00 0:06:33 0:05:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1045337 2017-04-19 17:57:33 2017-04-19 19:16:32 2017-04-19 19:58:32 0:42:00 0:13:32 0:28:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1045338 2017-04-19 17:57:34 2017-04-19 19:17:23 2017-04-19 20:13:24 0:56:01 0:15:53 0:40:08 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml} 4
Failure Reason:

"2017-04-19 19:58:16.171628 mon.0 172.21.15.203:6789/0 356 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

pass 1045339 2017-04-19 17:57:35 2017-04-19 19:18:02 2017-04-19 19:50:02 0:32:00 0:21:58 0:10:02 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1045340 2017-04-19 17:57:35 2017-04-19 19:18:53 2017-04-19 19:26:53 0:08:00 0:06:18 0:01:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1045341 2017-04-19 17:57:36 2017-04-19 19:20:10 2017-04-19 19:56:09 0:35:59 0:20:13 0:15:46 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1045342 2017-04-19 17:57:36 2017-04-19 19:20:33 2017-04-19 19:54:33 0:34:00 0:07:39 0:26:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1045343 2017-04-19 17:57:37 2017-04-19 19:21:24 2017-04-19 19:41:23 0:19:59 0:10:33 0:09:26 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1045344 2017-04-19 17:57:38 2017-04-19 19:21:39 2017-04-19 19:47:39 0:26:00 0:18:03 0:07:57 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml} 4
pass 1045345 2017-04-19 17:57:38 2017-04-19 19:21:59 2017-04-19 19:33:58 0:11:59 0:08:03 0:03:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1045346 2017-04-19 17:57:39 2017-04-19 19:22:01 2017-04-19 19:32:00 0:09:59 0:06:41 0:03:18 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1045347 2017-04-19 17:57:39 2017-04-19 19:22:08 2017-04-19 20:50:09 1:28:01 0:30:48 0:57:13 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
fail 1045348 2017-04-19 17:57:40 2017-04-19 19:22:33 2017-04-19 20:52:34 1:30:01 0:11:32 1:18:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml} 4
Failure Reason:

"2017-04-19 20:45:05.924591 mon.0 172.21.15.158:6789/0 447 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

pass 1045349 2017-04-19 17:57:40 2017-04-19 19:22:48 2017-04-19 19:34:48 0:12:00 0:07:34 0:04:26 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1045350 2017-04-19 17:57:41 2017-04-19 19:23:46 2017-04-19 19:53:46 0:30:00 0:23:45 0:06:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
fail 1045351 2017-04-19 17:57:42 2017-04-19 19:23:46 2017-04-19 20:03:46 0:40:00 0:17:42 0:22:18 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml} 4
Failure Reason:

"2017-04-19 19:48:33.489620 mon.0 172.21.15.161:6789/0 369 : cluster [ERR] MDS health message (mds.0): Metadata damage detected" in cluster log

pass 1045352 2017-04-19 17:57:42 2017-04-19 19:24:00 2017-04-19 19:56:00 0:32:00 0:25:10 0:06:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1045353 2017-04-19 17:57:43 2017-04-19 19:24:23 2017-04-19 19:50:23 0:26:00 0:18:47 0:07:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1045354 2017-04-19 17:57:43 2017-04-19 19:24:35 2017-04-19 19:54:35 0:30:00 0:09:18 0:20:42 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml} 4
pass 1045355 2017-04-19 17:57:44 2017-04-19 19:26:46 2017-04-19 20:14:46 0:48:00 0:31:36 0:16:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1045356 2017-04-19 17:57:44 2017-04-19 19:26:54 2017-04-19 19:50:53 0:23:59 0:21:04 0:02:55 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1045357 2017-04-19 17:57:45 2017-04-19 19:28:06 2017-04-19 20:56:07 1:28:01 0:11:13 1:16:48 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml} 4
Failure Reason:

Test failure: test_full_different_file (tasks.cephfs.test_full.TestClusterFull)

pass 1045358 2017-04-19 17:57:46 2017-04-19 19:28:13 2017-04-19 20:16:13 0:48:00 0:40:39 0:07:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1045359 2017-04-19 17:57:46 2017-04-19 19:30:07 2017-04-19 19:52:07 0:22:00 0:20:16 0:01:44 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1045360 2017-04-19 17:57:47 2017-04-19 19:30:09 2017-04-19 19:58:08 0:27:59 0:06:56 0:21:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml} 4
pass 1045361 2017-04-19 17:57:47 2017-04-19 19:30:10 2017-04-19 19:42:09 0:11:59 0:09:36 0:02:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1045362 2017-04-19 17:57:48 2017-04-19 19:30:10 2017-04-19 19:50:09 0:19:59 0:11:06 0:08:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1045363 2017-04-19 17:57:48 2017-04-19 19:30:10 2017-04-19 20:14:10 0:44:00 0:15:48 0:28:12 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml} 4
pass 1045364 2017-04-19 17:57:49 2017-04-19 19:30:10 2017-04-19 20:06:10 0:36:00 0:10:52 0:25:08 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1045365 2017-04-19 17:57:50 2017-04-19 19:30:10 2017-04-19 19:46:10 0:16:00 0:08:55 0:07:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1045366 2017-04-19 17:57:50 2017-04-19 19:30:12 2017-04-19 19:48:11 0:17:59 0:12:43 0:05:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 1045367 2017-04-19 17:57:51 2017-04-19 19:30:16 2017-04-19 20:02:15 0:31:59 0:22:26 0:09:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1045368 2017-04-19 17:57:51 2017-04-19 19:30:19 2017-04-19 19:46:18 0:15:59 0:07:38 0:08:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1045369 2017-04-19 17:57:52 2017-04-19 19:30:19 2017-04-19 19:56:19 0:26:00 0:17:17 0:08:43 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml} 4
pass 1045370 2017-04-19 17:57:53 2017-04-19 22:17:09 2017-04-19 22:39:09 0:22:00 0:06:10 0:15:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3