Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1638142 2017-09-15 22:35:24 2017-09-16 04:09:36 2017-09-16 04:33:35 0:23:59 0:08:55 0:15:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1638143 2017-09-15 22:35:25 2017-09-16 04:09:43 2017-09-16 05:05:43 0:56:00 0:48:43 0:07:17 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
fail 1638144 2017-09-15 22:35:25 2017-09-16 04:11:30 2017-09-16 04:29:30 0:18:00 0:12:00 0:06:00 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 04:22:31.484028 mon.a mon.0 172.21.15.56:6789/0 515 : cluster [WRN] Health check failed: 1 MDSs are read only (MDS_READ_ONLY)" in cluster log

pass 1638145 2017-09-15 22:35:26 2017-09-16 04:11:30 2017-09-16 04:37:30 0:26:00 0:19:21 0:06:39 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1638146 2017-09-15 22:35:27 2017-09-16 04:11:30 2017-09-16 04:49:30 0:38:00 0:22:18 0:15:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1638147 2017-09-15 22:35:27 2017-09-16 04:11:30 2017-09-16 04:41:30 0:30:00 0:10:54 0:19:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1638148 2017-09-15 22:35:28 2017-09-16 04:11:34 2017-09-16 04:53:34 0:42:00 0:29:28 0:12:32 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1638149 2017-09-15 22:35:28 2017-09-16 04:13:35 2017-09-16 04:39:34 0:25:59 0:17:31 0:08:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1638150 2017-09-15 22:35:29 2017-09-16 04:13:35 2017-09-16 04:57:35 0:44:00 0:16:06 0:27:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 04:46:16.532571 mon.a mon.0 172.21.15.72:6789/0 649 : cluster [WRN] MDS health message (mds.0): MDS cache is too large (521kB/1GB); 202 inodes in use by clients, 0 stray files" in cluster log

pass 1638151 2017-09-15 22:35:30 2017-09-16 04:13:37 2017-09-16 05:21:37 1:08:00 0:39:31 0:28:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1638152 2017-09-15 22:35:30 2017-09-16 04:14:15 2017-09-16 05:08:15 0:54:00 0:22:12 0:31:48 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
fail 1638153 2017-09-15 22:35:31 2017-09-16 04:15:43 2017-09-16 05:49:44 1:34:01 1:08:05 0:25:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 04:53:12.443863 mds.d mds.0 172.21.15.18:6810/1852095445 1 : cluster [WRN] evicting unresponsive client smithi044: (4326), after waiting 45 seconds during MDS startup" in cluster log

pass 1638154 2017-09-15 22:35:31 2017-09-16 04:17:28 2017-09-16 05:01:28 0:44:00 0:37:55 0:06:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1638155 2017-09-15 22:35:32 2017-09-16 04:17:28 2017-09-16 05:35:29 1:18:01 0:21:03 0:56:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1638156 2017-09-15 22:35:33 2017-09-16 04:17:28 2017-09-16 04:59:28 0:42:00 0:11:13 0:30:47 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1638157 2017-09-15 22:35:33 2017-09-16 04:17:30 2017-09-16 04:51:30 0:34:00 0:08:49 0:25:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1638158 2017-09-15 22:35:34 2017-09-16 04:17:33 2017-09-16 04:41:33 0:24:00 0:16:01 0:07:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1638159 2017-09-15 22:35:34 2017-09-16 04:17:34 2017-09-16 06:03:36 1:46:02 0:22:52 1:23:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
pass 1638160 2017-09-15 22:35:35 2017-09-16 04:17:52 2017-09-16 05:01:52 0:44:00 0:20:33 0:23:27 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1638161 2017-09-15 22:35:36 2017-09-16 04:19:33 2017-09-16 05:15:33 0:56:00 0:09:25 0:46:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1638162 2017-09-15 22:35:36 2017-09-16 04:19:33 2017-09-16 05:17:33 0:58:00 0:21:54 0:36:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1638163 2017-09-15 22:35:37 2017-09-16 04:19:33 2017-09-16 05:17:33 0:58:00 0:11:50 0:46:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1638164 2017-09-15 22:35:38 2017-09-16 04:19:33 2017-09-16 05:19:33 1:00:00 0:11:27 0:48:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1638165 2017-09-15 22:35:38 2017-09-16 04:21:35 2017-09-16 04:55:35 0:34:00 0:22:04 0:11:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 04:37:11.850398 mon.a mon.0 172.21.15.172:6789/0 456 : cluster [WRN] daemon mds.d is not responding, replacing it as rank 0 with standby daemon mds.b" in cluster log

pass 1638166 2017-09-15 22:35:39 2017-09-16 04:21:35 2017-09-16 04:51:35 0:30:00 0:09:51 0:20:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1638167 2017-09-15 22:35:40 2017-09-16 04:21:40 2017-09-16 04:33:39 0:11:59 0:10:15 0:01:44 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1638168 2017-09-15 22:35:40 2017-09-16 04:21:40 2017-09-16 06:13:42 1:52:02 0:30:51 1:21:11 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1638169 2017-09-15 22:35:41 2017-09-16 04:23:33 2017-09-16 05:11:33 0:48:00 0:12:20 0:35:40 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1638170 2017-09-15 22:35:41 2017-09-16 04:23:33 2017-09-16 05:15:33 0:52:00 0:23:34 0:28:26 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
fail 1638171 2017-09-15 22:35:42 2017-09-16 04:23:33 2017-09-16 05:25:33 1:02:00 0:24:27 0:37:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-09-16 05:04:55.703462 mon.b mon.0 172.21.15.38:6789/0 184 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1638172 2017-09-15 22:35:42 2017-09-16 04:25:25 2017-09-16 04:51:24 0:25:59 0:19:13 0:06:46 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1638173 2017-09-15 22:35:43 2017-09-16 04:25:25 2017-09-16 04:57:25 0:32:00 0:27:37 0:04:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1638174 2017-09-15 22:35:44 2017-09-16 04:25:28 2017-09-16 04:45:28 0:20:00 0:18:23 0:01:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1638175 2017-09-15 22:35:44 2017-09-16 04:27:33 2017-09-16 05:39:34 1:12:01 0:11:12 1:00:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1638176 2017-09-15 22:35:45 2017-09-16 04:27:33 2017-09-16 05:09:33 0:42:00 0:34:50 0:07:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1638177 2017-09-15 22:35:46 2017-09-16 04:29:40 2017-09-16 05:17:40 0:48:00 0:22:17 0:25:43 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1638178 2017-09-15 22:35:46 2017-09-16 04:29:40 2017-09-16 04:49:40 0:20:00 0:06:30 0:13:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi156 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmpSZc13y'

pass 1638179 2017-09-15 22:35:47 2017-09-16 04:29:40 2017-09-16 05:45:41 1:16:01 0:39:51 0:36:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1638180 2017-09-15 22:35:47 2017-09-16 04:29:40 2017-09-16 04:57:40 0:28:00 0:24:38 0:03:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1638181 2017-09-15 22:35:48 2017-09-16 04:31:29 2017-09-16 04:55:29 0:24:00 0:09:58 0:14:02 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1638182 2017-09-15 22:35:49 2017-09-16 04:31:29 2017-09-16 04:51:29 0:20:00 0:09:22 0:10:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1638183 2017-09-15 22:35:49 2017-09-16 04:31:30 2017-09-16 04:49:29 0:17:59 0:16:22 0:01:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1638184 2017-09-15 22:35:50 2017-09-16 04:31:30 2017-09-16 05:31:30 1:00:00 0:13:18 0:46:42 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
pass 1638185 2017-09-15 22:35:50 2017-09-16 04:33:28 2017-09-16 05:03:28 0:30:00 0:23:39 0:06:21 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1638186 2017-09-15 22:35:51 2017-09-16 04:33:28 2017-09-16 05:03:28 0:30:00 0:09:05 0:20:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1638187 2017-09-15 22:35:52 2017-09-16 04:33:30 2017-09-16 05:57:31 1:24:01 0:27:40 0:56:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_replicated_delete_speed (tasks.cephfs.test_strays.TestStrays)

pass 1638188 2017-09-15 22:35:52 2017-09-16 04:33:37 2017-09-16 05:05:36 0:31:59 0:22:17 0:09:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1638189 2017-09-15 22:35:53 2017-09-16 04:33:40 2017-09-16 04:47:40 0:14:00 0:09:06 0:04:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1638190 2017-09-15 22:35:53 2017-09-16 04:35:38 2017-09-16 05:57:38 1:22:00 0:18:25 1:03:35 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
pass 1638191 2017-09-15 22:35:54 2017-09-16 04:35:38 2017-09-16 04:47:37 0:11:59 0:07:39 0:04:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1638192 2017-09-15 22:35:55 2017-09-16 04:37:33 2017-09-16 05:25:33 0:48:00 0:09:27 0:38:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1638193 2017-09-15 22:35:55 2017-09-16 04:37:33 2017-09-16 05:53:34 1:16:01 0:41:53 0:34:08 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
fail 1638194 2017-09-15 22:35:56 2017-09-16 04:39:27 2017-09-16 05:43:28 1:04:01 0:11:38 0:52:23 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 05:36:47.651165 mon.a mon.0 172.21.15.114:6789/0 525 : cluster [WRN] Health check failed: 1 MDSs are read only (MDS_READ_ONLY)" in cluster log

pass 1638195 2017-09-15 22:35:57 2017-09-16 04:39:36 2017-09-16 05:17:35 0:37:59 0:27:31 0:10:28 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1638196 2017-09-15 22:35:57 2017-09-16 04:41:31 2017-09-16 05:13:31 0:32:00 0:23:04 0:08:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1638197 2017-09-15 22:35:58 2017-09-16 04:41:31 2017-09-16 05:15:31 0:34:00 0:11:04 0:22:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1638198 2017-09-15 22:35:59 2017-09-16 04:41:31 2017-09-16 05:15:31 0:34:00 0:26:03 0:07:57 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1638199 2017-09-15 22:35:59 2017-09-16 04:41:32 2017-09-16 05:37:32 0:56:00 0:19:38 0:36:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1638200 2017-09-15 22:36:00 2017-09-16 04:41:34 2017-09-16 05:37:35 0:56:01 0:14:32 0:41:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 05:26:42.032674 mon.a mon.0 172.21.15.55:6789/0 647 : cluster [WRN] MDS health message (mds.0): MDS cache is too large (496kB/1GB); 202 inodes in use by clients, 0 stray files" in cluster log

pass 1638201 2017-09-15 22:36:01 2017-09-16 04:41:41 2017-09-16 05:43:41 1:02:00 0:37:30 0:24:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1638202 2017-09-15 22:36:01 2017-09-16 04:43:28 2017-09-16 05:07:27 0:23:59 0:11:10 0:12:49 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
dead 1638203 2017-09-15 22:36:02 2017-09-16 04:43:28 2017-09-16 16:49:49 12:06:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1638204 2017-09-15 22:36:03 2017-09-16 04:43:35 2017-09-16 05:27:35 0:44:00 0:36:57 0:07:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1638205 2017-09-15 22:36:03 2017-09-16 04:45:28 2017-09-16 05:15:28 0:30:00 0:19:09 0:10:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-09-16 05:00:32.329776 mon.a mon.0 172.21.15.81:6789/0 257 : cluster [WRN] daemon mds.a-s is not responding, replacing it as rank 0 with standby daemon mds.a" in cluster log

pass 1638206 2017-09-15 22:36:04 2017-09-16 04:45:29 2017-09-16 05:03:28 0:17:59 0:11:45 0:06:14 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1638207 2017-09-15 22:36:04 2017-09-16 04:47:15 2017-09-16 05:25:15 0:38:00 0:08:40 0:29:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1638208 2017-09-15 22:36:05 2017-09-16 04:47:25 2017-09-16 05:09:25 0:22:00 0:17:47 0:04:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1638209 2017-09-15 22:36:06 2017-09-16 04:47:38 2017-09-16 05:33:38 0:46:00 0:22:23 0:23:37 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
pass 1638210 2017-09-15 22:36:06 2017-09-16 04:47:41 2017-09-16 05:19:41 0:32:00 0:23:53 0:08:07 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1638211 2017-09-15 22:36:07 2017-09-16 04:49:34 2017-09-16 05:11:33 0:21:59 0:08:56 0:13:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1638212 2017-09-15 22:36:08 2017-09-16 04:49:34 2017-09-16 05:17:33 0:27:59 0:22:49 0:05:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_rebuild_simple_altpool (tasks.cephfs.test_data_scan.TestDataScan)

pass 1638213 2017-09-15 22:36:08 2017-09-16 04:49:34 2017-09-16 05:07:33 0:17:59 0:10:28 0:07:31 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1638214 2017-09-15 22:36:09 2017-09-16 04:49:42 2017-09-16 05:09:41 0:19:59 0:11:03 0:08:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1638215 2017-09-15 22:36:09 2017-09-16 04:51:37 2017-09-16 05:59:38 1:08:01 0:19:33 0:48:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-09-16 05:42:49.292571 mon.a mon.0 172.21.15.67:6789/0 458 : cluster [WRN] daemon mds.c is not responding, replacing it as rank 0 with standby daemon mds.a" in cluster log

pass 1638216 2017-09-15 22:36:10 2017-09-16 04:51:37 2017-09-16 05:27:37 0:36:00 0:07:31 0:28:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1638217 2017-09-15 22:36:11 2017-09-16 04:51:37 2017-09-16 05:25:37 0:34:00 0:09:55 0:24:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1638218 2017-09-15 22:36:11 2017-09-16 04:51:37 2017-09-16 06:09:38 1:18:01 0:31:51 0:46:10 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1638219 2017-09-15 22:36:12 2017-09-16 04:51:37 2017-09-16 05:39:37 0:48:00 0:14:50 0:33:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1638220 2017-09-15 22:36:13 2017-09-16 04:53:35 2017-09-16 05:23:35 0:30:00 0:14:44 0:15:16 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1638221 2017-09-15 22:36:13 2017-09-16 04:55:33 2017-09-16 05:19:33 0:24:00 0:22:55 0:01:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1638222 2017-09-15 22:36:14 2017-09-16 04:55:33 2017-09-16 05:17:33 0:22:00 0:18:19 0:03:41 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
fail 1638223 2017-09-15 22:36:15 2017-09-16 04:55:36 2017-09-16 05:35:36 0:40:00 0:27:46 0:12:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
Failure Reason:

"2017-09-16 05:17:15.068807 mon.b mon.0 172.21.15.193:6789/0 260 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1638224 2017-09-15 22:36:15 2017-09-16 04:57:35 2017-09-16 05:21:35 0:24:00 0:17:45 0:06:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1638225 2017-09-15 22:36:16 2017-09-16 04:57:36 2017-09-16 05:27:36 0:30:00 0:11:29 0:18:31 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1638226 2017-09-15 22:36:16 2017-09-16 04:57:36 2017-09-16 05:51:37 0:54:01 0:35:57 0:18:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1638227 2017-09-15 22:36:17 2017-09-16 04:57:41 2017-09-16 05:41:41 0:44:00 0:23:06 0:20:54 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1638228 2017-09-15 22:36:18 2017-09-16 04:59:30 2017-09-16 06:11:31 1:12:01 0:06:56 1:05:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi055 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmppFh2TE'

fail 1638229 2017-09-15 22:36:18 2017-09-16 04:59:31 2017-09-16 05:45:31 0:46:00 0:39:45 0:06:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

"2017-09-16 05:28:27.695073 mon.b mon.0 172.21.15.3:6789/0 210 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1638230 2017-09-15 22:36:19 2017-09-16 05:01:39 2017-09-16 05:39:39 0:38:00 0:25:22 0:12:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1638231 2017-09-15 22:36:19 2017-09-16 05:01:39 2017-09-16 07:13:41 2:12:02 0:12:05 1:59:57 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1638232 2017-09-15 22:36:20 2017-09-16 05:01:39 2017-09-16 05:19:39 0:18:00 0:09:21 0:08:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1638233 2017-09-15 22:36:21 2017-09-16 05:01:53 2017-09-16 05:31:53 0:30:00 0:14:55 0:15:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1638234 2017-09-15 22:36:21 2017-09-16 05:03:10 2017-09-16 05:37:10 0:34:00 0:11:54 0:22:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
pass 1638235 2017-09-15 22:36:22 2017-09-16 05:03:29 2017-09-16 05:31:29 0:28:00 0:11:01 0:16:59 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1638236 2017-09-15 22:36:23 2017-09-16 05:03:29 2017-09-16 05:27:29 0:24:00 0:10:48 0:13:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1638237 2017-09-15 22:36:23 2017-09-16 05:03:29 2017-09-16 05:43:29 0:40:00 0:12:50 0:27:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 1638238 2017-09-15 22:36:24 2017-09-16 05:05:49 2017-09-16 05:43:49 0:38:00 0:21:01 0:16:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1638239 2017-09-15 22:36:25 2017-09-16 05:05:49 2017-09-16 05:31:49 0:26:00 0:11:06 0:14:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1638240 2017-09-15 22:36:25 2017-09-16 05:07:38 2017-09-16 05:31:38 0:24:00 0:18:06 0:05:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
pass 1638241 2017-09-15 22:36:26 2017-09-16 05:08:16 2017-09-16 05:28:16 0:20:00 0:07:50 0:12:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3