Pulpito

pdonnell-2017-10-24_05:42:49-kcephfs-wip-pdonnell-testing-201710240410-testing-basic-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail
pdonnell 2017-10-24 05:42:49 2017-10-24 08:44:08 2017-10-24 11:39:11 2:55:03 kcephfs wip-pdonnell-testing-201710240410 smithi fd98cf8 91 9

Average wait time: 0:28:14

See other runs of suite 'kcephfs' on branch 'wip-pdonnell-testing-201710240410'?

See other runs on branch 'wip-pdonnell-testing-201710240410'?

See other runs scheduled on 2017-10-24?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1768131 2017-10-24 05:42:53 2017-10-24 06:30:26 2017-10-24 06:54:26 0:24:00 0:09:48 0:14:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1768135 2017-10-24 05:42:54 2017-10-24 06:32:07 2017-10-24 09:00:13 2:28:06 0:51:08 1:36:58 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1768138 2017-10-24 05:42:54 2017-10-24 06:35:57 2017-10-24 07:55:58 1:20:01 0:11:33 1:08:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1768140 2017-10-24 05:42:55 2017-10-24 06:38:27 2017-10-24 07:02:26 0:23:59 0:23:03 0:00:56 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1768144 2017-10-24 05:42:56 2017-10-24 06:40:02 2017-10-24 07:08:02 0:28:00 0:22:58 0:05:02 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1768147 2017-10-24 05:42:57 2017-10-24 06:42:08 2017-10-24 07:10:08 0:28:00 0:10:55 0:17:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1768150 2017-10-24 05:42:58 2017-10-24 06:45:58 2017-10-24 07:25:58 0:40:00 0:29:36 0:10:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1768153 2017-10-24 05:42:59 2017-10-24 06:47:48 2017-10-24 07:25:48 0:38:00 0:18:08 0:19:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1768156 2017-10-24 05:43:00 2017-10-24 06:52:13 2017-10-24 07:58:12 1:05:59 0:17:48 0:48:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1768159 2017-10-24 05:43:00 2017-10-24 06:54:39 2017-10-24 07:38:39 0:44:00 0:38:49 0:05:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1768162 2017-10-24 05:43:01 2017-10-24 06:57:51 2017-10-24 07:33:50 0:35:59 0:20:56 0:15:03 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1768165 2017-10-24 05:43:02 2017-10-24 06:59:53 2017-10-24 08:21:54 1:22:01 1:09:15 0:12:46 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1768168 2017-10-24 05:43:03 2017-10-24 07:02:22 2017-10-24 07:54:22 0:52:00 0:37:19 0:14:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1768171 2017-10-24 05:43:04 2017-10-24 07:05:28 2017-10-24 08:09:28 1:04:00 0:18:31 0:45:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 1768174 2017-10-24 05:43:04 2017-10-24 07:07:49 2017-10-24 07:27:49 0:20:00 0:03:10 0:16:50 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F16.04%2Fx86_64&sha1=fd98cf8bc85e54de7959f9487919e04c20b4a086 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc7b73fb450>: Failed to establish a new connection: [Errno 113] No route to host',))

pass 1768177 2017-10-24 05:43:05 2017-10-24 07:08:10 2017-10-24 07:30:09 0:21:59 0:11:21 0:10:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1768180 2017-10-24 05:43:06 2017-10-24 07:10:09 2017-10-24 07:52:09 0:42:00 0:20:53 0:21:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1768183 2017-10-24 05:43:06 2017-10-24 07:13:43 2017-10-24 08:11:44 0:58:01 0:18:17 0:39:44 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1768186 2017-10-24 05:43:07 2017-10-24 07:17:41 2017-10-24 07:47:41 0:30:00 0:20:18 0:09:42 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-10-24 07:30:50.591716 mon.b mon.0 172.21.15.107:6789/0 141 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1768189 2017-10-24 05:43:08 2017-10-24 07:21:41 2017-10-24 07:39:41 0:18:00 0:11:26 0:06:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1768192 2017-10-24 05:43:08 2017-10-24 07:22:04 2017-10-24 09:06:07 1:44:03 0:25:59 1:18:04 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1768195 2017-10-24 05:43:09 2017-10-24 07:24:20 2017-10-24 07:44:19 0:19:59 0:13:26 0:06:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1768198 2017-10-24 05:43:10 2017-10-24 07:25:49 2017-10-24 07:51:49 0:26:00 0:11:53 0:14:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1768201 2017-10-24 05:43:11 2017-10-24 07:26:01 2017-10-24 08:26:06 1:00:05 0:22:17 0:37:48 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1768204 2017-10-24 05:43:11 2017-10-24 07:28:26 2017-10-24 07:52:26 0:24:00 0:07:47 0:16:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1768207 2017-10-24 05:43:12 2017-10-24 07:30:10 2017-10-24 07:52:10 0:22:00 0:09:33 0:12:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1768210 2017-10-24 05:43:13 2017-10-24 07:30:32 2017-10-24 08:38:32 1:08:00 0:29:15 0:38:45 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1768213 2017-10-24 05:43:13 2017-10-24 07:34:06 2017-10-24 08:10:06 0:36:00 0:13:37 0:22:23 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1768216 2017-10-24 05:43:14 2017-10-24 07:38:35 2017-10-24 08:08:35 0:30:00 0:27:17 0:02:43 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1768219 2017-10-24 05:43:15 2017-10-24 07:39:47 2017-10-24 08:47:48 1:08:01 0:25:57 0:42:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1768221 2017-10-24 05:43:16 2017-10-24 07:40:10 2017-10-24 09:58:20 2:18:10 0:20:01 1:58:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1768224 2017-10-24 05:43:16 2017-10-24 07:41:43 2017-10-24 08:09:42 0:27:59 0:23:13 0:04:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1768227 2017-10-24 05:43:17 2017-10-24 07:43:18 2017-10-24 08:07:17 0:23:59 0:17:31 0:06:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1768231 2017-10-24 05:43:18 2017-10-24 07:44:24 2017-10-24 08:02:23 0:17:59 0:11:10 0:06:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1768234 2017-10-24 05:43:19 2017-10-24 07:46:23 2017-10-24 08:24:23 0:38:00 0:34:30 0:03:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1768237 2017-10-24 05:43:19 2017-10-24 07:49:51 2017-10-24 08:11:51 0:22:00 0:20:41 0:01:19 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1768240 2017-10-24 05:43:20 2017-10-24 07:50:03 2017-10-24 10:00:07 2:10:04 0:06:36 2:03:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi067 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpgGMWnh'

pass 1768243 2017-10-24 05:43:21 2017-10-24 07:51:49 2017-10-24 08:31:49 0:40:00 0:39:24 0:00:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1768246 2017-10-24 05:43:22 2017-10-24 07:52:10 2017-10-24 09:36:13 1:44:03 0:23:44 1:20:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1768249 2017-10-24 05:43:23 2017-10-24 07:52:23 2017-10-24 08:24:23 0:32:00 0:11:15 0:20:45 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1768252 2017-10-24 05:43:23 2017-10-24 07:53:04 2017-10-24 08:05:03 0:11:59 0:09:11 0:02:48 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1768254 2017-10-24 05:43:24 2017-10-24 07:54:00 2017-10-24 08:24:00 0:30:00 0:16:54 0:13:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1768257 2017-10-24 05:43:25 2017-10-24 07:56:09 2017-10-24 10:02:11 2:06:02 0:11:24 1:54:38 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1768260 2017-10-24 05:43:26 2017-10-24 07:58:13 2017-10-24 08:34:14 0:36:01 0:21:43 0:14:18 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-10-24 08:14:46.070615 mon.a mon.0 172.21.15.45:6789/0 136 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1768263 2017-10-24 05:43:26 2017-10-24 08:00:08 2017-10-24 08:34:08 0:34:00 0:11:35 0:22:25 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1768267 2017-10-24 05:43:27 2017-10-24 08:04:09 2017-10-24 09:02:10 0:58:01 0:27:17 0:30:44 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1768270 2017-10-24 05:43:28 2017-10-24 08:06:41 2017-10-24 09:08:41 1:02:00 0:22:19 0:39:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1768273 2017-10-24 05:43:28 2017-10-24 08:08:40 2017-10-24 08:22:39 0:13:59 0:11:18 0:02:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1768276 2017-10-24 05:43:29 2017-10-24 08:10:02 2017-10-24 10:10:04 2:00:02 0:14:08 1:45:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1768280 2017-10-24 05:43:30 2017-10-24 08:10:50 2017-10-24 09:00:50 0:50:00 0:08:15 0:41:45 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1768283 2017-10-24 05:43:31 2017-10-24 08:12:00 2017-10-24 08:44:00 0:32:00 0:08:36 0:23:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1768286 2017-10-24 05:43:32 2017-10-24 08:13:57 2017-10-24 09:01:57 0:48:00 0:45:29 0:02:31 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1768289 2017-10-24 05:43:32 2017-10-24 08:16:16 2017-10-24 08:50:16 0:34:00 0:12:43 0:21:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1768292 2017-10-24 05:43:33 2017-10-24 08:18:12 2017-10-24 09:00:13 0:42:01 0:25:04 0:16:57 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1768295 2017-10-24 05:43:34 2017-10-24 08:20:07 2017-10-24 09:50:09 1:30:02 0:22:23 1:07:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1768297 2017-10-24 05:43:34 2017-10-24 08:22:04 2017-10-24 08:50:04 0:28:00 0:09:28 0:18:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1768300 2017-10-24 05:43:35 2017-10-24 08:24:32 2017-10-24 09:16:32 0:52:00 0:26:18 0:25:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1768303 2017-10-24 05:43:36 2017-10-24 08:25:14 2017-10-24 08:53:13 0:27:59 0:19:44 0:08:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1768305 2017-10-24 05:43:37 2017-10-24 08:26:25 2017-10-24 09:16:25 0:50:00 0:14:32 0:35:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1768308 2017-10-24 05:43:37 2017-10-24 08:29:52 2017-10-24 09:11:52 0:42:00 0:39:06 0:02:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1768311 2017-10-24 05:43:38 2017-10-24 08:31:58 2017-10-24 08:43:58 0:12:00 0:11:02 0:00:58 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1768315 2017-10-24 05:43:39 2017-10-24 08:34:09 2017-10-24 09:26:10 0:52:01 0:36:33 0:15:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1768318 2017-10-24 05:43:40 2017-10-24 08:34:41 2017-10-24 09:16:41 0:42:00 0:39:25 0:02:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1768320 2017-10-24 05:43:41 2017-10-24 08:35:36 2017-10-24 09:15:37 0:40:01 0:19:27 0:20:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1768324 2017-10-24 05:43:41 2017-10-24 08:38:28 2017-10-24 09:38:28 1:00:00 0:10:05 0:49:55 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1768327 2017-10-24 05:43:42 2017-10-24 08:38:35 2017-10-24 09:42:36 1:04:01 0:11:26 0:52:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1768330 2017-10-24 05:43:43 2017-10-24 08:40:08 2017-10-24 09:28:08 0:48:00 0:17:44 0:30:16 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1768333 2017-10-24 05:43:43 2017-10-24 08:44:08 2017-10-24 11:20:11 2:36:03 0:18:41 2:17:22 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1768335 2017-10-24 05:43:44 2017-10-24 08:44:10 2017-10-24 09:26:10 0:42:00 0:27:03 0:14:57 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-10-24 09:01:49.423449 mon.a mon.0 172.21.15.10:6789/0 159 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1768338 2017-10-24 05:43:45 2017-10-24 08:50:18 2017-10-24 09:24:18 0:34:00 0:09:30 0:24:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1768342 2017-10-24 05:43:45 2017-10-24 08:53:14 2017-10-24 09:29:14 0:36:00 0:23:57 0:12:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1768344 2017-10-24 05:43:46 2017-10-24 08:54:17 2017-10-24 09:14:17 0:20:00 0:11:36 0:08:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1768347 2017-10-24 05:43:47 2017-10-24 09:00:25 2017-10-24 09:14:31 0:14:06 0:10:59 0:03:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1768350 2017-10-24 05:43:47 2017-10-24 09:00:34 2017-10-24 11:26:36 2:26:02 0:22:02 2:04:00 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1768353 2017-10-24 05:43:48 2017-10-24 09:02:49 2017-10-24 09:22:48 0:19:59 0:07:29 0:12:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1768356 2017-10-24 05:43:49 2017-10-24 09:04:37 2017-10-24 09:18:36 0:13:59 0:11:31 0:02:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1768359 2017-10-24 05:43:49 2017-10-24 09:06:38 2017-10-24 10:20:38 1:14:00 0:31:46 0:42:14 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1768362 2017-10-24 05:43:50 2017-10-24 09:08:42 2017-10-24 09:28:42 0:20:00 0:11:32 0:08:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1768365 2017-10-24 05:43:51 2017-10-24 09:10:33 2017-10-24 10:10:37 1:00:04 0:12:31 0:47:33 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1768368 2017-10-24 05:43:52 2017-10-24 09:12:15 2017-10-24 09:50:15 0:38:00 0:23:25 0:14:35 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1768371 2017-10-24 05:43:52 2017-10-24 09:13:00 2017-10-24 09:49:03 0:36:03 0:16:35 0:19:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1768374 2017-10-24 05:43:53 2017-10-24 09:14:32 2017-10-24 09:48:32 0:34:00 0:23:54 0:10:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1768377 2017-10-24 05:43:54 2017-10-24 09:16:27 2017-10-24 09:42:27 0:26:00 0:17:55 0:08:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1768378 2017-10-24 05:43:54 2017-10-24 09:16:33 2017-10-24 09:58:33 0:42:00 0:10:33 0:31:27 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1768381 2017-10-24 05:43:55 2017-10-24 09:18:10 2017-10-24 10:46:11 1:28:01 0:38:10 0:49:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1768384 2017-10-24 05:43:56 2017-10-24 09:19:56 2017-10-24 09:47:56 0:28:00 0:24:38 0:03:22 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1768388 2017-10-24 05:43:56 2017-10-24 09:22:30 2017-10-24 10:10:30 0:48:00 0:06:15 0:41:45 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi045 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpHWfTMl'

pass 1768392 2017-10-24 05:43:57 2017-10-24 09:24:51 2017-10-24 10:16:54 0:52:03 0:41:01 0:11:02 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1768395 2017-10-24 05:43:58 2017-10-24 09:26:11 2017-10-24 10:02:11 0:36:00 0:24:53 0:11:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1768398 2017-10-24 05:43:59 2017-10-24 09:26:18 2017-10-24 10:32:20 1:06:02 0:10:38 0:55:24 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1768401 2017-10-24 05:43:59 2017-10-24 09:28:10 2017-10-24 10:00:09 0:31:59 0:09:29 0:22:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1768403 2017-10-24 05:44:00 2017-10-24 09:28:26 2017-10-24 09:48:26 0:20:00 0:17:48 0:02:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1768406 2017-10-24 05:44:01 2017-10-24 09:28:49 2017-10-24 10:28:50 1:00:01 0:11:54 0:48:07 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1768409 2017-10-24 05:44:02 2017-10-24 09:30:23 2017-10-24 09:44:22 0:13:59 0:09:54 0:04:05 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-10-24 09:36:15.601112 mon.b mon.0 172.21.15.40:6789/0 144 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1768412 2017-10-24 05:44:03 2017-10-24 09:32:33 2017-10-24 09:54:33 0:22:00 0:08:18 0:13:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1768415 2017-10-24 05:44:03 2017-10-24 09:34:04 2017-10-24 10:20:05 0:46:01 0:29:49 0:16:12 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1768418 2017-10-24 05:44:04 2017-10-24 09:36:38 2017-10-24 10:12:38 0:36:00 0:20:17 0:15:43 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1768421 2017-10-24 05:44:05 2017-10-24 09:38:52 2017-10-24 09:52:51 0:13:59 0:11:00 0:02:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1768424 2017-10-24 05:44:05 2017-10-24 09:41:09 2017-10-24 11:39:11 1:58:02 0:14:51 1:43:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1768427 2017-10-24 05:44:06 2017-10-24 09:44:18 2017-10-24 09:56:19 0:12:01 0:08:48 0:03:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3