Pulpito

pdonnell-2017-10-04_21:27:34-kcephfs-wip-pdonnell-testing-20171004-testing-basic-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail
pdonnell 2017-10-04 21:27:34 2017-10-05 00:54:08 2017-10-05 04:04:11 3:10:03 kcephfs wip-pdonnell-testing-20171004 smithi b820225 88 12

Average wait time: 0:23:52

See other runs of suite 'kcephfs' on branch 'wip-pdonnell-testing-20171004'?

See other runs on branch 'wip-pdonnell-testing-20171004'?

See other runs scheduled on 2017-10-04?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1702532 2017-10-04 21:27:37 2017-10-04 21:27:42 2017-10-04 21:41:42 0:14:00 0:08:54 0:05:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1702536 2017-10-04 21:27:38 2017-10-04 21:29:46 2017-10-04 22:17:46 0:48:00 0:43:43 0:04:17 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1702539 2017-10-04 21:27:39 2017-10-04 21:29:46 2017-10-04 21:45:46 0:16:00 0:10:55 0:05:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1702542 2017-10-04 21:27:39 2017-10-04 21:30:01 2017-10-04 22:00:01 0:30:00 0:23:07 0:06:53 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1702545 2017-10-04 21:27:40 2017-10-04 21:31:42 2017-10-04 22:07:42 0:36:00 0:25:24 0:10:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1702548 2017-10-04 21:27:41 2017-10-04 21:31:47 2017-10-04 21:57:46 0:25:59 0:11:12 0:14:47 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1702551 2017-10-04 21:27:41 2017-10-04 21:35:26 2017-10-04 22:11:26 0:36:00 0:27:46 0:08:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1702554 2017-10-04 21:27:42 2017-10-04 21:37:50 2017-10-04 21:59:50 0:22:00 0:17:35 0:04:25 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1702556 2017-10-04 21:27:43 2017-10-04 21:37:50 2017-10-04 21:59:50 0:22:00 0:15:31 0:06:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1702559 2017-10-04 21:27:43 2017-10-04 21:39:52 2017-10-04 22:23:52 0:44:00 0:42:51 0:01:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1702562 2017-10-04 21:27:44 2017-10-04 21:39:52 2017-10-04 22:15:52 0:36:00 0:21:12 0:14:48 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1702565 2017-10-04 21:27:44 2017-10-04 21:39:52 2017-10-04 23:01:53 1:22:01 1:10:22 0:11:39 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1702567 2017-10-04 21:27:45 2017-10-04 21:40:25 2017-10-04 22:36:26 0:56:01 0:38:22 0:17:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1702570 2017-10-04 21:27:46 2017-10-04 21:41:50 2017-10-04 22:11:50 0:30:00 0:19:37 0:10:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1702573 2017-10-04 21:27:46 2017-10-04 21:45:53 2017-10-04 22:25:53 0:40:00 0:10:24 0:29:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1702576 2017-10-04 21:27:47 2017-10-04 21:47:42 2017-10-04 22:03:42 0:16:00 0:09:02 0:06:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1702579 2017-10-04 21:27:48 2017-10-04 21:48:38 2017-10-04 22:20:38 0:32:00 0:21:40 0:10:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1702582 2017-10-04 21:27:48 2017-10-04 21:51:50 2017-10-04 22:41:50 0:50:00 0:23:09 0:26:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1702587 2017-10-04 21:27:49 2017-10-04 21:51:51 2017-10-04 22:31:51 0:40:00 0:19:04 0:20:56 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-10-04 22:13:55.219483 mon.b mon.0 172.21.15.41:6789/0 151 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1702590 2017-10-04 21:27:50 2017-10-04 21:53:41 2017-10-04 22:13:41 0:20:00 0:10:24 0:09:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1702593 2017-10-04 21:27:50 2017-10-04 21:53:44 2017-10-04 22:43:44 0:50:00 0:22:16 0:27:44 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1702596 2017-10-04 21:27:51 2017-10-04 21:54:01 2017-10-04 22:10:00 0:15:59 0:10:00 0:05:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1702598 2017-10-04 21:27:52 2017-10-04 21:55:53 2017-10-04 22:13:53 0:18:00 0:09:37 0:08:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1702601 2017-10-04 21:27:52 2017-10-04 23:18:09 2017-10-04 23:50:09 0:32:00 0:23:32 0:08:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1702604 2017-10-04 21:27:53 2017-10-04 23:20:10 2017-10-04 23:34:09 0:13:59 0:07:38 0:06:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1702608 2017-10-04 21:27:54 2017-10-04 23:20:10 2017-10-04 23:40:09 0:19:59 0:10:30 0:09:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
fail 1702611 2017-10-04 21:27:54 2017-10-04 23:22:04 2017-10-05 00:16:05 0:54:01 0:41:17 0:12:44 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
Failure Reason:

"2017-10-04 23:40:02.627489 mon.b mon.1 172.21.15.46:6789/0 37 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1702614 2017-10-04 21:27:55 2017-10-04 23:22:05 2017-10-05 00:40:05 1:18:00 0:13:43 1:04:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1702617 2017-10-04 21:27:56 2017-10-04 23:23:53 2017-10-04 23:57:53 0:34:00 0:21:58 0:12:02 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1702620 2017-10-04 21:27:56 2017-10-04 23:24:04 2017-10-04 23:58:04 0:34:00 0:28:19 0:05:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1702623 2017-10-04 21:27:57 2017-10-04 23:24:08 2017-10-05 01:42:10 2:18:02 0:19:31 1:58:31 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
fail 1702626 2017-10-04 21:27:58 2017-10-04 23:26:09 2017-10-05 00:04:09 0:38:00 0:29:18 0:08:42 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
Failure Reason:

"2017-10-04 23:43:59.125201 mon.b mon.0 172.21.15.35:6789/0 150 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum b,c" in cluster log

pass 1702629 2017-10-04 21:27:58 2017-10-04 23:26:09 2017-10-05 00:10:09 0:44:00 0:19:45 0:24:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1702632 2017-10-04 21:27:59 2017-10-04 23:28:09 2017-10-04 23:54:09 0:26:00 0:11:03 0:14:57 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1702635 2017-10-04 21:28:00 2017-10-04 23:30:13 2017-10-05 00:14:13 0:44:00 0:39:51 0:04:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1702638 2017-10-04 21:28:00 2017-10-04 23:31:35 2017-10-04 23:57:35 0:26:00 0:20:01 0:05:59 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1702641 2017-10-04 21:28:01 2017-10-04 23:32:10 2017-10-05 01:28:12 1:56:02 0:06:13 1:49:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi070 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpiQT6Ad'

pass 1702644 2017-10-04 21:28:02 2017-10-04 23:33:16 2017-10-05 00:35:16 1:02:00 0:39:22 0:22:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1702647 2017-10-04 21:28:02 2017-10-04 23:34:05 2017-10-05 00:22:05 0:48:00 0:24:07 0:23:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1702650 2017-10-04 21:28:03 2017-10-04 23:34:08 2017-10-04 23:50:08 0:16:00 0:09:59 0:06:01 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1702653 2017-10-04 21:28:03 2017-10-04 23:36:13 2017-10-04 23:52:12 0:15:59 0:08:54 0:07:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1702656 2017-10-04 21:28:04 2017-10-04 23:36:13 2017-10-05 00:14:13 0:38:00 0:17:47 0:20:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1702659 2017-10-04 21:28:05 2017-10-04 23:37:53 2017-10-05 00:07:53 0:30:00 0:14:12 0:15:48 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1702662 2017-10-04 21:28:05 2017-10-04 23:39:43 2017-10-05 00:49:43 1:10:00 0:21:52 0:48:08 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-10-05 00:31:25.523352 mon.b mon.0 172.21.15.137:6789/0 119 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1702665 2017-10-04 21:28:06 2017-10-04 23:40:06 2017-10-05 00:08:06 0:28:00 0:10:27 0:17:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1702668 2017-10-04 21:28:07 2017-10-04 23:42:07 2017-10-05 00:26:07 0:44:00 0:29:02 0:14:58 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1702671 2017-10-04 21:28:07 2017-10-04 23:43:56 2017-10-05 00:15:56 0:32:00 0:20:11 0:11:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1702674 2017-10-04 21:28:08 2017-10-04 23:44:05 2017-10-05 00:24:05 0:40:00 0:09:45 0:30:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1702677 2017-10-04 21:28:08 2017-10-04 23:48:07 2017-10-05 00:28:07 0:40:00 0:16:11 0:23:49 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1702680 2017-10-04 21:28:09 2017-10-04 23:50:15 2017-10-05 00:20:15 0:30:00 0:07:26 0:22:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1702683 2017-10-04 21:28:10 2017-10-04 23:52:10 2017-10-05 00:04:10 0:12:00 0:09:53 0:02:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1702686 2017-10-04 21:28:10 2017-10-04 23:52:16 2017-10-05 01:04:17 1:12:01 0:46:45 0:25:16 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1702689 2017-10-04 21:28:11 2017-10-04 23:54:11 2017-10-05 01:02:12 1:08:01 0:11:26 0:56:35 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1702692 2017-10-04 21:28:12 2017-10-04 23:54:29 2017-10-05 00:30:31 0:36:02 0:26:48 0:09:14 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1702695 2017-10-04 21:28:12 2017-10-04 23:56:00 2017-10-05 00:28:00 0:32:00 0:22:49 0:09:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1702698 2017-10-04 21:28:13 2017-10-04 23:58:00 2017-10-05 02:42:03 2:44:03 0:10:09 2:33:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1702701 2017-10-04 21:28:13 2017-10-04 23:58:12 2017-10-05 00:42:12 0:44:00 0:27:46 0:16:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1702704 2017-10-04 21:28:14 2017-10-05 00:02:01 2017-10-05 00:28:01 0:26:00 0:19:27 0:06:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1702707 2017-10-04 21:28:15 2017-10-05 00:03:35 2017-10-05 00:23:34 0:19:59 0:15:38 0:04:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1702710 2017-10-04 21:28:15 2017-10-05 00:04:14 2017-10-05 01:22:15 1:18:01 0:41:11 0:36:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1702713 2017-10-04 21:28:16 2017-10-05 00:08:03 2017-10-05 00:26:02 0:17:59 0:13:08 0:04:51 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1702716 2017-10-04 21:28:17 2017-10-05 00:08:11 2017-10-05 01:20:12 1:12:01 0:37:18 0:34:43 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1702719 2017-10-04 21:28:17 2017-10-05 00:10:20 2017-10-05 00:56:20 0:46:00 0:35:21 0:10:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1702722 2017-10-04 21:28:18 2017-10-05 00:12:20 2017-10-05 00:50:20 0:38:00 0:22:03 0:15:57 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1702725 2017-10-04 21:28:19 2017-10-05 00:14:08 2017-10-05 00:42:08 0:28:00 0:09:57 0:18:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1702728 2017-10-04 21:28:19 2017-10-05 00:14:14 2017-10-05 00:26:14 0:12:00 0:09:13 0:02:47 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1702731 2017-10-04 21:28:20 2017-10-05 00:16:04 2017-10-05 00:48:04 0:32:00 0:19:56 0:12:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1702734 2017-10-04 21:28:21 2017-10-05 00:17:54 2017-10-05 01:23:55 1:06:01 0:23:25 0:42:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1702737 2017-10-04 21:28:21 2017-10-05 00:18:04 2017-10-05 00:46:04 0:28:00 0:13:08 0:14:52 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-10-05 00:36:37.696968 mon.b mon.0 172.21.15.15:6789/0 117 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1702740 2017-10-04 21:28:22 2017-10-05 00:18:12 2017-10-05 00:50:12 0:32:00 0:08:41 0:23:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1702743 2017-10-04 21:28:22 2017-10-05 00:20:24 2017-10-05 01:36:25 1:16:01 0:24:08 0:51:53 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1702746 2017-10-04 21:28:23 2017-10-05 00:22:09 2017-10-05 00:40:09 0:18:00 0:11:51 0:06:09 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1702749 2017-10-04 21:28:24 2017-10-05 00:24:15 2017-10-05 00:38:14 0:13:59 0:11:01 0:02:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1702752 2017-10-04 21:28:24 2017-10-05 00:26:12 2017-10-05 01:58:14 1:32:02 0:21:45 1:10:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1702755 2017-10-04 21:28:25 2017-10-05 00:28:11 2017-10-05 00:40:10 0:11:59 0:09:13 0:02:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1702758 2017-10-04 21:28:26 2017-10-05 00:28:11 2017-10-05 00:46:10 0:17:59 0:10:26 0:07:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1702761 2017-10-04 21:28:26 2017-10-05 00:28:21 2017-10-05 01:40:21 1:12:00 0:35:15 0:36:45 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1702764 2017-10-04 21:28:27 2017-10-05 00:30:21 2017-10-05 01:04:21 0:34:00 0:13:30 0:20:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1702767 2017-10-04 21:28:28 2017-10-05 00:31:49 2017-10-05 00:53:49 0:22:00 0:12:59 0:09:01 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1702770 2017-10-04 21:28:28 2017-10-05 00:32:11 2017-10-05 01:06:11 0:34:00 0:25:07 0:08:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1702773 2017-10-04 21:28:29 2017-10-05 00:32:17 2017-10-05 00:58:17 0:26:00 0:20:27 0:05:33 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1702776 2017-10-04 21:28:30 2017-10-05 00:35:25 2017-10-05 01:27:26 0:52:01 0:26:42 0:25:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1702779 2017-10-04 21:28:30 2017-10-05 00:38:17 2017-10-05 01:00:17 0:22:00 0:20:06 0:01:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1702782 2017-10-04 21:28:31 2017-10-05 00:40:14 2017-10-05 02:56:17 2:16:03 0:08:33 2:07:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
fail 1702785 2017-10-04 21:28:31 2017-10-05 00:42:04 2017-10-05 01:36:04 0:54:00 0:35:59 0:18:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-10-05 01:17:19.617889 mon.b mon.0 172.21.15.63:6789/0 375 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1702788 2017-10-04 21:28:32 2017-10-05 00:42:09 2017-10-05 01:12:09 0:30:00 0:25:58 0:04:02 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1702791 2017-10-04 21:28:33 2017-10-05 00:46:14 2017-10-05 02:36:16 1:50:02 0:06:11 1:43:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi169 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpL81YWe'

pass 1702794 2017-10-04 21:28:33 2017-10-05 00:46:14 2017-10-05 01:36:14 0:50:00 0:36:34 0:13:26 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1702797 2017-10-04 21:28:34 2017-10-05 00:48:05 2017-10-05 01:30:05 0:42:00 0:24:32 0:17:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1702800 2017-10-04 21:28:35 2017-10-05 00:50:03 2017-10-05 02:10:04 1:20:01 0:09:46 1:10:15 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1702803 2017-10-04 21:28:35 2017-10-05 00:50:17 2017-10-05 01:12:17 0:22:00 0:10:37 0:11:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1702806 2017-10-04 21:28:36 2017-10-05 00:50:21 2017-10-05 01:16:21 0:26:00 0:16:01 0:09:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1702809 2017-10-04 21:28:36 2017-10-05 00:54:08 2017-10-05 04:04:11 3:10:03 0:14:29 2:55:34 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1702812 2017-10-04 21:28:37 2017-10-05 00:56:16 2017-10-05 01:22:16 0:26:00 0:13:20 0:12:40 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-10-05 01:11:58.941157 mon.a mon.0 172.21.15.37:6789/0 121 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1702815 2017-10-04 21:28:38 2017-10-05 01:00:15 2017-10-05 01:14:14 0:13:59 0:09:00 0:04:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1702818 2017-10-04 21:28:38 2017-10-05 01:00:15 2017-10-05 02:38:16 1:38:01 0:38:00 1:00:01 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
Failure Reason:

"2017-10-05 02:20:53.308122 mon.a mon.0 172.21.15.19:6789/0 1501 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 1702821 2017-10-04 21:28:39 2017-10-05 01:00:18 2017-10-05 01:44:18 0:44:00 0:23:43 0:20:17 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1702824 2017-10-04 21:28:40 2017-10-05 01:02:13 2017-10-05 01:18:12 0:15:59 0:11:38 0:04:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1702827 2017-10-04 21:28:40 2017-10-05 01:04:13 2017-10-05 01:52:14 0:48:01 0:14:56 0:33:05 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1702830 2017-10-04 21:28:41 2017-10-05 01:04:22 2017-10-05 01:26:21 0:21:59 0:09:01 0:12:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3