Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1886849 2017-11-25 03:25:32 2017-11-26 16:46:42 2017-11-26 17:22:42 0:36:00 0:10:32 0:25:28 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
dead 1886852 2017-11-25 03:25:33 2017-11-26 16:46:48 2017-11-26 18:26:49 1:40:01 1:06:29 0:33:32 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
Failure Reason:

SSH connection to smithi092 was lost: 'for d in ceph ceph-mds ceph-mgr ceph-common ceph-fuse ceph-test radosgw python-ceph libcephfs2 libcephfs-dev libcephfs-java libcephfs-jni librados2 librbd1 rbd-fuse ; do sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" purge $d || true ; done'

pass 1886855 2017-11-25 03:25:33 2017-11-26 16:47:05 2017-11-26 18:35:07 1:48:02 0:11:32 1:36:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1886858 2017-11-25 03:25:34 2017-11-26 16:49:06 2017-11-26 18:07:07 1:18:01 1:03:43 0:14:18 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1886861 2017-11-25 03:25:35 2017-11-26 16:49:32 2017-11-26 17:35:32 0:46:00 0:23:14 0:22:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1886864 2017-11-25 03:25:36 2017-11-26 16:49:57 2017-11-26 17:53:57 1:04:00 0:10:25 0:53:35 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1886866 2017-11-25 03:25:37 2017-11-26 16:50:31 2017-11-26 17:34:31 0:44:00 0:31:58 0:12:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1886869 2017-11-25 03:25:38 2017-11-26 16:51:50 2017-11-26 17:21:49 0:29:59 0:19:45 0:10:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1886872 2017-11-25 03:25:39 2017-11-26 16:53:04 2017-11-26 17:25:04 0:32:00 0:16:59 0:15:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1886875 2017-11-25 03:25:40 2017-11-26 16:53:38 2017-11-26 17:55:38 1:02:00 0:36:22 0:25:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1886877 2017-11-25 03:25:40 2017-11-26 16:54:14 2017-11-26 17:26:14 0:32:00 0:12:17 0:19:43 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1886880 2017-11-25 03:25:41 2017-11-26 16:55:42 2017-11-26 17:45:42 0:50:00 0:38:57 0:11:03 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1886883 2017-11-25 03:25:42 2017-11-26 16:56:19 2017-11-26 18:12:19 1:16:00 0:41:57 0:34:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1886887 2017-11-25 03:25:44 2017-11-26 16:57:19 2017-11-26 18:05:19 1:08:00 0:20:25 0:47:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 17:50:37.205803 mon.b mon.0 172.21.15.52:6789/0 147 : cluster [WRN] Health check failed: 16705 slow ops, oldest one blocked for 51 sec (SLOW_OPS)" in cluster log

pass 1886891 2017-11-25 03:25:45 2017-11-26 16:57:32 2017-11-26 21:11:36 4:14:04 0:11:24 4:02:40 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1886893 2017-11-25 03:25:46 2017-11-26 16:57:35 2017-11-26 17:31:34 0:33:59 0:10:08 0:23:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1886894 2017-11-25 03:25:46 2017-11-26 16:57:48 2017-11-26 17:25:48 0:28:00 0:19:35 0:08:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1886895 2017-11-25 03:25:47 2017-11-26 16:59:06 2017-11-26 17:35:06 0:36:00 0:18:51 0:17:09 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1886896 2017-11-25 03:25:48 2017-11-26 16:59:06 2017-11-26 18:09:06 1:10:00 0:50:25 0:19:35 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 17:21:53.226710 mon.b mon.0 172.21.15.132:6789/0 169 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1886897 2017-11-25 03:25:49 2017-11-26 16:59:33 2017-11-26 17:21:33 0:22:00 0:09:59 0:12:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1886898 2017-11-25 03:25:50 2017-11-26 17:00:42 2017-11-26 18:26:44 1:26:02 0:22:55 1:03:07 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1886899 2017-11-25 03:25:51 2017-11-26 17:01:00 2017-11-26 17:31:00 0:30:00 0:12:50 0:17:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1886900 2017-11-25 03:25:52 2017-11-26 17:03:00 2017-11-26 18:21:01 1:18:01 0:11:28 1:06:33 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1886901 2017-11-25 03:25:53 2017-11-26 17:03:00 2017-11-26 19:07:02 2:04:02 0:20:23 1:43:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1886902 2017-11-25 03:25:54 2017-11-26 17:03:04 2017-11-26 17:35:04 0:32:00 0:09:16 0:22:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1886903 2017-11-25 03:25:55 2017-11-26 17:03:12 2017-11-26 17:29:12 0:26:00 0:10:05 0:15:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1886904 2017-11-25 03:25:56 2017-11-26 17:03:23 2017-11-26 20:19:27 3:16:04 0:31:08 2:44:56 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1886905 2017-11-25 03:25:57 2017-11-26 17:03:25 2017-11-26 17:37:24 0:33:59 0:14:23 0:19:36 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1886906 2017-11-25 03:25:58 2017-11-26 17:03:28 2017-11-26 17:33:27 0:29:59 0:12:57 0:17:02 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1886907 2017-11-25 03:25:58 2017-11-26 17:03:28 2017-11-26 18:17:28 1:14:00 0:22:33 0:51:27 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1886908 2017-11-25 03:25:59 2017-11-26 17:03:33 2017-11-26 17:53:33 0:50:00 0:18:34 0:31:26 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1886909 2017-11-25 03:26:00 2017-11-26 17:03:34 2017-11-26 17:45:34 0:42:00 0:32:43 0:09:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1886910 2017-11-25 03:26:01 2017-11-26 17:03:49 2017-11-26 18:17:50 1:14:01 0:18:53 0:55:08 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1886911 2017-11-25 03:26:01 2017-11-26 17:04:53 2017-11-26 20:38:56 3:34:03 0:11:00 3:23:03 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1886912 2017-11-25 03:26:02 2017-11-26 17:04:53 2017-11-26 18:10:53 1:06:00 0:47:39 0:18:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1886913 2017-11-25 03:26:03 2017-11-26 17:05:13 2017-11-26 17:59:14 0:54:01 0:24:39 0:29:22 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1886914 2017-11-25 03:26:04 2017-11-26 17:05:19 2017-11-26 17:59:19 0:54:00 0:08:16 0:45:44 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi065 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmps7BCzT'

pass 1886915 2017-11-25 03:26:05 2017-11-26 17:05:40 2017-11-26 18:23:40 1:18:00 0:38:51 0:39:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1886916 2017-11-25 03:26:05 2017-11-26 17:06:10 2017-11-26 17:42:09 0:35:59 0:24:39 0:11:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1886917 2017-11-25 03:26:06 2017-11-26 17:06:10 2017-11-26 18:52:10 1:46:00 0:10:44 1:35:16 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1886918 2017-11-25 03:26:07 2017-11-26 17:06:17 2017-11-26 17:28:16 0:21:59 0:10:12 0:11:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1886919 2017-11-25 03:26:08 2017-11-26 17:06:37 2017-11-26 17:36:36 0:29:59 0:19:32 0:10:27 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1886920 2017-11-25 03:26:09 2017-11-26 17:07:30 2017-11-26 18:13:30 1:06:00 0:12:35 0:53:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1886921 2017-11-25 03:26:09 2017-11-26 17:07:42 2017-11-26 17:37:41 0:29:59 0:13:09 0:16:50 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 17:28:42.226044 mon.a mon.0 172.21.15.2:6789/0 8 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1886922 2017-11-25 03:26:10 2017-11-26 17:08:45 2017-11-26 17:34:45 0:26:00 0:10:16 0:15:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1886923 2017-11-25 03:26:11 2017-11-26 17:09:19 2017-11-26 18:07:20 0:58:01 0:29:12 0:28:49 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1886924 2017-11-25 03:26:12 2017-11-26 17:09:26 2017-11-26 17:43:26 0:34:00 0:11:49 0:22:11 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1886925 2017-11-25 03:26:13 2017-11-26 17:09:55 2017-11-26 17:45:55 0:36:00 0:11:14 0:24:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1886926 2017-11-25 03:26:14 2017-11-26 17:10:10 2017-11-26 21:12:14 4:02:04 0:13:22 3:48:42 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1886927 2017-11-25 03:26:15 2017-11-26 17:10:20 2017-11-26 17:38:19 0:27:59 0:09:11 0:18:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1886928 2017-11-25 03:26:16 2017-11-26 17:11:34 2017-11-26 17:31:33 0:19:59 0:10:13 0:09:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1886929 2017-11-25 03:26:16 2017-11-26 17:11:38 2017-11-26 18:31:39 1:20:01 0:51:40 0:28:21 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1886930 2017-11-25 03:26:18 2017-11-26 17:13:01 2017-11-26 18:27:01 1:14:00 0:11:20 1:02:40 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1886931 2017-11-25 03:26:18 2017-11-26 17:13:01 2017-11-26 17:51:01 0:38:00 0:22:05 0:15:55 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1886932 2017-11-25 03:26:19 2017-11-26 17:13:06 2017-11-26 17:51:06 0:38:00 0:26:57 0:11:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1886933 2017-11-25 03:26:20 2017-11-26 17:13:38 2017-11-26 17:55:38 0:42:00 0:10:26 0:31:34 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1886934 2017-11-25 03:26:20 2017-11-26 17:14:19 2017-11-26 18:06:19 0:52:00 0:26:12 0:25:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1886935 2017-11-25 03:26:21 2017-11-26 17:14:39 2017-11-26 17:58:39 0:44:00 0:19:36 0:24:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1886936 2017-11-25 03:26:22 2017-11-26 17:15:06 2017-11-26 18:01:06 0:46:00 0:16:52 0:29:08 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1886937 2017-11-25 03:26:23 2017-11-26 17:15:44 2017-11-26 18:55:45 1:40:01 0:47:09 0:52:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1886938 2017-11-25 03:26:24 2017-11-26 17:15:44 2017-11-26 17:41:43 0:25:59 0:12:14 0:13:45 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1886939 2017-11-25 03:26:25 2017-11-26 17:16:55 2017-11-26 19:56:57 2:40:02 0:37:24 2:02:38 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1886940 2017-11-25 03:26:26 2017-11-26 17:16:58 2017-11-26 18:08:58 0:52:00 0:39:26 0:12:34 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1886941 2017-11-25 03:26:27 2017-11-26 17:17:31 2017-11-26 18:43:32 1:26:01 0:53:03 0:32:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 17:55:15.309217 mon.b mon.0 172.21.15.53:6789/0 110 : cluster [WRN] Health check failed: 3444 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1886942 2017-11-25 03:26:28 2017-11-26 17:19:14 2017-11-26 18:31:15 1:12:01 0:11:26 1:00:35 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1886943 2017-11-25 03:26:29 2017-11-26 17:20:53 2017-11-26 19:02:54 1:42:01 0:10:06 1:31:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1886944 2017-11-25 03:26:29 2017-11-26 17:21:34 2017-11-26 17:59:34 0:38:00 0:16:02 0:21:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1886945 2017-11-25 03:26:30 2017-11-26 17:22:01 2017-11-26 19:04:03 1:42:02 0:18:59 1:23:03 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1886946 2017-11-25 03:26:31 2017-11-26 17:22:43 2017-11-26 18:06:43 0:44:00 0:20:58 0:23:02 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 17:49:30.007220 mon.b mon.0 172.21.15.180:6789/0 112 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1886947 2017-11-25 03:26:32 2017-11-26 17:23:10 2017-11-26 17:49:09 0:25:59 0:10:43 0:15:16 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1886948 2017-11-25 03:26:33 2017-11-26 17:24:46 2017-11-26 18:02:46 0:38:00 0:22:01 0:15:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1886949 2017-11-25 03:26:33 2017-11-26 17:25:05 2017-11-26 18:47:06 1:22:01 0:11:37 1:10:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1886950 2017-11-25 03:26:34 2017-11-26 17:26:01 2017-11-26 17:48:00 0:21:59 0:11:04 0:10:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1886951 2017-11-25 03:26:35 2017-11-26 17:26:15 2017-11-26 21:14:19 3:48:04 0:20:55 3:27:09 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1886952 2017-11-25 03:26:36 2017-11-26 17:28:27 2017-11-26 18:14:28 0:46:01 0:08:59 0:37:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1886953 2017-11-25 03:26:37 2017-11-26 17:29:13 2017-11-26 18:05:13 0:36:00 0:10:02 0:25:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1886954 2017-11-25 03:26:38 2017-11-26 17:30:10 2017-11-26 18:16:11 0:46:01 0:32:28 0:13:33 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1886955 2017-11-25 03:26:39 2017-11-26 17:30:10 2017-11-26 18:10:10 0:40:00 0:13:14 0:26:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1886956 2017-11-25 03:26:40 2017-11-26 17:31:01 2017-11-26 18:07:01 0:36:00 0:23:17 0:12:43 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1886957 2017-11-25 03:26:41 2017-11-26 17:31:46 2017-11-26 18:37:46 1:06:00 0:27:38 0:38:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1886958 2017-11-25 03:26:42 2017-11-26 17:31:46 2017-11-26 18:35:46 1:04:00 0:18:38 0:45:22 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1886959 2017-11-25 03:26:43 2017-11-26 17:31:46 2017-11-26 18:17:46 0:46:00 0:26:58 0:19:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1886960 2017-11-25 03:26:44 2017-11-26 17:33:36 2017-11-26 18:19:37 0:46:01 0:19:38 0:26:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1886961 2017-11-25 03:26:44 2017-11-26 17:33:36 2017-11-26 18:15:37 0:42:01 0:10:28 0:31:33 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1886962 2017-11-25 03:26:45 2017-11-26 17:33:57 2017-11-26 18:23:57 0:50:00 0:38:11 0:11:49 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1886963 2017-11-25 03:26:46 2017-11-26 17:34:44 2017-11-26 18:46:45 1:12:01 0:58:10 0:13:51 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1886964 2017-11-25 03:26:47 2017-11-26 17:34:46 2017-11-26 18:46:47 1:12:01 0:08:00 1:04:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi192 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpPfraH0'

pass 1886965 2017-11-25 03:26:48 2017-11-26 17:35:05 2017-11-26 19:21:06 1:46:01 0:37:29 1:08:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1886966 2017-11-25 03:26:48 2017-11-26 17:35:07 2017-11-26 20:23:10 2:48:03 0:53:27 1:54:36 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 19:34:15.808511 mon.b mon.0 172.21.15.55:6789/0 165 : cluster [WRN] Health check failed: 5848 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log

pass 1886967 2017-11-25 03:26:49 2017-11-26 17:35:19 2017-11-26 19:01:20 1:26:01 0:10:40 1:15:21 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1886968 2017-11-25 03:26:50 2017-11-26 17:35:35 2017-11-26 17:57:35 0:22:00 0:10:18 0:11:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1886969 2017-11-25 03:26:51 2017-11-26 17:35:35 2017-11-26 18:15:37 0:40:02 0:24:31 0:15:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1886970 2017-11-25 03:26:52 2017-11-26 17:36:48 2017-11-26 18:34:48 0:58:00 0:12:13 0:45:47 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1886971 2017-11-25 03:26:52 2017-11-26 17:36:59 2017-11-26 18:02:59 0:26:00 0:12:24 0:13:36 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 17:53:27.118345 mon.a mon.0 172.21.15.37:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1886972 2017-11-25 03:26:53 2017-11-26 17:37:25 2017-11-26 18:07:25 0:30:00 0:10:23 0:19:37 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1886973 2017-11-25 03:26:54 2017-11-26 17:37:42 2017-11-26 20:39:46 3:02:04 0:27:22 2:34:42 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
fail 1886974 2017-11-25 03:26:55 2017-11-26 17:37:42 2017-11-26 18:17:42 0:40:00 0:21:58 0:18:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 18:02:27.572749 mon.a mon.0 172.21.15.67:6789/0 180 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1886975 2017-11-25 03:26:56 2017-11-26 17:38:31 2017-11-26 18:06:31 0:28:00 0:11:15 0:16:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1886976 2017-11-25 03:26:56 2017-11-26 17:41:15 2017-11-26 21:51:20 4:10:05 0:13:48 3:56:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1886977 2017-11-25 03:26:57 2017-11-26 17:41:44 2017-11-26 18:31:45 0:50:01 0:08:50 0:41:11 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1886978 2017-11-25 03:26:58 2017-11-26 17:42:10 2017-11-26 18:40:10 0:58:00 0:10:10 0:47:50 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1886979 2017-11-25 03:26:59 2017-11-26 17:43:39 2017-11-26 18:57:40 1:14:01 0:48:08 0:25:53 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1886980 2017-11-25 03:27:00 2017-11-26 17:45:48 2017-11-26 20:07:49 2:22:01 0:11:33 2:10:28 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1886981 2017-11-25 03:27:00 2017-11-26 17:45:48 2017-11-26 20:05:49 2:20:01 0:37:17 1:42:44 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1886982 2017-11-25 03:27:01 2017-11-26 17:45:56 2017-11-26 18:41:56 0:56:00 0:24:29 0:31:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1886983 2017-11-25 03:27:02 2017-11-26 17:47:52 2017-11-26 18:21:52 0:34:00 0:10:56 0:23:04 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1886984 2017-11-25 03:27:03 2017-11-26 17:48:02 2017-11-26 18:34:02 0:46:00 0:24:57 0:21:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1886985 2017-11-25 03:27:04 2017-11-26 17:49:21 2017-11-26 18:27:21 0:38:00 0:19:32 0:18:28 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1886986 2017-11-25 03:27:05 2017-11-26 17:51:13 2017-11-26 18:47:13 0:56:00 0:16:37 0:39:23 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1886987 2017-11-25 03:27:06 2017-11-26 17:51:13 2017-11-26 19:07:14 1:16:01 0:41:36 0:34:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1886988 2017-11-25 03:27:06 2017-11-26 17:53:46 2017-11-26 18:35:46 0:42:00 0:11:45 0:30:15 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1886989 2017-11-25 03:27:07 2017-11-26 17:53:58 2017-11-26 19:40:00 1:46:02 0:35:13 1:10:49 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1886990 2017-11-25 03:27:08 2017-11-26 17:55:52 2017-11-26 18:47:53 0:52:01 0:42:37 0:09:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1886991 2017-11-25 03:27:09 2017-11-26 17:55:52 2017-11-26 18:27:52 0:32:00 0:18:47 0:13:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1886992 2017-11-25 03:27:10 2017-11-26 17:57:45 2017-11-26 19:33:47 1:36:02 0:10:51 1:25:11 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1886993 2017-11-25 03:27:10 2017-11-26 17:57:45 2017-11-26 18:31:45 0:34:00 0:09:54 0:24:06 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
dead 1886994 2017-11-25 03:27:11 2017-11-26 17:58:40 2017-11-27 06:04:25 12:05:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1886995 2017-11-25 03:27:12 2017-11-26 17:59:26 2017-11-26 18:43:26 0:44:00 0:19:43 0:24:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1886996 2017-11-25 03:27:13 2017-11-26 17:59:26 2017-11-26 18:45:26 0:46:00 0:25:10 0:20:50 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 18:24:49.410469 mon.b mon.0 172.21.15.68:6789/0 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1886997 2017-11-25 03:27:14 2017-11-26 17:59:36 2017-11-26 18:23:37 0:24:01 0:10:02 0:13:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1886998 2017-11-25 03:27:15 2017-11-26 18:01:18 2017-11-26 19:19:19 1:18:01 0:23:32 0:54:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1886999 2017-11-25 03:27:16 2017-11-26 18:02:58 2017-11-26 18:26:58 0:24:00 0:11:42 0:12:18 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887000 2017-11-25 03:27:17 2017-11-26 18:03:02 2017-11-26 18:29:01 0:25:59 0:11:01 0:14:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1887001 2017-11-25 03:27:18 2017-11-26 18:05:27 2017-11-26 19:13:29 1:08:02 0:19:23 0:48:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1887002 2017-11-25 03:27:18 2017-11-26 18:05:27 2017-11-26 18:41:27 0:36:00 0:08:58 0:27:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1887003 2017-11-25 03:27:19 2017-11-26 18:06:22 2017-11-26 19:24:22 1:18:00 0:10:51 1:07:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1887004 2017-11-25 03:27:20 2017-11-26 18:06:45 2017-11-26 19:56:46 1:50:01 0:39:33 1:10:28 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1887005 2017-11-25 03:27:21 2017-11-26 18:06:45 2017-11-26 18:52:45 0:46:00 0:13:14 0:32:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1887006 2017-11-25 03:27:22 2017-11-26 18:07:02 2017-11-26 19:05:02 0:58:00 0:13:27 0:44:33 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1887007 2017-11-25 03:27:23 2017-11-26 18:07:08 2017-11-26 19:43:10 1:36:02 0:24:57 1:11:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1887008 2017-11-25 03:27:24 2017-11-26 18:07:21 2017-11-26 19:31:22 1:24:01 0:18:36 1:05:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1887009 2017-11-25 03:27:25 2017-11-26 18:07:26 2017-11-26 18:49:26 0:42:00 0:30:39 0:11:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1887010 2017-11-25 03:27:26 2017-11-26 18:09:10 2017-11-26 18:59:11 0:50:01 0:19:57 0:30:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1887011 2017-11-25 03:27:27 2017-11-26 18:09:10 2017-11-26 19:01:11 0:52:01 0:10:33 0:41:28 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1887012 2017-11-25 03:27:27 2017-11-26 18:10:24 2017-11-26 19:02:24 0:52:00 0:36:09 0:15:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1887013 2017-11-25 03:27:28 2017-11-26 18:10:54 2017-11-26 18:46:54 0:36:00 0:21:23 0:14:37 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1887014 2017-11-25 03:27:29 2017-11-26 18:12:34 2017-11-26 18:42:34 0:30:00 0:08:10 0:21:50 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi172 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpMtA6Mn'

pass 1887015 2017-11-25 03:27:30 2017-11-26 18:13:42 2017-11-26 19:05:42 0:52:00 0:40:23 0:11:37 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1887016 2017-11-25 03:27:31 2017-11-26 18:14:29 2017-11-26 18:56:29 0:42:00 0:20:12 0:21:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 18:40:16.113596 mon.a mon.0 172.21.15.114:6789/0 126 : cluster [WRN] Health check failed: 16895 slow ops, oldest one blocked for 60 sec (SLOW_OPS)" in cluster log

pass 1887017 2017-11-25 03:27:31 2017-11-26 18:15:49 2017-11-26 19:07:51 0:52:02 0:10:27 0:41:35 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1887018 2017-11-25 03:27:32 2017-11-26 18:15:50 2017-11-26 18:49:50 0:34:00 0:10:18 0:23:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1887019 2017-11-25 03:27:33 2017-11-26 18:16:12 2017-11-26 19:36:12 1:20:00 0:19:19 1:00:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1887020 2017-11-25 03:27:34 2017-11-26 18:17:41 2017-11-26 20:17:43 2:00:02 0:11:45 1:48:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1887021 2017-11-25 03:27:36 2017-11-26 18:17:43 2017-11-26 19:29:45 1:12:02 0:12:02 1:00:00 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 19:21:40.153007 mon.a mon.0 172.21.15.136:6789/0 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1887022 2017-11-25 03:27:36 2017-11-26 18:17:47 2017-11-26 18:41:47 0:24:00 0:10:03 0:13:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1887025 2017-11-25 03:27:38 2017-11-26 18:21:12 2017-11-26 19:11:13 0:50:01 0:26:12 0:23:49 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1887027 2017-11-25 03:27:39 2017-11-26 18:23:49 2017-11-26 19:13:51 0:50:02 0:12:04 0:37:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887029 2017-11-25 03:27:40 2017-11-26 18:23:58 2017-11-26 18:45:58 0:22:00 0:10:41 0:11:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1887031 2017-11-25 03:27:41 2017-11-26 18:26:58 2017-11-26 18:54:57 0:27:59 0:13:54 0:14:05 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1887033 2017-11-25 03:27:42 2017-11-26 18:27:03 2017-11-26 19:41:03 1:14:00 0:09:35 1:04:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1887034 2017-11-25 03:27:42 2017-11-26 18:27:23 2017-11-26 18:47:23 0:20:00 0:10:03 0:09:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1887036 2017-11-25 03:27:43 2017-11-26 18:29:13 2017-11-26 20:17:15 1:48:02 0:47:53 1:00:09 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1887038 2017-11-25 03:27:44 2017-11-26 18:31:40 2017-11-26 19:01:40 0:30:00 0:11:10 0:18:50 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1887040 2017-11-25 03:27:46 2017-11-26 18:31:46 2017-11-26 19:17:46 0:46:00 0:20:37 0:25:23 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1887042 2017-11-25 03:27:47 2017-11-26 18:34:13 2017-11-26 19:48:14 1:14:01 0:21:51 0:52:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1887044 2017-11-25 03:27:48 2017-11-26 18:35:08 2017-11-26 21:35:11 3:00:03 0:10:13 2:49:50 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1887046 2017-11-25 03:27:49 2017-11-26 18:35:59 2017-11-26 19:27:59 0:52:00 0:31:51 0:20:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1887048 2017-11-25 03:27:50 2017-11-26 18:40:22 2017-11-26 19:14:22 0:34:00 0:19:22 0:14:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1887050 2017-11-25 03:27:51 2017-11-26 18:41:48 2017-11-26 19:25:48 0:44:00 0:16:43 0:27:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1887052 2017-11-25 03:27:52 2017-11-26 18:42:35 2017-11-26 19:56:36 1:14:01 0:46:07 0:27:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1887054 2017-11-25 03:27:52 2017-11-26 18:43:27 2017-11-26 19:21:29 0:38:02 0:21:09 0:16:53 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1887056 2017-11-25 03:27:53 2017-11-26 18:45:39 2017-11-26 21:15:42 2:30:03 0:36:32 1:53:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1887058 2017-11-25 03:27:54 2017-11-26 18:46:57 2017-11-26 19:38:57 0:52:00 0:38:53 0:13:07 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1887060 2017-11-25 03:27:55 2017-11-26 18:46:57 2017-11-26 20:30:58 1:44:01 0:24:34 1:19:27 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1887062 2017-11-25 03:27:56 2017-11-26 18:47:14 2017-11-26 20:29:15 1:42:01 0:11:40 1:30:21 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1887064 2017-11-25 03:27:57 2017-11-26 18:47:51 2017-11-26 19:15:51 0:28:00 0:10:45 0:17:15 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1887066 2017-11-25 03:27:58 2017-11-26 18:49:38 2017-11-26 19:23:38 0:34:00 0:19:17 0:14:43 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1887068 2017-11-25 03:27:59 2017-11-26 18:49:51 2017-11-26 19:25:52 0:36:01 0:20:10 0:15:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1887070 2017-11-25 03:28:00 2017-11-26 18:52:23 2017-11-26 20:18:25 1:26:02 0:52:03 0:33:59 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 19:30:17.474263 mon.a mon.1 172.21.15.50:6789/0 53 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1887072 2017-11-25 03:28:01 2017-11-26 18:55:04 2017-11-26 19:19:03 0:23:59 0:10:07 0:13:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1887074 2017-11-25 03:28:01 2017-11-26 18:55:04 2017-11-26 19:29:03 0:33:59 0:21:46 0:12:13 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1887076 2017-11-25 03:28:02 2017-11-26 18:55:46 2017-11-26 20:21:47 1:26:01 0:11:43 1:14:18 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887078 2017-11-25 03:28:03 2017-11-26 18:55:54 2017-11-26 19:21:54 0:26:00 0:11:00 0:15:00 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1887080 2017-11-25 03:28:04 2017-11-26 18:56:30 2017-11-26 20:02:30 1:06:00 0:19:35 0:46:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1887082 2017-11-25 03:28:05 2017-11-26 18:57:51 2017-11-26 20:33:52 1:36:01 0:09:37 1:26:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1887084 2017-11-25 03:28:06 2017-11-26 19:01:23 2017-11-26 19:21:23 0:20:00 0:09:51 0:10:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1887086 2017-11-25 03:28:07 2017-11-26 19:01:41 2017-11-26 20:47:44 1:46:03 0:39:03 1:07:00 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1887088 2017-11-25 03:28:09 2017-11-26 19:02:37 2017-11-26 19:26:37 0:24:00 0:13:15 0:10:45 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1887090 2017-11-25 03:28:09 2017-11-26 19:04:19 2017-11-26 19:50:19 0:46:00 0:16:11 0:29:49 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1887092 2017-11-25 03:28:10 2017-11-26 19:05:55 2017-11-26 19:45:55 0:40:00 0:28:14 0:11:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1887094 2017-11-25 03:28:11 2017-11-26 19:07:15 2017-11-26 19:43:14 0:35:59 0:17:43 0:18:16 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1887096 2017-11-25 03:28:13 2017-11-26 19:07:58 2017-11-26 19:55:58 0:48:00 0:26:48 0:21:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1887098 2017-11-25 03:28:14 2017-11-26 19:09:11 2017-11-26 20:29:12 1:20:01 0:19:01 1:01:00 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1887100 2017-11-25 03:28:15 2017-11-26 19:11:27 2017-11-26 20:03:27 0:52:00 0:10:44 0:41:16 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1887101 2017-11-25 03:28:16 2017-11-26 19:13:41 2017-11-26 20:19:42 1:06:01 0:45:53 0:20:08 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1887103 2017-11-25 03:28:17 2017-11-26 19:13:52 2017-11-26 21:03:56 1:50:04 1:12:09 0:37:55 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1887105 2017-11-25 03:28:18 2017-11-26 19:16:03 2017-11-26 19:48:03 0:32:00 0:08:17 0:23:43 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi175 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpvpY44W'

pass 1887107 2017-11-25 03:28:19 2017-11-26 19:18:00 2017-11-26 20:30:01 1:12:01 0:39:56 0:32:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1887109 2017-11-25 03:28:20 2017-11-26 19:19:15 2017-11-26 20:45:16 1:26:01 1:11:58 0:14:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 19:37:55.471980 mon.a mon.0 172.21.15.202:6789/0 129 : cluster [WRN] Health check failed: 16309 slow ops, oldest one blocked for 79 sec (SLOW_OPS)" in cluster log

pass 1887111 2017-11-25 03:28:21 2017-11-26 19:19:20 2017-11-26 19:45:20 0:26:00 0:11:15 0:14:45 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1887113 2017-11-25 03:28:22 2017-11-26 19:21:17 2017-11-26 19:49:17 0:28:00 0:10:48 0:17:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1887115 2017-11-25 03:28:23 2017-11-26 19:21:30 2017-11-26 20:51:31 1:30:01 0:15:39 1:14:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1887117 2017-11-25 03:28:25 2017-11-26 19:21:55 2017-11-26 21:05:56 1:44:01 0:12:23 1:31:38 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1887119 2017-11-25 03:28:26 2017-11-26 19:23:39 2017-11-26 20:13:39 0:50:00 0:12:19 0:37:41 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 20:04:31.288040 mon.a mon.1 172.21.15.49:6789/0 41 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1887121 2017-11-25 03:28:27 2017-11-26 19:26:00 2017-11-26 20:52:02 1:26:02 0:10:00 1:16:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1887123 2017-11-25 03:28:28 2017-11-26 19:26:38 2017-11-26 20:18:38 0:52:00 0:26:00 0:26:00 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1887125 2017-11-25 03:28:29 2017-11-26 19:27:10 2017-11-26 20:11:10 0:44:00 0:12:04 0:31:56 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887127 2017-11-25 03:28:30 2017-11-26 19:28:00 2017-11-26 21:10:03 1:42:03 0:11:41 1:30:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1887129 2017-11-25 03:28:31 2017-11-26 19:29:53 2017-11-26 21:39:57 2:10:04 0:14:07 1:55:57 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1887131 2017-11-25 03:28:32 2017-11-26 19:34:01 2017-11-26 20:14:01 0:40:00 0:08:54 0:31:06 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1887133 2017-11-25 03:28:32 2017-11-26 19:39:10 2017-11-26 20:01:09 0:21:59 0:09:42 0:12:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1887135 2017-11-25 03:28:33 2017-11-26 19:41:15 2017-11-26 20:45:15 1:04:00 0:47:43 0:16:17 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1887137 2017-11-25 03:28:34 2017-11-26 19:41:15 2017-11-26 20:43:15 1:02:00 0:11:01 0:50:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1887139 2017-11-25 03:28:35 2017-11-26 19:41:54 2017-11-26 20:31:55 0:50:01 0:27:06 0:22:55 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1887141 2017-11-25 03:28:36 2017-11-26 19:43:11 2017-11-26 20:23:11 0:40:00 0:28:39 0:11:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1887143 2017-11-25 03:28:37 2017-11-26 19:43:16 2017-11-26 22:57:19 3:14:03 0:10:12 3:03:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1887145 2017-11-25 03:28:38 2017-11-26 19:45:21 2017-11-26 20:23:21 0:38:00 0:26:55 0:11:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1887147 2017-11-25 03:28:39 2017-11-26 19:45:56 2017-11-26 21:03:58 1:18:02 0:19:19 0:58:43 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1887149 2017-11-25 03:28:40 2017-11-26 19:47:34 2017-11-26 21:33:36 1:46:02 0:17:47 1:28:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1887151 2017-11-25 03:28:41 2017-11-26 19:48:15 2017-11-26 20:48:16 1:00:01 0:39:30 0:20:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1887153 2017-11-25 03:28:42 2017-11-26 19:50:02 2017-11-26 20:14:01 0:23:59 0:13:44 0:10:15 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1887155 2017-11-25 03:28:43 2017-11-26 19:50:20 2017-11-26 21:04:21 1:14:01 0:36:01 0:38:00 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1887157 2017-11-25 03:28:44 2017-11-26 19:53:09 2017-11-26 21:19:10 1:26:01 0:38:19 0:47:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1887158 2017-11-25 03:28:44 2017-11-26 19:55:56 2017-11-26 21:09:56 1:14:00 0:51:48 0:22:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 20:22:32.241932 mon.b mon.0 172.21.15.92:6789/0 150 : cluster [WRN] Health check failed: 1200 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log

pass 1887161 2017-11-25 03:28:45 2017-11-26 19:56:47 2017-11-26 22:24:50 2:28:03 0:11:03 2:17:00 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1887163 2017-11-25 03:28:46 2017-11-26 19:59:37 2017-11-26 20:35:37 0:36:00 0:10:28 0:25:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1887165 2017-11-25 03:28:47 2017-11-26 20:02:02 2017-11-26 20:56:02 0:54:00 0:24:13 0:29:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1887166 2017-11-25 03:28:48 2017-11-26 20:02:03 2017-11-26 20:34:03 0:32:00 0:20:02 0:11:58 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1887168 2017-11-25 03:28:49 2017-11-26 20:02:35 2017-11-26 20:46:35 0:44:00 0:20:54 0:23:06 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-26 20:31:28.787084 mon.a mon.0 172.21.15.17:6789/0 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1887170 2017-11-25 03:28:50 2017-11-26 20:03:28 2017-11-26 21:01:28 0:58:00 0:10:31 0:47:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1887173 2017-11-25 03:28:51 2017-11-26 20:04:58 2017-11-26 21:57:00 1:52:02 0:22:43 1:29:19 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1887175 2017-11-25 03:28:52 2017-11-26 20:07:48 2017-11-26 20:49:48 0:42:00 0:22:40 0:19:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887177 2017-11-25 03:28:53 2017-11-26 20:11:24 2017-11-26 20:37:23 0:25:59 0:11:07 0:14:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1887179 2017-11-25 03:28:55 2017-11-26 20:13:55 2017-11-26 21:07:56 0:54:01 0:19:48 0:34:13 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1887181 2017-11-25 03:28:56 2017-11-26 20:14:03 2017-11-26 20:38:02 0:23:59 0:10:30 0:13:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1887183 2017-11-25 03:28:57 2017-11-26 20:14:38 2017-11-26 20:36:37 0:21:59 0:10:43 0:11:16 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1887185 2017-11-25 03:28:58 2017-11-26 20:15:30 2017-11-26 21:31:31 1:16:01 0:28:18 0:47:43 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1887187 2017-11-25 03:28:59 2017-11-26 20:17:44 2017-11-26 20:55:44 0:38:00 0:13:45 0:24:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1887189 2017-11-25 03:29:00 2017-11-26 20:18:37 2017-11-26 21:20:38 1:02:01 0:12:17 0:49:44 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1887191 2017-11-25 03:29:01 2017-11-26 20:19:29 2017-11-26 21:13:29 0:54:00 0:23:47 0:30:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1887193 2017-11-25 03:29:02 2017-11-26 20:21:59 2017-11-26 21:48:00 1:26:01 0:18:20 1:07:41 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1887195 2017-11-25 03:29:03 2017-11-26 20:23:21 2017-11-26 22:09:23 1:46:02 0:25:33 1:20:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1887197 2017-11-25 03:29:04 2017-11-26 20:23:22 2017-11-26 20:57:22 0:34:00 0:19:08 0:14:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1887199 2017-11-25 03:29:05 2017-11-26 20:23:56 2017-11-26 21:07:56 0:44:00 0:10:25 0:33:35 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1887201 2017-11-25 03:29:06 2017-11-26 20:27:43 2017-11-26 21:19:43 0:52:00 0:40:46 0:11:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1887203 2017-11-25 03:29:07 2017-11-26 20:29:26 2017-11-26 20:59:26 0:30:00 0:19:50 0:10:10 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1887205 2017-11-25 03:29:08 2017-11-26 20:30:03 2017-11-26 23:44:06 3:14:03 0:08:05 3:05:58 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi187 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp1ekVCx'

pass 1887207 2017-11-25 03:29:09 2017-11-26 20:31:18 2017-11-26 22:31:19 2:00:01 0:42:56 1:17:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1887209 2017-11-25 03:29:11 2017-11-26 20:34:05 2017-11-26 21:18:05 0:44:00 0:20:55 0:23:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1887211 2017-11-25 03:29:12 2017-11-26 20:34:05 2017-11-26 22:06:07 1:32:02 0:10:29 1:21:33 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1887213 2017-11-25 03:29:13 2017-11-26 20:35:49 2017-11-26 21:33:50 0:58:01 0:10:15 0:47:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
dead 1887214 2017-11-25 03:29:14 2017-11-26 20:36:38 2017-11-27 08:42:57 12:06:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1887216 2017-11-25 03:29:15 2017-11-26 20:37:25 2017-11-26 21:35:25 0:58:00 0:12:14 0:45:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1887219 2017-11-25 03:29:16 2017-11-26 20:39:26 2017-11-26 21:25:26 0:46:00 0:22:14 0:23:46 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-26 21:06:48.912268 mon.b mon.0 172.21.15.41:6789/0 112 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1887221 2017-11-25 03:29:18 2017-11-26 20:39:50 2017-11-26 21:15:50 0:36:00 0:10:13 0:25:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1887223 2017-11-25 03:29:19 2017-11-26 20:41:31 2017-11-26 21:19:31 0:38:00 0:27:09 0:10:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1887225 2017-11-25 03:29:21 2017-11-26 20:43:28 2017-11-26 21:29:28 0:46:00 0:12:31 0:33:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1887227 2017-11-25 03:29:22 2017-11-26 20:44:11 2017-11-26 21:06:10 0:21:59 0:11:15 0:10:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1887229 2017-11-25 03:29:23 2017-11-26 20:45:28 2017-11-26 22:01:29 1:16:01 0:14:47 1:01:14 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1887231 2017-11-25 03:29:25 2017-11-26 20:46:47 2017-11-26 21:28:47 0:42:00 0:08:45 0:33:15 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3