Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1893934 2017-11-27 03:25:24 2017-11-30 22:37:02 2017-11-30 23:05:02 0:28:00 0:10:12 0:17:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1893937 2017-11-27 03:25:25 2017-11-30 22:37:27 2017-11-30 23:53:28 1:16:01 0:51:00 0:25:01 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1893940 2017-11-27 03:25:25 2017-11-30 22:38:18 2017-12-01 00:52:20 2:14:02 0:11:25 2:02:37 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1893943 2017-11-27 03:25:26 2017-11-30 22:38:48 2017-12-01 00:16:49 1:38:01 1:07:07 0:30:54 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1893945 2017-11-27 03:25:27 2017-11-30 22:39:48 2017-11-30 23:15:48 0:36:00 0:23:53 0:12:07 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1893948 2017-11-27 03:25:27 2017-11-30 22:41:01 2017-12-01 00:05:02 1:24:01 0:10:07 1:13:54 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1893951 2017-11-27 03:25:28 2017-11-30 22:42:56 2017-11-30 23:52:57 1:10:01 0:31:41 0:38:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1893954 2017-11-27 03:25:29 2017-11-30 22:43:08 2017-11-30 23:33:09 0:50:01 0:19:44 0:30:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1893957 2017-11-27 03:25:29 2017-11-30 22:43:13 2017-11-30 23:23:13 0:40:00 0:17:24 0:22:36 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1893960 2017-11-27 03:25:30 2017-11-30 22:47:04 2017-11-30 23:41:04 0:54:00 0:37:56 0:16:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1893963 2017-11-27 03:25:31 2017-11-30 22:47:19 2017-11-30 23:25:19 0:38:00 0:13:36 0:24:24 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
dead 1893966 2017-11-27 03:25:31 2017-11-28 18:07:45 2017-11-28 18:13:42 0:05:57 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml}
pass 1893968 2017-11-27 03:25:32 2017-11-30 22:47:56 2017-11-30 23:45:56 0:58:00 0:41:55 0:16:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1893971 2017-11-27 03:25:32 2017-11-30 22:51:01 2017-11-30 23:33:01 0:42:00 0:21:01 0:20:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-30 23:14:30.141084 mon.b mon.0 172.21.15.3:6789/0 110 : cluster [WRN] Health check failed: 16287 slow ops, oldest one blocked for 52 sec (SLOW_OPS)" in cluster log

pass 1893974 2017-11-27 03:25:33 2017-11-30 22:53:02 2017-11-30 23:53:02 1:00:00 0:11:54 0:48:06 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1893977 2017-11-27 03:25:34 2017-11-30 22:55:13 2017-11-30 23:19:13 0:24:00 0:10:15 0:13:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1893980 2017-11-27 03:25:34 2017-11-30 22:55:18 2017-11-30 23:45:18 0:50:00 0:19:28 0:30:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1893983 2017-11-27 03:25:35 2017-11-30 22:56:32 2017-11-30 23:26:32 0:30:00 0:19:41 0:10:19 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1893984 2017-11-27 03:25:36 2017-11-30 22:56:45 2017-12-01 00:30:46 1:34:01 1:14:14 0:19:47 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-30 23:17:29.242158 mon.a mon.1 172.21.15.67:6789/0 12 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1893985 2017-11-27 03:25:36 2017-11-30 22:56:45 2017-11-30 23:24:45 0:28:00 0:10:13 0:17:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1893986 2017-11-27 03:25:37 2017-11-30 22:56:50 2017-12-01 00:40:52 1:44:02 0:22:21 1:21:41 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1893987 2017-11-27 03:25:37 2017-11-30 22:56:56 2017-11-30 23:20:56 0:24:00 0:13:05 0:10:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1893988 2017-11-27 03:25:38 2017-11-30 22:56:57 2017-11-30 23:20:57 0:24:00 0:11:25 0:12:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1893989 2017-11-27 03:25:39 2017-11-30 22:57:10 2017-11-30 23:55:10 0:58:00 0:20:01 0:37:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1893990 2017-11-27 03:25:39 2017-11-30 22:57:22 2017-11-30 23:23:22 0:26:00 0:09:22 0:16:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1893991 2017-11-27 03:25:40 2017-11-30 22:57:52 2017-11-30 23:17:52 0:20:00 0:09:51 0:10:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1893992 2017-11-27 03:25:41 2017-11-30 22:59:13 2017-12-01 01:39:16 2:40:03 0:33:26 2:06:37 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1893993 2017-11-27 03:25:41 2017-11-30 22:59:54 2017-12-01 00:13:54 1:14:00 0:13:31 1:00:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1893994 2017-11-27 03:25:42 2017-11-30 23:00:33 2017-11-30 23:24:33 0:24:00 0:12:33 0:11:27 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1893995 2017-11-27 03:25:42 2017-11-30 23:00:44 2017-11-30 23:36:44 0:36:00 0:22:02 0:13:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1893996 2017-11-27 03:25:43 2017-11-30 23:00:49 2017-12-01 00:20:50 1:20:01 0:17:55 1:02:06 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1893997 2017-11-27 03:25:44 2017-11-30 23:01:08 2017-11-30 23:45:08 0:44:00 0:31:56 0:12:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1893998 2017-11-27 03:25:44 2017-11-30 23:01:10 2017-11-30 23:33:10 0:32:00 0:19:36 0:12:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1893999 2017-11-27 03:25:45 2017-11-30 23:01:11 2017-12-01 00:09:11 1:08:00 0:10:10 0:57:50 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1894000 2017-11-27 03:25:46 2017-11-30 23:01:19 2017-12-01 00:01:19 1:00:00 0:46:21 0:13:39 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894001 2017-11-27 03:25:46 2017-11-30 23:02:57 2017-12-01 00:10:58 1:08:01 0:24:31 0:43:30 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1894002 2017-11-27 03:25:47 2017-11-30 23:03:17 2017-11-30 23:37:17 0:34:00 0:07:47 0:26:13 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi104 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpLM5LgC'

pass 1894003 2017-11-27 03:25:47 2017-11-30 23:03:26 2017-12-01 00:07:27 1:04:01 0:39:03 0:24:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1894004 2017-11-27 03:25:48 2017-11-30 23:05:08 2017-11-30 23:49:08 0:44:00 0:24:22 0:19:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1894005 2017-11-27 03:25:49 2017-11-30 23:05:08 2017-11-30 23:53:08 0:48:00 0:11:35 0:36:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1894006 2017-11-27 03:25:49 2017-11-30 23:05:08 2017-11-30 23:43:08 0:38:00 0:10:34 0:27:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894007 2017-11-27 03:25:50 2017-11-30 23:05:10 2017-12-01 00:01:10 0:56:00 0:20:35 0:35:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894008 2017-11-27 03:25:51 2017-11-30 23:05:16 2017-11-30 23:31:15 0:25:59 0:12:28 0:13:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1894009 2017-11-27 03:25:51 2017-11-30 23:05:26 2017-11-30 23:35:26 0:30:00 0:12:20 0:17:40 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-11-30 23:23:44.378949 mon.b mon.0 172.21.15.62:6789/0 111 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 1894010 2017-11-27 03:25:52 2017-11-30 23:05:40 2017-11-30 23:37:40 0:32:00 0:10:15 0:21:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894011 2017-11-27 03:25:53 2017-11-30 23:06:57 2017-11-30 23:50:57 0:44:00 0:28:44 0:15:16 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1894012 2017-11-27 03:25:53 2017-11-30 23:06:57 2017-11-30 23:30:57 0:24:00 0:10:48 0:13:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894013 2017-11-27 03:25:54 2017-11-30 23:06:58 2017-11-30 23:44:58 0:38:00 0:10:48 0:27:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1894014 2017-11-27 03:25:55 2017-11-30 23:09:14 2017-12-01 01:09:14 2:00:00 0:14:16 1:45:44 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1894015 2017-11-27 03:25:55 2017-11-30 23:09:14 2017-11-30 23:41:12 0:31:58 0:09:18 0:22:40 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894016 2017-11-27 03:25:56 2017-11-30 23:11:05 2017-11-30 23:39:04 0:27:59 0:09:31 0:18:28 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894017 2017-11-27 03:25:56 2017-11-30 23:11:05 2017-12-01 02:09:08 2:58:03 0:51:22 2:06:41 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1894018 2017-11-27 03:25:57 2017-11-30 23:11:05 2017-12-01 01:37:07 2:26:02 0:13:33 2:12:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1894019 2017-11-27 03:25:58 2017-11-30 23:11:22 2017-12-01 00:11:22 1:00:00 0:22:12 0:37:48 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1894020 2017-11-27 03:25:58 2017-11-30 23:15:09 2017-12-01 00:13:10 0:58:01 0:27:47 0:30:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894021 2017-11-27 03:25:59 2017-11-30 23:15:49 2017-11-30 23:49:49 0:34:00 0:10:35 0:23:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1894022 2017-11-27 03:26:00 2017-11-30 23:17:36 2017-11-30 23:57:36 0:40:00 0:25:56 0:14:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894023 2017-11-27 03:26:00 2017-11-30 23:17:53 2017-12-01 00:03:53 0:46:00 0:19:15 0:26:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894024 2017-11-27 03:26:01 2017-11-27 16:42:27 2017-11-27 17:14:22 0:31:55 0:16:35 0:15:20 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1894025 2017-11-27 03:26:01 2017-11-30 23:18:50 2017-12-01 00:26:50 1:08:00 0:46:47 0:21:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894026 2017-11-27 03:26:02 2017-11-30 23:18:58 2017-11-30 23:44:58 0:26:00 0:12:30 0:13:30 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894027 2017-11-27 03:26:03 2017-11-30 23:19:14 2017-12-01 01:09:16 1:50:02 0:37:45 1:12:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1894028 2017-11-27 03:26:03 2017-11-30 23:21:10 2017-12-01 00:37:11 1:16:01 0:38:09 0:37:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1894029 2017-11-27 03:26:04 2017-11-30 23:21:10 2017-12-01 00:41:11 1:20:01 0:49:32 0:30:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-30 23:54:32.381810 mon.b mon.0 172.21.15.86:6789/0 149 : cluster [WRN] Health check failed: 6691 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log

pass 1894030 2017-11-27 03:26:04 2017-11-30 23:23:25 2017-12-01 01:15:27 1:52:02 0:11:35 1:40:27 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1894031 2017-11-27 03:26:05 2017-11-30 23:23:25 2017-12-01 00:01:25 0:38:00 0:10:31 0:27:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894032 2017-11-27 03:26:06 2017-11-30 23:24:45 2017-12-01 00:06:45 0:42:00 0:15:57 0:26:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894033 2017-11-27 03:26:06 2017-11-30 23:24:46 2017-12-01 00:46:47 1:22:01 0:19:19 1:02:42 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1894034 2017-11-27 03:26:07 2017-11-30 23:25:19 2017-11-30 23:59:19 0:34:00 0:19:08 0:14:52 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-11-30 23:42:12.559627 mon.b mon.0 172.21.15.176:6789/0 154 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1894035 2017-11-27 03:26:07 2017-11-30 23:26:44 2017-11-30 23:50:44 0:24:00 0:10:40 0:13:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894036 2017-11-27 03:26:08 2017-11-30 23:30:51 2017-12-01 00:58:52 1:28:01 0:22:23 1:05:38 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1894037 2017-11-27 03:26:09 2017-11-30 23:30:53 2017-11-30 23:52:53 0:22:00 0:12:32 0:09:28 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894038 2017-11-27 03:26:09 2017-11-30 23:30:58 2017-11-30 23:52:57 0:21:59 0:10:58 0:11:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1894039 2017-11-27 03:26:10 2017-11-30 23:31:16 2017-12-01 02:09:19 2:38:03 0:20:51 2:17:12 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1894040 2017-11-27 03:26:11 2017-11-30 23:31:18 2017-12-01 00:03:18 0:32:00 0:09:12 0:22:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894041 2017-11-27 03:26:11 2017-11-30 23:32:48 2017-11-30 23:54:48 0:22:00 0:09:41 0:12:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894042 2017-11-27 03:26:12 2017-11-30 23:33:02 2017-12-01 00:37:03 1:04:01 0:35:00 0:29:01 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1894043 2017-11-27 03:26:13 2017-11-30 23:33:10 2017-12-01 00:03:09 0:29:59 0:12:44 0:17:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1894044 2017-11-27 03:26:13 2017-11-30 23:33:11 2017-12-01 00:23:12 0:50:01 0:24:09 0:25:52 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
fail 1894045 2017-11-27 03:26:14 2017-11-30 23:35:39 2017-12-01 00:27:39 0:52:00 0:30:57 0:21:03 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-12-01 00:00:33.447437 mon.b mon.0 172.21.15.26:6789/0 154 : cluster [WRN] Health check failed: 5051 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log

pass 1894046 2017-11-27 03:26:14 2017-11-30 23:36:50 2017-12-01 00:52:51 1:16:01 0:17:39 0:58:22 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1894047 2017-11-27 03:26:15 2017-11-30 23:36:50 2017-12-01 00:18:50 0:42:00 0:26:56 0:15:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894048 2017-11-27 03:26:16 2017-11-30 23:37:20 2017-12-01 00:13:20 0:36:00 0:19:14 0:16:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894049 2017-11-27 03:26:16 2017-11-30 23:37:41 2017-12-01 00:11:41 0:34:00 0:11:04 0:22:56 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1894050 2017-11-27 03:26:17 2017-11-30 23:39:16 2017-12-01 01:21:18 1:42:02 0:39:10 1:02:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894051 2017-11-27 03:26:18 2017-11-30 23:41:19 2017-12-01 01:03:20 1:22:01 1:12:04 0:09:57 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1894052 2017-11-27 03:26:18 2017-11-30 23:41:19 2017-12-01 00:17:19 0:36:00 0:08:03 0:27:57 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi131 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp0DWYJS'

pass 1894053 2017-11-27 03:26:19 2017-11-30 23:41:54 2017-12-01 00:47:53 1:05:59 0:37:59 0:28:00 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1894054 2017-11-27 03:26:20 2017-11-30 23:43:23 2017-12-01 01:23:24 1:40:01 1:16:19 0:23:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 00:09:51.562293 mon.a mon.0 172.21.15.84:6789/0 132 : cluster [WRN] Health check failed: 14379 slow ops, oldest one blocked for 60 sec (SLOW_OPS)" in cluster log

pass 1894055 2017-11-27 03:26:20 2017-11-30 23:43:23 2017-12-01 03:11:27 3:28:04 0:11:35 3:16:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1894056 2017-11-27 03:26:21 2017-11-30 23:45:10 2017-12-01 00:13:10 0:28:00 0:10:51 0:17:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894057 2017-11-27 03:26:21 2017-11-30 23:45:10 2017-12-01 00:25:10 0:40:00 0:24:49 0:15:11 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894058 2017-11-27 03:26:22 2017-11-30 23:45:10 2017-12-01 00:15:10 0:30:00 0:12:12 0:17:48 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1894059 2017-11-27 03:26:23 2017-11-30 23:45:19 2017-12-01 00:41:20 0:56:01 0:12:19 0:43:42 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 00:28:43.546381 mon.b mon.0 172.21.15.3:6789/0 107 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1894060 2017-11-27 03:26:23 2017-11-30 23:45:57 2017-12-01 00:11:57 0:26:00 0:10:52 0:15:08 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894061 2017-11-27 03:26:24 2017-11-30 23:48:28 2017-12-01 00:42:28 0:54:00 0:27:10 0:26:50 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
fail 1894062 2017-11-27 03:26:25 2017-11-30 23:49:09 2017-12-01 01:09:10 1:20:01 0:21:40 0:58:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 00:51:32.632463 mon.b mon.0 172.21.15.110:6789/0 122 : cluster [WRN] Health check failed: 43 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1894063 2017-11-27 03:26:25 2017-11-30 23:50:02 2017-12-01 00:24:02 0:34:00 0:11:29 0:22:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1894064 2017-11-27 03:26:26 2017-11-30 23:50:47 2017-12-01 01:44:49 1:54:02 0:15:44 1:38:18 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1894065 2017-11-27 03:26:27 2017-11-30 23:50:47 2017-12-01 00:14:47 0:24:00 0:09:23 0:14:37 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894066 2017-11-27 03:26:27 2017-11-30 23:50:58 2017-12-01 00:20:58 0:30:00 0:10:50 0:19:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894067 2017-11-27 03:26:28 2017-11-30 23:53:05 2017-12-01 01:01:06 1:08:01 0:48:55 0:19:06 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1894068 2017-11-27 03:26:28 2017-11-29 16:20:09 2017-11-29 16:50:08 0:29:59 0:11:45 0:18:14 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1894069 2017-11-27 03:26:29 2017-11-30 23:53:05 2017-12-01 01:01:06 1:08:01 0:53:58 0:14:03 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1894070 2017-11-27 03:26:30 2017-11-30 23:53:06 2017-12-01 00:35:06 0:42:00 0:25:16 0:16:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894071 2017-11-27 03:26:30 2017-11-30 23:53:06 2017-12-01 00:33:06 0:40:00 0:10:04 0:29:56 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1894072 2017-11-27 03:26:31 2017-11-30 23:53:09 2017-12-01 01:03:10 1:10:01 0:26:05 0:43:56 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894073 2017-11-27 03:26:32 2017-11-30 23:53:29 2017-12-01 00:33:29 0:40:00 0:19:37 0:20:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894074 2017-11-27 03:26:32 2017-11-30 23:55:02 2017-12-01 00:37:02 0:42:00 0:16:30 0:25:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1894075 2017-11-27 03:26:33 2017-11-30 23:55:11 2017-12-01 00:59:12 1:04:01 0:38:40 0:25:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894076 2017-11-27 03:26:34 2017-11-30 23:57:48 2017-12-01 00:21:48 0:24:00 0:12:08 0:11:52 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894077 2017-11-27 03:26:34 2017-11-30 23:59:32 2017-12-01 02:07:34 2:08:02 0:36:51 1:31:11 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1894078 2017-11-27 03:26:35 2017-12-01 00:01:16 2017-12-01 01:09:17 1:08:01 0:42:23 0:25:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1894079 2017-11-27 03:26:35 2017-12-01 00:01:16 2017-12-01 00:33:16 0:32:00 0:18:52 0:13:08 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1894080 2017-11-27 03:26:36 2017-12-01 00:01:20 2017-12-01 01:53:22 1:52:02 0:10:56 1:41:06 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1894081 2017-11-27 03:26:37 2017-12-01 00:01:26 2017-12-01 00:31:26 0:30:00 0:10:13 0:19:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
dead 1894082 2017-11-27 03:26:37 2017-12-01 00:03:24 2017-12-01 12:09:41 12:06:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894083 2017-11-27 03:26:38 2017-12-01 00:03:24 2017-12-01 00:49:24 0:46:00 0:19:00 0:27:00 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1894084 2017-11-27 03:26:39 2017-12-01 00:03:54 2017-12-01 00:51:54 0:48:00 0:25:06 0:22:54 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 00:28:05.850979 mon.a mon.0 172.21.15.23:6789/0 27 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1894085 2017-11-27 03:26:39 2017-12-01 00:05:17 2017-12-01 00:25:17 0:20:00 0:10:35 0:09:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894086 2017-11-27 03:26:40 2017-12-01 00:05:17 2017-12-01 00:55:17 0:50:00 0:22:01 0:27:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1894087 2017-11-27 03:26:40 2017-12-01 00:06:57 2017-12-01 00:30:57 0:24:00 0:11:56 0:12:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894088 2017-11-27 03:26:41 2017-12-01 00:07:28 2017-12-01 00:31:28 0:24:00 0:10:46 0:13:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1894089 2017-11-27 03:26:42 2017-12-01 00:09:24 2017-12-01 00:55:25 0:46:01 0:19:32 0:26:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1894090 2017-11-27 03:26:42 2017-12-01 00:11:11 2017-12-01 00:37:11 0:26:00 0:08:45 0:17:15 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894091 2017-11-27 03:26:43 2017-12-01 00:11:24 2017-12-01 00:33:23 0:21:59 0:10:28 0:11:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894092 2017-11-27 03:26:44 2017-12-01 00:11:43 2017-12-01 02:07:44 1:56:01 0:41:18 1:14:43 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1894093 2017-11-27 03:26:44 2017-12-01 00:11:58 2017-12-01 01:05:58 0:54:00 0:13:05 0:40:55 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1894094 2017-11-27 03:26:45 2017-12-01 00:13:23 2017-12-01 00:59:23 0:46:00 0:14:02 0:31:58 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894095 2017-11-27 03:26:45 2017-12-01 00:13:23 2017-12-01 01:11:23 0:58:00 0:23:31 0:34:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894096 2017-11-27 03:26:46 2017-12-01 00:13:23 2017-12-01 01:33:24 1:20:01 0:17:40 1:02:21 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1894097 2017-11-27 03:26:47 2017-12-01 00:13:56 2017-12-01 01:11:56 0:58:00 0:32:03 0:25:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894098 2017-11-27 03:26:47 2017-12-01 00:15:00 2017-12-01 00:45:00 0:30:00 0:19:13 0:10:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894099 2017-11-27 03:26:48 2017-12-01 00:15:11 2017-12-01 01:13:11 0:58:00 0:10:54 0:47:06 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1894100 2017-11-27 03:26:49 2017-12-01 00:17:05 2017-12-01 01:17:05 1:00:00 0:37:20 0:22:40 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894101 2017-11-27 03:26:49 2017-12-01 00:17:20 2017-12-01 00:53:20 0:36:00 0:20:20 0:15:40 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1894102 2017-11-27 03:26:50 2017-12-01 00:19:03 2017-12-01 01:19:03 1:00:00 0:09:09 0:50:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi073 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmppg2EyJ'

pass 1894103 2017-11-27 03:26:50 2017-12-01 00:21:03 2017-12-01 01:33:04 1:12:01 0:44:07 0:27:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1894104 2017-11-27 03:26:51 2017-12-01 00:21:03 2017-12-01 01:13:03 0:52:00 0:20:34 0:31:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1894105 2017-11-27 03:26:52 2017-12-01 00:21:49 2017-12-01 01:13:50 0:52:01 0:11:22 0:40:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1894106 2017-11-27 03:26:52 2017-12-01 00:23:28 2017-12-01 02:29:30 2:06:02 0:11:20 1:54:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894107 2017-11-27 03:26:53 2017-12-01 00:24:03 2017-12-01 00:54:02 0:29:59 0:19:00 0:10:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894108 2017-11-27 03:26:54 2017-12-01 00:25:07 2017-12-01 01:21:08 0:56:01 0:12:53 0:43:08 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1894109 2017-11-27 03:26:54 2017-12-01 00:25:11 2017-12-01 00:59:11 0:34:00 0:12:51 0:21:09 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 00:46:19.394850 mon.b mon.0 172.21.15.4:6789/0 145 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1894110 2017-11-27 03:26:55 2017-12-01 00:25:18 2017-12-01 00:51:18 0:26:00 0:10:18 0:15:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894111 2017-11-27 03:26:55 2017-12-01 00:27:05 2017-12-01 01:35:06 1:08:01 0:27:42 0:40:19 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1894112 2017-11-27 03:26:56 2017-12-01 00:27:40 2017-12-01 01:11:40 0:44:00 0:12:39 0:31:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894113 2017-11-27 03:26:57 2017-12-01 00:30:57 2017-12-01 00:56:57 0:26:00 0:11:14 0:14:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1894114 2017-11-27 03:26:57 2017-12-01 00:30:58 2017-12-01 01:12:58 0:42:00 0:13:33 0:28:27 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1894115 2017-11-27 03:26:58 2017-12-01 00:31:27 2017-12-01 00:53:27 0:22:00 0:09:05 0:12:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894116 2017-11-27 03:26:58 2017-12-01 00:31:28 2017-12-01 01:15:29 0:44:01 0:10:20 0:33:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894117 2017-11-27 03:26:59 2017-12-01 00:33:19 2017-12-01 04:01:23 3:28:04 0:48:55 2:39:09 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1894118 2017-11-27 03:27:00 2017-12-01 00:33:19 2017-12-01 03:57:24 3:24:05 0:13:20 3:10:45 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1894119 2017-11-27 03:27:00 2017-12-01 00:33:24 2017-12-01 01:07:24 0:34:00 0:22:55 0:11:05 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1894120 2017-11-27 03:27:01 2017-12-01 00:33:30 2017-12-01 01:09:30 0:36:00 0:22:43 0:13:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894121 2017-11-27 03:27:01 2017-12-01 00:35:18 2017-12-01 02:37:20 2:02:02 0:10:32 1:51:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1894122 2017-11-27 03:27:02 2017-12-01 00:37:17 2017-12-01 01:29:17 0:52:00 0:34:29 0:17:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894123 2017-11-27 03:27:03 2017-12-01 00:37:17 2017-12-01 01:19:17 0:42:00 0:19:46 0:22:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894124 2017-11-27 03:27:03 2017-12-01 00:37:17 2017-12-01 01:21:17 0:44:00 0:17:45 0:26:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1894125 2017-11-27 03:27:04 2017-12-01 00:37:17 2017-12-01 01:55:18 1:18:01 0:50:28 0:27:33 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894126 2017-11-27 03:27:05 2017-12-01 00:41:04 2017-12-01 01:35:05 0:54:01 0:22:35 0:31:26 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894127 2017-11-27 03:27:05 2017-12-01 00:41:12 2017-12-01 01:37:13 0:56:01 0:38:00 0:18:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1894128 2017-11-27 03:27:06 2017-12-01 00:41:21 2017-12-01 01:37:21 0:56:00 0:38:31 0:17:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1894129 2017-11-27 03:27:06 2017-12-01 00:42:40 2017-12-01 01:40:41 0:58:01 0:24:48 0:33:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1894130 2017-11-27 03:27:07 2017-12-01 00:45:12 2017-12-01 01:15:12 0:30:00 0:11:36 0:18:24 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1894131 2017-11-27 03:27:08 2017-12-01 00:47:00 2017-12-01 01:18:59 0:31:59 0:11:03 0:20:56 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894132 2017-11-27 03:27:08 2017-12-01 00:47:55 2017-12-01 01:21:54 0:33:59 0:19:53 0:14:06 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894133 2017-11-27 03:27:09 2017-12-01 00:49:39 2017-12-01 01:37:39 0:48:00 0:19:19 0:28:41 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1894134 2017-11-27 03:27:10 2017-12-01 00:51:31 2017-12-01 02:39:33 1:48:02 0:52:23 0:55:39 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 01:49:06.354732 mon.a mon.0 172.21.15.60:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1894135 2017-11-27 03:27:10 2017-12-01 00:51:50 2017-12-01 01:13:50 0:22:00 0:10:55 0:11:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894136 2017-11-27 03:27:11 2017-12-01 00:51:55 2017-12-01 02:25:57 1:34:02 0:22:52 1:11:10 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1894137 2017-11-27 03:27:12 2017-12-01 00:52:21 2017-12-01 01:54:22 1:02:01 0:11:19 0:50:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894138 2017-11-27 03:27:12 2017-12-01 00:53:03 2017-12-01 01:19:03 0:26:00 0:11:39 0:14:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1894139 2017-11-27 03:27:13 2017-12-01 00:53:21 2017-12-01 01:51:21 0:58:00 0:19:59 0:38:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1894140 2017-11-27 03:27:14 2017-12-01 00:53:28 2017-12-01 01:19:28 0:26:00 0:08:59 0:17:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894141 2017-11-27 03:27:14 2017-12-01 00:53:31 2017-12-01 01:39:31 0:46:00 0:10:47 0:35:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894142 2017-11-27 03:27:15 2017-12-01 00:54:15 2017-12-01 01:58:16 1:04:01 0:39:04 0:24:57 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1894143 2017-11-27 03:27:15 2017-12-01 00:55:31 2017-12-01 01:57:31 1:02:00 0:13:08 0:48:52 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1894144 2017-11-27 03:27:16 2017-12-01 00:55:31 2017-12-01 01:59:31 1:04:00 0:13:25 0:50:35 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894145 2017-11-27 03:27:17 2017-12-01 00:57:10 2017-12-01 01:39:10 0:42:00 0:27:34 0:14:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894146 2017-11-27 03:27:17 2017-12-01 00:57:40 2017-12-01 01:31:40 0:34:00 0:18:30 0:15:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1894147 2017-11-27 03:27:18 2017-12-01 00:59:05 2017-12-01 01:37:05 0:38:00 0:27:25 0:10:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894148 2017-11-27 03:27:19 2017-12-01 00:59:11 2017-12-01 01:57:11 0:58:00 0:18:45 0:39:15 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894149 2017-11-27 03:27:19 2017-12-01 00:59:13 2017-12-01 01:37:13 0:38:00 0:12:13 0:25:47 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1894150 2017-11-27 03:27:20 2017-12-01 00:59:13 2017-12-01 02:09:14 1:10:01 0:48:17 0:21:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894151 2017-11-27 03:27:20 2017-12-01 00:59:24 2017-12-01 03:25:27 2:26:03 1:16:53 1:09:10 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1894152 2017-11-27 03:27:21 2017-12-01 01:01:19 2017-12-01 01:55:19 0:54:00 0:07:53 0:46:07 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi026 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmps1IoiH'

pass 1894153 2017-11-27 03:27:22 2017-12-01 01:01:19 2017-12-01 01:55:19 0:54:00 0:39:22 0:14:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1894154 2017-11-27 03:27:22 2017-12-01 01:03:13 2017-12-01 03:03:15 2:00:02 1:08:24 0:51:38 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 01:57:38.035985 mon.b mon.0 172.21.15.28:6789/0 119 : cluster [WRN] Health check failed: 4869 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1894155 2017-11-27 03:27:23 2017-12-01 01:03:13 2017-12-01 01:39:13 0:36:00 0:12:23 0:23:37 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1894156 2017-11-27 03:27:24 2017-12-01 01:03:21 2017-12-01 01:33:20 0:29:59 0:10:58 0:19:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894157 2017-11-27 03:27:24 2017-12-01 01:06:16 2017-12-01 01:40:16 0:34:00 0:18:09 0:15:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894158 2017-11-27 03:27:25 2017-12-01 01:07:38 2017-12-01 01:59:38 0:52:00 0:13:55 0:38:05 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1894159 2017-11-27 03:27:26 2017-12-01 01:09:28 2017-12-01 01:37:28 0:28:00 0:12:26 0:15:34 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 01:25:52.866689 mon.b mon.0 172.21.15.94:6789/0 152 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1894160 2017-11-27 03:27:26 2017-12-01 01:09:28 2017-12-01 01:31:28 0:22:00 0:10:59 0:11:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894161 2017-11-27 03:27:27 2017-12-01 01:09:28 2017-12-01 02:15:29 1:06:01 0:28:10 0:37:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1894162 2017-11-27 03:27:28 2017-12-01 01:09:28 2017-12-01 01:31:27 0:21:59 0:11:52 0:10:07 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894163 2017-11-27 03:27:28 2017-12-01 01:09:31 2017-12-01 01:35:31 0:26:00 0:13:17 0:12:43 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1894164 2017-11-27 03:27:29 2017-12-01 01:11:37 2017-12-01 02:29:38 1:18:01 0:15:15 1:02:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1894165 2017-11-27 03:27:29 2017-12-01 01:11:37 2017-12-01 01:51:37 0:40:00 0:09:15 0:30:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894167 2017-11-27 03:27:30 2017-12-01 01:11:57 2017-12-01 02:15:58 1:04:01 0:10:20 0:53:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894169 2017-11-27 03:27:31 2017-12-01 01:13:14 2017-12-01 02:17:15 1:04:01 0:48:07 0:15:54 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1894171 2017-11-27 03:27:31 2017-12-01 01:13:51 2017-12-01 01:57:51 0:44:00 0:11:23 0:32:37 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1894173 2017-11-27 03:27:32 2017-12-01 01:15:24 2017-12-01 02:17:25 1:02:01 0:26:10 0:35:51 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1894175 2017-11-27 03:27:33 2017-12-01 01:15:30 2017-12-01 01:57:30 0:42:00 0:28:42 0:13:18 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894177 2017-11-27 03:27:33 2017-12-01 01:19:13 2017-12-01 02:39:14 1:20:01 0:10:51 1:09:10 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1894179 2017-11-27 03:27:34 2017-12-01 01:19:13 2017-12-01 01:57:13 0:38:00 0:27:33 0:10:27 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894181 2017-11-27 03:27:35 2017-12-01 01:19:29 2017-12-01 02:07:29 0:48:00 0:20:20 0:27:40 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894183 2017-11-27 03:27:35 2017-12-01 01:21:22 2017-12-01 02:39:22 1:18:00 0:16:35 1:01:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1894185 2017-11-27 03:27:36 2017-12-01 01:21:56 2017-12-01 02:29:56 1:08:00 0:42:01 0:25:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894187 2017-11-27 03:27:37 2017-12-01 01:29:50 2017-12-01 01:53:49 0:23:59 0:12:42 0:11:17 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894189 2017-11-27 03:27:37 2017-12-01 01:31:42 2017-12-01 02:47:43 1:16:01 0:38:32 0:37:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1894191 2017-11-27 03:27:38 2017-12-01 01:33:16 2017-12-01 02:59:18 1:26:02 0:37:25 0:48:37 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1894193 2017-11-27 03:27:39 2017-12-01 01:33:25 2017-12-01 03:35:27 2:02:02 1:16:18 0:45:44 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 02:22:17.066410 mon.a mon.0 172.21.15.25:6789/0 135 : cluster [WRN] Health check failed: 14948 slow ops, oldest one blocked for 72 sec (SLOW_OPS)" in cluster log

pass 1894195 2017-11-27 03:27:39 2017-12-01 01:35:18 2017-12-01 02:59:20 1:24:02 0:18:34 1:05:28 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1894197 2017-11-27 03:27:40 2017-12-01 01:35:42 2017-12-01 01:59:41 0:23:59 0:11:14 0:12:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894199 2017-11-27 03:27:40 2017-12-01 01:37:16 2017-12-01 02:25:17 0:48:01 0:24:36 0:23:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894202 2017-11-27 03:27:41 2017-12-01 01:37:22 2017-12-01 02:29:23 0:52:01 0:20:46 0:31:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1894203 2017-11-27 03:27:42 2017-12-01 01:37:29 2017-12-01 02:15:29 0:38:00 0:21:41 0:16:19 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-01 01:56:03.220935 mon.a mon.0 172.21.15.95:6789/0 120 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1894205 2017-11-27 03:27:42 2017-12-01 01:39:15 2017-12-01 01:59:14 0:19:59 0:10:05 0:09:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1894207 2017-11-27 03:27:43 2017-12-01 01:39:15 2017-12-01 02:49:16 1:10:01 0:23:08 0:46:53 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
fail 1894209 2017-11-27 03:27:44 2017-12-01 01:39:32 2017-12-01 02:31:33 0:52:01 0:22:03 0:29:58 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 02:13:03.583224 mon.b mon.0 172.21.15.81:6789/0 153 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log

pass 1894211 2017-11-27 03:27:44 2017-12-01 01:40:42 2017-12-01 02:10:42 0:30:00 0:11:08 0:18:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1894213 2017-11-27 03:27:45 2017-12-01 01:45:01 2017-12-01 02:29:02 0:44:01 0:21:12 0:22:49 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1894215 2017-11-27 03:27:46 2017-12-01 01:51:39 2017-12-01 03:05:40 1:14:01 0:09:19 1:04:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1894217 2017-11-27 03:27:46 2017-12-01 01:53:50 2017-12-01 02:35:50 0:42:00 0:11:08 0:30:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1894219 2017-11-27 03:27:47 2017-12-01 01:55:30 2017-12-01 04:47:34 2:52:04 0:32:07 2:19:57 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1894221 2017-11-27 03:27:48 2017-12-01 01:55:30 2017-12-01 04:15:33 2:20:03 0:13:32 2:06:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1894223 2017-11-27 03:27:48 2017-12-01 01:57:23 2017-12-01 03:07:25 1:10:02 0:13:30 0:56:32 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1894226 2017-11-27 03:27:49 2017-12-01 01:57:52 2017-12-01 02:53:53 0:56:01 0:35:42 0:20:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1894228 2017-11-27 03:27:50 2017-12-01 01:58:17 2017-12-01 02:36:17 0:38:00 0:19:08 0:18:52 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1894230 2017-11-27 03:27:50 2017-12-01 01:59:23 2017-12-01 02:55:24 0:56:01 0:36:47 0:19:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1894232 2017-11-27 03:27:51 2017-12-01 01:59:39 2017-12-01 02:29:39 0:30:00 0:19:23 0:10:37 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1894234 2017-11-27 03:27:52 2017-12-01 02:01:34 2017-12-01 03:39:36 1:38:02 0:09:59 1:28:03 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1894235 2017-11-27 03:27:52 2017-12-01 02:03:24 2017-12-01 03:17:25 1:14:01 0:43:10 0:30:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1894237 2017-11-27 03:27:53 2017-12-01 02:07:43 2017-12-01 02:53:44 0:46:01 0:29:30 0:16:31 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1894239 2017-11-27 03:27:53 2017-12-01 02:07:45 2017-12-01 03:21:46 1:14:01 0:08:15 1:05:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi110 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmph0Y6ml'

pass 1894241 2017-11-27 03:27:54 2017-12-01 02:09:23 2017-12-01 03:21:24 1:12:01 0:45:55 0:26:06 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1894243 2017-11-27 03:27:55 2017-12-01 02:09:44 2017-12-01 03:29:45 1:20:01 0:21:16 0:58:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1894245 2017-11-27 03:27:55 2017-12-01 02:13:36 2017-12-01 03:11:37 0:58:01 0:11:56 0:46:05 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1894247 2017-11-27 03:27:56 2017-12-01 02:15:40 2017-12-01 03:45:42 1:30:02 0:10:11 1:19:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1894249 2017-11-27 03:27:57 2017-12-01 02:15:40 2017-12-01 03:37:42 1:22:02 0:26:16 0:55:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1894251 2017-11-27 03:27:57 2017-12-01 02:17:27 2017-12-01 02:43:27 0:26:00 0:12:29 0:13:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1894253 2017-11-27 03:27:58 2017-12-01 02:17:42 2017-12-01 03:11:43 0:54:01 0:29:18 0:24:43 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-01 02:51:44.345818 mon.a mon.0 172.21.15.5:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1894255 2017-11-27 03:27:58 2017-12-01 02:19:35 2017-12-01 03:01:36 0:42:01 0:14:42 0:27:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
fail 1894257 2017-11-27 03:27:59 2017-12-01 02:21:51 2017-12-01 03:11:51 0:50:00 0:17:57 0:32:03 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 1894259 2017-11-27 03:28:00 2017-12-01 02:25:32 2017-12-01 03:21:33 0:56:01 0:12:07 0:43:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1894261 2017-11-27 03:28:00 2017-12-01 02:29:15 2017-12-01 03:01:16 0:32:01 0:17:18 0:14:43 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1894263 2017-11-27 03:28:01 2017-12-01 02:29:24 2017-12-01 04:09:26 1:40:02 0:13:16 1:26:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1894265 2017-11-27 03:28:02 2017-12-01 02:29:32 2017-12-01 03:13:33 0:44:01 0:09:10 0:34:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3