Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1924639 2017-12-04 03:25:24 2017-12-09 14:17:57 2017-12-09 14:37:57 0:20:00 0:09:45 0:10:15 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924642 2017-12-04 03:25:24 2017-12-09 14:19:27 2017-12-09 17:03:29 2:44:02 0:50:47 1:53:15 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1924645 2017-12-04 03:25:25 2017-12-09 14:19:56 2017-12-09 17:35:59 3:16:03 0:10:55 3:05:08 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1924648 2017-12-04 03:25:26 2017-12-09 14:21:49 2017-12-09 15:29:49 1:08:00 0:55:22 0:12:38 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1924651 2017-12-04 03:25:26 2017-12-05 11:32:52 2017-12-05 12:26:48 0:53:56 0:24:47 0:29:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924653 2017-12-04 03:25:27 2017-12-09 14:21:52 2017-12-09 15:11:52 0:50:00 0:10:34 0:39:26 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1924656 2017-12-04 03:25:27 2017-12-09 14:21:58 2017-12-09 15:03:58 0:42:00 0:29:01 0:12:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924658 2017-12-04 03:25:28 2017-12-09 14:22:02 2017-12-09 15:10:02 0:48:00 0:19:06 0:28:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924661 2017-12-04 03:25:29 2017-12-09 14:24:08 2017-12-09 16:36:10 2:12:02 0:15:58 1:56:04 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1924664 2017-12-04 03:25:29 2017-12-09 14:24:08 2017-12-09 15:28:08 1:04:00 0:38:07 0:25:53 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924667 2017-12-04 03:25:30 2017-12-09 14:26:07 2017-12-09 15:52:08 1:26:01 0:11:53 1:14:08 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924670 2017-12-04 03:25:31 2017-12-09 14:27:57 2017-12-09 15:59:58 1:32:01 0:38:32 0:53:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1924673 2017-12-04 03:25:31 2017-12-09 14:28:02 2017-12-09 15:30:03 1:02:01 0:39:42 0:22:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924676 2017-12-04 03:25:32 2017-12-09 14:32:09 2017-12-09 15:14:09 0:42:00 0:20:13 0:21:47 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:01:20.253937 mon.a mon.0 172.21.15.60:6789/0 120 : cluster [WRN] Health check failed: 17213 slow ops, oldest one blocked for 57 sec (SLOW_OPS)" in cluster log

pass 1924679 2017-12-04 03:25:33 2017-12-09 14:32:09 2017-12-09 14:58:09 0:26:00 0:10:30 0:15:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1924682 2017-12-04 03:25:33 2017-12-09 14:33:57 2017-12-09 16:09:58 1:36:01 0:09:27 1:26:34 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924684 2017-12-04 03:25:34 2017-12-09 14:33:57 2017-12-09 15:43:57 1:10:00 0:18:59 0:51:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924687 2017-12-04 03:25:35 2017-12-09 14:36:10 2017-12-09 15:16:10 0:40:00 0:18:43 0:21:17 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1924690 2017-12-04 03:25:35 2017-12-09 14:38:01 2017-12-09 16:10:03 1:32:02 1:10:47 0:21:15 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:05:09.735353 mon.a mon.0 172.21.15.132:6789/0 124 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924692 2017-12-04 03:25:36 2017-12-09 14:38:01 2017-12-09 15:12:01 0:34:00 0:09:37 0:24:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924693 2017-12-04 03:25:36 2017-12-09 14:39:45 2017-12-09 15:47:45 1:08:00 0:22:27 0:45:33 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1924694 2017-12-04 03:25:37 2017-12-09 14:40:10 2017-12-09 15:22:10 0:42:00 0:11:55 0:30:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924695 2017-12-04 03:25:38 2017-12-09 14:42:07 2017-12-09 15:14:07 0:32:00 0:10:09 0:21:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1924696 2017-12-04 03:25:38 2017-12-09 14:42:07 2017-12-09 16:16:08 1:34:01 0:19:22 1:14:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1924697 2017-12-04 03:25:39 2017-12-09 14:42:07 2017-12-09 16:00:08 1:18:01 0:08:44 1:09:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924698 2017-12-04 03:25:40 2017-12-09 14:42:07 2017-12-09 16:16:09 1:34:02 0:09:10 1:24:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924699 2017-12-04 03:25:40 2017-12-09 14:43:54 2017-12-09 15:41:55 0:58:01 0:29:45 0:28:16 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1924700 2017-12-04 03:25:41 2017-12-09 14:43:54 2017-12-09 15:15:54 0:32:00 0:13:17 0:18:43 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1924701 2017-12-04 03:25:42 2017-12-09 14:43:54 2017-12-09 15:11:54 0:28:00 0:11:28 0:16:32 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924702 2017-12-04 03:25:42 2017-12-09 14:44:03 2017-12-09 15:18:03 0:34:00 0:21:29 0:12:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924703 2017-12-04 03:25:43 2017-12-09 14:45:59 2017-12-09 16:28:00 1:42:01 0:16:55 1:25:06 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1924704 2017-12-04 03:25:43 2017-12-09 14:46:00 2017-12-09 15:40:01 0:54:01 0:30:51 0:23:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924705 2017-12-04 03:25:44 2017-12-09 14:47:46 2017-12-09 15:19:46 0:32:00 0:19:21 0:12:39 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924706 2017-12-04 03:25:45 2017-12-09 14:47:51 2017-12-09 17:37:54 2:50:03 0:09:58 2:40:05 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1924707 2017-12-04 03:25:45 2017-12-09 14:47:51 2017-12-09 15:47:52 1:00:01 0:48:29 0:11:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924708 2017-12-04 03:25:46 2017-12-09 14:48:10 2017-12-09 15:22:10 0:34:00 0:24:09 0:09:51 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1924709 2017-12-04 03:25:47 2017-12-09 14:49:58 2017-12-09 16:25:59 1:36:01 0:07:42 1:28:19 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi002 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp4gL1NK'

pass 1924710 2017-12-04 03:25:47 2017-12-09 14:49:58 2017-12-09 16:21:59 1:32:01 0:38:19 0:53:42 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924711 2017-12-04 03:25:48 2017-12-09 14:49:58 2017-12-09 15:55:58 1:06:00 0:23:31 0:42:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:38:27.259269 mon.a mon.0 172.21.15.26:6789/0 130 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1924712 2017-12-04 03:25:48 2017-12-09 14:49:58 2017-12-09 16:52:00 2:02:02 0:11:18 1:50:44 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1924713 2017-12-04 03:25:49 2017-12-09 14:49:58 2017-12-09 16:15:59 1:26:01 0:09:38 1:16:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924714 2017-12-04 03:25:50 2017-12-09 14:49:58 2017-12-09 17:10:00 2:20:02 0:17:26 2:02:36 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924715 2017-12-04 03:25:50 2017-12-09 14:50:01 2017-12-09 15:14:01 0:24:00 0:12:29 0:11:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1924716 2017-12-04 03:25:51 2017-12-09 14:51:52 2017-12-09 15:19:51 0:27:59 0:12:21 0:15:38 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-09 15:13:48.262698 mon.b mon.0 172.21.15.158:6789/0 192 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1924717 2017-12-04 03:25:51 2017-12-09 14:51:52 2017-12-09 15:15:51 0:23:59 0:10:08 0:13:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924718 2017-12-04 03:25:52 2017-12-09 14:51:52 2017-12-09 15:33:52 0:42:00 0:28:38 0:13:22 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1924719 2017-12-04 03:25:53 2017-12-09 14:51:52 2017-12-09 15:13:51 0:21:59 0:10:24 0:11:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924720 2017-12-04 03:25:54 2017-12-09 14:51:52 2017-12-09 15:31:52 0:40:00 0:10:14 0:29:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1924721 2017-12-04 03:25:54 2017-12-09 14:51:56 2017-12-09 15:23:56 0:32:00 0:13:26 0:18:34 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1924722 2017-12-04 03:25:56 2017-12-09 14:51:59 2017-12-09 15:33:59 0:42:00 0:08:50 0:33:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924723 2017-12-04 03:25:57 2017-12-09 14:52:10 2017-12-09 15:44:11 0:52:01 0:09:08 0:42:53 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924724 2017-12-04 03:25:59 2017-12-09 14:54:08 2017-12-09 17:00:10 2:06:02 0:51:21 1:14:41 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1924725 2017-12-04 03:25:59 2017-12-09 14:54:08 2017-12-09 17:12:11 2:18:03 0:10:23 2:07:40 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
fail 1924726 2017-12-04 03:26:00 2017-12-09 14:56:07 2017-12-09 15:44:07 0:48:00 0:37:19 0:10:41 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

fail 1924727 2017-12-04 03:26:01 2017-12-09 14:56:07 2017-12-09 15:24:07 0:28:00 0:03:34 0:24:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924728 2017-12-04 03:26:01 2017-12-09 14:56:07 2017-12-09 16:04:08 1:08:01 0:09:31 0:58:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1924729 2017-12-04 03:26:02 2017-12-09 14:56:07 2017-12-09 15:44:07 0:48:00 0:25:05 0:22:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924730 2017-12-04 03:26:02 2017-12-09 14:58:03 2017-12-09 16:40:04 1:42:01 0:18:47 1:23:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924731 2017-12-04 03:26:03 2017-12-09 14:58:03 2017-12-09 16:52:04 1:54:01 0:16:36 1:37:25 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
fail 1924732 2017-12-04 03:26:04 2017-12-09 14:58:11 2017-12-09 16:14:11 1:16:00 0:46:29 0:29:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
Failure Reason:

"2017-12-09 15:51:10.243919 mon.b mon.0 172.21.15.158:6789/0 261 : cluster [WRN] Health check failed: 153 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log

pass 1924733 2017-12-04 03:26:04 2017-12-09 15:00:09 2017-12-09 15:32:09 0:32:00 0:11:22 0:20:38 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924734 2017-12-04 03:26:05 2017-12-08 03:48:38 2017-12-08 04:50:37 1:01:59 0:36:20 0:25:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
fail 1924735 2017-12-04 03:26:06 2017-12-09 15:00:09 2017-12-09 15:48:09 0:48:00 0:03:29 0:44:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

fail 1924736 2017-12-04 03:26:06 2017-12-09 15:00:09 2017-12-09 16:38:10 1:38:01 1:15:27 0:22:34 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:29:48.309385 mon.a mon.0 172.21.15.60:6789/0 124 : cluster [WRN] Health check failed: 16879 slow ops, oldest one blocked for 79 sec (SLOW_OPS)" in cluster log

pass 1924737 2017-12-04 03:26:07 2017-12-09 15:02:04 2017-12-09 15:24:04 0:22:00 0:09:53 0:12:07 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1924738 2017-12-04 03:26:08 2017-12-09 15:02:05 2017-12-09 15:38:04 0:35:59 0:10:00 0:25:59 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924739 2017-12-04 03:26:08 2017-12-09 15:02:04 2017-12-09 15:36:04 0:34:00 0:14:56 0:19:04 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1924740 2017-12-04 03:26:09 2017-12-09 15:02:04 2017-12-09 22:00:12 6:58:08 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/damage.yaml whitelist_health.yaml} 3
Failure Reason:

Command failed on smithi076 with status 2: 'sudo dpkg -i /tmp/linux-image.deb'

fail 1924741 2017-12-04 03:26:09 2017-12-09 15:04:11 2017-12-09 15:44:11 0:40:00 0:19:54 0:20:06 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:29:50.712418 mon.a mon.1 172.21.15.24:6789/0 82 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924742 2017-12-04 03:26:10 2017-12-09 15:05:55 2017-12-09 15:37:55 0:32:00 0:09:40 0:22:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924743 2017-12-04 03:26:11 2017-12-09 15:10:16 2017-12-09 15:46:16 0:36:00 0:22:28 0:13:32 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1924744 2017-12-04 03:26:11 2017-12-09 15:10:16 2017-12-09 15:36:16 0:26:00 0:12:04 0:13:56 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924745 2017-12-04 03:26:12 2017-12-09 15:12:04 2017-12-09 15:36:04 0:24:00 0:10:41 0:13:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1924746 2017-12-04 03:26:13 2017-12-09 15:12:04 2017-12-09 22:22:13 7:10:09 0:19:02 6:51:07 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1924747 2017-12-04 03:26:13 2017-12-09 15:12:04 2017-12-09 15:42:04 0:30:00 0:08:55 0:21:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924748 2017-12-04 03:26:14 2017-12-09 15:12:04 2017-12-09 16:24:05 1:12:01 0:08:42 1:03:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924749 2017-12-04 03:26:15 2017-12-09 15:14:02 2017-12-09 19:04:06 3:50:04 0:31:14 3:18:50 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1924750 2017-12-04 03:26:15 2017-12-09 15:14:02 2017-12-09 16:06:03 0:52:01 0:12:16 0:39:45 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1924751 2017-12-04 03:26:16 2017-12-09 15:14:02 2017-12-09 15:54:02 0:40:00 0:21:26 0:18:34 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
fail 1924752 2017-12-04 03:26:17 2017-12-09 15:14:08 2017-12-09 16:02:08 0:48:00 0:28:09 0:19:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-12-09 15:43:09.584101 mon.b mon.0 172.21.15.99:6789/0 152 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1924753 2017-12-04 03:26:17 2017-12-09 15:14:10 2017-12-09 15:46:10 0:32:00 0:17:59 0:14:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1924754 2017-12-04 03:26:18 2017-12-09 15:16:04 2017-12-09 16:26:05 1:10:01 0:26:00 0:44:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924755 2017-12-04 03:26:18 2017-12-09 15:16:04 2017-12-09 16:08:04 0:52:00 0:18:40 0:33:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
fail 1924756 2017-12-04 03:26:19 2017-12-09 15:16:04 2017-12-09 17:26:06 2:10:02 0:03:31 2:06:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924757 2017-12-04 03:26:20 2017-12-09 15:16:11 2017-12-09 16:52:12 1:36:01 0:39:13 0:56:48 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924758 2017-12-04 03:26:20 2017-12-09 15:18:15 2017-12-09 16:56:16 1:38:01 1:17:04 0:20:57 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1924759 2017-12-04 03:26:21 2017-12-09 15:19:58 2017-12-09 15:37:57 0:17:59 0:03:31 0:14:28 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924760 2017-12-04 03:26:22 2017-12-09 15:19:58 2017-12-09 16:17:58 0:58:00 0:37:47 0:20:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924761 2017-12-04 03:26:22 2017-12-09 15:19:58 2017-12-09 16:55:59 1:36:01 1:12:16 0:23:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 15:52:03.196855 mon.b mon.0 172.21.15.23:6789/0 124 : cluster [WRN] Health check failed: 14973 slow ops, oldest one blocked for 62 sec (SLOW_OPS)" in cluster log

pass 1924762 2017-12-04 03:26:23 2017-12-09 15:22:24 2017-12-09 19:30:29 4:08:05 0:09:44 3:58:21 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1924763 2017-12-04 03:26:24 2017-12-09 15:22:24 2017-12-09 16:08:25 0:46:01 0:09:43 0:36:18 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924764 2017-12-04 03:26:24 2017-12-09 15:24:05 2017-12-09 16:10:06 0:46:01 0:24:12 0:21:49 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924765 2017-12-04 03:26:25 2017-12-09 15:24:06 2017-12-09 15:58:05 0:33:59 0:12:00 0:21:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
pass 1924766 2017-12-04 03:26:26 2017-12-09 15:24:05 2017-12-09 15:50:05 0:26:00 0:11:37 0:14:23 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924767 2017-12-04 03:26:27 2017-12-09 15:24:08 2017-12-09 15:44:07 0:19:59 0:09:33 0:10:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924768 2017-12-04 03:26:27 2017-12-09 15:26:08 2017-12-09 17:54:11 2:28:03 0:26:41 2:01:22 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
fail 1924769 2017-12-04 03:26:28 2017-12-09 15:26:09 2017-12-09 15:58:08 0:31:59 0:20:37 0:11:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-09 15:45:48.998069 mon.b mon.0 172.21.15.45:6789/0 121 : cluster [WRN] Health check failed: 22 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1924770 2017-12-04 03:26:28 2017-12-09 15:28:21 2017-12-09 15:50:21 0:22:00 0:10:10 0:11:50 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1924771 2017-12-04 03:26:29 2017-12-09 15:30:02 2017-12-09 16:10:02 0:40:00 0:13:46 0:26:14 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1924772 2017-12-04 03:26:30 2017-12-09 15:30:02 2017-12-09 15:56:01 0:25:59 0:08:27 0:17:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924773 2017-12-04 03:26:30 2017-12-09 15:30:04 2017-12-09 15:52:04 0:22:00 0:09:20 0:12:40 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924774 2017-12-04 03:26:31 2017-12-09 15:32:05 2017-12-09 17:46:07 2:14:02 0:46:17 1:27:45 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1924775 2017-12-04 03:26:32 2017-12-09 15:32:10 2017-12-09 16:06:10 0:34:00 0:11:05 0:22:55 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1924776 2017-12-04 03:26:32 2017-12-09 15:34:06 2017-12-09 17:12:07 1:38:01 1:01:42 0:36:19 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1924777 2017-12-04 03:26:33 2017-12-06 00:18:19 2017-12-06 01:12:19 0:54:00 0:25:26 0:28:34 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924778 2017-12-04 03:26:34 2017-12-09 15:34:06 2017-12-09 16:06:06 0:32:00 0:09:46 0:22:14 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1924779 2017-12-04 03:26:34 2017-12-09 15:36:05 2017-12-09 16:12:04 0:35:59 0:24:45 0:11:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924780 2017-12-04 03:26:35 2017-12-09 15:36:05 2017-12-09 16:08:05 0:32:00 0:18:53 0:13:07 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924781 2017-12-04 03:26:35 2017-12-09 15:36:05 2017-12-09 18:48:08 3:12:03 0:15:43 2:56:20 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1924782 2017-12-04 03:26:36 2017-12-09 15:36:17 2017-12-09 16:28:17 0:52:00 0:39:41 0:12:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924783 2017-12-04 03:26:37 2017-12-09 15:38:07 2017-12-09 16:02:07 0:24:00 0:11:31 0:12:29 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924784 2017-12-04 03:26:37 2017-12-09 15:38:07 2017-12-09 19:34:12 3:56:05 0:33:58 3:22:07 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1924785 2017-12-04 03:26:38 2017-12-08 03:48:38 2017-12-08 04:40:37 0:51:59 0:40:02 0:11:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1924786 2017-12-04 03:26:38 2017-12-09 15:38:07 2017-12-09 17:24:09 1:46:02 0:18:07 1:27:55 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1924787 2017-12-04 03:26:39 2017-12-09 15:38:07 2017-12-09 22:14:15 6:36:08 0:10:14 6:25:54 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1924788 2017-12-04 03:26:40 2017-12-09 15:40:13 2017-12-09 16:02:13 0:22:00 0:09:48 0:12:12 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924789 2017-12-04 03:26:40 2017-12-09 15:40:13 2017-12-09 16:18:13 0:38:00 0:24:50 0:13:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924790 2017-12-04 03:26:41 2017-12-09 15:42:07 2017-12-09 17:06:08 1:24:01 0:19:04 1:04:57 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1924791 2017-12-04 03:26:42 2017-12-06 19:19:14 2017-12-06 20:01:13 0:41:59 0:25:24 0:16:35 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-06 19:42:27.026745 mon.a mon.0 172.21.15.117:6789/0 124 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924792 2017-12-04 03:26:42 2017-12-09 15:42:07 2017-12-09 16:24:07 0:42:00 0:09:42 0:32:18 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924793 2017-12-04 03:26:43 2017-12-09 15:44:11 2017-12-09 16:58:12 1:14:01 0:22:07 0:51:54 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
fail 1924794 2017-12-04 03:26:44 2017-12-09 15:44:11 2017-12-09 16:00:11 0:16:00 0:03:31 0:12:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924795 2017-12-04 03:26:44 2017-12-09 15:44:11 2017-12-09 16:12:11 0:28:00 0:10:06 0:17:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1924796 2017-12-04 03:26:45 2017-12-09 15:44:11 2017-12-09 17:12:12 1:28:01 0:19:08 1:08:53 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1924797 2017-12-04 03:26:46 2017-12-09 15:44:12 2017-12-09 16:10:12 0:26:00 0:08:43 0:17:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924798 2017-12-04 03:26:46 2017-12-09 15:44:12 2017-12-09 16:08:12 0:24:00 0:09:39 0:14:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924799 2017-12-04 03:26:47 2017-12-09 15:46:23 2017-12-09 18:42:26 2:56:03 0:35:38 2:20:25 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
fail 1924800 2017-12-04 03:26:48 2017-12-09 15:46:23 2017-12-09 17:12:24 1:26:01 0:03:34 1:22:27 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924801 2017-12-04 03:26:48 2017-12-09 15:47:58 2017-12-09 16:15:57 0:27:59 0:12:09 0:15:50 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924802 2017-12-04 03:26:49 2017-12-09 15:47:58 2017-12-09 16:25:58 0:38:00 0:23:49 0:14:11 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924803 2017-12-04 03:26:49 2017-12-09 15:48:10 2017-12-09 16:56:11 1:08:01 0:17:42 0:50:19 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1924804 2017-12-04 03:26:50 2017-12-09 15:50:18 2017-12-09 16:34:18 0:44:00 0:30:11 0:13:49 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924805 2017-12-04 03:26:51 2017-12-09 15:50:22 2017-12-09 16:44:22 0:54:00 0:18:30 0:35:30 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924806 2017-12-04 03:26:51 2017-12-09 15:52:09 2017-12-09 17:54:11 2:02:02 0:09:47 1:52:15 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1924807 2017-12-04 03:26:52 2017-12-09 15:52:09 2017-12-09 17:02:10 1:10:01 0:37:08 0:32:53 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924808 2017-12-04 03:26:52 2017-12-09 15:52:09 2017-12-09 16:40:09 0:48:00 0:20:09 0:27:51 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1924809 2017-12-04 03:26:53 2017-12-05 11:32:52 2017-12-05 12:14:48 0:41:56 0:08:54 0:33:02 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi030 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmprirO_e'

pass 1924810 2017-12-04 03:26:54 2017-12-09 15:54:16 2017-12-09 17:08:17 1:14:01 0:43:11 0:30:50 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924811 2017-12-04 03:26:54 2017-12-09 15:54:16 2017-12-09 16:44:16 0:50:00 0:19:37 0:30:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 16:31:45.339871 mon.b mon.0 172.21.15.185:6789/0 114 : cluster [WRN] Health check failed: 4384 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1924812 2017-12-04 03:26:55 2017-12-09 15:56:11 2017-12-09 17:08:12 1:12:01 0:09:48 1:02:13 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
fail 1924813 2017-12-04 03:26:56 2017-12-09 15:56:11 2017-12-09 16:12:11 0:16:00 0:03:21 0:12:39 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924814 2017-12-04 03:26:56 2017-12-09 15:58:18 2017-12-09 17:00:19 1:02:01 0:18:04 0:43:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924815 2017-12-04 03:26:57 2017-12-09 15:58:18 2017-12-09 16:48:18 0:50:00 0:12:18 0:37:42 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1924816 2017-12-04 03:26:57 2017-12-09 16:00:11 2017-12-09 16:24:11 0:24:00 0:12:06 0:11:54 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-09 16:17:58.689499 mon.a mon.1 172.21.15.167:6789/0 44 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924817 2017-12-04 03:26:58 2017-12-09 16:00:11 2017-12-09 16:46:11 0:46:00 0:09:19 0:36:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924818 2017-12-04 03:26:59 2017-12-09 16:00:12 2017-12-09 17:40:13 1:40:01 0:26:31 1:13:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1924819 2017-12-04 03:26:59 2017-12-09 16:02:19 2017-12-09 16:32:19 0:30:00 0:12:08 0:17:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924820 2017-12-04 03:27:00 2017-12-09 16:02:19 2017-12-09 16:30:19 0:28:00 0:10:46 0:17:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1924821 2017-12-04 03:27:01 2017-12-09 16:02:19 2017-12-09 17:14:20 1:12:01 0:12:52 0:59:09 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1924822 2017-12-04 03:27:01 2017-12-09 16:04:21 2017-12-09 16:26:21 0:22:00 0:08:41 0:13:19 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924823 2017-12-04 03:27:02 2017-12-09 16:06:15 2017-12-09 16:26:15 0:20:00 0:09:07 0:10:53 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924824 2017-12-04 03:27:02 2017-12-09 16:06:15 2017-12-09 17:52:17 1:46:02 0:48:26 0:57:36 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1924825 2017-12-04 03:27:03 2017-12-09 16:06:15 2017-12-09 16:38:15 0:32:00 0:10:18 0:21:42 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1924826 2017-12-04 03:27:04 2017-12-09 16:30:28 2017-12-09 17:56:29 1:26:01 0:18:43 1:07:18 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1924827 2017-12-04 03:27:05 2017-12-09 16:30:28 2017-12-09 17:06:28 0:36:00 0:22:14 0:13:46 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924828 2017-12-04 03:27:05 2017-12-09 16:32:28 2017-12-09 17:04:28 0:32:00 0:09:31 0:22:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1924829 2017-12-04 03:27:06 2017-12-09 16:32:28 2017-12-09 17:14:28 0:42:00 0:30:11 0:11:49 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924830 2017-12-04 03:27:06 2017-12-09 16:34:30 2017-12-09 17:08:30 0:34:00 0:18:51 0:15:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924831 2017-12-04 03:27:07 2017-12-09 16:36:22 2017-12-09 18:30:24 1:54:02 0:16:16 1:37:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1924832 2017-12-04 03:27:08 2017-12-09 16:36:22 2017-12-09 17:30:22 0:54:00 0:45:39 0:08:21 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924833 2017-12-04 03:27:08 2017-12-09 16:36:22 2017-12-09 17:10:22 0:34:00 0:22:11 0:11:49 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924834 2017-12-04 03:27:09 2017-12-09 16:36:22 2017-12-09 18:14:23 1:38:01 0:37:14 1:00:47 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
fail 1924835 2017-12-04 03:27:10 2017-12-09 16:38:23 2017-12-09 18:02:24 1:24:01 0:03:36 1:20:25 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924836 2017-12-04 03:27:10 2017-12-09 16:38:23 2017-12-09 17:20:23 0:42:00 0:23:36 0:18:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1924837 2017-12-04 03:27:11 2017-12-09 16:40:17 2017-12-09 18:04:18 1:24:01 0:10:51 1:13:10 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1924838 2017-12-04 03:27:12 2017-12-09 16:40:17 2017-12-09 17:16:17 0:36:00 0:09:47 0:26:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924839 2017-12-04 03:27:12 2017-12-09 16:40:17 2017-12-09 17:24:17 0:44:00 0:18:25 0:25:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
fail 1924840 2017-12-04 03:27:13 2017-12-09 16:42:21 2017-12-09 17:00:21 0:18:00 0:03:31 0:14:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

fail 1924841 2017-12-04 03:27:14 2017-12-09 16:42:21 2017-12-09 18:08:22 1:26:01 1:14:40 0:11:21 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 17:00:20.121718 mon.a mon.0 172.21.15.2:6789/0 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924842 2017-12-04 03:27:14 2017-12-09 16:42:21 2017-12-09 17:08:21 0:26:00 0:09:29 0:16:31 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924843 2017-12-04 03:27:15 2017-12-09 16:44:20 2017-12-09 17:44:20 1:00:00 0:21:52 0:38:08 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1924844 2017-12-04 03:27:16 2017-12-09 16:44:20 2017-12-09 17:26:20 0:42:00 0:10:52 0:31:08 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924845 2017-12-04 03:27:16 2017-12-09 16:44:20 2017-12-09 17:30:20 0:46:00 0:10:10 0:35:50 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1924846 2017-12-04 03:27:17 2017-12-09 16:44:20 2017-12-09 17:28:20 0:44:00 0:19:12 0:24:48 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1924847 2017-12-04 03:27:17 2017-12-09 16:44:23 2017-12-09 17:10:23 0:26:00 0:08:51 0:17:09 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924848 2017-12-04 03:27:18 2017-12-09 16:46:23 2017-12-09 17:18:23 0:32:00 0:09:00 0:23:00 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924849 2017-12-04 03:27:19 2017-12-09 16:46:24 2017-12-09 17:52:24 1:06:00 0:39:07 0:26:53 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1924850 2017-12-04 03:27:19 2017-12-09 16:46:23 2017-12-09 18:10:24 1:24:01 0:13:00 1:11:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1924851 2017-12-04 03:27:20 2017-12-06 18:20:57 2017-12-06 19:10:56 0:49:59 0:18:45 0:31:14 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
fail 1924852 2017-12-04 03:27:20 2017-12-09 16:46:23 2017-12-09 18:22:25 1:36:02 0:28:22 1:07:40 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2017-12-09 18:00:47.153815 mon.b mon.0 172.21.15.131:6789/0 116 : cluster [WRN] Health check failed: 1330 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1924853 2017-12-04 03:27:21 2017-12-09 16:46:24 2017-12-09 18:32:25 1:46:01 0:17:27 1:28:34 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1924854 2017-12-04 03:27:22 2017-12-09 16:48:31 2017-12-09 17:28:31 0:40:00 0:25:24 0:14:36 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924855 2017-12-04 03:27:22 2017-12-09 16:48:31 2017-12-09 17:22:31 0:34:00 0:18:43 0:15:17 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924856 2017-12-04 03:27:23 2017-12-09 16:50:20 2017-12-09 18:04:21 1:14:01 0:10:17 1:03:44 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1924857 2017-12-04 03:27:24 2017-12-09 16:50:20 2017-12-09 18:04:21 1:14:01 0:47:16 0:26:45 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924858 2017-12-04 03:27:24 2017-12-05 05:35:48 2017-12-05 07:13:46 1:37:58 1:22:58 0:15:00 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1924859 2017-12-04 03:27:25 2017-12-09 16:52:12 2017-12-09 18:10:13 1:18:01 0:07:14 1:10:47 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi204 with status 1: 'sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmpbGywJ_'

pass 1924860 2017-12-04 03:27:26 2017-12-09 16:52:12 2017-12-09 17:46:12 0:54:00 0:38:50 0:15:10 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924861 2017-12-04 03:27:26 2017-12-09 16:52:13 2017-12-09 18:06:14 1:14:01 0:49:27 0:24:34 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 17:24:10.601668 mon.b mon.0 172.21.15.154:6789/0 112 : cluster [WRN] Health check failed: 5040 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log

pass 1924862 2017-12-04 03:27:27 2017-12-09 16:52:19 2017-12-09 18:50:20 1:58:01 0:10:31 1:47:30 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1924863 2017-12-04 03:27:28 2017-12-09 16:54:21 2017-12-09 17:30:21 0:36:00 0:09:38 0:26:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924864 2017-12-04 03:27:28 2017-12-09 16:54:21 2017-12-09 17:28:21 0:34:00 0:15:40 0:18:20 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924865 2017-12-04 03:27:29 2017-12-09 16:54:21 2017-12-09 17:26:21 0:32:00 0:12:29 0:19:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1924866 2017-12-04 03:27:30 2017-12-09 16:56:11 2017-12-09 17:18:11 0:22:00 0:10:23 0:11:37 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-09 17:13:49.954022 mon.a mon.0 172.21.15.175:6789/0 118 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924867 2017-12-04 03:27:31 2017-12-09 16:56:12 2017-12-09 17:18:11 0:21:59 0:09:43 0:12:16 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924868 2017-12-04 03:27:31 2017-12-09 16:56:17 2017-12-09 18:14:18 1:18:01 0:26:00 0:52:01 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1924869 2017-12-04 03:27:32 2017-12-09 16:56:17 2017-12-09 17:20:17 0:24:00 0:11:28 0:12:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924871 2017-12-04 03:27:32 2017-12-09 16:58:25 2017-12-09 17:30:25 0:32:00 0:10:25 0:21:35 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1924873 2017-12-04 03:27:33 2017-12-09 16:58:25 2017-12-09 17:26:25 0:28:00 0:13:31 0:14:29 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1924875 2017-12-04 03:27:34 2017-12-09 17:00:25 2017-12-09 17:36:25 0:36:00 0:08:47 0:27:13 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924877 2017-12-04 03:27:34 2017-12-09 17:00:25 2017-12-09 17:44:25 0:44:00 0:09:38 0:34:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924879 2017-12-04 03:27:35 2017-12-09 17:00:25 2017-12-09 18:04:25 1:04:00 0:47:45 0:16:15 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1924881 2017-12-04 03:27:36 2017-12-09 17:00:25 2017-12-09 17:56:25 0:56:00 0:10:13 0:45:47 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1924883 2017-12-04 03:27:36 2017-12-09 17:00:25 2017-12-09 17:56:25 0:56:00 0:24:12 0:31:48 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1924885 2017-12-04 03:27:37 2017-12-09 17:02:23 2017-12-09 17:48:23 0:46:00 0:28:03 0:17:57 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924887 2017-12-04 03:27:38 2017-12-09 17:03:42 2017-12-09 19:45:45 2:42:03 0:10:04 2:31:59 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1924889 2017-12-04 03:27:38 2017-12-09 17:03:57 2017-12-09 17:43:57 0:40:00 0:25:28 0:14:32 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1924891 2017-12-04 03:27:39 2017-12-09 17:04:06 2017-12-09 18:08:06 1:04:00 0:18:59 0:45:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1924893 2017-12-04 03:27:40 2017-12-09 17:04:16 2017-12-09 17:34:16 0:30:00 0:17:09 0:12:51 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1924895 2017-12-04 03:27:40 2017-12-09 17:04:26 2017-12-09 17:56:26 0:52:00 0:40:33 0:11:27 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924897 2017-12-04 03:27:41 2017-12-09 17:04:29 2017-12-09 17:32:29 0:28:00 0:12:22 0:15:38 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924899 2017-12-04 03:27:42 2017-12-09 17:06:22 2017-12-09 18:52:23 1:46:01 0:33:30 1:12:31 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1924901 2017-12-04 03:27:42 2017-12-09 17:06:22 2017-12-09 17:54:22 0:48:00 0:38:08 0:09:52 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1924903 2017-12-04 03:27:43 2017-12-09 17:06:29 2017-12-09 18:32:30 1:26:01 1:10:32 0:15:29 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 17:30:07.602410 mon.a mon.0 172.21.15.162:6789/0 126 : cluster [WRN] Health check failed: 15556 slow ops, oldest one blocked for 73 sec (SLOW_OPS)" in cluster log

pass 1924905 2017-12-04 03:27:43 2017-12-09 17:08:26 2017-12-09 18:24:27 1:16:01 0:10:18 1:05:43 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1924907 2017-12-04 03:27:44 2017-12-09 17:08:26 2017-12-09 18:08:26 1:00:00 0:09:58 0:50:02 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1924909 2017-12-04 03:27:45 2017-12-09 17:08:26 2017-12-09 18:20:27 1:12:01 0:24:10 0:47:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1924911 2017-12-04 03:27:46 2017-12-09 17:08:31 2017-12-09 17:50:31 0:42:00 0:19:27 0:22:33 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1924913 2017-12-04 03:27:46 2017-12-09 17:10:13 2017-12-09 17:44:13 0:34:00 0:20:25 0:13:35 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-09 17:31:32.900304 mon.a mon.0 172.21.15.5:6789/0 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1924915 2017-12-04 03:27:47 2017-12-09 17:10:16 2017-12-09 17:34:16 0:24:00 0:10:09 0:13:51 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924917 2017-12-04 03:27:48 2017-12-09 17:10:23 2017-12-09 18:40:24 1:30:01 0:21:51 1:08:10 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1924919 2017-12-04 03:27:48 2017-12-09 17:10:24 2017-12-09 18:02:24 0:52:00 0:22:06 0:29:54 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924921 2017-12-04 03:27:49 2017-12-09 17:12:19 2017-12-09 17:46:19 0:34:00 0:11:36 0:22:24 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1924923 2017-12-04 03:27:50 2017-12-09 17:12:19 2017-12-09 22:22:25 5:10:06 0:19:27 4:50:39 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1924925 2017-12-04 03:27:50 2017-12-09 17:12:19 2017-12-09 17:44:19 0:32:00 0:09:19 0:22:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1924927 2017-12-04 03:27:51 2017-12-09 17:12:25 2017-12-09 17:50:25 0:38:00 0:10:19 0:27:41 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1924929 2017-12-04 03:27:52 2017-12-09 17:14:29 2017-12-09 20:58:33 3:44:04 0:28:39 3:15:25 smithi wip-fog kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1924931 2017-12-04 03:27:52 2017-12-09 17:14:29 2017-12-09 18:54:30 1:40:01 0:12:47 1:27:14 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1924933 2017-12-04 03:27:53 2017-12-09 17:14:29 2017-12-09 17:40:29 0:26:00 0:12:24 0:13:36 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1924935 2017-12-04 03:27:54 2017-12-06 17:44:12 2017-12-06 18:22:05 0:37:53 0:23:57 0:13:56 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1924937 2017-12-04 03:27:54 2017-12-09 17:16:30 2017-12-09 19:58:33 2:42:03 0:17:26 2:24:37 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1924939 2017-12-04 03:27:55 2017-12-09 17:18:23 2017-12-09 17:56:23 0:38:00 0:23:55 0:14:05 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
fail 1924941 2017-12-04 03:27:56 2017-12-09 17:18:24 2017-12-09 17:38:23 0:19:59 0:03:37 0:16:22 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924943 2017-12-04 03:27:56 2017-12-09 17:18:23 2017-12-09 18:14:24 0:56:01 0:09:18 0:46:43 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1924945 2017-12-04 03:27:57 2017-12-09 17:18:24 2017-12-09 18:06:24 0:48:00 0:38:00 0:10:00 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1924947 2017-12-04 03:27:58 2017-12-09 17:20:31 2017-12-09 17:56:31 0:36:00 0:19:05 0:16:55 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1924949 2017-12-04 03:27:58 2017-12-09 17:20:31 2017-12-09 18:28:31 1:08:00 0:03:36 1:04:24 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924951 2017-12-04 03:27:59 2017-12-09 17:22:15 2017-12-09 18:16:15 0:54:00 0:41:37 0:12:23 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
pass 1924953 2017-12-04 03:27:59 2017-12-09 17:22:33 2017-12-09 17:54:33 0:32:00 0:19:49 0:12:11 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
pass 1924955 2017-12-04 03:28:00 2017-12-09 17:24:21 2017-12-09 21:56:26 4:32:05 0:10:01 4:22:04 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1924957 2017-12-04 03:28:01 2017-12-09 17:24:21 2017-12-09 17:48:21 0:24:00 0:09:27 0:14:33 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
fail 1924960 2017-12-04 03:28:01 2017-12-09 17:26:18 2017-12-09 18:14:18 0:48:00 0:03:46 0:44:14 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}

pass 1924962 2017-12-04 03:28:02 2017-12-09 17:26:21 2017-12-09 22:18:27 4:52:06 0:11:40 4:40:26 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1924964 2017-12-04 03:28:02 2017-12-09 17:26:22 2017-12-09 18:02:22 0:36:00 0:21:48 0:14:12 smithi wip-fog kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-09 17:45:41.181781 mon.b mon.0 172.21.15.179:6789/0 146 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 1924966 2017-12-04 03:28:03 2017-12-09 17:26:26 2017-12-09 17:48:25 0:21:59 0:09:33 0:12:26 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1924968 2017-12-04 03:28:04 2017-12-09 17:28:33 2017-12-09 19:16:34 1:48:01 0:25:15 1:22:46 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1924970 2017-12-04 03:28:04 2017-12-09 17:28:33 2017-12-09 17:58:32 0:29:59 0:11:29 0:18:30 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1924972 2017-12-04 03:28:05 2017-12-09 17:28:33 2017-12-09 17:54:32 0:25:59 0:10:58 0:15:01 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1924974 2017-12-04 03:28:06 2017-12-09 17:30:33 2017-12-09 18:28:34 0:58:01 0:12:17 0:45:44 smithi wip-fog kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 1924976 2017-12-04 03:28:06 2017-12-09 17:30:33 2017-12-09 17:50:33 0:20:00 0:03:30 0:16:30 smithi wip-fog kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
Failure Reason:

{'smithi025.front.sepia.ceph.com': {'msg': 'All items completed', 'failed': True, 'changed': False}}