Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 1982079 2017-12-19 20:57:51 2017-12-20 00:42:29 2017-12-20 01:26:29 0:44:00 0:09:59 0:34:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982080 2017-12-19 20:57:52 2017-12-20 00:42:40 2017-12-20 02:02:40 1:20:00 0:51:29 0:28:31 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1982081 2017-12-19 20:57:52 2017-12-20 00:42:40 2017-12-20 01:40:40 0:58:00 0:10:24 0:47:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1982082 2017-12-19 20:57:53 2017-12-20 00:46:29 2017-12-20 01:44:29 0:58:00 0:44:10 0:13:50 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1982083 2017-12-19 20:57:54 2017-12-20 00:46:29 2017-12-20 01:22:29 0:36:00 0:22:10 0:13:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982084 2017-12-19 20:57:54 2017-12-20 00:48:16 2017-12-20 01:38:16 0:50:00 0:09:29 0:40:31 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1982085 2017-12-19 20:57:55 2017-12-20 00:48:19 2017-12-20 01:28:19 0:40:00 0:29:34 0:10:26 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982086 2017-12-19 20:57:56 2017-12-20 00:48:20 2017-12-20 01:34:21 0:46:01 0:18:44 0:27:17 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982087 2017-12-19 20:57:56 2017-12-20 00:48:24 2017-12-20 01:30:24 0:42:00 0:16:15 0:25:45 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1982088 2017-12-19 20:57:57 2017-12-20 00:48:24 2017-12-20 02:02:25 1:14:01 0:35:27 0:38:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982089 2017-12-19 20:57:58 2017-12-20 00:48:40 2017-12-20 01:18:39 0:29:59 0:11:16 0:18:43 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982090 2017-12-19 20:57:58 2017-12-20 00:50:08 2017-12-20 01:38:09 0:48:01 0:37:32 0:10:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1982091 2017-12-19 20:57:59 2017-12-20 00:50:14 2017-12-20 03:38:17 2:48:03 0:41:20 2:06:43 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982092 2017-12-19 20:58:00 2017-12-20 00:50:17 2017-12-20 01:20:17 0:30:00 0:19:14 0:10:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 01:08:28.633019 mon.a mon.0 172.21.15.118:6789/0 158 : cluster [WRN] Health check failed: 17612 slow ops, oldest one blocked for 60 sec (SLOW_OPS)" in cluster log

pass 1982093 2017-12-19 20:58:00 2017-12-20 00:50:20 2017-12-20 01:12:20 0:22:00 0:10:01 0:11:59 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1982094 2017-12-19 20:58:01 2017-12-20 00:52:26 2017-12-20 01:16:26 0:24:00 0:09:56 0:14:04 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982095 2017-12-19 20:58:02 2017-12-20 00:52:26 2017-12-20 01:38:27 0:46:01 0:18:13 0:27:48 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982096 2017-12-19 20:58:02 2017-12-20 00:52:27 2017-12-20 02:40:28 1:48:01 0:18:50 1:29:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1982097 2017-12-19 20:58:03 2017-12-20 00:52:27 2017-12-20 02:50:28 1:58:01 1:17:41 0:40:20 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 01:38:07.855771 mon.a mon.0 172.21.15.49:6789/0 131 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982098 2017-12-19 20:58:04 2017-12-20 00:52:27 2017-12-20 01:36:27 0:44:00 0:09:10 0:34:50 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982099 2017-12-19 20:58:05 2017-12-20 00:52:38 2017-12-20 01:30:38 0:38:00 0:21:26 0:16:34 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1982100 2017-12-19 20:58:05 2017-12-20 00:54:27 2017-12-20 01:44:27 0:50:00 0:11:41 0:38:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982101 2017-12-19 20:58:06 2017-12-20 00:54:27 2017-12-20 02:46:29 1:52:02 0:12:35 1:39:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1982102 2017-12-19 20:58:07 2017-12-20 00:56:35 2017-12-20 02:32:36 1:36:01 0:19:25 1:16:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1982103 2017-12-19 20:58:07 2017-12-20 00:56:35 2017-12-20 01:32:34 0:35:59 0:08:21 0:27:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982104 2017-12-19 20:58:08 2017-12-20 00:56:40 2017-12-20 01:44:40 0:48:00 0:09:11 0:38:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982105 2017-12-19 20:58:09 2017-12-20 00:58:30 2017-12-20 01:48:30 0:50:00 0:30:47 0:19:13 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1982106 2017-12-19 20:58:09 2017-12-20 00:58:30 2017-12-20 01:26:30 0:28:00 0:11:58 0:16:02 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1982107 2017-12-19 20:58:10 2017-12-20 00:58:40 2017-12-20 01:26:40 0:28:00 0:11:41 0:16:19 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982108 2017-12-19 20:58:11 2017-12-20 01:00:29 2017-12-20 02:40:30 1:40:01 0:21:15 1:18:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982109 2017-12-19 20:58:11 2017-12-20 01:00:29 2017-12-20 01:40:29 0:40:00 0:16:16 0:23:44 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1982110 2017-12-19 20:58:12 2017-12-20 01:00:29 2017-12-20 02:48:30 1:48:01 0:30:34 1:17:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982111 2017-12-19 20:58:13 2017-12-20 01:04:18 2017-12-20 02:46:20 1:42:02 0:18:50 1:23:12 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982112 2017-12-19 20:58:13 2017-12-20 01:04:18 2017-12-20 01:50:18 0:46:00 0:09:48 0:36:12 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1982113 2017-12-19 20:58:14 2017-12-20 01:04:22 2017-12-20 02:16:23 1:12:01 0:44:12 0:27:49 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982114 2017-12-19 20:58:15 2017-12-20 01:06:27 2017-12-20 02:10:27 1:04:00 0:23:05 0:40:55 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
dead 1982115 2017-12-19 20:58:15 2017-12-20 01:06:27 2017-12-20 13:08:57 12:02:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
pass 1982116 2017-12-19 20:58:16 2017-12-20 01:06:27 2017-12-20 02:00:27 0:54:00 0:38:05 0:15:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982117 2017-12-19 20:58:17 2017-12-20 01:06:40 2017-12-20 02:04:41 0:58:01 0:23:44 0:34:17 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 01:46:26.874465 mon.b mon.0 172.21.15.22:6789/0 107 : cluster [WRN] Health check failed: 43 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1982118 2017-12-19 20:58:17 2017-12-20 01:08:27 2017-12-20 02:00:27 0:52:00 0:10:17 0:41:43 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1982119 2017-12-19 20:58:18 2017-12-20 01:08:27 2017-12-20 01:46:27 0:38:00 0:09:38 0:28:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982120 2017-12-19 20:58:18 2017-12-20 01:08:27 2017-12-20 03:56:30 2:48:03 0:18:26 2:29:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982121 2017-12-19 20:58:19 2017-12-20 01:10:25 2017-12-20 01:52:25 0:42:00 0:11:57 0:30:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1982122 2017-12-19 20:58:20 2017-12-20 01:10:25 2017-12-20 01:52:25 0:42:00 0:12:04 0:29:56 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-20 01:46:43.868170 mon.a mon.1 172.21.15.202:6789/0 45 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

dead 1982123 2017-12-19 20:58:20 2017-12-20 01:10:30 2017-12-20 02:00:30 0:50:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml}
Failure Reason:

reached maximum tries (40) after waiting for 600 seconds

pass 1982124 2017-12-19 20:58:21 2017-12-20 01:12:29 2017-12-20 02:26:29 1:14:00 0:28:02 0:45:58 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1982125 2017-12-19 20:58:22 2017-12-20 01:12:29 2017-12-20 01:46:29 0:34:00 0:10:30 0:23:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982126 2017-12-19 20:58:22 2017-12-20 01:12:29 2017-12-20 02:36:30 1:24:01 0:09:59 1:14:02 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1982127 2017-12-19 20:58:23 2017-12-20 01:12:29 2017-12-20 04:32:33 3:20:04 0:12:48 3:07:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1982128 2017-12-19 20:58:24 2017-12-20 01:12:34 2017-12-20 01:34:33 0:21:59 0:08:22 0:13:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982129 2017-12-19 20:58:24 2017-12-20 01:12:41 2017-12-20 01:36:40 0:23:59 0:09:07 0:14:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982130 2017-12-19 20:58:25 2017-12-20 01:14:31 2017-12-20 03:00:33 1:46:02 0:50:06 0:55:56 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1982131 2017-12-19 20:58:26 2017-12-20 01:14:31 2017-12-20 02:18:32 1:04:01 0:10:25 0:53:36 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1982132 2017-12-19 20:58:26 2017-12-20 01:16:27 2017-12-20 02:08:27 0:52:00 0:21:52 0:30:08 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1982133 2017-12-19 20:58:27 2017-12-20 01:16:27 2017-12-20 02:12:27 0:56:00 0:27:23 0:28:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982134 2017-12-19 20:58:28 2017-12-20 01:18:23 2017-12-20 02:54:24 1:36:01 0:10:26 1:25:35 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1982135 2017-12-19 20:58:28 2017-12-20 01:18:23 2017-12-20 02:10:23 0:52:00 0:25:19 0:26:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982136 2017-12-19 20:58:29 2017-12-20 01:18:40 2017-12-20 02:24:41 1:06:01 0:18:29 0:47:32 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982137 2017-12-19 20:58:29 2017-12-20 01:19:52 2017-12-20 02:17:53 0:58:01 0:15:50 0:42:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1982138 2017-12-19 20:58:30 2017-12-20 01:20:18 2017-12-20 02:20:18 1:00:00 0:45:06 0:14:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982139 2017-12-19 20:58:31 2017-12-20 01:20:24 2017-12-20 02:32:25 1:12:01 0:11:41 1:00:20 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982140 2017-12-19 20:58:31 2017-12-20 01:22:39 2017-12-20 02:10:39 0:48:00 0:35:13 0:12:47 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1982141 2017-12-19 20:58:32 2017-12-20 01:24:42 2017-12-20 02:18:43 0:54:01 0:38:10 0:15:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982142 2017-12-19 20:58:33 2017-12-20 01:26:33 2017-12-20 02:52:34 1:26:01 1:13:16 0:12:45 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 01:47:47.680743 mon.a mon.0 172.21.15.53:6789/0 170 : cluster [WRN] Health check failed: 18887 slow ops, oldest one blocked for 93 sec (SLOW_OPS)" in cluster log

pass 1982143 2017-12-19 20:58:33 2017-12-20 01:26:33 2017-12-20 01:58:33 0:32:00 0:10:31 0:21:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1982144 2017-12-19 20:58:34 2017-12-20 01:26:33 2017-12-20 02:04:33 0:38:00 0:09:35 0:28:25 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982145 2017-12-19 20:58:35 2017-12-20 01:26:41 2017-12-20 02:10:41 0:44:00 0:14:20 0:29:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982146 2017-12-19 20:58:35 2017-12-20 01:28:28 2017-12-20 02:08:28 0:40:00 0:18:50 0:21:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1982147 2017-12-19 20:58:36 2017-12-20 01:28:28 2017-12-20 02:38:29 1:10:01 0:20:37 0:49:24 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 02:22:34.909688 mon.a mon.0 172.21.15.58:6789/0 120 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1982148 2017-12-19 20:58:37 2017-12-20 01:30:17 2017-12-20 01:50:16 0:19:59 0:09:53 0:10:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982149 2017-12-19 20:58:37 2017-12-20 01:30:22 2017-12-20 02:08:22 0:38:00 0:22:44 0:15:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1982150 2017-12-19 20:58:38 2017-12-20 01:30:23 2017-12-20 01:54:22 0:23:59 0:11:06 0:12:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982151 2017-12-19 20:58:39 2017-12-20 01:30:24 2017-12-20 02:24:25 0:54:01 0:10:01 0:44:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1982152 2017-12-19 20:58:39 2017-12-20 01:30:24 2017-12-20 03:00:26 1:30:02 0:20:24 1:09:38 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1982153 2017-12-19 20:58:40 2017-12-20 01:30:25 2017-12-20 02:16:25 0:46:00 0:08:22 0:37:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982154 2017-12-19 20:58:41 2017-12-20 01:30:39 2017-12-20 01:58:39 0:28:00 0:08:53 0:19:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982155 2017-12-19 20:58:41 2017-12-20 01:32:11 2017-12-20 03:44:14 2:12:03 0:29:20 1:42:43 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1982156 2017-12-19 20:58:42 2017-12-20 01:32:24 2017-12-20 02:40:25 1:08:01 0:12:20 0:55:41 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1982157 2017-12-19 20:58:42 2017-12-20 01:32:35 2017-12-20 03:00:37 1:28:02 0:24:27 1:03:35 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982158 2017-12-19 20:58:43 2017-12-20 01:34:31 2017-12-20 02:22:31 0:48:00 0:26:36 0:21:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982159 2017-12-19 20:58:44 2017-12-20 01:34:34 2017-12-20 02:24:34 0:50:00 0:16:49 0:33:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1982160 2017-12-19 20:58:44 2017-12-20 01:34:34 2017-12-20 02:22:34 0:48:00 0:26:19 0:21:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982161 2017-12-19 20:58:45 2017-12-20 01:36:29 2017-12-20 02:24:29 0:48:00 0:19:07 0:28:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982162 2017-12-19 20:58:46 2017-12-20 01:36:29 2017-12-20 02:26:30 0:50:01 0:09:40 0:40:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1982163 2017-12-19 20:58:46 2017-12-20 01:36:42 2017-12-20 02:44:42 1:08:00 0:38:33 0:29:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982164 2017-12-19 20:58:47 2017-12-20 01:38:17 2017-12-20 03:10:19 1:32:02 1:13:13 0:18:49 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1982165 2017-12-19 20:58:48 2017-12-20 01:38:17 2017-12-20 03:26:19 1:48:02 0:07:33 1:40:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi162 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true'

pass 1982166 2017-12-19 20:58:48 2017-12-20 01:38:18 2017-12-20 02:30:18 0:52:00 0:36:27 0:15:33 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982167 2017-12-19 20:58:49 2017-12-20 01:38:23 2017-12-20 02:50:24 1:12:01 0:55:16 0:16:45 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 02:02:44.041723 mon.b mon.0 172.21.15.86:6789/0 156 : cluster [WRN] Health check failed: 6413 slow ops, oldest one blocked for 32 sec (SLOW_OPS)" in cluster log

pass 1982168 2017-12-19 20:58:50 2017-12-20 01:38:28 2017-12-20 02:04:27 0:25:59 0:09:58 0:16:01 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1982169 2017-12-19 20:58:50 2017-12-20 01:40:39 2017-12-20 02:06:39 0:26:00 0:09:05 0:16:55 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982170 2017-12-19 20:58:51 2017-12-20 01:40:41 2017-12-20 02:24:41 0:44:00 0:23:46 0:20:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982171 2017-12-19 20:58:51 2017-12-20 01:44:37 2017-12-20 02:10:37 0:26:00 0:11:14 0:14:46 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1982172 2017-12-19 20:58:52 2017-12-20 01:44:37 2017-12-20 02:16:37 0:32:00 0:11:28 0:20:32 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-20 02:11:37.995514 mon.a mon.0 172.21.15.61:6789/0 121 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1982173 2017-12-19 20:58:53 2017-12-20 01:44:41 2017-12-20 02:12:41 0:28:00 0:09:06 0:18:54 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982174 2017-12-19 20:58:53 2017-12-20 01:46:31 2017-12-20 03:24:33 1:38:02 0:26:35 1:11:27 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1982175 2017-12-19 20:58:54 2017-12-20 01:46:31 2017-12-20 02:40:32 0:54:01 0:21:15 0:32:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982176 2017-12-19 20:58:55 2017-12-20 01:46:31 2017-12-20 03:00:32 1:14:01 0:10:54 1:03:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1982177 2017-12-19 20:58:55 2017-12-20 01:46:37 2017-12-20 02:50:37 1:04:00 0:15:54 0:48:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1982178 2017-12-19 20:58:56 2017-12-20 01:48:27 2017-12-20 02:58:28 1:10:01 0:09:29 1:00:32 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982179 2017-12-19 20:58:57 2017-12-20 01:48:27 2017-12-20 02:34:27 0:46:00 0:09:09 0:36:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982180 2017-12-19 20:58:57 2017-12-20 01:48:31 2017-12-20 03:06:32 1:18:01 0:46:52 0:31:09 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1982181 2017-12-19 20:58:58 2017-12-20 01:49:41 2017-12-20 03:17:42 1:28:01 0:11:05 1:16:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1982182 2017-12-19 20:58:59 2017-12-20 01:50:17 2017-12-20 03:14:18 1:24:01 1:07:46 0:16:15 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1982183 2017-12-19 20:58:59 2017-12-20 01:50:19 2017-12-20 02:28:19 0:38:00 0:23:19 0:14:41 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982184 2017-12-19 20:59:00 2017-12-20 01:52:34 2017-12-20 04:12:37 2:20:03 0:09:46 2:10:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1982185 2017-12-19 20:59:01 2017-12-20 01:52:34 2017-12-20 03:28:35 1:36:01 0:23:58 1:12:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982186 2017-12-19 20:59:01 2017-12-20 01:54:31 2017-12-20 02:24:31 0:30:00 0:18:47 0:11:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982187 2017-12-19 20:59:02 2017-12-20 01:55:27 2017-12-20 04:53:32 2:58:05 0:15:35 2:42:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1982188 2017-12-19 20:59:03 2017-12-20 01:56:29 2017-12-20 03:06:29 1:10:00 0:38:57 0:31:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982189 2017-12-19 20:59:03 2017-12-20 01:56:29 2017-12-20 03:04:29 1:08:00 0:10:48 0:57:12 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982190 2017-12-19 20:59:04 2017-12-20 01:56:29 2017-12-20 03:30:30 1:34:01 0:35:59 0:58:02 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1982191 2017-12-19 20:59:05 2017-12-20 01:56:29 2017-12-20 03:18:30 1:22:01 0:43:48 0:38:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982192 2017-12-19 20:59:05 2017-12-20 01:58:29 2017-12-20 02:54:29 0:56:00 0:21:21 0:34:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 02:43:09.239379 mon.b mon.0 172.21.15.45:6789/0 99 : cluster [WRN] Health check failed: 159 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log

pass 1982193 2017-12-19 20:59:06 2017-12-20 01:58:34 2017-12-20 02:38:34 0:40:00 0:10:22 0:29:38 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1982194 2017-12-19 20:59:07 2017-12-20 01:58:40 2017-12-20 02:20:40 0:22:00 0:08:50 0:13:10 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982195 2017-12-19 20:59:07 2017-12-20 01:59:27 2017-12-20 02:39:27 0:40:00 0:26:23 0:13:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982196 2017-12-19 20:59:08 2017-12-20 02:00:36 2017-12-20 02:32:36 0:32:00 0:18:32 0:13:28 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1982197 2017-12-19 20:59:09 2017-12-20 02:00:36 2017-12-20 02:50:36 0:50:00 0:24:28 0:25:32 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 02:31:37.409880 mon.a mon.0 172.21.15.36:6789/0 8 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982198 2017-12-19 20:59:09 2017-12-20 02:00:37 2017-12-20 02:24:36 0:23:59 0:09:54 0:14:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982199 2017-12-19 20:59:10 2017-12-20 02:02:34 2017-12-20 02:58:34 0:56:00 0:22:09 0:33:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1982200 2017-12-19 20:59:11 2017-12-20 02:02:42 2017-12-20 02:30:41 0:27:59 0:11:08 0:16:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982201 2017-12-19 20:59:11 2017-12-20 02:04:36 2017-12-20 02:30:36 0:26:00 0:10:02 0:15:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1982202 2017-12-19 20:59:12 2017-12-20 02:04:36 2017-12-20 02:40:36 0:36:00 0:19:22 0:16:38 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1982203 2017-12-19 20:59:13 2017-12-20 02:04:42 2017-12-20 02:26:41 0:21:59 0:08:31 0:13:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982204 2017-12-19 20:59:14 2017-12-20 02:06:49 2017-12-20 03:00:50 0:54:01 0:09:40 0:44:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982205 2017-12-19 20:59:14 2017-12-20 02:08:29 2017-12-20 03:30:30 1:22:01 0:36:31 0:45:30 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1982206 2017-12-19 20:59:15 2017-12-20 02:08:29 2017-12-20 03:40:31 1:32:02 0:12:56 1:19:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1982207 2017-12-19 20:59:16 2017-12-20 02:08:29 2017-12-20 03:24:30 1:16:01 0:18:24 0:57:37 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982208 2017-12-19 20:59:16 2017-12-20 02:08:30 2017-12-20 03:08:30 1:00:00 0:23:30 0:36:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982209 2017-12-19 20:59:17 2017-12-20 02:09:37 2017-12-20 02:47:37 0:38:00 0:16:52 0:21:08 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1982210 2017-12-19 20:59:18 2017-12-20 02:10:24 2017-12-20 02:50:24 0:40:00 0:29:39 0:10:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982211 2017-12-19 20:59:18 2017-12-20 02:10:28 2017-12-20 02:54:28 0:44:00 0:21:00 0:23:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982212 2017-12-19 20:59:19 2017-12-20 02:10:46 2017-12-20 03:16:47 1:06:01 0:10:07 0:55:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1982213 2017-12-19 20:59:20 2017-12-20 02:10:46 2017-12-20 03:16:47 1:06:01 0:36:38 0:29:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982214 2017-12-19 20:59:20 2017-12-20 02:10:46 2017-12-20 03:34:47 1:24:01 0:19:45 1:04:16 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
dead 1982215 2017-12-19 20:59:21 2017-12-20 02:11:13 2017-12-20 14:13:44 12:02:31 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
pass 1982216 2017-12-19 20:59:22 2017-12-20 02:12:36 2017-12-20 03:28:37 1:16:01 0:42:17 0:33:44 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982217 2017-12-19 20:59:22 2017-12-20 02:12:42 2017-12-20 03:10:43 0:58:01 0:20:55 0:37:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 02:56:34.260531 mon.b mon.0 172.21.15.19:6789/0 102 : cluster [WRN] Health check failed: 3230 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 1982218 2017-12-19 20:59:23 2017-12-20 02:13:29 2017-12-20 02:59:30 0:46:01 0:10:29 0:35:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1982219 2017-12-19 20:59:24 2017-12-20 02:16:32 2017-12-20 02:56:32 0:40:00 0:10:23 0:29:37 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982220 2017-12-19 20:59:24 2017-12-20 02:16:32 2017-12-20 02:48:32 0:32:00 0:17:36 0:14:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982221 2017-12-19 20:59:25 2017-12-20 02:16:38 2017-12-20 02:56:38 0:40:00 0:12:39 0:27:21 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1982222 2017-12-19 20:59:26 2017-12-20 02:18:02 2017-12-20 03:08:03 0:50:01 0:11:57 0:38:04 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-20 03:02:33.972162 mon.a mon.1 172.21.15.191:6789/0 40 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982223 2017-12-19 20:59:26 2017-12-20 02:18:02 2017-12-20 02:58:02 0:40:00 0:09:53 0:30:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982224 2017-12-19 20:59:27 2017-12-20 02:18:33 2017-12-20 03:18:34 1:00:01 0:26:07 0:33:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1982225 2017-12-19 20:59:28 2017-12-20 02:18:44 2017-12-20 03:20:44 1:02:00 0:11:54 0:50:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982226 2017-12-19 20:59:28 2017-12-20 02:20:28 2017-12-20 02:40:28 0:20:00 0:10:22 0:09:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1982227 2017-12-19 20:59:29 2017-12-20 02:20:41 2017-12-20 02:58:41 0:38:00 0:13:51 0:24:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1982228 2017-12-19 20:59:30 2017-12-20 02:22:41 2017-12-20 02:44:41 0:22:00 0:11:09 0:10:51 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982229 2017-12-19 20:59:30 2017-12-20 02:22:41 2017-12-20 02:44:41 0:22:00 0:11:31 0:10:29 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982230 2017-12-19 20:59:31 2017-12-20 02:24:34 2017-12-20 03:26:34 1:02:00 0:48:43 0:13:17 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-comp.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1982231 2017-12-19 20:59:32 2017-12-20 02:24:34 2017-12-20 03:00:34 0:36:00 0:11:51 0:24:09 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1982232 2017-12-19 20:59:32 2017-12-20 02:24:34 2017-12-20 02:56:34 0:32:00 0:21:24 0:10:36 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1982233 2017-12-19 20:59:33 2017-12-20 02:24:36 2017-12-20 03:24:37 1:00:01 0:22:00 0:38:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982234 2017-12-19 20:59:34 2017-12-20 02:24:39 2017-12-20 04:16:41 1:52:02 0:10:50 1:41:12 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1982235 2017-12-19 20:59:34 2017-12-20 02:24:42 2017-12-20 03:14:43 0:50:01 0:30:36 0:19:25 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982236 2017-12-19 20:59:35 2017-12-20 02:24:42 2017-12-20 03:44:43 1:20:01 0:18:46 1:01:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982237 2017-12-19 20:59:36 2017-12-20 02:26:31 2017-12-20 05:12:34 2:46:03 0:16:00 2:30:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1982238 2017-12-19 20:59:37 2017-12-20 02:26:31 2017-12-20 03:54:32 1:28:01 0:44:40 0:43:21 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982239 2017-12-19 20:59:37 2017-12-20 02:26:51 2017-12-20 03:02:53 0:36:02 0:22:30 0:13:32 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982240 2017-12-19 20:59:38 2017-12-20 02:28:30 2017-12-20 05:02:33 2:34:03 0:38:23 1:55:40 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1982241 2017-12-19 20:59:39 2017-12-20 02:28:30 2017-12-20 03:54:31 1:26:01 0:37:15 0:48:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982242 2017-12-19 20:59:39 2017-12-20 02:30:28 2017-12-20 03:34:29 1:04:01 0:23:59 0:40:02 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:18:12.456458 mon.b mon.0 172.21.15.179:6789/0 104 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1982243 2017-12-19 20:59:40 2017-12-20 02:30:37 2017-12-20 04:24:39 1:54:02 0:10:02 1:44:00 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1982244 2017-12-19 20:59:41 2017-12-20 02:30:43 2017-12-20 03:00:42 0:29:59 0:10:53 0:19:06 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982245 2017-12-19 20:59:41 2017-12-20 02:32:35 2017-12-20 03:26:35 0:54:00 0:18:37 0:35:23 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982246 2017-12-19 20:59:42 2017-12-20 02:32:37 2017-12-20 03:14:37 0:42:00 0:18:07 0:23:53 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1982247 2017-12-19 20:59:43 2017-12-20 02:32:38 2017-12-20 04:10:39 1:38:01 1:16:17 0:21:44 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:01:03.044642 mon.a mon.0 172.21.15.3:6789/0 128 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 1982248 2017-12-19 20:59:43 2017-12-20 02:33:37 2017-12-20 03:03:33 0:29:56 0:09:17 0:20:39 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982249 2017-12-19 20:59:44 2017-12-20 02:35:19 2017-12-20 04:23:16 1:47:57 0:21:37 1:26:20 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1982250 2017-12-19 20:59:45 2017-12-20 02:36:34 2017-12-20 03:08:32 0:31:58 0:10:47 0:21:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982251 2017-12-19 20:59:45 2017-12-20 02:38:50 2017-12-20 03:06:50 0:28:00 0:10:24 0:17:36 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1982252 2017-12-19 20:59:46 2017-12-20 02:38:50 2017-12-20 03:42:51 1:04:01 0:19:07 0:44:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1982253 2017-12-19 20:59:47 2017-12-20 02:39:29 2017-12-20 03:03:28 0:23:59 0:08:42 0:15:17 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982254 2017-12-19 20:59:47 2017-12-20 02:40:42 2017-12-20 03:14:41 0:33:59 0:09:07 0:24:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982255 2017-12-19 20:59:48 2017-12-20 02:40:43 2017-12-20 06:04:47 3:24:04 0:38:09 2:45:55 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1982256 2017-12-19 20:59:49 2017-12-20 02:40:43 2017-12-20 05:16:46 2:36:03 0:12:55 2:23:08 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1982257 2017-12-19 20:59:49 2017-12-20 02:40:42 2017-12-20 03:10:41 0:29:59 0:11:19 0:18:40 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982258 2017-12-19 20:59:50 2017-12-20 02:40:42 2017-12-20 04:00:42 1:20:00 0:30:00 0:50:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982259 2017-12-19 20:59:50 2017-12-20 02:40:43 2017-12-20 04:36:43 1:56:00 0:16:59 1:39:01 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1982260 2017-12-19 20:59:51 2017-12-20 02:42:41 2017-12-20 04:08:41 1:26:00 0:25:57 1:00:03 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982261 2017-12-19 20:59:52 2017-12-20 02:44:28 2017-12-20 03:18:28 0:34:00 0:18:01 0:15:59 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982262 2017-12-19 20:59:52 2017-12-20 02:44:43 2017-12-20 03:08:42 0:23:59 0:09:22 0:14:37 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1982263 2017-12-19 20:59:53 2017-12-20 02:44:43 2017-12-20 03:50:43 1:06:00 0:45:53 0:20:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982264 2017-12-19 20:59:54 2017-12-20 02:44:44 2017-12-20 04:28:45 1:44:01 0:51:04 0:52:57 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
dead 1982265 2017-12-19 20:59:54 2017-12-20 02:46:34 2017-12-20 14:49:03 12:02:29 9:56:16 2:06:13 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_full_different_file (tasks.cephfs.test_full.TestClusterFull), test_full_different_file (tasks.cephfs.test_full.TestClusterFull)

pass 1982266 2017-12-19 20:59:55 2017-12-20 02:46:34 2017-12-20 04:06:35 1:20:01 0:38:43 0:41:18 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982267 2017-12-19 20:59:55 2017-12-20 02:46:34 2017-12-20 04:18:35 1:32:01 1:09:03 0:22:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:17:01.623563 mon.b mon.0 172.21.15.77:6789/0 119 : cluster [WRN] Health check failed: 15469 slow ops, oldest one blocked for 66 sec (SLOW_OPS)" in cluster log

pass 1982268 2017-12-19 20:59:56 2017-12-20 02:47:51 2017-12-20 03:21:51 0:34:00 0:11:44 0:22:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1982269 2017-12-19 20:59:57 2017-12-20 02:48:32 2017-12-20 03:06:31 0:17:59 0:09:03 0:08:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982270 2017-12-19 20:59:57 2017-12-20 02:48:34 2017-12-20 03:38:34 0:50:00 0:15:36 0:34:24 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982271 2017-12-19 20:59:58 2017-12-20 02:49:43 2017-12-20 03:47:43 0:58:00 0:11:50 0:46:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1982272 2017-12-19 20:59:59 2017-12-20 02:50:25 2017-12-20 03:26:25 0:36:00 0:10:29 0:25:31 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-20 03:21:48.611543 mon.a mon.0 172.21.15.104:6789/0 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982273 2017-12-19 20:59:59 2017-12-20 02:50:26 2017-12-20 03:22:25 0:31:59 0:09:13 0:22:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982274 2017-12-19 21:00:00 2017-12-20 02:50:30 2017-12-20 03:30:30 0:40:00 0:25:03 0:14:57 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1982275 2017-12-19 21:00:00 2017-12-20 02:50:38 2017-12-20 03:18:37 0:27:59 0:10:58 0:17:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982276 2017-12-19 21:00:01 2017-12-20 02:50:39 2017-12-20 03:20:38 0:29:59 0:11:03 0:18:56 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1982277 2017-12-19 21:00:02 2017-12-20 02:52:44 2017-12-20 05:14:47 2:22:03 0:13:09 2:08:54 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1982278 2017-12-19 21:00:02 2017-12-20 02:54:25 2017-12-20 03:30:25 0:36:00 0:08:33 0:27:27 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982279 2017-12-19 21:00:03 2017-12-20 02:54:30 2017-12-20 03:20:29 0:25:59 0:10:01 0:15:58 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982280 2017-12-19 21:00:04 2017-12-20 02:54:31 2017-12-20 03:56:31 1:02:00 0:48:13 0:13:47 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/bluestore.yaml tasks/kernel_cfuse_workunits_dbench_iozone.yaml} 4
pass 1982281 2017-12-19 21:00:04 2017-12-20 02:56:44 2017-12-20 04:46:45 1:50:01 0:10:48 1:39:13 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/auto-repair.yaml whitelist_health.yaml} 4
pass 1982282 2017-12-19 21:00:05 2017-12-20 02:56:44 2017-12-20 03:34:44 0:38:00 0:25:32 0:12:28 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
pass 1982283 2017-12-19 21:00:06 2017-12-20 02:56:44 2017-12-20 03:50:44 0:54:00 0:28:46 0:25:14 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982284 2017-12-19 21:00:06 2017-12-20 02:58:13 2017-12-20 04:32:15 1:34:02 0:10:37 1:23:25 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/backtrace.yaml whitelist_health.yaml} 4
pass 1982285 2017-12-19 21:00:07 2017-12-20 02:58:29 2017-12-20 03:38:29 0:40:00 0:27:47 0:12:13 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982286 2017-12-19 21:00:07 2017-12-20 02:58:35 2017-12-20 03:48:36 0:50:01 0:18:39 0:31:22 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982287 2017-12-19 21:00:08 2017-12-20 02:58:42 2017-12-20 03:50:42 0:52:00 0:16:43 0:35:17 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/client-limits.yaml whitelist_health.yaml} 4
pass 1982288 2017-12-19 21:00:09 2017-12-20 02:59:40 2017-12-20 03:49:40 0:50:00 0:39:40 0:10:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982289 2017-12-19 21:00:09 2017-12-20 03:00:27 2017-12-20 03:38:27 0:38:00 0:12:11 0:25:49 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982290 2017-12-19 21:00:10 2017-12-20 03:00:34 2017-12-20 04:16:35 1:16:01 0:36:50 0:39:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/client-recovery.yaml whitelist_health.yaml} 4
pass 1982291 2017-12-19 21:00:11 2017-12-20 03:00:34 2017-12-20 04:04:35 1:04:01 0:37:00 0:27:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982292 2017-12-19 21:00:11 2017-12-20 03:00:36 2017-12-20 04:30:37 1:30:01 0:53:13 0:36:48 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:43:58.790667 mon.a mon.0 172.21.15.51:6789/0 161 : cluster [WRN] Health check failed: 6725 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 1982293 2017-12-19 21:00:12 2017-12-20 03:00:38 2017-12-20 03:50:38 0:50:00 0:10:25 0:39:35 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/config-commands.yaml whitelist_health.yaml} 4
pass 1982294 2017-12-19 21:00:13 2017-12-20 03:00:52 2017-12-20 03:22:52 0:22:00 0:09:14 0:12:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982295 2017-12-19 21:00:13 2017-12-20 03:00:52 2017-12-20 03:34:52 0:34:00 0:24:22 0:09:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982296 2017-12-19 21:00:14 2017-12-20 03:03:02 2017-12-20 06:33:09 3:30:07 0:19:11 3:10:56 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/damage.yaml whitelist_health.yaml} 4
fail 1982297 2017-12-19 21:00:15 2017-12-20 03:03:29 2017-12-20 03:35:29 0:32:00 0:19:23 0:12:37 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:24:12.934794 mon.a mon.0 172.21.15.110:6789/0 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982298 2017-12-19 21:00:15 2017-12-20 03:03:35 2017-12-20 03:29:34 0:25:59 0:09:21 0:16:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982299 2017-12-19 21:00:16 2017-12-20 03:04:39 2017-12-20 03:54:39 0:50:00 0:21:57 0:28:03 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/data-scan.yaml whitelist_health.yaml} 4
pass 1982300 2017-12-19 21:00:16 2017-12-20 03:06:31 2017-12-20 03:40:31 0:34:00 0:21:32 0:12:28 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982301 2017-12-19 21:00:17 2017-12-20 03:06:33 2017-12-20 03:28:32 0:21:59 0:09:54 0:12:05 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
pass 1982302 2017-12-19 21:00:18 2017-12-20 03:06:33 2017-12-20 04:26:34 1:20:01 0:20:09 0:59:52 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/failover.yaml whitelist_health.yaml} 4
pass 1982303 2017-12-19 21:00:18 2017-12-20 03:06:51 2017-12-20 03:24:51 0:18:00 0:07:45 0:10:15 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_trivial_sync.yaml} 3
pass 1982304 2017-12-19 21:00:19 2017-12-20 03:08:14 2017-12-20 03:28:13 0:19:59 0:09:19 0:10:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_direct_io.yaml} 3
pass 1982305 2017-12-19 21:00:20 2017-12-20 03:08:33 2017-12-20 04:00:33 0:52:00 0:28:16 0:23:44 smithi master kcephfs/mixed-clients/{clusters/2-clients.yaml conf.yaml objectstore-ec/filestore-xfs.yaml tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} 4
pass 1982306 2017-12-19 21:00:20 2017-12-20 03:08:33 2017-12-20 04:00:33 0:52:00 0:12:30 0:39:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/forward-scrub.yaml whitelist_health.yaml} 4
pass 1982307 2017-12-19 21:00:21 2017-12-20 03:08:43 2017-12-20 03:48:43 0:40:00 0:11:15 0:28:45 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/default.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
pass 1982308 2017-12-19 21:00:21 2017-12-20 03:10:24 2017-12-20 04:04:24 0:54:00 0:23:53 0:30:07 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
pass 1982309 2017-12-19 21:00:22 2017-12-20 03:10:43 2017-12-20 03:48:42 0:37:59 0:16:49 0:21:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/journal-repair.yaml whitelist_health.yaml} 4
pass 1982310 2017-12-19 21:00:23 2017-12-20 03:10:44 2017-12-20 03:50:44 0:40:00 0:23:44 0:16:16 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_misc.yaml} 3
pass 1982311 2017-12-19 21:00:23 2017-12-20 03:14:34 2017-12-20 03:56:34 0:42:00 0:18:40 0:23:20 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_o_trunc.yaml} 3
pass 1982312 2017-12-19 21:00:24 2017-12-20 03:14:38 2017-12-20 04:36:39 1:22:01 0:09:50 1:12:11 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-flush.yaml whitelist_health.yaml} 4
pass 1982313 2017-12-19 21:00:25 2017-12-20 03:14:42 2017-12-20 04:06:43 0:52:01 0:37:42 0:14:19 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_snaps.yaml} 3
pass 1982314 2017-12-19 21:00:25 2017-12-20 03:14:44 2017-12-20 03:50:44 0:36:00 0:19:46 0:16:14 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mds.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
fail 1982315 2017-12-19 21:00:26 2017-12-20 03:16:48 2017-12-20 04:06:48 0:50:00 0:07:54 0:42:06 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi200 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true'

pass 1982316 2017-12-19 21:00:27 2017-12-20 03:16:49 2017-12-20 04:12:50 0:56:01 0:43:01 0:13:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_dbench.yaml} 3
fail 1982317 2017-12-19 21:00:27 2017-12-20 03:17:51 2017-12-20 03:51:51 0:34:00 0:18:14 0:15:46 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2017-12-20 03:40:51.762299 mon.a mon.0 172.21.15.136:6789/0 165 : cluster [WRN] Health check failed: 5 slow ops, oldest one blocked for 30 sec (SLOW_OPS)" in cluster log

pass 1982318 2017-12-19 21:00:28 2017-12-20 03:18:29 2017-12-20 03:58:29 0:40:00 0:09:50 0:30:10 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/pool-perm.yaml whitelist_health.yaml} 4
pass 1982319 2017-12-19 21:00:29 2017-12-20 03:18:31 2017-12-20 03:44:30 0:25:59 0:09:29 0:16:30 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_fsstress.yaml} 3
pass 1982320 2017-12-19 21:00:29 2017-12-20 03:18:35 2017-12-20 04:08:35 0:50:00 0:25:17 0:24:43 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_fsx.yaml} 3
pass 1982321 2017-12-19 21:00:30 2017-12-20 03:18:38 2017-12-20 04:18:39 1:00:01 0:12:31 0:47:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/sessionmap.yaml whitelist_health.yaml} 4
fail 1982322 2017-12-19 21:00:30 2017-12-20 03:20:39 2017-12-20 04:06:40 0:46:01 0:21:23 0:24:38 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2017-12-20 03:50:54.130008 mon.a mon.0 172.21.15.110:6789/0 166 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 1982323 2017-12-19 21:00:31 2017-12-20 03:20:39 2017-12-20 03:54:39 0:34:00 0:09:44 0:24:16 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_fsync.yaml} 3
pass 1982324 2017-12-19 21:00:32 2017-12-20 03:20:45 2017-12-20 04:02:45 0:42:00 0:26:20 0:15:40 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
pass 1982325 2017-12-19 21:00:32 2017-12-20 03:21:59 2017-12-20 03:55:59 0:34:00 0:11:07 0:22:53 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
pass 1982326 2017-12-19 21:00:33 2017-12-20 03:22:27 2017-12-20 03:44:26 0:21:59 0:10:48 0:11:11 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore.yaml tasks/kclient_workunit_suites_pjd.yaml} 3
fail 1982327 2017-12-19 21:00:34 2017-12-20 03:22:53 2017-12-20 04:18:53 0:56:00 0:13:44 0:42:16 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 1982328 2017-12-19 21:00:34 2017-12-20 03:24:42 2017-12-20 03:44:43 0:20:01 0:08:27 0:11:34 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_trivial_sync.yaml} 3