Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 2129094 2018-01-30 20:49:05 2018-01-30 21:04:42 2018-01-30 22:18:43 1:14:01 0:48:54 0:25:07 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:34:50.159507 mon.b mon.0 172.21.15.86:6789/0 120 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 2129095 2018-01-30 20:49:05 2018-01-30 21:04:42 2018-01-30 22:24:43 1:20:01 0:47:23 0:32:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_snaps.yaml} 3
dead 2129096 2018-01-30 20:49:06 2018-01-30 21:04:44 2018-01-31 09:07:11 12:02:27 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
fail 2129097 2018-01-30 20:49:07 2018-01-30 21:05:08 2018-01-30 21:53:08 0:48:00 0:12:08 0:35:52 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2018-01-30 21:47:18.094458 mon.a mon.0 172.21.15.11:6789/0 126 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 2129098 2018-01-30 20:49:07 2018-01-30 21:06:43 2018-01-30 21:42:43 0:36:00 0:13:18 0:22:42 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 2129099 2018-01-30 20:49:08 2018-01-30 21:12:34 2018-01-31 00:48:38 3:36:04 0:48:33 2:47:31 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-31 00:06:52.394581 mon.b mon.0 172.21.15.169:6789/0 148 : cluster [WRN] Health check failed: 5201 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

fail 2129100 2018-01-30 20:49:09 2018-01-30 21:12:40 2018-01-30 21:48:40 0:36:00 0:18:34 0:17:26 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:35:32.603978 mon.a mon.0 172.21.15.12:6789/0 163 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 2129101 2018-01-30 20:49:09 2018-01-30 21:12:53 2018-01-30 22:18:54 1:06:01 0:37:00 0:29:01 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_kernel_untar_build.yaml} 3
Failure Reason:

"2018-01-30 21:48:26.004230 mon.b mon.0 172.21.15.16:6789/0 108 : cluster [WRN] Health check failed: 468 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

fail 2129102 2018-01-30 20:49:10 2018-01-30 21:13:03 2018-01-30 21:33:02 0:19:59 0:07:32 0:12:27 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi202 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true'

fail 2129103 2018-01-30 20:49:11 2018-01-30 21:14:50 2018-01-30 22:20:51 1:06:01 0:52:29 0:13:32 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:34:29.137321 mon.b mon.0 172.21.15.71:6789/0 164 : cluster [WRN] Health check failed: 7494 slow ops, oldest one blocked for 35 sec (SLOW_OPS)" in cluster log

fail 2129104 2018-01-30 20:49:11 2018-01-30 21:16:46 2018-01-30 23:10:48 1:54:02 0:11:01 1:43:01 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2018-01-30 23:06:44.500448 mon.a mon.0 172.21.15.53:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 2129105 2018-01-30 20:49:12 2018-01-30 21:16:46 2018-01-30 22:04:46 0:48:00 0:21:20 0:26:40 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/filestore-xfs.yaml tasks/kclient_workunit_suites_iozone.yaml} 3
fail 2129106 2018-01-30 20:49:12 2018-01-30 21:16:54 2018-01-30 23:12:55 1:56:01 0:13:10 1:42:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 2129107 2018-01-30 20:49:13 2018-01-30 21:18:49 2018-01-30 22:20:50 1:02:01 0:23:44 0:38:17 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 22:03:11.737738 mon.a mon.0 172.21.15.192:6789/0 28 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

dead 2129108 2018-01-30 20:49:14 2018-01-30 21:18:49 2018-01-31 09:21:18 12:02:29 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
pass 2129109 2018-01-30 20:49:14 2018-01-30 21:20:52 2018-01-30 22:12:25 0:51:33 0:19:33 0:32:00 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-comp.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
fail 2129110 2018-01-30 20:49:15 2018-01-30 21:20:52 2018-01-30 21:54:18 0:33:26 0:11:18 0:22:08 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2018-01-30 21:48:42.034124 mon.a mon.1 172.21.15.202:6789/0 45 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 2129111 2018-01-30 20:49:16 2018-01-30 21:26:40 2018-01-30 22:00:40 0:34:00 0:13:46 0:20:14 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-ec-root.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 2129112 2018-01-30 20:49:16 2018-01-30 21:28:34 2018-01-30 23:22:35 1:54:01 1:15:41 0:38:20 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp-ec-root.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 22:13:00.700313 mon.a mon.0 172.21.15.44:6789/0 129 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

dead 2129113 2018-01-30 20:49:17 2018-01-30 21:28:41 2018-01-31 09:31:11 12:02:30 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
fail 2129114 2018-01-30 20:49:18 2018-01-30 21:32:26 2018-01-30 22:50:27 1:18:01 1:08:09 0:09:52 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/yes.yaml objectstore-ec/bluestore-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:50:23.955239 mon.b mon.0 172.21.15.26:6789/0 156 : cluster [WRN] Health check failed: 17600 slow ops, oldest one blocked for 84 sec (SLOW_OPS)" in cluster log

fail 2129115 2018-01-30 20:49:18 2018-01-30 21:32:32 2018-01-30 22:16:32 0:44:00 0:11:18 0:32:42 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2018-01-30 22:09:41.569159 mon.b mon.0 172.21.15.155:6789/0 155 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

fail 2129116 2018-01-30 20:49:19 2018-01-30 21:33:03 2018-01-30 22:53:04 1:20:01 0:13:09 1:06:52 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 2129117 2018-01-30 20:49:20 2018-01-30 21:34:18 2018-01-30 22:44:18 1:10:00 0:53:22 0:16:38 smithi master kcephfs/cephfs/{clusters/fixed-3-cephfs.yaml conf.yaml inline/no.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:56:56.690863 mon.a mon.0 172.21.15.167:6789/0 114 : cluster [WRN] Health check failed: 5863 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log

fail 2129118 2018-01-30 20:49:20 2018-01-30 21:34:41 2018-01-30 22:12:41 0:38:00 0:19:24 0:18:36 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/bluestore-comp.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2018-01-30 21:59:46.532856 mon.b mon.0 172.21.15.80:6789/0 193 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

fail 2129119 2018-01-30 20:49:21 2018-01-30 21:34:42 2018-01-30 22:12:42 0:38:00 0:07:28 0:30:32 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore-comp-ec-root.yaml tasks/mds-full.yaml whitelist_health.yaml} 4
Failure Reason:

Command failed on smithi024 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true'

fail 2129120 2018-01-30 20:49:22 2018-01-30 21:36:40 2018-01-30 22:24:40 0:48:00 0:21:35 0:26:25 smithi master kcephfs/thrash/{clusters/fixed-3-cephfs.yaml conf.yaml objectstore-ec/filestore-xfs.yaml thrashers/mon.yaml thrashosds-health.yaml whitelist_health.yaml workloads/kclient_workunit_suites_iozone.yaml} 3
Failure Reason:

"2018-01-30 22:07:57.304205 mon.b mon.0 172.21.15.1:6789/0 149 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 2129121 2018-01-30 20:49:22 2018-01-30 21:36:49 2018-01-30 23:44:51 2:08:02 0:26:17 1:41:45 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/bluestore.yaml tasks/strays.yaml whitelist_health.yaml} 4
fail 2129122 2018-01-30 20:49:23 2018-01-30 21:40:55 2018-01-30 22:42:55 1:02:00 0:13:09 0:48:51 smithi master kcephfs/recovery/{clusters/4-remote-clients.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml mounts/kmounts.yaml objectstore-ec/filestore-xfs.yaml tasks/volume-client.yaml whitelist_health.yaml} 4
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)