Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 117296 2014-03-05 17:49:10 2014-03-05 17:49:10 2014-03-06 15:04:18 21:15:08 0:09:30 21:05:38 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.35 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117297 2014-03-05 17:49:23 2014-03-05 17:49:23 2014-03-06 15:02:03 21:12:40 0:05:33 21:07:07 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml} 2
pass 117298 2014-03-05 17:50:07 2014-03-05 17:50:07 2014-03-06 15:01:46 21:11:39 0:05:07 21:06:32 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_python.yaml} 2
pass 117299 2014-03-05 17:52:14 2014-03-05 17:52:14 2014-03-06 15:01:47 21:09:33 0:05:27 21:04:06 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_stress_watch.yaml} 2
pass 117300 2014-03-05 17:54:13 2014-03-05 17:54:13 2014-03-06 15:03:56 21:09:43 0:31:36 20:38:07 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 117301 2014-03-05 17:54:48 2014-03-05 17:54:48 2014-03-06 15:03:56 21:09:08 0:21:51 20:47:17 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 117302 2014-03-05 17:55:06 2014-03-05 17:55:06 2014-03-06 15:03:54 21:08:48 1:42:08 19:26:40 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
fail 117303 2014-03-05 17:57:22 2014-03-05 17:57:22 2014-03-06 15:03:55 21:06:33 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_api_tests.yaml} 2
pass 117304 2014-03-05 17:55:57 2014-03-05 17:55:57 2014-03-06 15:03:53 21:07:56 0:05:56 21:02:00 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_cls_all.yaml} 2
pass 117305 2014-03-05 17:57:37 2014-03-05 17:57:37 2014-03-06 15:03:53 21:06:16 0:05:57 21:00:19 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_python.yaml} 2
pass 117306 2014-03-05 17:57:39 2014-03-05 17:57:39 2014-03-06 15:03:51 21:06:12 0:05:14 21:00:58 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_stress_watch.yaml} 2
pass 117307 2014-03-05 17:58:36 2014-03-05 17:58:36 2014-03-06 15:03:52 21:05:16 0:31:40 20:33:36 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 117308 2014-03-05 18:00:55 2014-03-05 18:00:55 2014-03-06 15:03:58 21:03:03 0:21:45 20:41:18 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 117309 2014-03-05 18:01:43 2014-03-05 18:01:43 2014-03-06 15:03:58 21:02:15 1:40:07 19:22:08 plana firefly ubuntu rados/basic/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/many.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 117310 2014-03-05 18:01:48 2014-03-05 18:01:48 2014-03-06 15:05:29 21:03:41 0:06:44 20:56:57 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
fail 117311 2014-03-05 18:01:59 2014-03-05 18:01:59 2014-03-06 15:05:29 21:03:30 0:12:07 20:51:23 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.12 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117312 2014-03-05 18:02:00 2014-03-05 18:02:00 2014-03-06 15:05:31 21:03:31 0:08:14 20:55:17 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117313 2014-03-05 18:03:39 2014-03-05 18:03:39 2014-03-06 15:05:30 21:01:51 0:34:20 20:27:31 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117314 2014-03-05 18:04:00 2014-03-05 18:04:00 2014-03-06 15:05:26 21:01:26 0:04:47 20:56:39 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
fail 117315 2014-03-05 18:04:16 2014-03-05 18:04:16 2014-03-06 15:05:26 21:01:10 0:13:07 20:48:03 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.38 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117316 2014-03-05 18:05:50 2014-03-05 18:05:50 2014-03-06 15:05:28 20:59:38 0:08:17 20:51:21 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117317 2014-03-05 18:06:50 2014-03-05 18:06:50 2014-03-06 15:05:28 20:58:38 0:42:03 20:16:35 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
pass 117318 2014-03-05 18:07:19 2014-03-05 18:07:19 2014-03-06 15:05:32 20:58:13 0:04:24 20:53:49 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 117319 2014-03-05 18:09:08 2014-03-05 18:09:08 2014-03-06 15:05:32 20:56:24 6:08:10 14:48:14 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.10 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117320 2014-03-05 18:09:59 2014-03-05 18:09:59 2014-03-06 15:01:21 20:51:22 0:08:04 20:43:18 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 117321 2014-03-05 18:10:09 2014-03-05 18:10:09 2014-03-06 15:01:22 20:51:13 0:45:28 20:05:45 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
pass 117322 2014-03-05 18:11:14 2014-03-05 18:11:14 2014-03-06 15:01:22 20:50:08 0:05:42 20:44:26 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_5925.yaml} 2
fail 117323 2014-03-05 18:11:50 2014-03-05 18:11:50 2014-03-06 15:01:23 20:49:33 0:15:30 20:34:03 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.29 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117324 2014-03-05 18:16:04 2014-03-05 18:16:04 2014-03-06 15:01:23 20:45:19 0:07:47 20:37:32 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117325 2014-03-05 18:16:13 2014-03-05 18:16:13 2014-03-06 15:01:24 20:45:11 0:32:43 20:12:28 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117326 2014-03-05 18:18:19 2014-03-05 18:18:19 2014-03-06 15:01:25 20:43:06 0:05:54 20:37:12 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 117327 2014-03-05 18:20:08 2014-03-05 18:20:08 2014-03-06 15:01:25 20:41:17 0:12:26 20:28:51 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.15 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117328 2014-03-05 18:20:44 2014-03-05 18:20:44 2014-03-06 15:01:26 20:40:42 0:07:54 20:32:48 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
pass 117329 2014-03-05 18:21:21 2014-03-05 18:21:21 2014-03-06 15:01:28 20:40:07 0:31:04 20:09:03 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
pass 117330 2014-03-05 18:22:27 2014-03-05 18:22:27 2014-03-06 15:03:10 20:40:43 0:05:47 20:34:56 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
fail 117331 2014-03-05 18:22:29 2014-03-05 18:22:29 2014-03-06 15:03:10 20:40:41 0:15:42 20:24:59 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.30 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117332 2014-03-05 18:22:35 2014-03-05 18:22:35 2014-03-06 15:03:09 20:40:34 0:08:08 20:32:26 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117333 2014-03-05 18:23:35 2014-03-05 18:23:35 2014-03-06 15:03:08 20:39:33 0:32:24 20:07:09 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117334 2014-03-05 18:23:36 2014-03-05 18:23:36 2014-03-06 15:03:07 20:39:31 0:04:39 20:34:52 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
fail 117335 2014-03-05 18:23:37 2014-03-05 18:23:37 2014-03-06 15:03:07 20:39:30 0:16:45 20:22:45 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.3 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117336 2014-03-05 18:23:40 2014-03-05 18:23:40 2014-03-06 15:03:06 20:39:26 0:09:46 20:29:40 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117337 2014-03-05 18:23:39 2014-03-05 18:23:39 2014-03-06 15:03:05 20:39:26 0:43:27 19:55:59 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
pass 117338 2014-03-05 18:23:38 2014-03-05 18:23:38 2014-03-06 15:03:04 20:39:26 0:05:04 20:34:22 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 117339 2014-03-05 18:23:47 2014-03-05 18:23:47 2014-03-06 15:03:04 20:39:17 0:16:13 20:23:04 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.6 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117340 2014-03-05 18:23:52 2014-03-05 18:23:52 2014-03-06 15:04:36 20:40:44 0:08:54 20:31:50 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 117341 2014-03-05 18:23:55 2014-03-05 18:23:55 2014-03-06 15:04:37 20:40:42 0:44:53 19:55:49 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
pass 117342 2014-03-05 18:23:57 2014-03-05 18:23:57 2014-03-06 15:04:35 20:40:38 0:05:50 20:34:48 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_5925.yaml} 2
fail 117343 2014-03-05 18:24:05 2014-03-05 18:24:05 2014-03-06 15:04:36 20:40:31 0:12:20 20:28:11 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.29 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117344 2014-03-05 18:24:08 2014-03-05 18:24:08 2014-03-06 15:04:38 20:40:30 0:10:08 20:30:22 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117345 2014-03-05 18:24:09 2014-03-05 18:24:09 2014-03-06 15:04:40 20:40:31 0:33:53 20:06:38 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117346 2014-03-05 18:24:10 2014-03-05 18:24:10 2014-03-06 15:04:38 20:40:28 0:06:13 20:34:15 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 117347 2014-03-05 18:24:11 2014-03-05 18:24:11 2014-03-06 15:04:38 20:40:27 0:16:02 20:24:25 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.26 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117348 2014-03-05 18:24:14 2014-03-05 18:24:14 2014-03-06 15:04:33 20:40:19 0:07:50 20:32:29 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
pass 117349 2014-03-05 18:24:17 2014-03-05 18:24:17 2014-03-06 15:04:34 20:40:17 0:34:07 20:06:10 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
pass 117350 2014-03-05 18:24:28 2014-03-05 18:24:28 2014-03-06 15:06:07 20:41:39 0:06:14 20:35:25 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
fail 117351 2014-03-05 18:24:29 2014-03-05 18:24:29 2014-03-06 15:06:07 20:41:38 0:13:44 20:27:54 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.31 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117352 2014-03-05 18:24:31 2014-03-05 18:24:31 2014-03-06 15:06:10 20:41:39 0:08:08 20:33:31 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117353 2014-03-05 18:24:39 2014-03-05 18:24:39 2014-03-06 15:06:09 20:41:30 0:35:28 20:06:02 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117354 2014-03-05 18:24:44 2014-03-05 18:24:44 2014-03-06 15:06:11 20:41:27 0:05:44 20:35:43 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
fail 117355 2014-03-05 18:24:45 2014-03-05 18:24:45 2014-03-06 15:06:10 20:41:25 0:12:35 20:28:50 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.17 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117356 2014-03-05 18:24:50 2014-03-05 18:24:50 2014-03-06 15:06:12 20:41:22 0:09:23 20:31:59 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117357 2014-03-05 18:24:52 2014-03-05 18:24:52 2014-03-06 15:06:11 20:41:19 0:43:25 19:57:54 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
pass 117358 2014-03-05 18:24:53 2014-03-05 18:24:53 2014-03-06 15:06:07 20:41:14 0:06:03 20:35:11 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 117359 2014-03-05 18:24:55 2014-03-05 18:24:55 2014-03-06 15:06:06 20:41:11 0:16:37 20:24:34 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.4 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117360 2014-03-05 18:24:54 2014-03-05 18:24:54 2014-03-06 15:02:14 20:37:20 0:07:44 20:29:36 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 117361 2014-03-05 18:25:04 2014-03-05 18:25:04 2014-03-06 15:02:15 20:37:11 0:46:41 19:50:30 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
pass 117362 2014-03-05 18:25:05 2014-03-05 18:25:05 2014-03-06 15:02:16 20:37:11 0:06:35 20:30:36 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_5925.yaml} 2
fail 117363 2014-03-05 18:25:06 2014-03-05 18:25:06 2014-03-06 15:02:16 20:37:10 0:10:40 20:26:30 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.6 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117364 2014-03-05 18:25:07 2014-03-05 18:25:07 2014-03-06 15:02:12 20:37:05 0:08:33 20:28:32 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117365 2014-03-05 18:25:08 2014-03-05 18:25:08 2014-03-06 15:02:12 20:37:04 0:35:52 20:01:12 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117366 2014-03-05 18:25:28 2014-03-05 18:25:28 2014-03-06 15:02:13 20:36:45 0:06:19 20:30:26 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 117367 2014-03-05 18:27:22 2014-03-05 18:27:22 2014-03-06 15:02:14 20:34:52 0:16:44 20:18:08 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.34 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117368 2014-03-05 18:27:57 2014-03-05 18:27:57 2014-03-06 15:02:17 20:34:20 0:08:03 20:26:17 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
pass 117369 2014-03-05 18:28:27 2014-03-05 18:28:27 2014-03-06 15:02:17 20:33:50 0:36:55 19:56:55 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
pass 117370 2014-03-05 18:29:32 2014-03-05 18:29:32 2014-03-06 15:03:46 20:34:14 0:06:12 20:28:02 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
fail 117371 2014-03-05 18:31:45 2014-03-05 18:31:45 2014-03-06 15:03:45 20:32:00 0:15:54 20:16:06 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.19 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117372 2014-03-05 18:33:41 2014-03-05 18:33:41 2014-03-06 15:03:45 20:30:04 0:09:01 20:21:03 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117373 2014-03-05 18:34:00 2014-03-05 18:34:00 2014-03-06 15:03:44 20:29:44 0:43:54 19:45:50 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117374 2014-03-05 18:34:46 2014-03-05 18:34:46 2014-03-06 15:03:48 20:29:02 0:05:05 20:23:57 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
fail 117375 2014-03-05 18:35:31 2014-03-05 18:35:31 2014-03-06 15:03:48 20:28:17 0:17:18 20:10:59 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.30 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117376 2014-03-05 18:35:32 2014-03-05 18:35:32 2014-03-06 15:03:47 20:28:15 0:10:52 20:17:23 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117377 2014-03-05 18:35:58 2014-03-05 18:35:58 2014-03-06 15:03:47 20:27:49 0:44:02 19:43:47 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
pass 117378 2014-03-05 18:36:23 2014-03-05 18:36:23 2014-03-06 15:03:50 20:27:27 0:04:43 20:22:44 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 117379 2014-03-05 18:36:25 2014-03-05 18:36:25 2014-03-06 15:03:49 20:27:24 0:15:47 20:11:37 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.16 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117380 2014-03-05 18:36:56 2014-03-05 18:36:56 2014-03-06 15:05:25 20:28:29 0:08:22 20:20:07 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 117381 2014-03-05 18:38:49 2014-03-05 18:38:49 2014-03-06 15:05:25 20:26:36 0:48:49 19:37:47 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
pass 117382 2014-03-05 18:39:10 2014-03-05 18:39:10 2014-03-06 15:05:23 20:26:13 0:06:29 20:19:44 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_5925.yaml} 2
fail 117383 2014-03-05 18:40:03 2014-03-05 18:40:03 2014-03-06 15:05:24 20:25:21 0:16:05 20:09:16 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.28 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117384 2014-03-05 18:40:11 2014-03-05 18:40:11 2014-03-06 15:05:22 20:25:11 0:08:53 20:16:18 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 117385 2014-03-05 18:40:57 2014-03-05 18:40:57 2014-03-06 15:05:22 20:24:25 0:36:25 19:48:00 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 117386 2014-03-05 18:41:55 2014-03-05 18:41:55 2014-03-06 15:05:21 20:23:26 0:06:07 20:17:19 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 117387 2014-03-05 18:42:11 2014-03-05 18:42:11 2014-03-06 15:05:21 20:23:10 0:13:41 20:09:29 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.22 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117388 2014-03-05 18:42:32 2014-03-05 18:42:32 2014-03-06 15:05:19 20:22:47 0:08:13 20:14:34 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
pass 117389 2014-03-05 18:42:33 2014-03-05 18:42:33 2014-03-06 15:05:20 20:22:47 0:36:43 19:46:04 plana firefly ubuntu rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
pass 117390 2014-03-05 18:42:49 2014-03-05 18:42:49 2014-03-06 15:01:17 20:18:28 0:04:08 20:14:20 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/few.yaml tasks/mon_clock_no_skews.yaml} 3
pass 117391 2014-03-05 18:44:01 2014-03-05 18:44:01 2014-03-06 15:01:16 20:17:15 0:04:45 20:12:30 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/few.yaml tasks/mon_clock_with_skews.yaml} 3
pass 117392 2014-03-05 18:44:10 2014-03-05 18:44:10 2014-03-06 15:01:19 20:17:09 0:14:39 20:02:30 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml} 3
pass 117393 2014-03-05 18:44:26 2014-03-05 18:44:26 2014-03-06 15:03:32 20:19:06 0:04:27 20:14:39 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/many.yaml tasks/mon_clock_no_skews.yaml} 3
pass 117394 2014-03-05 18:44:49 2014-03-05 18:44:49 2014-03-06 15:01:14 20:16:25 0:04:31 20:11:54 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/many.yaml tasks/mon_clock_with_skews.yaml} 3
pass 117395 2014-03-05 18:44:54 2014-03-05 18:44:54 2014-03-06 15:01:13 20:16:19 0:15:09 20:01:10 plana firefly ubuntu rados/multimon/{clusters/21.yaml msgr-failures/many.yaml tasks/mon_recovery.yaml} 3
pass 117396 2014-03-05 18:46:14 2014-03-05 18:46:14 2014-03-06 15:01:16 20:15:02 0:03:48 20:11:14 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/few.yaml tasks/mon_clock_no_skews.yaml} 1
pass 117397 2014-03-05 18:46:15 2014-03-05 18:46:15 2014-03-06 15:01:15 20:15:00 0:03:33 20:11:27 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/few.yaml tasks/mon_clock_with_skews.yaml} 1
pass 117398 2014-03-05 18:46:50 2014-03-05 18:46:50 2014-03-06 15:01:10 20:14:20 0:06:42 20:07:38 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml} 1
pass 117399 2014-03-05 18:47:41 2014-03-05 18:47:41 2014-03-06 15:01:09 20:13:28 0:03:34 20:09:54 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/many.yaml tasks/mon_clock_no_skews.yaml} 1
pass 117400 2014-03-05 18:48:43 2014-03-05 18:48:43 2014-03-06 15:02:41 20:13:58 0:04:23 20:09:35 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/many.yaml tasks/mon_clock_with_skews.yaml} 1
pass 117401 2014-03-05 18:48:44 2014-03-05 18:48:44 2014-03-06 15:02:40 20:13:56 0:07:06 20:06:50 plana firefly ubuntu rados/multimon/{clusters/3.yaml msgr-failures/many.yaml tasks/mon_recovery.yaml} 1
pass 117402 2014-03-05 18:49:54 2014-03-05 18:49:54 2014-03-06 15:02:42 20:12:48 0:04:20 20:08:28 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/few.yaml tasks/mon_clock_no_skews.yaml} 2
pass 117403 2014-03-05 18:50:06 2014-03-05 18:50:06 2014-03-06 15:02:42 20:12:36 0:22:36 19:50:00 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/few.yaml tasks/mon_clock_with_skews.yaml} 2
pass 117404 2014-03-05 18:50:23 2014-03-05 18:50:23 2014-03-06 15:02:44 20:12:21 0:07:22 20:04:59 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml} 2
pass 117405 2014-03-05 18:51:00 2014-03-05 18:51:00 2014-03-06 15:02:43 20:11:43 0:03:49 20:07:54 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/many.yaml tasks/mon_clock_no_skews.yaml} 2
pass 117406 2014-03-05 18:51:02 2014-03-05 18:51:02 2014-03-06 15:02:45 20:11:43 0:04:20 20:07:23 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/many.yaml tasks/mon_clock_with_skews.yaml} 2
pass 117407 2014-03-05 18:52:06 2014-03-05 18:52:06 2014-03-06 15:02:45 20:10:39 0:07:34 20:03:05 plana firefly ubuntu rados/multimon/{clusters/6.yaml msgr-failures/many.yaml tasks/mon_recovery.yaml} 2
pass 117408 2014-03-05 18:52:32 2014-03-05 18:52:32 2014-03-06 15:02:39 20:10:07 0:03:55 20:06:12 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/few.yaml tasks/mon_clock_no_skews.yaml} 3
pass 117409 2014-03-05 18:52:46 2014-03-05 18:52:46 2014-03-06 15:02:38 20:09:52 0:04:06 20:05:46 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/few.yaml tasks/mon_clock_with_skews.yaml} 3
fail 117410 2014-03-05 18:54:18 2014-03-05 18:54:18 2014-03-06 15:00:57 20:06:39 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml} 3
pass 117411 2014-03-05 18:54:45 2014-03-05 18:54:45 2014-03-06 15:00:58 20:06:13 0:03:51 20:02:22 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/many.yaml tasks/mon_clock_no_skews.yaml} 3
pass 117412 2014-03-05 18:55:36 2014-03-05 18:55:36 2014-03-06 15:00:55 20:05:19 0:04:31 20:00:48 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/many.yaml tasks/mon_clock_with_skews.yaml} 3
pass 117413 2014-03-05 18:55:41 2014-03-05 18:55:41 2014-03-06 15:00:55 20:05:14 0:09:34 19:55:40 plana firefly ubuntu rados/multimon/{clusters/9.yaml msgr-failures/many.yaml tasks/mon_recovery.yaml} 3
fail 117414 2014-03-05 18:56:49 2014-03-05 18:56:49 2014-03-06 15:01:00 20:04:11 plana firefly ubuntu rados/singleton/{all/admin-socket.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117415 2014-03-05 18:56:50 2014-03-05 18:56:50 2014-03-06 15:01:00 20:04:10 0:03:13 20:00:57 plana firefly ubuntu rados/singleton/{all/admin-socket.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117416 2014-03-05 18:57:12 2014-03-05 18:57:12 2014-03-06 15:00:58 20:03:46 0:09:54 19:53:52 plana firefly ubuntu rados/singleton/{all/cephtool.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117417 2014-03-05 18:57:14 2014-03-05 18:57:14 2014-03-06 15:00:59 20:03:45 0:10:11 19:53:34 plana firefly ubuntu rados/singleton/{all/cephtool.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117418 2014-03-05 18:57:44 2014-03-05 18:57:44 2014-03-06 15:00:53 20:03:09 0:04:44 19:58:25 plana firefly ubuntu rados/singleton/{all/dump-stuck.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117419 2014-03-05 18:57:45 2014-03-05 18:57:45 2014-03-06 15:00:54 20:03:09 0:05:11 19:57:58 plana firefly ubuntu rados/singleton/{all/dump-stuck.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117420 2014-03-05 18:58:13 2014-03-05 18:58:13 2014-03-06 15:05:44 20:07:31 0:05:42 20:01:49 plana firefly ubuntu rados/singleton/{all/lost-unfound.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117421 2014-03-05 18:59:01 2014-03-05 18:59:01 2014-03-06 15:05:43 20:06:42 0:05:45 20:00:57 plana firefly ubuntu rados/singleton/{all/lost-unfound.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117422 2014-03-05 18:59:02 2014-03-05 18:59:02 2014-03-06 15:02:20 20:03:18 0:08:38 19:54:40 plana firefly ubuntu rados/singleton/{all/mon-config-keys.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117423 2014-03-05 19:00:00 2014-03-05 19:00:00 2014-03-06 15:02:19 20:02:19 0:08:47 19:53:32 plana firefly ubuntu rados/singleton/{all/mon-config-keys.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117424 2014-03-05 17:33:39 2014-03-05 17:33:39 2014-03-06 15:05:47 21:32:08 0:14:37 21:17:31 plana firefly ubuntu rados/singleton/{all/mon-thrasher.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117425 2014-03-05 19:00:11 2014-03-05 19:00:11 2014-03-06 15:05:46 20:05:35 0:14:10 19:51:25 plana firefly ubuntu rados/singleton/{all/mon-thrasher.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117426 2014-03-05 19:00:14 2014-03-05 19:00:14 2014-03-06 15:05:45 20:05:31 0:07:07 19:58:24 plana firefly ubuntu rados/singleton/{all/osd-backfill.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117427 2014-03-05 19:00:52 2014-03-05 19:00:52 2014-03-06 15:05:44 20:04:52 0:05:24 19:59:28 plana firefly ubuntu rados/singleton/{all/osd-backfill.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117428 2014-03-05 19:00:54 2014-03-05 19:00:54 2014-03-06 15:02:23 20:01:29 0:07:45 19:53:44 plana firefly ubuntu rados/singleton/{all/osd-recovery-incomplete.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117429 2014-03-05 19:00:56 2014-03-05 19:00:56 2014-03-06 15:02:21 20:01:25 0:06:42 19:54:43 plana firefly ubuntu rados/singleton/{all/osd-recovery-incomplete.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117430 2014-03-05 19:01:51 2014-03-05 19:01:51 2014-03-06 15:04:13 20:02:22 0:05:21 19:57:01 plana firefly ubuntu rados/singleton/{all/osd-recovery.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117431 2014-03-05 19:01:52 2014-03-05 19:01:52 2014-03-06 15:04:14 20:02:22 0:07:13 19:55:09 plana firefly ubuntu rados/singleton/{all/osd-recovery.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117432 2014-03-05 19:02:25 2014-03-05 19:02:25 2014-03-06 15:04:15 20:01:50 0:04:24 19:57:26 plana firefly ubuntu rados/singleton/{all/peer.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117433 2014-03-05 19:02:56 2014-03-05 19:02:56 2014-03-06 15:04:15 20:01:19 0:04:38 19:56:41 plana firefly ubuntu rados/singleton/{all/peer.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
pass 117434 2014-03-05 19:03:46 2014-03-05 19:03:46 2014-03-06 15:04:11 20:00:25 0:03:44 19:56:41 plana firefly ubuntu rados/singleton/{all/radostool.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
pass 117435 2014-03-05 19:04:19 2014-03-05 19:04:19 2014-03-06 15:04:12 19:59:53 0:04:38 19:55:15 plana firefly ubuntu rados/singleton/{all/radostool.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
fail 117436 2014-03-05 19:04:25 2014-03-05 19:04:25 2014-03-06 15:04:12 19:59:47 0:03:26 19:56:21 plana firefly ubuntu rados/singleton/{all/rest-api.yaml fs/btrfs.yaml msgr-failures/few.yaml} 1
Failure Reason:

Command failed on 10.214.131.2 with status 11: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd scrub osd.0'

fail 117437 2014-03-05 19:04:26 2014-03-05 19:04:26 2014-03-06 15:04:13 19:59:47 0:03:46 19:56:01 plana firefly ubuntu rados/singleton/{all/rest-api.yaml fs/btrfs.yaml msgr-failures/many.yaml} 1
Failure Reason:

Command failed on 10.214.131.16 with status 11: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd scrub osd.0'

pass 117438 2014-03-05 19:04:34 2014-03-05 19:04:34 2014-03-06 15:04:16 19:59:42 0:14:19 19:45:23 plana firefly ubuntu rados/singleton/{all/thrash-rados.yaml fs/btrfs.yaml msgr-failures/few.yaml} 2
pass 117439 2014-03-05 19:04:49 2014-03-05 19:04:49 2014-03-06 15:04:17 19:59:28 0:14:09 19:45:19 plana firefly ubuntu rados/singleton/{all/thrash-rados.yaml fs/btrfs.yaml msgr-failures/many.yaml} 2
pass 117440 2014-03-05 19:04:50 2014-03-05 19:04:50 2014-03-06 15:01:55 19:57:05 0:03:36 19:53:29 plana firefly ubuntu rados/singleton-nomsgr/{all/filejournal.yaml} 1
pass 117441 2014-03-05 19:04:51 2014-03-05 19:04:51 2014-03-06 15:01:54 19:57:03 2:02:23 17:54:40 plana firefly ubuntu rados/singleton-nomsgr/{all/filestore-idempotent-aio-journal.yaml} 1
pass 117442 2014-03-05 19:05:03 2014-03-05 19:05:03 2014-03-06 15:01:59 19:56:56 1:51:24 18:05:32 plana firefly ubuntu rados/singleton-nomsgr/{all/filestore-idempotent.yaml} 1
pass 117443 2014-03-05 19:05:17 2014-03-05 19:05:17 2014-03-06 15:01:56 19:56:39 0:18:22 19:38:17 plana firefly ubuntu rados/singleton-nomsgr/{all/objectcacher-stress.yaml} 1
pass 117444 2014-03-05 19:05:44 2014-03-05 19:05:44 2014-03-06 15:01:51 19:56:07 0:05:30 19:50:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117445 2014-03-05 19:05:48 2014-03-05 19:05:48 2014-03-06 15:01:50 19:56:02 0:37:03 19:18:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 117446 2014-03-05 19:05:58 2014-03-05 19:05:58 2014-03-06 15:01:49 19:55:51 0:28:33 19:27:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 117447 2014-03-05 19:07:05 2014-03-05 19:07:05 2014-03-06 15:01:52 19:54:47 0:35:06 19:19:41 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117448 2014-03-05 19:07:28 2014-03-05 19:07:28 2014-03-06 15:02:04 19:54:36 0:24:56 19:29:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 117449 2014-03-05 19:07:45 2014-03-05 19:07:45 2014-03-06 15:02:04 19:54:19 1:10:16 18:44:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
pass 117450 2014-03-05 19:08:31 2014-03-05 19:08:31 2014-03-06 15:03:42 19:55:11 1:04:59 18:50:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
pass 117451 2014-03-05 19:08:56 2014-03-05 19:08:56 2014-03-06 15:03:43 19:54:47 0:15:27 19:39:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117452 2014-03-05 19:09:06 2014-03-05 19:09:06 2014-03-06 15:05:58 19:56:52 0:04:05 19:52:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117453 2014-03-05 19:09:19 2014-03-05 19:09:19 2014-03-06 15:05:59 19:56:40 6:07:47 13:48:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.35 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117454 2014-03-05 19:09:48 2014-03-05 19:09:48 2014-03-06 15:05:56 19:56:08 0:45:04 19:11:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
pass 117455 2014-03-05 19:10:18 2014-03-05 19:10:18 2014-03-06 15:05:56 19:55:38 0:30:21 19:25:17 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117456 2014-03-05 19:10:21 2014-03-05 19:10:21 2014-03-06 15:05:54 19:55:33 0:15:41 19:39:52 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117457 2014-03-05 19:10:54 2014-03-05 19:10:54 2014-03-06 15:05:55 19:55:01 0:41:17 19:13:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117458 2014-03-05 19:10:58 2014-03-05 19:10:58 2014-03-06 15:06:04 19:55:06 0:06:25 19:48:41 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117459 2014-03-05 19:11:01 2014-03-05 19:11:01 2014-03-06 15:06:05 19:55:04 0:28:50 19:26:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 117460 2014-03-05 19:11:02 2014-03-05 19:11:02 2014-03-06 15:05:17 19:54:15 0:26:25 19:27:50 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 117461 2014-03-05 19:11:20 2014-03-05 19:11:20 2014-03-06 15:05:16 19:53:56 0:30:58 19:22:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117462 2014-03-05 19:11:54 2014-03-05 19:11:54 2014-03-06 15:05:15 19:53:21 0:23:47 19:29:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
pass 117463 2014-03-05 19:12:18 2014-03-05 19:12:18 2014-03-06 15:05:15 19:52:57 0:44:46 19:08:11 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
pass 117464 2014-03-05 19:12:19 2014-03-05 19:12:19 2014-03-06 15:05:13 19:52:54 0:59:25 18:53:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
pass 117465 2014-03-05 19:12:22 2014-03-05 19:12:22 2014-03-06 15:05:12 19:52:50 0:14:59 19:37:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
fail 117466 2014-03-05 19:12:33 2014-03-05 19:12:33 2014-03-06 15:05:11 19:52:38 1:26:06 18:26:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

failed to become clean before timeout expired

fail 117467 2014-03-05 19:12:56 2014-03-05 19:12:56 2014-03-06 15:05:11 19:52:15 0:13:53 19:38:22 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.30 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117468 2014-03-05 19:13:29 2014-03-05 19:13:29 2014-03-06 15:05:10 19:51:41 0:45:39 19:06:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 117469 2014-03-05 19:14:06 2014-03-05 19:14:06 2014-03-06 15:05:10 19:51:04 0:27:30 19:23:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117470 2014-03-05 19:15:01 2014-03-05 19:15:01 2014-03-06 15:05:41 19:50:40 0:14:49 19:35:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117471 2014-03-05 19:15:08 2014-03-05 19:15:08 2014-03-06 15:03:33 19:48:25 0:33:32 19:14:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117472 2014-03-05 19:15:19 2014-03-05 19:15:19 2014-03-06 15:03:34 19:48:15 0:05:08 19:43:07 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117473 2014-03-05 19:15:39 2014-03-05 19:15:39 2014-03-06 15:03:35 19:47:56 0:36:39 19:11:17 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2014-03-05 12:11:15.943017 osd.2 10.214.133.31:6804/27463 64 : [ERR] 4.1 scrub stat mismatch, got 981/981 objects, 0/0 clones, 482/486 dirty, 0/0 whiteouts, 1967799886/1967799886 bytes." in cluster log

pass 117474 2014-03-05 19:15:40 2014-03-05 19:15:40 2014-03-06 15:03:35 19:47:55 0:29:05 19:18:50 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117475 2014-03-05 19:16:45 2014-03-05 19:16:45 2014-03-06 15:03:36 19:46:51 0:35:36 19:11:15 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 117476 2014-03-05 19:17:11 2014-03-05 19:17:11 2014-03-06 15:03:36 19:46:25 0:23:53 19:22:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 117477 2014-03-05 19:17:17 2014-03-05 19:17:17 2014-03-06 15:03:37 19:46:20 0:39:05 19:07:15 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
pass 117478 2014-03-05 19:18:19 2014-03-05 19:18:19 2014-03-06 15:05:53 19:47:34 1:09:40 18:37:54 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117479 2014-03-05 19:18:36 2014-03-05 19:18:36 2014-03-06 15:03:39 19:45:03 0:16:39 19:28:24 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117480 2014-03-05 19:18:46 2014-03-05 19:18:46 2014-03-06 15:04:18 19:45:32 0:12:07 19:33:25 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117481 2014-03-05 19:19:54 2014-03-05 19:19:54 2014-03-06 15:04:18 19:44:24 6:07:46 13:36:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.4 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117482 2014-03-05 19:19:56 2014-03-05 19:19:56 2014-03-06 15:04:20 19:44:24 0:57:40 18:46:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117483 2014-03-05 19:20:13 2014-03-05 19:20:13 2014-03-06 15:04:19 19:44:06 0:33:41 19:10:25 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117484 2014-03-05 19:22:56 2014-03-05 19:22:56 2014-03-06 15:04:21 19:41:25 0:15:41 19:25:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117485 2014-03-05 19:23:50 2014-03-05 19:23:50 2014-03-06 15:04:20 19:40:30 0:37:55 19:02:35 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117486 2014-03-05 19:24:23 2014-03-05 19:24:23 2014-03-06 15:04:23 19:40:00 0:05:23 19:34:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117487 2014-03-05 19:26:18 2014-03-05 19:26:18 2014-03-06 15:04:22 19:38:04 0:25:50 19:12:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117488 2014-03-05 19:26:29 2014-03-05 19:26:29 2014-03-06 15:04:24 19:37:55 0:29:12 19:08:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117489 2014-03-05 19:27:12 2014-03-05 19:27:12 2014-03-06 15:04:23 19:37:11 0:34:49 19:02:22 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117490 2014-03-05 19:27:51 2014-03-05 19:27:51 2014-03-06 15:02:48 19:34:57 0:22:53 19:12:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
pass 117491 2014-03-05 19:28:28 2014-03-05 19:28:28 2014-03-06 15:02:49 19:34:21 0:50:09 18:44:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
pass 117492 2014-03-05 19:29:08 2014-03-05 19:29:08 2014-03-06 15:02:47 19:33:39 1:11:05 18:22:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117493 2014-03-05 19:32:31 2014-03-05 19:32:31 2014-03-06 15:02:48 19:30:17 0:17:14 19:13:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117494 2014-03-05 19:32:49 2014-03-05 19:32:49 2014-03-06 15:02:52 19:30:03 0:09:47 19:20:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117495 2014-03-05 19:33:56 2014-03-05 19:33:56 2014-03-06 15:02:52 19:28:56 0:12:09 19:16:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.28 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117496 2014-03-05 19:34:27 2014-03-05 19:34:27 2014-03-06 15:02:50 19:28:23 0:44:02 18:44:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117497 2014-03-05 19:34:32 2014-03-05 19:34:32 2014-03-06 15:02:51 19:28:19 0:30:15 18:58:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117498 2014-03-05 19:35:01 2014-03-05 19:35:01 2014-03-06 15:02:52 19:27:51 0:16:08 19:11:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117499 2014-03-05 19:35:03 2014-03-05 19:35:03 2014-03-06 15:02:53 19:27:50 0:37:53 18:49:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117500 2014-03-05 19:35:07 2014-03-05 19:35:07 2014-03-06 15:04:26 19:29:19 0:05:07 19:24:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117501 2014-03-05 19:36:09 2014-03-05 19:36:09 2014-03-06 15:04:27 19:28:18 0:25:45 19:02:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 117502 2014-03-05 19:37:14 2014-03-05 19:37:14 2014-03-06 15:04:28 19:27:14 0:30:10 18:57:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 117503 2014-03-05 19:37:14 2014-03-05 19:37:14 2014-03-06 15:04:29 19:27:15 0:34:04 18:53:11 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117504 2014-03-05 19:37:55 2014-03-05 19:37:55 2014-03-06 15:04:29 19:26:34 0:26:22 19:00:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 117505 2014-03-05 19:37:56 2014-03-05 19:37:56 2014-03-06 15:04:30 19:26:34 0:58:22 18:28:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
pass 117506 2014-03-05 19:38:51 2014-03-05 19:38:51 2014-03-06 15:04:31 19:25:40 1:03:40 18:22:00 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
pass 117507 2014-03-05 19:39:16 2014-03-05 19:39:16 2014-03-06 15:04:31 19:25:15 0:15:55 19:09:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117508 2014-03-05 19:39:23 2014-03-05 19:39:23 2014-03-06 15:04:32 19:25:09 0:52:10 18:32:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

fail 117509 2014-03-05 19:40:00 2014-03-05 19:40:00 2014-03-06 15:04:33 19:24:33 0:11:47 19:12:46 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.25 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

fail 117510 2014-03-05 19:40:41 2014-03-05 19:40:41 2014-03-06 15:03:51 19:23:10 0:49:36 18:33:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117511 2014-03-05 19:40:45 2014-03-05 19:40:45 2014-03-06 15:03:50 19:23:05 0:30:28 18:52:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117512 2014-03-05 19:41:18 2014-03-05 19:41:18 2014-03-06 15:06:04 19:24:46 0:14:43 19:10:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117513 2014-03-05 19:42:04 2014-03-05 19:42:04 2014-03-06 15:06:03 19:23:59 0:35:24 18:48:35 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117514 2014-03-05 19:44:00 2014-03-05 19:44:00 2014-03-06 15:06:02 19:22:02 0:05:06 19:16:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117515 2014-03-05 19:44:13 2014-03-05 19:44:13 2014-03-06 15:06:02 19:21:49 0:25:22 18:56:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 117516 2014-03-05 19:45:23 2014-03-05 19:45:23 2014-03-06 15:06:01 19:20:38 0:26:25 18:54:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 117517 2014-03-05 19:46:52 2014-03-05 19:46:52 2014-03-06 15:06:00 19:19:08 0:31:04 18:48:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117518 2014-03-05 19:48:23 2014-03-05 19:48:23 2014-03-06 15:05:59 19:17:36 0:23:03 18:54:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 117519 2014-03-05 19:49:24 2014-03-05 19:49:24 2014-03-06 15:05:59 19:16:35 0:48:33 18:28:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Command failed on 10.214.131.26 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 1'

pass 117520 2014-03-05 19:51:01 2014-03-05 19:51:01 2014-03-06 15:01:11 19:10:10 1:03:08 18:07:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
pass 117521 2014-03-05 19:57:10 2014-03-05 19:57:10 2014-03-06 15:01:12 19:04:02 0:15:00 18:49:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
fail 117522 2014-03-05 19:57:36 2014-03-05 19:57:36 2014-03-06 15:03:18 19:05:42 0:03:44 19:01:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117523 2014-03-05 19:57:58 2014-03-05 19:57:58 2014-03-06 15:03:19 19:05:21 0:12:08 18:53:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.10 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117524 2014-03-05 20:00:03 2014-03-05 20:00:03 2014-03-06 15:01:07 19:01:04 0:45:07 18:15:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 117525 2014-03-05 20:01:27 2014-03-05 20:01:27 2014-03-06 15:01:08 18:59:41 0:27:40 18:32:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117526 2014-03-05 20:01:39 2014-03-05 20:01:39 2014-03-06 15:01:06 18:59:27 0:15:49 18:43:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117527 2014-03-05 20:02:13 2014-03-05 20:02:13 2014-03-06 15:01:07 18:58:54 0:37:41 18:21:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117528 2014-03-05 20:02:21 2014-03-05 20:02:21 2014-03-06 15:01:18 18:58:57 0:05:39 18:53:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117529 2014-03-05 20:02:35 2014-03-05 20:02:35 2014-03-06 15:03:32 19:00:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117530 2014-03-05 20:03:27 2014-03-05 20:03:27 2014-03-06 15:02:57 18:59:30 0:29:30 18:30:00 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117531 2014-03-05 20:04:25 2014-03-05 20:04:25 2014-03-06 15:02:55 18:58:30 0:31:37 18:26:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 117532 2014-03-05 20:05:29 2014-03-05 20:05:29 2014-03-06 15:02:58 18:57:29 0:26:53 18:30:36 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 117533 2014-03-05 20:06:03 2014-03-05 20:06:03 2014-03-06 15:02:58 18:56:55 1:12:59 17:43:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
pass 117534 2014-03-05 20:06:04 2014-03-05 20:06:04 2014-03-06 15:02:54 18:56:50 1:15:07 17:41:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117535 2014-03-05 20:06:13 2014-03-05 20:06:13 2014-03-06 15:02:54 18:56:41 0:15:41 18:41:00 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117536 2014-03-05 20:06:32 2014-03-05 20:06:32 2014-03-06 15:02:55 18:56:23 0:44:26 18:11:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117537 2014-03-05 20:06:41 2014-03-05 20:06:41 2014-03-06 15:02:55 18:56:14 6:08:13 12:48:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.4 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117538 2014-03-05 20:11:29 2014-03-05 20:11:29 2014-03-06 15:03:00 18:51:31 1:00:26 17:51:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117539 2014-03-05 20:12:16 2014-03-05 20:12:16 2014-03-06 15:02:59 18:50:43 0:31:46 18:18:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117540 2014-03-05 20:13:39 2014-03-05 20:13:39 2014-03-06 15:05:05 18:51:26 0:17:48 18:33:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117541 2014-03-05 20:13:40 2014-03-05 20:13:40 2014-03-06 15:05:06 18:51:26 0:35:07 18:16:19 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117542 2014-03-05 20:14:19 2014-03-05 20:14:19 2014-03-06 15:05:06 18:50:47 0:05:21 18:45:26 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117543 2014-03-05 20:14:42 2014-03-05 20:14:42 2014-03-06 15:05:07 18:50:25 0:30:21 18:20:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117544 2014-03-05 20:14:50 2014-03-05 20:14:50 2014-03-06 15:05:02 18:50:12 0:28:24 18:21:48 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117545 2014-03-05 20:15:08 2014-03-05 20:15:08 2014-03-06 15:05:03 18:49:55 0:36:04 18:13:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117546 2014-03-05 20:15:30 2014-03-05 20:15:30 2014-03-06 15:05:03 18:49:33 0:26:06 18:23:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
pass 117547 2014-03-05 20:15:39 2014-03-05 20:15:39 2014-03-06 15:05:05 18:49:26 1:02:53 17:46:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
pass 117548 2014-03-05 20:17:17 2014-03-05 20:17:17 2014-03-06 15:05:07 18:47:50 1:05:23 17:42:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117549 2014-03-05 20:18:42 2014-03-05 20:18:42 2014-03-06 15:05:08 18:46:26 0:16:08 18:30:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117550 2014-03-05 20:19:50 2014-03-05 20:19:50 2014-03-06 15:00:49 18:40:59 1:11:26 17:29:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

fail 117551 2014-03-05 20:21:44 2014-03-05 20:21:44 2014-03-06 15:00:48 18:39:04 0:12:20 18:26:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.12 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117552 2014-03-05 20:21:45 2014-03-05 20:21:45 2014-03-06 15:00:47 18:39:02 0:51:21 17:47:41 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117553 2014-03-05 20:22:05 2014-03-05 20:22:05 2014-03-06 15:00:47 18:38:42 0:34:53 18:03:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117554 2014-03-05 20:24:07 2014-03-05 20:24:07 2014-03-06 15:00:51 18:36:44 0:17:41 18:19:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117555 2014-03-05 20:28:22 2014-03-05 20:28:22 2014-03-06 15:00:51 18:32:29 0:36:09 17:56:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117556 2014-03-05 20:28:31 2014-03-05 20:28:31 2014-03-06 15:00:50 18:32:19 0:06:08 18:26:11 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117557 2014-03-05 20:28:41 2014-03-05 20:28:41 2014-03-06 15:00:49 18:32:08 0:27:43 18:04:25 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
fail 117558 2014-03-05 20:30:20 2014-03-05 20:30:20 2014-03-06 15:00:53 18:30:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 117559 2014-03-05 20:30:25 2014-03-05 20:30:25 2014-03-06 15:00:52 18:30:27 0:31:00 17:59:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117560 2014-03-05 20:30:32 2014-03-05 20:30:32 2014-03-06 15:02:00 18:31:28 0:29:20 18:02:08 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 117561 2014-03-05 20:31:42 2014-03-05 20:31:42 2014-03-06 15:02:01 18:30:19 1:08:01 17:22:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
pass 117562 2014-03-05 20:33:03 2014-03-05 20:33:03 2014-03-06 15:01:59 18:28:56 1:15:10 17:13:46 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
pass 117563 2014-03-05 20:34:35 2014-03-05 20:34:35 2014-03-06 15:02:00 18:27:25 0:16:02 18:11:23 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117564 2014-03-05 20:34:57 2014-03-05 20:34:57 2014-03-06 15:02:03 18:27:06 0:45:28 17:41:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on 10.214.132.36 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 1'

fail 117565 2014-03-05 20:35:04 2014-03-05 20:35:04 2014-03-06 15:02:10 18:27:06 0:15:27 18:11:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.30 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117566 2014-03-05 20:36:35 2014-03-05 20:36:35 2014-03-06 15:02:02 18:25:27 0:47:22 17:38:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
pass 117567 2014-03-05 20:37:37 2014-03-05 20:37:37 2014-03-06 15:02:02 18:24:25 0:34:30 17:49:55 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117568 2014-03-05 20:38:34 2014-03-05 20:38:34 2014-03-06 15:01:48 18:23:14 0:14:54 18:08:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117569 2014-03-05 20:39:50 2014-03-05 20:39:50 2014-03-06 15:01:53 18:22:03 0:37:01 17:45:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117570 2014-03-05 20:40:23 2014-03-05 20:40:23 2014-03-06 15:05:53 18:25:30 0:06:51 18:18:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117571 2014-03-05 20:43:45 2014-03-05 20:43:45 2014-03-06 15:03:38 18:19:53 0:48:54 17:30:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
fail 117572 2014-03-05 20:44:21 2014-03-05 20:44:21 2014-03-06 15:03:40 18:19:19 0:25:47 17:53:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

pass 117573 2014-03-05 20:44:54 2014-03-05 20:44:54 2014-03-06 15:03:39 18:18:45 0:29:47 17:48:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117574 2014-03-05 20:46:00 2014-03-05 20:46:00 2014-03-06 15:03:41 18:17:41 0:26:06 17:51:35 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 117575 2014-03-05 20:46:13 2014-03-05 20:46:13 2014-03-06 15:03:40 18:17:27 1:14:30 17:02:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to become clean before timeout expired

pass 117576 2014-03-05 20:49:50 2014-03-05 20:49:50 2014-03-06 15:03:42 18:13:52 1:02:23 17:11:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
pass 117577 2014-03-05 20:50:55 2014-03-05 20:50:55 2014-03-06 15:03:41 18:12:46 0:16:32 17:56:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
fail 117578 2014-03-05 20:53:01 2014-03-05 20:53:01 2014-03-06 15:05:42 18:12:41 1:26:42 16:45:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

failed to become clean before timeout expired

fail 117579 2014-03-05 20:53:44 2014-03-05 20:53:44 2014-03-06 15:03:32 18:09:48 6:08:12 12:01:36 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.7 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

fail 117580 2014-03-05 20:56:42 2014-03-05 20:56:42 2014-03-06 15:05:48 18:09:06 0:50:58 17:18:08 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
Failure Reason:

failed to become clean before timeout expired

pass 117581 2014-03-05 20:56:44 2014-03-05 20:56:44 2014-03-06 15:05:48 18:09:04 0:27:55 17:41:09 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117582 2014-03-05 20:56:46 2014-03-05 20:56:46 2014-03-06 15:05:49 18:09:03 0:17:49 17:51:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117583 2014-03-05 21:00:44 2014-03-05 21:00:44 2014-03-06 15:05:50 18:05:06 0:34:24 17:30:42 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117584 2014-03-05 21:02:01 2014-03-05 21:02:01 2014-03-06 15:05:50 18:03:49 0:05:48 17:58:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117585 2014-03-05 21:04:33 2014-03-05 21:04:33 2014-03-06 15:05:51 18:01:18 0:55:22 17:05:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117586 2014-03-05 21:05:47 2014-03-05 21:05:47 2014-03-06 15:05:52 18:00:05 0:32:53 17:27:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117587 2014-03-05 21:10:28 2014-03-05 21:10:28 2014-03-06 15:05:52 17:55:24 0:47:07 17:08:17 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
fail 117588 2014-03-05 21:10:39 2014-03-05 21:10:39 2014-03-06 15:05:42 17:55:03 0:31:17 17:23:46 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on 10.214.132.2 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f -i a'

pass 117589 2014-03-05 21:10:45 2014-03-05 21:10:45 2014-03-06 15:05:42 17:54:57 1:10:52 16:44:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
fail 117590 2014-03-05 21:11:29 2014-03-05 21:11:29 2014-03-06 15:02:10 17:50:41 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117591 2014-03-05 21:14:35 2014-03-05 21:14:35 2014-03-06 15:02:09 17:47:34 0:15:54 17:31:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117592 2014-03-05 21:14:42 2014-03-05 21:14:42 2014-03-06 15:02:09 17:47:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117593 2014-03-05 21:14:56 2014-03-05 21:14:56 2014-03-06 15:02:09 17:47:13 6:08:12 11:39:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.33 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117594 2014-03-05 21:15:00 2014-03-05 21:15:00 2014-03-06 15:02:08 17:47:08 0:39:35 17:07:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117595 2014-03-05 21:17:31 2014-03-05 21:17:31 2014-03-06 15:02:07 17:44:36 0:36:20 17:08:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117596 2014-03-05 21:18:27 2014-03-05 21:18:27 2014-03-06 15:02:07 17:43:40 0:16:00 17:27:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117597 2014-03-05 21:22:16 2014-03-05 21:22:16 2014-03-06 15:02:06 17:39:50 0:40:36 16:59:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117598 2014-03-05 21:23:02 2014-03-05 21:23:02 2014-03-06 15:02:11 17:39:09 0:06:05 17:33:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117599 2014-03-05 21:23:47 2014-03-05 21:23:47 2014-03-06 15:02:11 17:38:24 1:04:55 16:33:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 117600 2014-03-05 21:24:32 2014-03-05 21:24:32 2014-03-06 15:06:16 17:41:44 0:27:57 17:13:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

pass 117601 2014-03-05 21:24:49 2014-03-05 21:24:49 2014-03-06 15:06:15 17:41:26 0:36:01 17:05:25 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117602 2014-03-05 21:25:40 2014-03-05 21:25:40 2014-03-06 15:06:14 17:40:34 0:28:42 17:11:52 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 117603 2014-03-05 21:26:03 2014-03-05 21:26:03 2014-03-06 15:06:14 17:40:11 1:02:29 16:37:42 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117604 2014-03-05 21:26:24 2014-03-05 21:26:24 2014-03-06 15:06:18 17:39:54 1:19:26 16:20:28 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117605 2014-03-05 21:28:23 2014-03-05 21:28:23 2014-03-06 15:06:17 17:37:54 0:15:33 17:22:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117606 2014-03-05 21:30:07 2014-03-05 21:30:07 2014-03-06 15:06:16 17:36:09 0:59:15 16:36:54 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on 10.214.133.31 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 0'

fail 117607 2014-03-05 21:32:27 2014-03-05 21:32:27 2014-03-06 15:06:16 17:33:49 0:15:59 17:17:50 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.16 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117608 2014-03-05 21:32:53 2014-03-05 21:32:53 2014-03-06 15:06:13 17:33:20 0:39:10 16:54:10 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117609 2014-03-05 21:33:08 2014-03-05 21:33:08 2014-03-06 15:06:12 17:33:04 0:35:33 16:57:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117610 2014-03-05 21:35:53 2014-03-05 21:35:53 2014-03-06 15:04:45 17:28:52 0:17:29 17:11:23 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117611 2014-03-05 21:36:33 2014-03-05 21:36:33 2014-03-06 15:04:46 17:28:13 0:44:19 16:43:54 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117612 2014-03-05 21:36:39 2014-03-05 21:36:39 2014-03-06 15:04:47 17:28:08 0:05:17 17:22:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117613 2014-03-05 21:36:43 2014-03-05 21:36:43 2014-03-06 15:04:48 17:28:05 0:25:23 17:02:42 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
fail 117614 2014-03-05 21:38:44 2014-03-05 21:38:44 2014-03-06 15:04:43 17:25:59 0:26:32 16:59:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

pass 117615 2014-03-05 21:44:13 2014-03-05 21:44:13 2014-03-06 15:04:43 17:20:30 0:36:47 16:43:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117616 2014-03-05 21:45:19 2014-03-05 21:45:19 2014-03-06 15:04:44 17:19:25 0:27:53 16:51:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 117617 2014-03-05 21:48:44 2014-03-05 21:48:44 2014-03-06 15:04:45 17:16:01 1:07:12 16:08:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
pass 117618 2014-03-05 21:50:37 2014-03-05 21:50:37 2014-03-06 15:04:42 17:14:05 1:05:34 16:08:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
fail 117619 2014-03-05 21:51:50 2014-03-05 21:51:50 2014-03-06 15:04:43 17:12:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117620 2014-03-05 21:52:07 2014-03-05 21:52:07 2014-03-06 15:03:11 17:11:04 0:51:19 16:19:45 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

fail 117621 2014-03-05 21:54:08 2014-03-05 21:54:08 2014-03-06 15:03:11 17:09:03 0:17:02 16:52:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.30 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117622 2014-03-05 21:54:59 2014-03-05 21:54:59 2014-03-06 15:03:13 17:08:14 1:00:16 16:07:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
pass 117623 2014-03-05 21:55:59 2014-03-05 21:55:59 2014-03-06 15:03:12 17:07:13 0:37:08 16:30:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117624 2014-03-05 21:56:27 2014-03-05 21:56:27 2014-03-06 15:03:15 17:06:48 0:15:46 16:51:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117625 2014-03-05 21:58:58 2014-03-05 21:58:58 2014-03-06 15:03:14 17:04:16 0:41:40 16:22:36 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117626 2014-03-05 21:59:32 2014-03-05 21:59:32 2014-03-06 15:03:16 17:03:44 0:05:51 16:57:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117627 2014-03-05 21:59:47 2014-03-05 21:59:47 2014-03-06 15:03:16 17:03:29 0:55:08 16:08:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 117628 2014-03-05 22:03:53 2014-03-05 22:03:53 2014-03-06 15:03:18 16:59:25 0:26:10 16:33:15 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 117629 2014-03-05 22:04:19 2014-03-05 22:04:19 2014-03-06 15:03:17 16:58:58 0:30:00 16:28:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117630 2014-03-05 22:04:51 2014-03-05 22:04:51 2014-03-06 15:01:31 16:56:40 0:25:24 16:31:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
pass 117631 2014-03-05 22:04:52 2014-03-05 22:04:52 2014-03-06 15:01:31 16:56:39 1:31:50 15:24:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
pass 117632 2014-03-05 22:05:23 2014-03-05 22:05:23 2014-03-06 15:01:30 16:56:07 0:59:18 15:56:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
fail 117633 2014-03-05 22:06:31 2014-03-05 22:06:31 2014-03-06 15:01:30 16:54:59 0:46:06 16:08:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

failed to become clean before timeout expired

fail 117634 2014-03-05 22:06:32 2014-03-05 22:06:32 2014-03-06 15:01:33 16:55:01 1:04:32 15:50:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timeout expired in wait_for_all_up

fail 117635 2014-03-05 22:08:29 2014-03-05 22:08:29 2014-03-06 15:01:34 16:53:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
pass 117636 2014-03-05 22:09:36 2014-03-05 22:09:36 2014-03-06 15:01:32 16:51:56 0:46:54 16:05:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 117637 2014-03-05 22:14:51 2014-03-05 22:14:51 2014-03-06 15:01:32 16:46:41 0:33:08 16:13:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117638 2014-03-05 22:14:52 2014-03-05 22:14:52 2014-03-06 15:01:35 16:46:43 0:16:21 16:30:22 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117639 2014-03-05 22:15:07 2014-03-05 22:15:07 2014-03-06 15:01:35 16:46:28 0:40:01 16:06:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117640 2014-03-05 22:18:22 2014-03-05 22:18:22 2014-03-06 15:05:36 16:47:14 0:06:07 16:41:07 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117641 2014-03-05 22:18:37 2014-03-05 22:18:37 2014-03-06 15:05:36 16:46:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117642 2014-03-05 22:19:32 2014-03-05 22:19:32 2014-03-06 15:05:35 16:46:03 0:31:04 16:14:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117643 2014-03-05 22:25:21 2014-03-05 22:25:21 2014-03-06 15:05:34 16:40:13 0:40:30 15:59:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 117644 2014-03-05 22:25:42 2014-03-05 22:25:42 2014-03-06 15:05:34 16:39:52 0:34:13 16:05:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
fail 117645 2014-03-05 22:26:26 2014-03-05 22:26:26 2014-03-06 15:05:33 16:39:07 0:45:10 15:53:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117646 2014-03-05 22:27:34 2014-03-05 22:27:34 2014-03-06 15:05:33 16:37:59 1:23:00 15:14:59 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
fail 117647 2014-03-05 22:30:29 2014-03-05 22:30:29 2014-03-06 15:05:33 16:35:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117648 2014-03-05 22:31:50 2014-03-05 22:31:50 2014-03-06 15:05:41 16:33:51 0:52:31 15:41:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

fail 117649 2014-03-05 22:33:19 2014-03-05 22:33:19 2014-03-06 15:05:41 16:32:22 6:08:04 10:24:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.14 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117650 2014-03-05 22:37:12 2014-03-05 22:37:12 2014-03-06 15:04:06 16:26:54 0:42:38 15:44:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117651 2014-03-05 22:37:26 2014-03-05 22:37:26 2014-03-06 15:04:06 16:26:40 0:37:56 15:48:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117652 2014-03-05 22:39:05 2014-03-05 22:39:05 2014-03-06 15:04:07 16:25:02 0:16:31 16:08:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117653 2014-03-05 22:42:15 2014-03-05 22:42:15 2014-03-06 15:04:08 16:21:53 0:42:50 15:39:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117654 2014-03-05 22:42:21 2014-03-05 22:42:21 2014-03-06 15:04:09 16:21:48 0:05:12 16:16:36 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117655 2014-03-05 22:42:54 2014-03-05 22:42:54 2014-03-06 15:04:09 16:21:15 0:40:12 15:41:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117656 2014-03-05 22:43:36 2014-03-05 22:43:36 2014-03-06 15:04:09 16:20:33 0:30:11 15:50:22 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117657 2014-03-05 22:44:08 2014-03-05 22:44:08 2014-03-06 15:04:10 16:20:02 0:39:12 15:40:50 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117658 2014-03-05 22:44:17 2014-03-05 22:44:17 2014-03-06 15:04:04 16:19:47 0:30:56 15:48:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 117659 2014-03-05 22:50:28 2014-03-05 22:50:28 2014-03-06 15:04:05 16:13:37 0:56:50 15:16:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

pass 117660 2014-03-05 22:51:23 2014-03-05 22:51:23 2014-03-06 15:02:36 16:11:13 1:14:13 14:57:00 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117661 2014-03-05 22:52:26 2014-03-05 22:52:26 2014-03-06 15:02:36 16:10:10 0:18:30 15:51:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117662 2014-03-05 22:56:54 2014-03-05 22:56:54 2014-03-06 15:02:37 16:05:43 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117663 2014-03-05 22:59:02 2014-03-05 22:59:02 2014-03-06 15:02:37 16:03:35 0:15:33 15:48:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.21 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117664 2014-03-05 22:59:43 2014-03-05 22:59:43 2014-03-06 15:02:33 16:02:50 0:43:00 15:19:50 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117665 2014-03-05 23:00:11 2014-03-05 23:00:11 2014-03-06 15:02:32 16:02:21 0:49:19 15:13:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117666 2014-03-05 23:00:35 2014-03-05 23:00:35 2014-03-06 15:02:35 16:02:00 0:16:30 15:45:30 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117667 2014-03-05 23:01:47 2014-03-05 23:01:47 2014-03-06 15:02:34 16:00:47 0:38:42 15:22:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/ext4.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117668 2014-03-05 23:01:54 2014-03-05 23:01:54 2014-03-06 15:02:31 16:00:37 0:05:31 15:55:06 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117669 2014-03-05 23:02:12 2014-03-05 23:02:12 2014-03-06 15:02:31 16:00:19 0:35:11 15:25:08 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 117670 2014-03-05 23:04:59 2014-03-05 23:04:59 2014-03-06 15:00:45 15:55:46 0:29:59 15:25:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 117671 2014-03-05 23:05:44 2014-03-05 23:05:44 2014-03-06 15:00:46 15:55:02 0:32:48 15:22:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117672 2014-03-05 23:05:58 2014-03-05 23:05:58 2014-03-06 15:00:44 15:54:46 0:27:15 15:27:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 117673 2014-03-05 23:06:27 2014-03-05 23:06:27 2014-03-06 15:00:44 15:54:17 0:56:02 14:58:15 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117674 2014-03-05 23:07:43 2014-03-05 23:07:43 2014-03-06 15:00:42 15:52:59 1:11:35 14:41:24 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
pass 117675 2014-03-05 23:10:35 2014-03-05 23:10:35 2014-03-06 15:00:43 15:50:08 0:14:42 15:35:26 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117676 2014-03-05 23:15:10 2014-03-05 23:15:10 2014-03-06 15:00:41 15:45:31 0:25:45 15:19:46 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 0 --op rmattr 0 --op watch 0 --op append 100 --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op copy_from 50 --pool unique_pool_0'

fail 117677 2014-03-05 23:15:51 2014-03-05 23:15:51 2014-03-06 15:00:42 15:44:51 6:07:50 9:37:01 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.19 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

fail 117678 2014-03-05 23:18:42 2014-03-05 23:18:42 2014-03-06 15:00:40 15:41:58 0:38:51 15:03:07 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117679 2014-03-05 23:26:30 2014-03-05 23:26:30 2014-03-06 15:00:41 15:34:11 0:30:05 15:04:06 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117680 2014-03-05 23:26:58 2014-03-05 23:26:58 2014-03-06 15:04:53 15:37:55 0:14:47 15:23:08 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117681 2014-03-05 23:32:25 2014-03-05 23:32:25 2014-03-06 15:04:53 15:32:28 0:38:23 14:54:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117682 2014-03-05 23:33:01 2014-03-05 23:33:01 2014-03-06 15:04:52 15:31:51 0:06:21 15:25:30 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117683 2014-03-05 23:33:23 2014-03-05 23:33:23 2014-03-06 15:04:51 15:31:28 0:24:07 15:07:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 117684 2014-03-05 23:37:48 2014-03-05 23:37:48 2014-03-06 15:04:56 15:27:08 0:25:33 15:01:35 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 117685 2014-03-05 23:40:45 2014-03-05 23:40:45 2014-03-06 15:04:55 15:24:10 0:30:33 14:53:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117686 2014-03-05 23:42:16 2014-03-05 23:42:16 2014-03-06 15:04:55 15:22:39 0:24:42 14:57:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 117687 2014-03-05 23:44:01 2014-03-05 23:44:01 2014-03-06 15:04:54 15:20:53 0:54:00 14:26:53 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Command failed on 10.214.133.38 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 5'

pass 117688 2014-03-05 23:46:53 2014-03-05 23:46:53 2014-03-06 15:04:58 15:18:05 1:02:52 14:15:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
pass 117689 2014-03-05 23:49:02 2014-03-05 23:49:02 2014-03-06 15:04:58 15:15:56 0:15:05 15:00:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
fail 117690 2014-03-05 23:51:26 2014-03-05 23:51:26 2014-03-06 15:03:23 15:11:57 0:49:11 14:22:46 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

fail 117691 2014-03-05 23:52:05 2014-03-05 23:52:05 2014-03-06 15:03:23 15:11:18 0:10:04 15:01:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.15 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117692 2014-03-05 23:54:02 2014-03-05 23:54:02 2014-03-06 15:03:23 15:09:21 0:39:00 14:30:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 117693 2014-03-05 23:54:43 2014-03-05 23:54:43 2014-03-06 15:03:24 15:08:41 0:27:23 14:41:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117694 2014-03-05 23:56:49 2014-03-05 23:56:49 2014-03-06 15:03:19 15:06:30 0:14:59 14:51:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117695 2014-03-05 23:59:07 2014-03-05 23:59:07 2014-03-06 15:03:20 15:04:13 0:34:01 14:30:12 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117696 2014-03-05 23:59:20 2014-03-05 23:59:20 2014-03-06 15:03:21 15:04:01 0:05:29 14:58:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117697 2014-03-06 00:00:53 2014-03-06 00:00:53 2014-03-06 15:03:22 15:02:29 0:27:37 14:34:52 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117698 2014-03-06 00:03:20 2014-03-06 00:03:20 2014-03-06 15:03:26 15:00:06 0:29:03 14:31:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117699 2014-03-06 00:06:46 2014-03-06 00:06:46 2014-03-06 15:03:29 14:56:43 0:34:27 14:22:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 117700 2014-03-06 00:06:48 2014-03-06 00:06:48 2014-03-06 15:02:23 14:55:35 0:27:41 14:27:54 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 117701 2014-03-06 00:11:43 2014-03-06 00:11:43 2014-03-06 15:04:48 14:53:05 1:03:33 13:49:32 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
fail 117702 2014-03-06 00:13:11 2014-03-06 00:13:11 2014-03-06 15:02:22 14:49:11 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117703 2014-03-06 00:13:30 2014-03-06 00:13:30 2014-03-06 15:02:22 14:48:52 0:16:12 14:32:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117704 2014-03-06 00:17:13 2014-03-06 00:17:13 2014-03-06 15:02:26 14:45:13 0:52:13 13:53:00 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

fail 117705 2014-03-06 00:19:04 2014-03-06 00:19:04 2014-03-06 15:02:28 14:43:24 0:12:33 14:30:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.16 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117706 2014-03-06 00:24:51 2014-03-06 00:24:51 2014-03-06 15:02:24 14:37:33 0:38:30 13:59:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117707 2014-03-06 00:24:56 2014-03-06 00:24:56 2014-03-06 15:02:25 14:37:29 0:35:14 14:02:15 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117708 2014-03-06 00:25:31 2014-03-06 00:25:31 2014-03-06 15:02:28 14:36:57 0:17:39 14:19:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117709 2014-03-06 00:29:00 2014-03-06 00:29:00 2014-03-06 15:02:29 14:33:29 0:39:50 13:53:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117710 2014-03-06 00:29:38 2014-03-06 00:29:38 2014-03-06 15:04:00 14:34:22 0:04:57 14:29:25 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117711 2014-03-06 00:30:43 2014-03-06 00:30:43 2014-03-06 15:03:59 14:33:16 0:29:13 14:04:03 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
pass 117712 2014-03-06 00:33:02 2014-03-06 00:33:02 2014-03-06 15:04:01 14:30:59 0:33:19 13:57:40 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117713 2014-03-06 00:33:59 2014-03-06 00:33:59 2014-03-06 15:04:00 14:30:01 0:40:43 13:49:18 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117714 2014-03-06 00:36:23 2014-03-06 00:36:23 2014-03-06 15:04:02 14:27:39 0:26:48 14:00:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 117715 2014-03-06 00:37:30 2014-03-06 00:37:30 2014-03-06 15:04:02 14:26:32 1:17:06 13:09:26 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117716 2014-03-06 00:38:04 2014-03-06 00:38:04 2014-03-06 15:04:03 14:25:59 1:15:20 13:10:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117717 2014-03-06 00:39:59 2014-03-06 00:39:59 2014-03-06 15:04:02 14:24:03 0:16:32 14:07:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117718 2014-03-06 00:40:27 2014-03-06 00:40:27 2014-03-06 15:04:04 14:23:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117719 2014-03-06 00:41:43 2014-03-06 00:41:43 2014-03-06 15:04:04 14:22:21 0:13:19 14:09:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.133.32 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117720 2014-03-06 00:45:06 2014-03-06 00:45:06 2014-03-06 15:05:39 14:20:33 1:00:49 13:19:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117721 2014-03-06 00:45:15 2014-03-06 00:45:15 2014-03-06 15:05:40 14:20:25 0:33:02 13:47:23 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117722 2014-03-06 00:45:28 2014-03-06 00:45:28 2014-03-06 15:01:19 14:15:51 0:15:28 14:00:23 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117723 2014-03-06 00:45:45 2014-03-06 00:45:45 2014-03-06 15:01:20 14:15:35 0:36:14 13:39:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117724 2014-03-06 00:53:12 2014-03-06 00:53:12 2014-03-06 15:05:37 14:12:25 0:06:18 14:06:07 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117725 2014-03-06 00:53:33 2014-03-06 00:53:33 2014-03-06 15:05:37 14:12:04 0:33:35 13:38:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 117726 2014-03-06 00:55:44 2014-03-06 00:55:44 2014-03-06 15:05:38 14:09:54 0:30:17 13:39:37 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 117727 2014-03-06 00:59:13 2014-03-06 00:59:13 2014-03-06 15:05:38 14:06:25 0:36:11 13:30:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 117728 2014-03-06 01:03:02 2014-03-06 01:03:02 2014-03-06 15:03:31 14:00:29 0:31:25 13:29:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 117729 2014-03-06 01:03:44 2014-03-06 01:03:44 2014-03-06 15:02:18 13:58:34 0:50:23 13:08:11 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 117730 2014-03-06 01:07:23 2014-03-06 01:07:23 2014-03-06 15:05:18 13:57:55 1:13:24 12:44:31 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-readwrite.yaml} 2
pass 117731 2014-03-06 01:08:43 2014-03-06 01:08:43 2014-03-06 15:05:18 13:56:35 0:15:33 13:41:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 117732 2014-03-06 01:08:47 2014-03-06 01:08:47 2014-03-06 15:01:34 13:52:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117733 2014-03-06 01:10:39 2014-03-06 01:10:39 2014-03-06 15:01:34 13:50:55 6:07:59 7:42:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.10 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117734 2014-03-06 01:15:34 2014-03-06 01:15:34 2014-03-06 15:01:39 13:46:05 0:46:09 12:59:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
pass 117735 2014-03-06 01:13:43 2014-03-06 01:13:43 2014-03-06 15:01:38 13:47:55 0:28:06 13:19:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 117736 2014-03-06 01:15:29 2014-03-06 01:15:29 2014-03-06 15:01:38 13:46:09 0:16:30 13:29:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 117737 2014-03-06 01:15:43 2014-03-06 01:15:43 2014-03-06 15:01:37 13:45:54 0:36:41 13:09:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 117738 2014-03-06 01:16:05 2014-03-06 01:16:05 2014-03-06 15:05:09 13:49:04 0:05:16 13:43:48 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117739 2014-03-06 01:19:34 2014-03-06 01:19:34 2014-03-06 15:04:25 13:44:51 0:36:37 13:08:14 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 117740 2014-03-06 01:22:43 2014-03-06 01:22:43 2014-03-06 15:01:44 13:39:01 0:26:03 13:12:58 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 117741 2014-03-06 01:25:32 2014-03-06 01:25:32 2014-03-06 15:01:45 13:36:13 0:34:21 13:01:52 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 117742 2014-03-06 01:25:55 2014-03-06 01:25:55 2014-03-06 15:01:43 13:35:48 0:21:00 13:14:48 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 117743 2014-03-06 01:26:00 2014-03-06 01:26:00 2014-03-06 15:01:43 13:35:43 0:45:26 12:50:17 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 117744 2014-03-06 01:26:09 2014-03-06 01:26:09 2014-03-06 15:01:42 13:35:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-readwrite.yaml} 2
pass 117745 2014-03-06 01:27:53 2014-03-06 01:27:53 2014-03-06 15:01:42 13:33:49 0:17:16 13:16:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
fail 117746 2014-03-06 01:29:14 2014-03-06 01:29:14 2014-03-06 15:01:41 13:32:27 1:18:14 12:14:13 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml} 2
Failure Reason:

failed to become clean before timeout expired

fail 117747 2014-03-06 01:30:08 2014-03-06 01:30:08 2014-03-06 15:01:42 13:31:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
pass 117748 2014-03-06 01:35:32 2014-03-06 01:35:32 2014-03-06 15:01:40 13:26:08 0:38:35 12:47:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 117749 2014-03-06 01:36:05 2014-03-06 01:36:05 2014-03-06 15:01:41 13:25:36 0:37:47 12:47:49 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 117750 2014-03-06 01:38:02 2014-03-06 01:38:02 2014-03-06 15:04:50 13:26:48 0:16:00 13:10:48 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 117751 2014-03-06 01:40:16 2014-03-06 01:40:16 2014-03-06 15:04:49 13:24:33 0:32:04 12:52:29 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 117752 2014-03-06 01:41:20 2014-03-06 01:41:20 2014-03-06 15:03:30 13:22:10 0:06:36 13:15:34 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 117753 2014-03-06 01:41:37 2014-03-06 01:41:37 2014-03-06 15:03:29 13:21:52 0:23:28 12:58:24 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
fail 117754 2014-03-06 01:43:04 2014-03-06 01:43:04 2014-03-06 15:03:25 13:20:21 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 117755 2014-03-06 01:46:49 2014-03-06 01:46:49 2014-03-06 15:03:25 13:16:36 0:36:39 12:39:57 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 117756 2014-03-06 01:47:18 2014-03-06 01:47:18 2014-03-06 15:03:26 13:16:08 0:29:21 12:46:47 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
fail 117757 2014-03-06 01:47:29 2014-03-06 01:47:29 2014-03-06 15:03:25 13:15:56 1:02:01 12:13:55 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 117758 2014-03-06 01:49:19 2014-03-06 01:49:19 2014-03-06 15:04:42 13:15:23 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117759 2014-03-06 01:52:48 2014-03-06 01:52:48 2014-03-06 15:04:41 13:11:53 0:16:08 12:55:45 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117760 2014-03-06 01:54:17 2014-03-06 01:54:17 2014-03-06 15:04:56 13:10:39 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117761 2014-03-06 01:55:54 2014-03-06 01:55:54 2014-03-06 15:04:58 13:09:04 0:13:44 12:55:20 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.131.18 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117762 2014-03-06 01:59:45 2014-03-06 01:59:45 2014-03-06 15:03:02 13:03:17 0:49:39 12:13:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 117763 2014-03-06 02:01:46 2014-03-06 02:01:46 2014-03-06 15:03:03 13:01:17 0:37:08 12:24:09 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 117764 2014-03-06 02:10:59 2014-03-06 02:10:59 2014-03-06 15:04:59 12:54:00 0:15:25 12:38:35 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 117765 2014-03-06 02:14:19 2014-03-06 02:14:19 2014-03-06 15:05:00 12:50:41 0:38:50 12:11:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117766 2014-03-06 02:15:28 2014-03-06 02:15:28 2014-03-06 15:05:01 12:49:33 0:05:28 12:44:05 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 117767 2014-03-06 02:19:58 2014-03-06 02:19:58 2014-03-06 15:05:02 12:45:04 0:35:31 12:09:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on 10.214.132.3 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 4'

fail 117768 2014-03-06 02:21:41 2014-03-06 02:21:41 2014-03-06 15:03:01 12:41:20 0:23:42 12:17:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

pass 117769 2014-03-06 02:21:44 2014-03-06 02:21:44 2014-03-06 15:03:02 12:41:18 0:44:02 11:57:16 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
pass 117770 2014-03-06 02:21:48 2014-03-06 02:21:48 2014-03-06 15:00:37 12:38:49 0:28:05 12:10:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 117771 2014-03-06 02:22:54 2014-03-06 02:22:54 2014-03-06 15:00:37 12:37:43 0:48:05 11:49:38 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 117772 2014-03-06 02:24:11 2014-03-06 02:24:11 2014-03-06 15:00:37 12:36:26 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-readwrite.yaml} 2
pass 117773 2014-03-06 02:25:01 2014-03-06 02:25:01 2014-03-06 15:00:36 12:35:35 0:15:31 12:20:04 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
fail 117774 2014-03-06 02:25:45 2014-03-06 02:25:45 2014-03-06 15:00:36 12:34:51 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml} 2
fail 117775 2014-03-06 02:26:53 2014-03-06 02:26:53 2014-03-06 15:00:35 12:33:42 0:13:58 12:19:44 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on 10.214.132.35 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117776 2014-03-06 02:27:16 2014-03-06 02:27:16 2014-03-06 15:00:35 12:33:19 1:00:23 11:32:56 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
pass 117777 2014-03-06 02:27:32 2014-03-06 02:27:32 2014-03-06 15:00:34 12:33:02 0:32:35 12:00:27 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 117778 2014-03-06 02:27:50 2014-03-06 02:27:50 2014-03-06 15:00:39 12:32:49 0:15:16 12:17:33 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 117779 2014-03-06 02:29:30 2014-03-06 02:29:30 2014-03-06 15:00:38 12:31:08 0:34:06 11:57:02 plana firefly ubuntu rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 117780 2014-03-06 02:36:13 2014-03-06 02:36:13 2014-03-06 15:01:03 12:24:50 0:07:54 12:16:56 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
fail 117781 2014-03-06 02:38:12 2014-03-06 02:38:12 2014-03-06 15:01:04 12:22:52 0:11:35 12:11:17 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.133.27 with status 1: 'cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --tool=memcheck ceph-osd -f -i 3'

fail 117782 2014-03-06 02:40:04 2014-03-06 02:40:04 2014-03-06 15:01:02 12:20:58 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
fail 117783 2014-03-06 02:40:33 2014-03-06 02:40:33 2014-03-06 15:01:02 12:20:29 0:18:47 12:01:42 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.132.37 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117784 2014-03-06 02:45:29 2014-03-06 02:45:29 2014-03-06 15:01:05 12:15:36 0:07:10 12:08:26 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 117785 2014-03-06 02:50:18 2014-03-06 02:50:18 2014-03-06 15:01:06 12:10:48 0:10:26 12:00:22 plana firefly ubuntu rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.131.12 with status 1: 'cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --tool=memcheck ceph-osd -f -i 3'

pass 117786 2014-03-06 02:52:11 2014-03-06 02:52:11 2014-03-06 15:01:04 12:08:53 0:07:22 12:01:31 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
fail 117787 2014-03-06 02:54:40 2014-03-06 02:54:40 2014-03-06 15:01:05 12:06:25 0:09:33 11:56:52 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.132.14 with status 1: 'cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --tool=memcheck ceph-osd -f -i 4'

fail 117788 2014-03-06 02:55:57 2014-03-06 02:55:57 2014-03-06 15:01:01 12:05:04 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
fail 117789 2014-03-06 02:56:23 2014-03-06 02:56:23 2014-03-06 15:01:02 12:04:39 0:21:35 11:43:04 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.132.39 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fdfece9fd5419eeb1bc65b3ac4987f6e150fd9f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 117790 2014-03-06 02:56:25 2014-03-06 02:56:25 2014-03-06 15:02:46 12:06:21 0:06:20 12:00:01 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 117791 2014-03-05 18:57:07 2014-03-05 18:57:07 2014-03-06 15:02:46 20:05:39 0:08:45 19:56:54 plana firefly ubuntu rados/verify/{1thrash/none.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on 10.214.133.38 with status 1: 'cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --tool=memcheck ceph-osd -f -i 4'