Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 1345426 2017-06-30 14:18:17 2017-06-30 14:19:00 2017-06-30 20:25:07 6:06:07 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
fail 1345427 2017-06-30 14:18:17 2017-06-30 14:19:00 2017-06-30 14:55:00 0:36:00 0:18:55 0:17:05 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

"2017-06-30 14:31:13.998070 mon.a mon.0 172.21.15.88:6789/0 59 : cluster [WRN] Manager daemon x is unresponsive. No standby daemons available." in cluster log

fail 1345428 2017-06-30 14:18:18 2017-06-30 14:19:23 2017-06-30 16:53:26 2:34:03 2:04:14 0:29:49 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1345429 2017-06-30 14:18:19 2017-06-30 14:19:37 2017-06-30 14:45:37 0:26:00 0:22:22 0:03:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-snaps.yaml} 2
fail 1345430 2017-06-30 14:18:20 2017-06-30 14:20:02 2017-06-30 14:54:02 0:34:00 0:28:28 0:05:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
Failure Reason:

"2017-06-30 14:29:29.997203 mon.b mon.0 172.21.15.44:6789/0 144 : cluster [WRN] Manager daemon x is unresponsive. No standby daemons available." in cluster log

pass 1345431 2017-06-30 14:18:20 2017-06-30 14:20:49 2017-06-30 14:28:48 0:07:59 0:06:07 0:01:52 smithi master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 1345432 2017-06-30 14:18:21 2017-06-30 14:20:49 2017-06-30 14:54:49 0:34:00 0:26:07 0:07:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

pass 1345433 2017-06-30 14:18:22 2017-06-30 14:20:49 2017-06-30 15:00:49 0:40:00 0:18:20 0:21:40 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
fail 1345434 2017-06-30 14:18:22 2017-06-30 14:20:53 2017-06-30 17:46:57 3:26:04 3:19:43 0:06:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (180) after waiting for 1080 seconds

fail 1345435 2017-06-30 14:18:23 2017-06-30 14:23:26 2017-06-30 14:57:26 0:34:00 0:26:40 0:07:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/small-objects.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 1345436 2017-06-30 14:18:24 2017-06-30 14:23:26 2017-06-30 15:03:26 0:40:00 0:35:40 0:04:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
dead 1345437 2017-06-30 14:18:25 2017-06-30 14:24:19 2017-06-30 20:26:27 6:02:08 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1345438 2017-06-30 14:18:25 2017-06-30 14:26:27 2017-06-30 14:36:26 0:09:59 0:06:35 0:03:24 smithi master ubuntu 14.04 rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml} 1
dead 1345439 2017-06-30 14:18:26 2017-06-30 14:26:51 2017-06-30 20:24:59 5:58:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 1345440 2017-06-30 14:18:27 2017-06-30 14:26:52 2017-06-30 15:10:52 0:44:00 0:08:46 0:35:14 smithi master ubuntu 14.04 rados/thrash-luminous/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/redirect.yaml} 2
pass 1345441 2017-06-30 14:18:27 2017-06-30 14:26:52 2017-06-30 15:02:52 0:36:00 0:34:42 0:01:18 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
fail 1345442 2017-06-30 14:18:28 2017-06-30 14:26:58 2017-06-30 14:56:57 0:29:59 0:24:42 0:05:17 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/bluestore-comp.yaml rados.yaml scrub_test.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 1345443 2017-06-30 14:18:29 2017-06-30 14:27:26 2017-06-30 14:41:26 0:14:00 0:10:00 0:04:00 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/failover.yaml} 2
Failure Reason:

"2017-06-30 14:36:15.461176 mon.b mon.0 172.21.15.131:6789/0 224 : cluster [WRN] Manager daemon x is unresponsive. No standby daemons available." in cluster log

pass 1345444 2017-06-30 14:18:29 2017-06-30 14:28:19 2017-06-30 14:34:18 0:05:59 0:05:15 0:00:44 smithi master rados/objectstore/alloc-hint.yaml 1
pass 1345445 2017-06-30 14:18:30 2017-06-30 14:28:37 2017-06-30 14:36:36 0:07:59 0:05:49 0:02:10 smithi master rados/rest/mgr-restful.yaml 1
pass 1345446 2017-06-30 14:18:31 2017-06-30 14:28:49 2017-06-30 14:38:49 0:10:00 0:08:10 0:01:50 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
dead 1345447 2017-06-30 14:18:31 2017-06-30 14:28:58 2017-06-30 20:25:05 5:56:07 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 1345448 2017-06-30 14:18:32 2017-06-30 14:28:58 2017-06-30 15:12:58 0:44:00 0:31:49 0:12:11 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi147 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

dead 1345449 2017-06-30 14:18:33 2017-06-30 14:29:00 2017-06-30 20:25:07 5:56:07 smithi master rados/upgrade/jewel-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-luminous.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml}} 3
pass 1345450 2017-06-30 14:18:33 2017-06-30 14:29:04 2017-06-30 14:47:03 0:17:59 0:11:45 0:06:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-agent-small.yaml} 2
dead 1345451 2017-06-30 14:18:34 2017-06-30 14:29:07 2017-06-30 20:25:14 5:56:07 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 1345452 2017-06-30 14:18:35 2017-06-30 14:29:08 2017-06-30 14:49:08 0:20:00 0:10:37 0:09:23 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml} 2
pass 1345453 2017-06-30 14:18:35 2017-06-30 14:29:36 2017-06-30 15:01:36 0:32:00 0:30:21 0:01:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
dead 1345454 2017-06-30 14:18:36 2017-06-30 14:31:02 2017-06-30 20:25:09 5:54:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
fail 1345455 2017-06-30 14:18:37 2017-06-30 14:31:02 2017-06-30 14:55:02 0:24:00 0:16:47 0:07:13 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
Failure Reason:

Socket is closed

pass 1345456 2017-06-30 14:18:38 2017-06-30 14:31:02 2017-06-30 14:43:01 0:11:59 0:10:34 0:01:25 smithi master rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 1345457 2017-06-30 14:18:38 2017-06-30 14:32:46 2017-06-30 15:02:46 0:30:00 0:26:21 0:03:39 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 1345458 2017-06-30 14:18:39 2017-06-30 14:34:27 2017-06-30 14:46:26 0:11:59 0:08:44 0:03:15 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
dead 1345459 2017-06-30 14:18:40 2017-06-30 14:34:27 2017-06-30 20:26:35 5:52:08 smithi master ubuntu 14.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-btrfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-radosbench.yaml} 2
fail 1345460 2017-06-30 14:18:40 2017-06-30 14:34:42 2017-06-30 15:46:43 1:12:01 1:06:49 0:05:12 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

dead 1345461 2017-06-30 14:18:41 2017-06-30 14:34:50 2017-06-30 20:24:57 5:50:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
pass 1345462 2017-06-30 14:18:42 2017-06-30 14:34:51 2017-06-30 14:56:51 0:22:00 0:19:12 0:02:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
fail 1345463 2017-06-30 14:18:42 2017-06-30 14:34:54 2017-06-30 17:20:57 2:46:03 1:46:05 0:59:58 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1345464 2017-06-30 14:18:43 2017-06-30 14:35:08 2017-06-30 14:49:07 0:13:59 0:12:06 0:01:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1345465 2017-06-30 14:18:43 2017-06-30 14:35:47 2017-06-30 14:59:46 0:23:59 0:22:02 0:01:57 smithi master rados/singleton/{all/random-eio.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
pass 1345466 2017-06-30 14:18:44 2017-06-30 14:36:27 2017-06-30 15:16:28 0:40:01 0:39:23 0:00:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 1345467 2017-06-30 14:18:45 2017-06-30 14:36:45 2017-06-30 15:10:45 0:34:00 0:28:42 0:05:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1345468 2017-06-30 14:18:46 2017-06-30 14:36:53 2017-06-30 20:24:59 5:48:06 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 1345469 2017-06-30 14:18:46 2017-06-30 14:36:53 2017-06-30 15:10:52 0:33:59 0:32:24 0:01:35 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 1345470 2017-06-30 14:18:47 2017-06-30 14:36:58 2017-06-30 14:50:58 0:14:00 0:11:08 0:02:52 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_python.yaml} 2
pass 1345471 2017-06-30 14:18:48 2017-06-30 14:36:59 2017-06-30 15:16:59 0:40:00 0:37:46 0:02:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-pool-snaps.yaml} 2
fail 1345472 2017-06-30 14:18:49 2017-06-30 14:37:04 2017-06-30 15:33:04 0:56:00 0:51:51 0:04:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1345473 2017-06-30 14:18:49 2017-06-30 14:37:24 2017-06-30 14:55:33 0:18:09 0:16:45 0:01:24 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 1345474 2017-06-30 14:18:50 2017-06-30 14:37:52 2017-06-30 15:09:52 0:32:00 0:11:29 0:20:31 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 1345475 2017-06-30 14:18:51 2017-06-30 14:38:32 2017-06-30 14:48:31 0:09:59 0:09:25 0:00:34 smithi master rados/singleton/{all/rebuild-mondb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
dead 1345476 2017-06-30 14:18:51 2017-06-30 14:38:47 2017-06-30 20:24:55 5:46:08 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/few.yaml objectstore/filestore-btrfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
dead 1345477 2017-06-30 14:18:52 2017-06-30 14:38:48 2017-06-30 20:24:55 5:46:07 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml fast/normal.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/fastread.yaml workloads/ec-small-objects-overwrites.yaml} 2
dead 1345478 2017-06-30 14:18:53 2017-06-30 14:38:47 2017-06-30 20:24:55 5:46:08 smithi master rados/thrash-luminous/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/redirect_set_object.yaml} 2
fail 1345479 2017-06-30 14:18:53 2017-06-30 14:38:50 2017-06-30 16:56:52 2:18:02 2:12:16 0:05:46 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

failed to become clean before timeout expired

pass 1345480 2017-06-30 14:18:54 2017-06-30 14:38:51 2017-06-30 14:46:51 0:08:00 0:05:49 0:02:11 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
dead 1345481 2017-06-30 14:18:55 2017-06-30 14:40:05 2017-06-30 20:26:11 5:46:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
pass 1345482 2017-06-30 14:18:55 2017-06-30 14:40:59 2017-06-30 15:22:59 0:42:00 0:40:07 0:01:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/radosbench.yaml} 2
pass 1345483 2017-06-30 14:18:56 2017-06-30 14:41:00 2017-06-30 15:00:59 0:19:59 0:18:48 0:01:11 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
fail 1345484 2017-06-30 14:18:57 2017-06-30 14:41:43 2017-06-30 16:11:44 1:30:01 0:55:58 0:34:03 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi078 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

fail 1345485 2017-06-30 14:18:57 2017-06-30 14:41:43 2017-06-30 16:27:44 1:46:01 1:41:49 0:04:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Socket is closed

pass 1345486 2017-06-30 14:18:58 2017-06-30 14:41:43 2017-06-30 14:59:42 0:17:59 0:15:58 0:02:01 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
fail 1345487 2017-06-30 14:18:59 2017-06-30 14:41:43 2017-06-30 15:11:43 0:30:00 0:24:12 0:05:48 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2017-06-30 14:58:45.506118 mon.f mon.1 172.21.15.188:6789/0 116 : cluster [WRN] Manager daemon x is unresponsive. No standby daemons available." in cluster log

fail 1345488 2017-06-30 14:19:00 2017-06-30 14:42:59 2017-06-30 15:00:58 0:17:59 0:11:19 0:06:40 smithi master ubuntu 14.04 rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml} 1
fail 1345489 2017-06-30 14:19:00 2017-06-30 14:42:59 2017-06-30 17:03:01 2:20:02 2:15:07 0:04:55 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

reached maximum tries (280) after waiting for 1680 seconds

fail 1345490 2017-06-30 14:19:01 2017-06-30 14:42:59 2017-06-30 15:06:59 0:24:00 0:16:55 0:07:05 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3
Failure Reason:

Command failed on smithi149 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 1345491 2017-06-30 14:19:02 2017-06-30 14:43:03 2017-06-30 15:27:03 0:44:00 0:41:40 0:02:20 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml d-thrash/default.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
dead 1345492 2017-06-30 14:19:02 2017-06-30 14:43:22 2017-06-30 20:25:29 5:42:07 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-agent-big.yaml} 2
pass 1345493 2017-06-30 14:19:03 2017-06-30 14:45:06 2017-06-30 14:57:05 0:11:59 0:10:02 0:01:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
fail 1345494 2017-06-30 14:19:04 2017-06-30 14:45:06 2017-06-30 16:53:13 2:08:07 2:03:54 0:04:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

failed to recover before timeout expired

dead 1345495 2017-06-30 14:19:04 2017-06-30 14:45:38 2017-06-30 20:25:45 5:40:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
fail 1345496 2017-06-30 14:19:05 2017-06-30 14:46:17 2017-06-30 18:02:23 3:16:06 0:37:29 2:38:37 smithi master ubuntu 14.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 1345497 2017-06-30 14:19:06 2017-06-30 14:46:36 2017-06-30 17:42:39 2:56:03 0:34:21 2:21:42 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
dead 1345498 2017-06-30 14:19:07 2017-06-30 14:46:43 2017-06-30 20:26:50 5:40:07 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 1345499 2017-06-30 14:19:07 2017-06-30 14:46:55 2017-06-30 15:00:54 0:13:59 0:11:07 0:02:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache.yaml} 2
dead 1345500 2017-06-30 14:19:08 2017-06-30 14:47:04 2017-06-30 20:25:11 5:38:07 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
dead 1345501 2017-06-30 14:19:09 2017-06-30 14:47:37 2017-06-30 20:25:44 5:38:07 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 1345502 2017-06-30 14:19:09 2017-06-30 14:48:32 2017-06-30 15:00:32 0:12:00 0:07:21 0:04:39 smithi master rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
dead 1345503 2017-06-30 14:19:10 2017-06-30 14:48:34 2017-06-30 20:26:41 5:38:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 1345504 2017-06-30 14:19:10 2017-06-30 14:48:36 2017-06-30 15:10:36 0:22:00 0:21:12 0:00:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
dead 1345505 2017-06-30 14:19:11 2017-06-30 14:48:46 2017-06-30 20:24:54 5:36:08 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 1345506 2017-06-30 14:19:12 2017-06-30 14:48:46 2017-06-30 15:12:46 0:24:00 0:22:07 0:01:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 1345507 2017-06-30 14:19:12 2017-06-30 14:49:10 2017-06-30 15:17:09 0:27:59 0:26:47 0:01:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/snaps-few-objects.yaml} 2
dead 1345508 2017-06-30 14:19:13 2017-06-30 14:49:10 2017-06-30 20:25:16 5:36:06 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1345509 2017-06-30 14:19:14 2017-06-30 14:49:20 2017-06-30 14:55:19 0:05:59 0:04:29 0:01:30 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 1345510 2017-06-30 14:19:15 2017-06-30 14:49:23 2017-06-30 14:57:22 0:07:59 0:06:45 0:01:14 smithi master rados/singleton/{all/rest-api.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
dead 1345511 2017-06-30 14:19:15 2017-06-30 14:50:04 2017-06-30 20:26:11 5:36:07 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
dead 1345512 2017-06-30 14:19:16 2017-06-30 14:50:06 2017-06-30 20:26:12 5:36:06 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/redirect.yaml} 2
pass 1345513 2017-06-30 14:19:17 2017-06-30 14:50:59 2017-06-30 15:06:58 0:15:59 0:14:31 0:01:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
dead 1345514 2017-06-30 14:19:17 2017-06-30 14:51:15 2017-06-30 20:25:22 5:34:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
fail 1345515 2017-06-30 14:19:18 2017-06-30 14:51:15 2017-06-30 15:27:15 0:36:00 0:30:29 0:05:31 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 1345516 2017-06-30 14:19:19 2017-06-30 14:51:23 2017-06-30 14:59:22 0:07:59 0:05:54 0:02:05 smithi master rados/objectstore/filejournal.yaml 1
fail 1345517 2017-06-30 14:19:19 2017-06-30 14:51:26 2017-06-30 16:47:28 1:56:02 0:31:33 1:24:29 smithi master ubuntu 14.04 rados/monthrash/{ceph.yaml clusters/3-mons.yaml d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

failed to reach quorum size 3 before timeout expired

pass 1345518 2017-06-30 14:19:20 2017-06-30 14:54:14 2017-06-30 16:34:15 1:40:01 0:39:36 1:00:25 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
pass 1345519 2017-06-30 14:19:21 2017-06-30 14:54:49 2017-06-30 15:02:49 0:08:00 0:06:06 0:01:54 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_striper.yaml} 2
fail 1345520 2017-06-30 14:19:21 2017-06-30 14:54:50 2017-06-30 18:22:54 3:28:04 3:24:03 0:04:01 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

dead 1345521 2017-06-30 14:19:22 2017-06-30 14:55:01 2017-06-30 20:25:08 5:30:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
pass 1345522 2017-06-30 14:19:22 2017-06-30 14:55:03 2017-06-30 15:13:02 0:17:59 0:11:56 0:06:03 smithi master rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 1345523 2017-06-30 14:19:23 2017-06-30 14:55:28 2017-06-30 15:29:28 0:34:00 0:33:33 0:00:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
dead 1345524 2017-06-30 14:19:24 2017-06-30 14:55:34 2017-06-30 20:25:40 5:30:06 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/rados_api_tests.yaml} 2
fail 1345525 2017-06-30 14:19:24 2017-06-30 14:56:25 2017-06-30 15:30:25 0:34:00 0:25:56 0:08:04 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/bluestore.yaml rados.yaml scrub_test.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 1345526 2017-06-30 14:19:25 2017-06-30 14:57:00 2017-06-30 15:08:59 0:11:59 0:06:51 0:05:08 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore.yaml tasks/failover.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config get mon_pg_warn_min_per_osd'

fail 1345527 2017-06-30 14:19:26 2017-06-30 14:57:00 2017-06-30 15:29:00 0:32:00 0:26:32 0:05:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

dead 1345528 2017-06-30 14:19:27 2017-06-30 14:57:00 2017-06-30 20:25:07 5:28:07 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
dead 1345529 2017-06-30 14:19:28 2017-06-30 14:57:06 2017-06-30 20:25:13 5:28:07 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
pass 1345530 2017-06-30 14:19:28 2017-06-30 14:57:23 2017-06-30 15:23:23 0:26:00 0:21:15 0:04:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
dead 1345531 2017-06-30 14:19:29 2017-06-30 14:57:27 2017-06-30 20:25:34 5:28:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
dead 1345532 2017-06-30 14:19:30 2017-06-30 14:59:32 2017-06-30 20:25:38 5:26:06 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1345533 2017-06-30 14:19:31 2017-06-30 14:59:44 2017-06-30 15:31:44 0:32:00 0:21:34 0:10:26 smithi master ubuntu 14.04 rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml} 2
pass 1345534 2017-06-30 14:19:31 2017-06-30 14:59:47 2017-06-30 15:09:47 0:10:00 0:09:09 0:00:51 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/admin_socket_objecter_requests.yaml} 2
dead 1345535 2017-06-30 14:19:32 2017-06-30 15:00:43 2017-06-30 20:26:49 5:26:06 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
fail 1345536 2017-06-30 14:19:33 2017-06-30 15:00:50 2017-06-30 15:20:50 0:20:00 0:14:25 0:05:35 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

dead 1345537 2017-06-30 14:19:33 2017-06-30 15:00:56 2017-06-30 20:25:02 5:24:06 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
pass 1345538 2017-06-30 14:19:34 2017-06-30 15:00:59 2017-06-30 15:53:00 0:52:01 0:30:32 0:21:29 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 1345539 2017-06-30 14:19:35 2017-06-30 15:01:00 2017-06-30 18:55:05 3:54:05 3:49:12 0:04:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1345540 2017-06-30 14:19:36 2017-06-30 15:01:37 2017-06-30 15:07:36 0:05:59 0:05:37 0:00:22 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
pass 1345541 2017-06-30 14:19:36 2017-06-30 15:02:55 2017-06-30 15:36:55 0:34:00 0:29:57 0:04:03 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
fail 1345542 2017-06-30 14:19:37 2017-06-30 15:02:55 2017-06-30 15:44:55 0:42:00 0:34:28 0:07:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 1345543 2017-06-30 14:19:38 2017-06-30 15:02:55 2017-06-30 15:26:55 0:24:00 0:14:50 0:09:10 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
pass 1345544 2017-06-30 14:19:38 2017-06-30 15:02:55 2017-06-30 15:56:55 0:54:00 0:44:57 0:09:03 smithi master rados/singleton/{all/thrash-rados.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 1345545 2017-06-30 14:19:39 2017-06-30 15:03:27 2017-06-30 15:19:27 0:16:00 0:12:27 0:03:33 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/redirect_set_object.yaml} 2
dead 1345546 2017-06-30 14:19:40 2017-06-30 15:07:08 2017-06-30 20:25:14 5:18:06 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1345547 2017-06-30 14:19:40 2017-06-30 15:07:08 2017-06-30 15:37:08 0:30:00 0:22:43 0:07:17 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi134 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs '--mon_osd_down_out_interval 600'"

fail 1345548 2017-06-30 14:19:41 2017-06-30 15:07:08 2017-06-30 15:45:08 0:38:00 0:30:30 0:07:30 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

pass 1345549 2017-06-30 14:19:42 2017-06-30 15:07:37 2017-06-30 16:55:39 1:48:02 1:44:17 0:03:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
pass 1345550 2017-06-30 14:19:42 2017-06-30 15:09:09 2017-06-30 15:31:08 0:21:59 0:17:47 0:04:12 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml workloads/small-objects.yaml} 2
pass 1345551 2017-06-30 14:19:43 2017-06-30 15:09:47 2017-06-30 19:29:53 4:20:06 4:17:46 0:02:20 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
dead 1345552 2017-06-30 14:19:44 2017-06-30 15:09:53 2017-06-30 20:25:59 5:16:06 smithi master ubuntu 14.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-btrfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml}
dead 1345553 2017-06-30 14:19:44 2017-06-30 15:10:48 2017-06-30 20:24:54 5:14:06 smithi master ubuntu 14.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-btrfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml}
fail 1345554 2017-06-30 14:19:45 2017-06-30 15:10:48 2017-06-30 17:42:50 2:32:02 0:51:37 1:40:25 smithi master ubuntu 14.04 rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-btrfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1345555 2017-06-30 14:19:46 2017-06-30 15:10:53 2017-06-30 15:32:53 0:22:00 0:09:25 0:12:35 smithi master ubuntu 14.04 rados/multimon/{clusters/3.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-btrfs.yaml rados.yaml tasks/mon_recovery.yaml} 2