Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 1869454 2017-11-20 15:00:52 2017-11-20 15:01:21 2017-11-20 15:31:20 0:29:59 0:22:57 0:07:02 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869455 2017-11-20 15:00:53 2017-11-20 15:01:21 2017-11-21 03:06:49 12:05:28 smithi master centos rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
fail 1869456 2017-11-20 15:00:53 2017-11-20 15:01:22 2017-11-20 15:37:21 0:35:59 0:23:41 0:12:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869457 2017-11-20 15:00:54 2017-11-20 15:01:21 2017-11-20 16:57:23 1:56:02 1:47:18 0:08:44 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

fail 1869458 2017-11-20 15:00:55 2017-11-20 15:01:51 2017-11-20 15:29:51 0:28:00 0:19:42 0:08:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869459 2017-11-20 15:00:55 2017-11-20 15:03:06 2017-11-20 15:33:06 0:30:00 0:22:51 0:07:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869460 2017-11-20 15:00:56 2017-11-20 15:03:17 2017-11-20 15:45:17 0:42:00 0:22:19 0:19:41 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2017-11-20 15:23:51.520613 mon.a mon.0 172.21.15.91:6789/0 159 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

pass 1869461 2017-11-20 15:00:57 2017-11-20 15:03:18 2017-11-20 15:33:18 0:30:00 0:21:49 0:08:11 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
fail 1869462 2017-11-20 15:00:57 2017-11-20 15:03:21 2017-11-20 15:33:20 0:29:59 0:23:09 0:06:50 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869463 2017-11-20 15:00:58 2017-11-20 15:03:24 2017-11-20 15:15:23 0:11:59 0:10:13 0:01:46 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml settings/optimized.yaml workloads/sample_radosbench.yaml} 1
fail 1869464 2017-11-20 15:00:59 2017-11-20 15:03:24 2017-11-20 17:17:26 2:14:02 2:05:23 0:08:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 1869465 2017-11-20 15:00:59 2017-11-20 15:03:49 2017-11-20 15:45:49 0:42:00 0:19:15 0:22:45 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

pass 1869466 2017-11-20 15:01:00 2017-11-20 15:05:22 2017-11-20 15:53:22 0:48:00 0:14:14 0:33:46 smithi master rados/multimon/{clusters/9.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml} 3
fail 1869467 2017-11-20 15:01:01 2017-11-20 15:05:22 2017-11-20 15:39:22 0:34:00 0:22:27 0:11:33 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869468 2017-11-20 15:01:01 2017-11-20 15:05:24 2017-11-21 03:11:00 12:05:36 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
fail 1869469 2017-11-20 15:01:02 2017-11-20 15:05:56 2017-11-20 15:37:55 0:31:59 0:20:17 0:11:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869470 2017-11-20 15:01:03 2017-11-20 15:07:21 2017-11-20 15:53:21 0:46:00 0:23:42 0:22:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1869471 2017-11-20 15:01:03 2017-11-20 15:07:21 2017-11-20 18:53:27 3:46:06 3:25:00 0:21:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi010 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 1869472 2017-11-20 15:01:04 2017-11-20 15:07:21 2017-11-20 15:45:21 0:38:00 0:20:40 0:17:20 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869473 2017-11-20 15:01:05 2017-11-20 15:08:37 2017-11-20 15:38:36 0:29:59 0:23:15 0:06:44 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
fail 1869474 2017-11-20 15:01:06 2017-11-20 15:09:09 2017-11-20 15:37:09 0:28:00 0:17:35 0:10:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7'

fail 1869475 2017-11-20 15:01:06 2017-11-20 15:09:10 2017-11-20 16:35:12 1:26:02 1:07:13 0:18:49 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.7 restart

pass 1869476 2017-11-20 15:01:07 2017-11-20 15:11:14 2017-11-20 18:25:18 3:14:04 3:09:46 0:04:18 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 1869477 2017-11-20 15:01:08 2017-11-20 15:11:14 2017-11-20 15:39:14 0:28:00 0:20:07 0:07:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869478 2017-11-20 15:01:08 2017-11-20 15:11:14 2017-11-20 15:43:14 0:32:00 0:22:49 0:09:11 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

"2017-11-20 15:22:09.951591 mon.a mon.0 172.21.15.152:6789/0 196 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

dead 1869479 2017-11-20 15:01:09 2017-11-20 15:12:56 2017-11-21 03:19:20 12:06:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
dead 1869480 2017-11-20 15:01:10 2017-11-20 15:13:02 2017-11-21 03:18:35 12:05:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 1869481 2017-11-20 15:01:10 2017-11-20 15:13:10 2017-11-20 15:23:09 0:09:59 0:06:56 0:03:03 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 1869482 2017-11-20 15:01:11 2017-11-20 15:13:15 2017-11-20 15:53:15 0:40:00 0:23:32 0:16:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869483 2017-11-20 15:01:12 2017-11-20 15:13:16 2017-11-20 15:45:16 0:32:00 0:21:56 0:10:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Socket is closed

pass 1869484 2017-11-20 15:01:13 2017-11-20 15:13:21 2017-11-20 15:37:21 0:24:00 0:10:52 0:13:08 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/dashboard.yaml} 2
pass 1869485 2017-11-20 15:01:14 2017-11-20 15:13:24 2017-11-20 15:27:24 0:14:00 0:07:33 0:06:27 smithi master rados/objectstore/alloc-hint.yaml 1
pass 1869486 2017-11-20 15:01:14 2017-11-20 15:14:09 2017-11-20 15:26:09 0:12:00 0:11:18 0:00:42 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
pass 1869487 2017-11-20 15:01:15 2017-11-20 15:15:19 2017-11-20 15:25:18 0:09:59 0:06:21 0:03:38 smithi master rados/rest/mgr-restful.yaml 1
fail 1869488 2017-11-20 15:01:16 2017-11-20 15:15:24 2017-11-20 15:55:24 0:40:00 0:32:36 0:07:24 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi081 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 1869489 2017-11-20 15:01:16 2017-11-20 15:17:15 2017-11-20 15:43:15 0:26:00 0:18:55 0:07:05 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 15:23:54.806591 mon.a mon.0 172.21.15.156:6789/0 98 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 1869490 2017-11-20 15:01:17 2017-11-20 15:17:18 2017-11-20 18:29:22 3:12:04 3:05:38 0:06:26 smithi master rados/standalone/crush.yaml 1
Failure Reason:

Command failed (workunit test crush/crush-classes.sh) on smithi174 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh'

fail 1869491 2017-11-20 15:01:18 2017-11-20 15:18:44 2017-11-20 16:22:45 1:04:01 0:24:50 0:39:11 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869492 2017-11-20 15:01:18 2017-11-20 15:18:47 2017-11-20 17:10:49 1:52:02 1:41:40 0:10:22 smithi master rados/upgrade/luminous-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/luminous.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-mimic.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} thrashosds-health.yaml} 3
Failure Reason:

failed to recover before timeout expired

pass 1869493 2017-11-20 15:01:19 2017-11-20 15:18:59 2017-11-20 17:55:02 2:36:03 2:30:58 0:05:05 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 1869494 2017-11-20 15:01:20 2017-11-20 15:21:10 2017-11-20 16:07:10 0:46:00 0:21:22 0:24:38 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
dead 1869495 2017-11-20 15:01:20 2017-11-20 15:21:18 2017-11-21 03:27:51 12:06:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
fail 1869496 2017-11-20 15:01:21 2017-11-20 15:21:20 2017-11-20 15:55:20 0:34:00 0:23:14 0:10:46 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869497 2017-11-20 15:01:22 2017-11-20 15:23:18 2017-11-20 15:43:18 0:20:00 0:13:01 0:06:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
dead 1869498 2017-11-20 15:01:23 2017-11-20 15:23:18 2017-11-21 03:28:48 12:05:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1869499 2017-11-20 15:01:23 2017-11-20 15:23:18 2017-11-20 16:05:18 0:42:00 0:23:21 0:18:39 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869500 2017-11-20 15:01:24 2017-11-20 15:23:18 2017-11-20 15:49:18 0:26:00 0:18:46 0:07:14 smithi master rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 15:29:41.075117 mon.a mon.0 172.21.15.161:6789/0 60 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

dead 1869501 2017-11-20 15:01:25 2017-11-20 15:23:28 2017-11-21 03:30:22 12:06:54 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 1869502 2017-11-20 15:01:25 2017-11-20 15:25:19 2017-11-20 15:55:18 0:29:59 0:20:18 0:09:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
fail 1869503 2017-11-20 15:01:26 2017-11-20 15:25:19 2017-11-20 16:57:21 1:32:02 1:18:53 0:13:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

fail 1869504 2017-11-20 15:01:27 2017-11-20 15:26:10 2017-11-20 16:14:10 0:48:00 0:23:19 0:24:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869505 2017-11-20 15:01:27 2017-11-20 15:27:29 2017-11-20 16:01:28 0:33:59 0:23:29 0:10:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869506 2017-11-20 15:01:28 2017-11-20 15:27:28 2017-11-20 15:55:28 0:28:00 0:20:25 0:07:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869507 2017-11-20 15:01:29 2017-11-20 15:29:22 2017-11-20 16:11:22 0:42:00 0:25:57 0:16:03 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
fail 1869508 2017-11-20 15:01:29 2017-11-20 15:29:52 2017-11-20 16:09:52 0:40:00 0:23:02 0:16:58 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_striper.yaml} 2
Failure Reason:

"2017-11-20 15:45:40.235818 mon.a mon.0 172.21.15.1:6789/0 205 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

pass 1869509 2017-11-20 15:01:30 2017-11-20 15:31:31 2017-11-20 15:53:30 0:21:59 0:14:24 0:07:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
dead 1869510 2017-11-20 15:01:31 2017-11-20 15:33:16 2017-11-21 03:38:59 12:05:43 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 1869511 2017-11-20 15:01:32 2017-11-20 15:33:16 2017-11-20 16:11:16 0:38:00 0:22:55 0:15:05 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869512 2017-11-20 15:01:32 2017-11-20 15:33:19 2017-11-20 15:53:19 0:20:00 0:13:54 0:06:06 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml settings/optimized.yaml workloads/fio_4K_rand_rw.yaml} 1
fail 1869513 2017-11-20 15:01:33 2017-11-20 15:33:22 2017-11-20 16:13:21 0:39:59 0:22:53 0:17:06 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869514 2017-11-20 15:01:34 2017-11-20 15:34:02 2017-11-20 16:10:01 0:35:59 0:21:20 0:14:39 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi170 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11'

fail 1869515 2017-11-20 15:01:35 2017-11-20 15:35:19 2017-11-20 16:09:19 0:34:00 0:24:05 0:09:55 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869516 2017-11-20 15:01:35 2017-11-20 15:35:20 2017-11-20 16:09:20 0:34:00 0:22:40 0:11:20 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869517 2017-11-20 15:01:36 2017-11-20 15:37:19 2017-11-20 16:09:19 0:32:00 0:20:59 0:11:01 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869518 2017-11-20 15:01:37 2017-11-20 15:37:19 2017-11-20 16:13:19 0:36:00 0:23:08 0:12:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869519 2017-11-20 15:01:37 2017-11-20 15:37:22 2017-11-20 15:49:21 0:11:59 0:10:01 0:01:58 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
fail 1869520 2017-11-20 15:01:38 2017-11-20 15:37:22 2017-11-20 16:05:22 0:28:00 0:19:57 0:08:03 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869521 2017-11-20 15:01:39 2017-11-20 15:37:56 2017-11-21 03:44:26 12:06:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
fail 1869522 2017-11-20 15:01:39 2017-11-20 15:38:49 2017-11-20 16:12:50 0:34:01 0:20:14 0:13:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869523 2017-11-20 15:01:40 2017-11-20 15:39:15 2017-11-20 19:11:20 3:32:05 3:22:53 0:09:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi172 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 1869524 2017-11-20 15:01:41 2017-11-20 15:39:23 2017-11-20 16:25:23 0:46:00 0:40:12 0:05:48 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
fail 1869525 2017-11-20 15:01:42 2017-11-20 15:41:19 2017-11-20 16:23:19 0:42:00 0:22:22 0:19:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869526 2017-11-20 15:01:42 2017-11-20 15:41:19 2017-11-20 15:59:19 0:18:00 0:13:27 0:04:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 1869527 2017-11-20 15:01:43 2017-11-20 15:43:20 2017-11-20 15:57:20 0:14:00 0:11:21 0:02:39 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
dead 1869528 2017-11-20 15:01:44 2017-11-20 15:43:20 2017-11-21 03:50:03 12:06:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 1869529 2017-11-20 15:01:44 2017-11-20 15:43:20 2017-11-20 16:11:20 0:28:00 0:22:16 0:05:44 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869530 2017-11-20 15:01:45 2017-11-20 15:43:20 2017-11-20 16:03:20 0:20:00 0:09:49 0:10:11 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
fail 1869531 2017-11-20 15:01:46 2017-11-20 15:45:27 2017-11-20 16:19:27 0:34:00 0:20:17 0:13:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869532 2017-11-20 15:01:46 2017-11-20 15:45:27 2017-11-20 16:21:27 0:36:00 0:22:07 0:13:53 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

"2017-11-20 15:58:14.763633 mon.b mon.0 172.21.15.132:6789/0 196 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

pass 1869533 2017-11-20 15:01:47 2017-11-20 15:45:27 2017-11-20 16:05:27 0:20:00 0:12:54 0:07:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1869534 2017-11-20 15:01:48 2017-11-20 15:45:50 2017-11-20 16:01:50 0:16:00 0:11:49 0:04:11 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml settings/optimized.yaml workloads/fio_4M_rand_read.yaml} 1
fail 1869535 2017-11-20 15:01:49 2017-11-20 15:47:10 2017-11-20 16:27:11 0:40:01 0:23:07 0:16:54 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869536 2017-11-20 15:01:49 2017-11-20 15:47:28 2017-11-20 17:05:30 1:18:02 1:06:58 0:11:04 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

fail 1869537 2017-11-20 15:01:50 2017-11-20 15:49:19 2017-11-20 16:27:19 0:38:00 0:24:31 0:13:29 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869538 2017-11-20 15:01:51 2017-11-20 15:49:19 2017-11-20 16:23:19 0:34:00 0:21:14 0:12:46 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

"2017-11-20 16:02:37.342693 mon.b mon.0 172.21.15.59:6789/0 55 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

dead 1869539 2017-11-20 15:01:51 2017-11-20 15:49:19 2017-11-21 03:55:14 12:05:55 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
fail 1869540 2017-11-20 15:01:52 2017-11-20 15:49:23 2017-11-20 16:25:23 0:36:00 0:22:15 0:13:45 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
Failure Reason:

"2017-11-20 16:00:40.072261 mon.b mon.0 172.21.15.108:6789/0 204 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 1869541 2017-11-20 15:01:53 2017-11-20 15:51:16 2017-11-20 17:25:17 1:34:01 1:18:13 0:15:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

timeout expired in wait_for_all_osds_up

fail 1869542 2017-11-20 15:01:54 2017-11-20 15:53:08 2017-11-20 16:21:08 0:28:00 0:18:42 0:09:18 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869543 2017-11-20 15:01:54 2017-11-20 15:53:16 2017-11-20 16:27:16 0:34:00 0:20:20 0:13:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869544 2017-11-20 15:01:55 2017-11-20 15:53:20 2017-11-20 16:27:20 0:34:00 0:23:28 0:10:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869545 2017-11-20 15:01:56 2017-11-20 15:53:22 2017-11-20 16:23:22 0:30:00 0:20:45 0:09:15 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869546 2017-11-20 15:01:56 2017-11-20 15:53:23 2017-11-20 16:27:23 0:34:00 0:23:15 0:10:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869547 2017-11-20 15:01:57 2017-11-20 15:53:31 2017-11-20 16:29:31 0:36:00 0:17:35 0:18:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

pass 1869548 2017-11-20 15:01:58 2017-11-20 15:55:29 2017-11-20 16:07:29 0:12:00 0:07:19 0:04:41 smithi master rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml} 1
fail 1869549 2017-11-20 15:01:59 2017-11-20 15:55:29 2017-11-20 16:19:29 0:24:00 0:15:40 0:08:20 smithi master rados/standalone/erasure-code.yaml 1
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-code-plugins.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh'

pass 1869550 2017-11-20 15:01:59 2017-11-20 15:55:30 2017-11-20 16:35:30 0:40:00 0:11:01 0:28:59 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 1869551 2017-11-20 15:02:00 2017-11-20 15:55:30 2017-11-20 17:35:31 1:40:01 1:19:23 0:20:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

dead 1869552 2017-11-20 15:02:01 2017-11-20 15:55:29 2017-11-21 04:02:07 12:06:38 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 1869553 2017-11-20 15:02:01 2017-11-20 15:57:30 2017-11-20 16:17:29 0:19:59 0:12:14 0:07:45 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 1869554 2017-11-20 15:02:02 2017-11-20 15:59:29 2017-11-20 16:07:28 0:07:59 0:05:37 0:02:22 smithi master rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 1869555 2017-11-20 15:02:03 2017-11-20 16:01:40 2017-11-20 16:23:40 0:22:00 0:15:54 0:06:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 1869556 2017-11-20 15:02:03 2017-11-20 16:01:52 2017-11-20 16:33:51 0:31:59 0:20:44 0:11:15 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869557 2017-11-20 15:02:04 2017-11-20 16:03:32 2017-11-20 16:35:32 0:32:00 0:20:52 0:11:08 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869558 2017-11-20 15:02:05 2017-11-20 16:03:32 2017-11-20 16:43:32 0:40:00 0:23:45 0:16:15 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869559 2017-11-20 15:02:06 2017-11-20 16:05:33 2017-11-20 16:31:33 0:26:00 0:13:01 0:12:59 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/failover.yaml} 2
pass 1869560 2017-11-20 15:02:06 2017-11-20 16:05:33 2017-11-20 16:21:33 0:16:00 0:12:14 0:03:46 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml settings/optimized.yaml workloads/fio_4M_rand_rw.yaml} 1
fail 1869561 2017-11-20 15:02:07 2017-11-20 16:05:33 2017-11-20 16:41:33 0:36:00 0:20:38 0:15:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869562 2017-11-20 15:02:08 2017-11-20 16:07:21 2017-11-20 16:41:21 0:34:00 0:23:31 0:10:29 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
Failure Reason:

"2017-11-20 16:19:17.225911 mon.a mon.0 172.21.15.28:6789/0 206 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 1869563 2017-11-20 15:02:08 2017-11-20 16:07:30 2017-11-20 16:43:30 0:36:00 0:25:17 0:10:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869564 2017-11-20 15:02:09 2017-11-20 16:07:30 2017-11-20 16:27:29 0:19:59 0:16:42 0:03:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
fail 1869565 2017-11-20 15:02:10 2017-11-20 16:09:29 2017-11-20 16:37:28 0:27:59 0:22:17 0:05:42 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869566 2017-11-20 15:02:10 2017-11-20 16:09:29 2017-11-20 16:43:28 0:33:59 0:24:11 0:09:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869567 2017-11-20 15:02:11 2017-11-20 16:09:29 2017-11-20 16:41:28 0:31:59 0:28:22 0:03:37 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
fail 1869568 2017-11-20 15:02:12 2017-11-20 16:09:53 2017-11-20 16:41:53 0:32:00 0:23:20 0:08:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869569 2017-11-20 15:02:13 2017-11-20 16:10:03 2017-11-20 16:54:03 0:44:00 0:36:24 0:07:36 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

fail 1869570 2017-11-20 15:02:13 2017-11-20 16:11:26 2017-11-20 16:47:26 0:36:00 0:23:22 0:12:38 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869571 2017-11-20 15:02:14 2017-11-20 16:11:26 2017-11-20 16:21:25 0:09:59 0:09:01 0:00:58 smithi master rados/objectstore/filejournal.yaml 1
pass 1869572 2017-11-20 15:02:15 2017-11-20 16:11:26 2017-11-20 16:29:25 0:17:59 0:10:49 0:07:10 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
fail 1869573 2017-11-20 15:02:15 2017-11-20 16:13:01 2017-11-20 17:27:02 1:14:01 0:58:15 0:15:46 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

failed to recover before timeout expired

fail 1869574 2017-11-20 15:02:16 2017-11-20 16:13:20 2017-11-20 16:53:20 0:40:00 0:23:48 0:16:12 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869575 2017-11-20 15:02:17 2017-11-20 16:13:23 2017-11-20 16:45:23 0:32:00 0:20:51 0:11:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869576 2017-11-20 15:02:18 2017-11-20 16:14:22 2017-11-20 16:48:22 0:34:00 0:26:32 0:07:28 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

fail 1869577 2017-11-20 15:02:18 2017-11-20 16:17:19 2017-11-20 16:53:18 0:35:59 0:23:34 0:12:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869578 2017-11-20 15:02:19 2017-11-20 16:17:31 2017-11-20 16:37:30 0:19:59 0:15:22 0:04:37 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 1869579 2017-11-20 15:02:20 2017-11-20 16:19:41 2017-11-20 16:35:40 0:15:59 0:13:21 0:02:38 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 1869580 2017-11-20 15:02:20 2017-11-20 16:19:41 2017-11-20 16:33:40 0:13:59 0:09:40 0:04:19 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml settings/optimized.yaml workloads/fio_4M_rand_write.yaml} 1
fail 1869581 2017-11-20 15:02:21 2017-11-20 16:21:20 2017-11-20 17:03:21 0:42:01 0:37:40 0:04:21 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 1869582 2017-11-20 15:02:22 2017-11-20 16:21:29 2017-11-20 16:31:28 0:09:59 0:08:13 0:01:46 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
fail 1869583 2017-11-20 15:02:22 2017-11-20 16:21:29 2017-11-20 16:47:29 0:26:00 0:20:20 0:05:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869584 2017-11-20 15:02:23 2017-11-20 16:21:34 2017-11-20 17:05:34 0:44:00 0:37:50 0:06:10 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

fail 1869585 2017-11-20 15:02:24 2017-11-20 16:22:56 2017-11-20 16:54:57 0:32:01 0:23:17 0:08:44 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869586 2017-11-20 15:02:25 2017-11-20 16:23:20 2017-11-20 16:49:20 0:26:00 0:23:48 0:02:12 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 1869587 2017-11-20 15:02:25 2017-11-20 16:23:21 2017-11-20 16:37:20 0:13:59 0:08:19 0:05:40 smithi master rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 1869588 2017-11-20 15:02:26 2017-11-20 16:23:23 2017-11-20 18:17:26 1:54:03 1:43:19 0:10:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 1869589 2017-11-20 15:02:27 2017-11-20 16:23:41 2017-11-21 04:29:38 12:05:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 1869590 2017-11-20 15:02:27 2017-11-20 16:24:12 2017-11-20 16:40:11 0:15:59 0:13:12 0:02:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
fail 1869591 2017-11-20 15:02:28 2017-11-20 16:24:35 2017-11-20 17:18:35 0:54:00 0:45:33 0:08:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 1869592 2017-11-20 15:02:29 2017-11-20 16:25:33 2017-11-20 17:05:33 0:40:00 0:35:16 0:04:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

dead 1869593 2017-11-20 15:02:29 2017-11-20 16:25:33 2017-11-21 04:31:58 12:06:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
fail 1869594 2017-11-20 15:02:30 2017-11-20 16:27:23 2017-11-20 16:57:23 0:30:00 0:20:46 0:09:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869595 2017-11-20 15:02:31 2017-11-20 16:27:23 2017-11-21 04:32:43 12:05:20 smithi master rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 1869596 2017-11-20 15:02:32 2017-11-20 16:27:23 2017-11-20 16:59:23 0:32:00 0:19:57 0:12:03 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869597 2017-11-20 15:02:32 2017-11-20 16:27:23 2017-11-20 20:01:28 3:34:05 3:25:02 0:09:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi154 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 1869598 2017-11-20 15:02:33 2017-11-20 16:27:25 2017-11-20 17:03:25 0:36:00 0:23:09 0:12:51 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869599 2017-11-20 15:02:34 2017-11-20 16:27:31 2017-11-20 16:57:30 0:29:59 0:21:02 0:08:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869600 2017-11-20 15:02:35 2017-11-20 16:27:35 2017-11-20 16:47:34 0:19:59 0:12:17 0:07:42 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 1869601 2017-11-20 15:02:35 2017-11-20 16:29:36 2017-11-20 16:43:35 0:13:59 0:12:08 0:01:51 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml settings/optimized.yaml workloads/radosbench_4K_rand_read.yaml} 1
fail 1869602 2017-11-20 15:02:36 2017-11-20 16:29:36 2017-11-20 17:01:36 0:32:00 0:20:49 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869603 2017-11-20 15:02:37 2017-11-20 16:31:38 2017-11-20 17:07:38 0:36:00 0:23:07 0:12:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869604 2017-11-20 15:02:37 2017-11-20 16:31:38 2017-11-21 04:37:56 12:06:18 smithi master rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
dead 1869605 2017-11-20 15:02:38 2017-11-20 16:33:49 2017-11-21 04:40:11 12:06:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
fail 1869606 2017-11-20 15:02:39 2017-11-20 16:37:32 2017-11-20 17:13:32 0:36:00 0:30:05 0:05:55 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.7 restart

pass 1869607 2017-11-20 15:02:40 2017-11-20 16:40:21 2017-11-20 16:54:20 0:13:59 0:12:22 0:01:37 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/readwrite.yaml} 2
pass 1869608 2017-11-20 15:02:40 2017-11-20 16:41:30 2017-11-20 16:55:30 0:14:00 0:11:27 0:02:33 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3
pass 1869609 2017-11-20 15:02:41 2017-11-20 16:41:30 2017-11-20 20:33:37 3:52:07 3:51:21 0:00:46 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 1869610 2017-11-20 15:02:42 2017-11-20 16:41:34 2017-11-20 16:55:34 0:14:00 0:11:13 0:02:47 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
fail 1869611 2017-11-20 15:02:42 2017-11-20 16:41:54 2017-11-20 16:57:54 0:16:00 0:09:29 0:06:31 smithi master rados/standalone/misc.yaml 1
Failure Reason:

Command failed (workunit test misc/rados-striper.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh'

fail 1869612 2017-11-20 15:02:43 2017-11-20 16:43:38 2017-11-20 18:31:40 1:48:02 1:42:38 0:05:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

dead 1869613 2017-11-20 15:02:44 2017-11-20 16:43:38 2017-11-21 04:50:08 12:06:30 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
fail 1869614 2017-11-20 15:02:45 2017-11-20 16:43:38 2017-11-20 17:41:39 0:58:01 0:39:53 0:18:08 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml supported/centos_latest.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

dead 1869615 2017-11-20 15:02:45 2017-11-20 16:43:38 2017-11-21 04:49:06 12:05:28 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
fail 1869616 2017-11-20 15:02:46 2017-11-20 16:45:13 2017-11-20 17:15:13 0:30:00 0:22:10 0:07:50 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869617 2017-11-20 15:02:47 2017-11-20 16:45:24 2017-11-20 23:55:34 7:10:10 6:34:06 0:36:04 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi067 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 1869618 2017-11-20 15:02:48 2017-11-20 16:47:39 2017-11-20 17:23:38 0:35:59 0:20:49 0:15:10 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869619 2017-11-20 15:02:48 2017-11-20 16:47:38 2017-11-20 17:23:38 0:36:00 0:20:08 0:15:52 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869620 2017-11-20 15:02:49 2017-11-20 16:47:39 2017-11-20 17:15:38 0:27:59 0:20:36 0:07:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869621 2017-11-20 15:02:50 2017-11-20 16:48:23 2017-11-20 17:26:23 0:38:00 0:25:18 0:12:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869622 2017-11-20 15:02:51 2017-11-20 16:48:57 2017-11-20 17:00:56 0:11:59 0:09:55 0:02:04 smithi master rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 1869623 2017-11-20 15:02:51 2017-11-20 16:49:21 2017-11-20 17:57:21 1:08:00 1:01:41 0:06:19 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 1869624 2017-11-20 15:02:52 2017-11-20 16:49:21 2017-11-20 17:23:21 0:34:00 0:20:43 0:13:17 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869625 2017-11-20 15:02:53 2017-11-20 16:53:14 2017-11-20 20:49:20 3:56:06 3:50:26 0:05:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

pass 1869626 2017-11-20 15:02:54 2017-11-20 16:53:19 2017-11-20 17:13:19 0:20:00 0:17:47 0:02:13 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
fail 1869627 2017-11-20 15:02:54 2017-11-20 16:53:21 2017-11-20 18:29:22 1:36:01 1:29:33 0:06:28 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 1869628 2017-11-20 15:02:55 2017-11-20 16:54:05 2017-11-20 17:14:04 0:19:59 0:14:30 0:05:29 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore.yaml tasks/module_selftest.yaml} 2
pass 1869629 2017-11-20 15:02:56 2017-11-20 16:54:30 2017-11-20 17:06:29 0:11:59 0:11:11 0:00:48 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml settings/optimized.yaml workloads/radosbench_4K_seq_read.yaml} 1
fail 1869630 2017-11-20 15:02:56 2017-11-20 16:54:58 2017-11-20 17:24:58 0:30:00 0:23:44 0:06:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869631 2017-11-20 15:02:57 2017-11-20 16:55:40 2017-11-20 17:25:40 0:30:00 0:23:23 0:06:37 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 17:07:13.799257 mon.a mon.0 172.21.15.140:6789/0 53 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

pass 1869632 2017-11-20 15:02:58 2017-11-20 16:55:40 2017-11-20 17:19:40 0:24:00 0:16:41 0:07:19 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 1869633 2017-11-20 15:02:59 2017-11-20 16:57:08 2017-11-20 17:49:08 0:52:00 0:14:59 0:37:01 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

timed out waiting for admin_socket to appear after osd.10 restart

fail 1869634 2017-11-20 15:02:59 2017-11-20 16:57:22 2017-11-20 17:27:22 0:30:00 0:23:04 0:06:56 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869635 2017-11-20 15:03:00 2017-11-20 16:57:24 2017-11-20 17:21:23 0:23:59 0:22:52 0:01:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
fail 1869636 2017-11-20 15:03:01 2017-11-20 16:57:24 2017-11-20 17:35:24 0:38:00 0:23:06 0:14:54 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869637 2017-11-20 15:03:02 2017-11-20 16:57:32 2017-11-21 05:04:12 12:06:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
fail 1869638 2017-11-20 15:03:02 2017-11-20 16:57:55 2017-11-20 17:33:55 0:36:00 0:20:13 0:15:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869639 2017-11-20 15:03:03 2017-11-20 16:59:35 2017-11-20 17:31:35 0:32:00 0:20:56 0:11:04 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.6 restart

dead 1869640 2017-11-20 15:03:04 2017-11-20 16:59:35 2017-11-21 05:04:33 12:04:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
fail 1869641 2017-11-20 15:03:05 2017-11-20 17:01:06 2017-11-20 17:29:06 0:28:00 0:19:52 0:08:08 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

pass 1869642 2017-11-20 15:03:05 2017-11-20 17:01:37 2017-11-20 17:11:36 0:09:59 0:07:53 0:02:06 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 1869643 2017-11-20 15:03:06 2017-11-20 17:03:30 2017-11-20 17:33:30 0:30:00 0:20:53 0:09:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869644 2017-11-20 15:03:07 2017-11-20 17:03:30 2017-11-20 17:33:30 0:30:00 0:22:17 0:07:43 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 17:13:21.752184 mon.a mon.0 172.21.15.143:6789/0 84 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 1869645 2017-11-20 15:03:07 2017-11-20 17:05:39 2017-11-20 17:29:38 0:23:59 0:20:16 0:03:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
fail 1869646 2017-11-20 15:03:08 2017-11-20 17:05:39 2017-11-20 17:39:39 0:34:00 0:20:19 0:13:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi007 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5'

pass 1869647 2017-11-20 15:03:09 2017-11-20 17:05:39 2017-11-20 17:27:38 0:21:59 0:11:00 0:10:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
fail 1869648 2017-11-20 15:03:09 2017-11-20 17:05:39 2017-11-20 17:45:39 0:40:00 0:24:06 0:15:54 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869649 2017-11-20 15:03:10 2017-11-20 17:06:30 2017-11-20 17:18:30 0:12:00 0:10:22 0:01:38 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml settings/optimized.yaml workloads/radosbench_4M_rand_read.yaml} 1
fail 1869650 2017-11-20 15:03:11 2017-11-20 17:07:05 2017-11-20 17:43:05 0:36:00 0:22:59 0:13:01 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869651 2017-11-20 15:03:12 2017-11-20 17:07:39 2017-11-20 17:35:39 0:28:00 0:19:41 0:08:19 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869652 2017-11-20 15:03:12 2017-11-20 17:11:45 2017-11-20 17:39:44 0:27:59 0:20:27 0:07:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869653 2017-11-20 15:03:13 2017-11-20 17:13:28 2017-11-20 20:53:35 3:40:07 3:38:50 0:01:17 smithi master rados/objectstore/filestore-idempotent.yaml 1
fail 1869654 2017-11-20 15:03:14 2017-11-20 17:13:33 2017-11-20 17:37:33 0:24:00 0:17:45 0:06:15 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

fail 1869655 2017-11-20 15:03:14 2017-11-20 17:13:42 2017-11-20 17:43:42 0:30:00 0:20:30 0:09:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869656 2017-11-20 15:03:15 2017-11-20 17:14:05 2017-11-20 17:42:05 0:28:00 0:19:51 0:08:09 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869657 2017-11-20 15:03:16 2017-11-20 17:15:22 2017-11-21 05:22:13 12:06:51 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 1869658 2017-11-20 15:03:16 2017-11-20 17:15:39 2017-11-20 17:37:39 0:22:00 0:16:29 0:05:31 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1869659 2017-11-20 15:03:17 2017-11-20 17:17:31 2017-11-20 17:37:30 0:19:59 0:12:21 0:07:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 1869660 2017-11-20 15:03:18 2017-11-20 17:17:31 2017-11-20 18:17:31 1:00:00 0:54:28 0:05:32 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 1869661 2017-11-20 15:03:18 2017-11-20 17:17:33 2017-11-20 17:37:33 0:20:00 0:18:30 0:01:30 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rgw_snaps.yaml} 2
fail 1869662 2017-11-20 15:03:19 2017-11-20 17:18:41 2017-11-20 18:16:42 0:58:01 0:51:09 0:06:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 1869663 2017-11-20 15:03:20 2017-11-20 17:18:41 2017-11-20 17:52:41 0:34:00 0:20:34 0:13:26 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869664 2017-11-20 15:03:21 2017-11-20 17:19:41 2017-11-20 17:47:40 0:27:59 0:20:18 0:07:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869665 2017-11-20 15:03:21 2017-11-20 17:21:36 2017-11-20 17:41:35 0:19:59 0:15:37 0:04:22 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
dead 1869666 2017-11-20 15:03:22 2017-11-20 17:23:30 2017-11-21 05:30:04 12:06:34 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
fail 1869667 2017-11-20 15:03:23 2017-11-20 17:23:39 2017-11-20 17:57:39 0:34:00 0:24:28 0:09:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869668 2017-11-20 15:03:23 2017-11-20 17:23:40 2017-11-20 17:55:40 0:32:00 0:20:30 0:11:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869669 2017-11-20 15:03:24 2017-11-20 17:25:07 2017-11-20 17:57:07 0:32:00 0:23:22 0:08:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869670 2017-11-20 15:03:25 2017-11-20 17:25:18 2017-11-20 18:01:18 0:36:00 0:22:40 0:13:20 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

pass 1869671 2017-11-20 15:03:25 2017-11-20 17:25:41 2017-11-20 17:37:40 0:11:59 0:10:20 0:01:39 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml settings/optimized.yaml workloads/radosbench_4M_seq_read.yaml} 1
fail 1869672 2017-11-20 15:03:26 2017-11-20 17:26:32 2017-11-20 18:04:32 0:38:00 0:33:35 0:04:25 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi097 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 1869673 2017-11-20 15:03:27 2017-11-20 17:27:03 2017-11-20 18:01:05 0:34:02 0:29:56 0:04:06 smithi master rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test rados/test_health_warnings.sh) on smithi044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh'

fail 1869674 2017-11-20 15:03:27 2017-11-20 17:27:23 2017-11-20 17:49:22 0:21:59 0:14:45 0:07:14 smithi master rados/standalone/mon.yaml 1
Failure Reason:

Command failed (workunit test mon/osd-pool-df.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh'

pass 1869675 2017-11-20 15:03:28 2017-11-20 17:27:49 2017-11-20 17:49:49 0:22:00 0:11:21 0:10:39 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 1869676 2017-11-20 15:03:29 2017-11-20 17:29:17 2017-11-20 18:13:17 0:44:00 0:39:01 0:04:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

fail 1869677 2017-11-20 15:03:30 2017-11-20 17:29:40 2017-11-20 17:59:39 0:29:59 0:22:37 0:07:22 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869678 2017-11-20 15:03:30 2017-11-20 17:31:36 2017-11-20 17:57:36 0:26:00 0:20:32 0:05:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869679 2017-11-20 15:03:31 2017-11-20 17:33:25 2017-11-20 18:15:25 0:42:00 0:37:11 0:04:49 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

pass 1869680 2017-11-20 15:03:32 2017-11-20 17:33:31 2017-11-20 17:51:31 0:18:00 0:14:53 0:03:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 1869681 2017-11-20 15:03:32 2017-11-20 17:33:31 2017-11-20 17:53:31 0:20:00 0:16:35 0:03:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 1869682 2017-11-20 15:03:33 2017-11-20 17:33:56 2017-11-20 18:05:56 0:32:00 0:23:55 0:08:05 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 1869683 2017-11-20 15:03:34 2017-11-20 17:35:34 2017-11-20 18:07:34 0:32:00 0:24:15 0:07:45 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml} 2
Failure Reason:

"2017-11-20 17:48:24.418280 mon.a mon.0 172.21.15.28:6789/0 68 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 1869684 2017-11-20 15:03:34 2017-11-20 17:35:35 2017-11-20 18:07:34 0:31:59 0:24:00 0:07:59 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869685 2017-11-20 15:03:35 2017-11-20 17:35:41 2017-11-20 17:49:41 0:14:00 0:11:57 0:02:03 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 1869686 2017-11-20 15:03:36 2017-11-20 17:37:42 2017-11-20 18:25:41 0:47:59 0:38:01 0:09:58 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

fail 1869687 2017-11-20 15:03:37 2017-11-20 17:37:42 2017-11-20 18:11:42 0:34:00 0:26:16 0:07:44 smithi master rados/singleton/{all/peer.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

dead 1869688 2017-11-20 15:03:37 2017-11-20 17:37:42 2017-11-21 05:44:27 12:06:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
dead 1869689 2017-11-20 15:03:38 2017-11-20 17:37:42 2017-11-21 05:44:02 12:06:20 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 1869690 2017-11-20 15:03:39 2017-11-20 17:37:42 2017-11-20 18:17:42 0:40:00 0:23:26 0:16:34 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869691 2017-11-20 15:03:40 2017-11-20 17:39:49 2017-11-20 17:51:48 0:11:59 0:10:32 0:01:27 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/scrub_test.yaml} 2
fail 1869692 2017-11-20 15:03:40 2017-11-20 17:39:49 2017-11-20 18:21:49 0:42:00 0:24:37 0:17:23 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869693 2017-11-20 15:03:41 2017-11-20 17:41:45 2017-11-20 18:09:44 0:27:59 0:17:46 0:10:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi076 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4'

fail 1869694 2017-11-20 15:03:42 2017-11-20 17:41:45 2017-11-20 18:19:45 0:38:00 0:23:29 0:14:31 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869695 2017-11-20 15:03:42 2017-11-20 17:42:06 2017-11-20 17:48:05 0:05:59 0:05:32 0:00:27 smithi master rados/objectstore/fusestore.yaml 1
fail 1869696 2017-11-20 15:03:43 2017-11-20 17:43:15 2017-11-20 18:19:15 0:36:00 0:23:38 0:12:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869697 2017-11-20 15:03:44 2017-11-20 17:43:17 2017-11-20 18:11:17 0:28:00 0:17:53 0:10:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi184 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6'

fail 1869698 2017-11-20 15:03:44 2017-11-20 17:43:43 2017-11-20 18:09:43 0:26:00 0:19:06 0:06:54 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869699 2017-11-20 15:03:45 2017-11-20 17:45:50 2017-11-20 17:59:50 0:14:00 0:09:56 0:04:04 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/workunits.yaml} 2
pass 1869700 2017-11-20 15:03:46 2017-11-20 17:47:43 2017-11-20 17:57:42 0:09:59 0:09:33 0:00:26 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml settings/optimized.yaml workloads/radosbench_4M_write.yaml} 1
pass 1869701 2017-11-20 15:03:47 2017-11-20 17:47:43 2017-11-20 17:59:42 0:11:59 0:10:09 0:01:50 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
fail 1869702 2017-11-20 15:03:47 2017-11-20 17:48:06 2017-11-20 18:16:06 0:28:00 0:20:29 0:07:31 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869703 2017-11-20 15:03:48 2017-11-20 17:49:19 2017-11-20 18:21:18 0:31:59 0:22:55 0:09:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869704 2017-11-20 15:03:49 2017-11-20 17:49:19 2017-11-20 18:01:18 0:11:59 0:09:42 0:02:17 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 1869705 2017-11-20 15:03:49 2017-11-20 17:49:23 2017-11-20 19:09:27 1:20:04 1:12:42 0:07:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

fail 1869706 2017-11-20 15:03:50 2017-11-20 17:49:42 2017-11-20 18:21:42 0:32:00 0:21:07 0:10:53 smithi master rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 18:04:19.074163 mon.a mon.0 172.21.15.143:6789/0 61 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 1869707 2017-11-20 15:03:51 2017-11-20 17:49:50 2017-11-20 18:17:50 0:28:00 0:16:35 0:11:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

pass 1869708 2017-11-20 15:03:52 2017-11-20 23:18:31 2017-11-20 23:38:31 0:20:00 0:13:52 0:06:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 1869709 2017-11-20 15:03:52 2017-11-20 23:20:09 2017-11-20 23:48:09 0:28:00 0:19:40 0:08:20 smithi master rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

"2017-11-20 23:27:48.999903 mon.a mon.0 172.21.15.95:6789/0 94 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1869710 2017-11-20 15:03:53 2017-11-20 23:20:09 2017-11-20 23:50:09 0:30:00 0:20:22 0:09:38 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869711 2017-11-20 15:03:54 2017-11-20 23:20:10 2017-11-20 23:50:09 0:29:59 0:20:30 0:09:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2017-11-20 23:28:40.288352 mon.a mon.0 172.21.15.100:6789/0 13 : cluster [WRN] mon.1 172.21.15.116:6789/0 clock skew 0.801415s > max 0.5s" in cluster log

fail 1869712 2017-11-20 15:03:54 2017-11-20 23:20:10 2017-11-20 23:42:10 0:22:00 0:13:03 0:08:57 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

fail 1869713 2017-11-20 15:03:55 2017-11-20 23:20:11 2017-11-20 23:58:11 0:38:00 0:23:35 0:14:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869714 2017-11-20 15:03:56 2017-11-20 23:22:22 2017-11-21 00:00:22 0:38:00 0:22:43 0:15:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869715 2017-11-20 15:03:57 2017-11-20 23:22:22 2017-11-20 23:46:21 0:23:59 0:20:03 0:03:56 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml} 2
fail 1869716 2017-11-20 15:03:57 2017-11-20 23:22:49 2017-11-21 00:00:49 0:38:00 0:20:20 0:17:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2017-11-20 23:34:11.532906 mon.c mon.2 172.21.15.53:6790/0 2 : cluster [WRN] message from mon.0 was stamped 0.704200s in the future, clocks not synchronized" in cluster log

fail 1869717 2017-11-20 15:03:58 2017-11-20 23:23:50 2017-11-21 00:13:50 0:50:00 0:40:25 0:09:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart

fail 1869718 2017-11-20 15:03:59 2017-11-20 23:23:56 2017-11-20 23:59:56 0:36:00 0:22:49 0:13:11 smithi master rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2017-11-20 23:36:41.094861 mon.a mon.0 172.21.15.23:6789/0 168 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 1869719 2017-11-20 15:03:59 2017-11-20 23:26:04 2017-11-20 23:46:03 0:19:59 0:16:09 0:03:50 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml settings/optimized.yaml workloads/sample_fio.yaml} 1
fail 1869720 2017-11-20 15:04:00 2017-11-20 23:26:04 2017-11-21 00:00:04 0:34:00 0:20:12 0:13:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869721 2017-11-20 15:04:01 2017-11-20 23:26:09 2017-11-21 00:02:09 0:36:00 0:20:44 0:15:16 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869722 2017-11-20 15:04:01 2017-11-20 23:26:10 2017-11-21 00:04:10 0:38:00 0:22:48 0:15:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869723 2017-11-20 15:04:02 2017-11-20 23:26:17 2017-11-20 23:52:17 0:26:00 0:21:48 0:04:12 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1869724 2017-11-20 15:04:03 2017-11-20 23:26:19 2017-11-21 00:00:19 0:34:00 0:22:40 0:11:20 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869725 2017-11-20 15:04:03 2017-11-20 23:26:22 2017-11-21 02:56:28 3:30:06 3:22:10 0:07:56 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi048 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 1869726 2017-11-20 15:04:04 2017-11-20 23:26:27 2017-11-20 23:58:27 0:32:00 0:20:21 0:11:39 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869727 2017-11-20 15:04:05 2017-11-20 23:26:43 2017-11-20 23:58:43 0:32:00 0:19:46 0:12:14 smithi master rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869728 2017-11-20 15:04:06 2017-11-20 23:28:06 2017-11-20 23:54:06 0:26:00 0:15:22 0:10:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

dead 1869729 2017-11-20 15:04:06 2017-11-20 23:28:06 2017-11-21 11:34:40 12:06:34 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 1869730 2017-11-20 15:04:07 2017-11-20 23:28:06 2017-11-20 23:56:06 0:28:00 0:20:17 0:07:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 1869731 2017-11-20 15:04:08 2017-11-20 23:28:07 2017-11-21 00:16:07 0:48:00 0:36:08 0:11:52 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

pass 1869732 2017-11-20 15:04:08 2017-11-20 23:30:25 2017-11-20 23:44:24 0:13:59 0:08:34 0:05:25 smithi master rados/objectstore/keyvaluedb.yaml 1
pass 1869733 2017-11-20 15:04:09 2017-11-20 23:31:33 2017-11-20 23:59:33 0:28:00 0:22:20 0:05:40 smithi master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
fail 1869734 2017-11-20 15:04:10 2017-11-20 23:32:00 2017-11-20 23:46:00 0:14:00 0:07:54 0:06:06 smithi master rados/standalone/osd.yaml 1
Failure Reason:

Command failed (workunit test osd/osd-copy-from.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh'

fail 1869735 2017-11-20 15:04:10 2017-11-20 23:32:05 2017-11-21 00:10:05 0:38:00 0:22:12 0:15:48 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869736 2017-11-20 15:04:11 2017-11-20 23:32:14 2017-11-21 00:06:14 0:34:00 0:20:11 0:13:49 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869737 2017-11-20 15:04:12 2017-11-20 23:32:18 2017-11-21 00:06:18 0:34:00 0:20:00 0:14:00 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869738 2017-11-20 15:04:13 2017-11-20 23:32:25 2017-11-21 00:02:25 0:30:00 0:21:22 0:08:38 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
fail 1869739 2017-11-20 15:04:14 2017-11-20 23:35:55 2017-11-21 00:09:55 0:34:00 0:23:58 0:10:02 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.7 restart

fail 1869740 2017-11-20 15:04:14 2017-11-20 23:36:05 2017-11-21 00:10:05 0:34:00 0:20:39 0:13:21 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869741 2017-11-20 15:04:15 2017-11-20 23:36:09 2017-11-21 00:08:09 0:32:00 0:20:16 0:11:44 smithi master rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869742 2017-11-20 15:04:16 2017-11-20 23:36:14 2017-11-21 00:06:14 0:30:00 0:22:13 0:07:47 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml} 2
Failure Reason:

"2017-11-20 23:45:15.090792 mon.a mon.0 172.21.15.59:6789/0 200 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 1869743 2017-11-20 15:04:16 2017-11-20 23:38:19 2017-11-21 00:14:19 0:36:00 0:22:39 0:13:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869744 2017-11-20 15:04:17 2017-11-20 23:38:28 2017-11-20 23:52:28 0:14:00 0:10:21 0:03:39 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml settings/optimized.yaml workloads/sample_radosbench.yaml} 1
fail 1869745 2017-11-20 15:04:18 2017-11-20 23:38:32 2017-11-21 00:10:32 0:32:00 0:20:53 0:11:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869746 2017-11-20 15:04:19 2017-11-20 23:39:28 2017-11-21 00:31:28 0:52:00 0:23:53 0:28:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869747 2017-11-20 15:04:19 2017-11-20 23:39:28 2017-11-21 11:45:10 12:05:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
fail 1869748 2017-11-20 15:04:20 2017-11-20 23:42:19 2017-11-21 00:14:19 0:32:00 0:20:34 0:11:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869749 2017-11-20 15:04:21 2017-11-20 23:42:25 2017-11-21 11:49:11 12:06:46 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1869750 2017-11-20 15:04:21 2017-11-20 23:44:13 2017-11-21 00:20:13 0:36:00 0:25:09 0:10:51 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869751 2017-11-20 15:04:22 2017-11-20 23:44:26 2017-11-21 11:51:31 12:07:05 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 1869752 2017-11-20 15:04:23 2017-11-20 23:46:07 2017-11-21 00:30:07 0:44:00 0:20:11 0:23:49 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869753 2017-11-20 15:04:23 2017-11-20 23:46:07 2017-11-21 00:18:07 0:32:00 0:20:46 0:11:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869754 2017-11-20 15:04:24 2017-11-20 23:46:07 2017-11-21 00:00:07 0:14:00 0:08:38 0:05:22 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
dead 1869755 2017-11-20 15:04:25 2017-11-20 23:46:11 2017-11-21 11:52:50 12:06:39 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
fail 1869756 2017-11-20 15:04:26 2017-11-20 23:46:22 2017-11-21 00:34:23 0:48:01 0:31:56 0:16:05 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.2 restart

pass 1869757 2017-11-20 15:04:26 2017-11-20 23:48:23 2017-11-21 00:02:23 0:14:00 0:12:04 0:01:56 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
fail 1869758 2017-11-20 15:04:27 2017-11-20 23:48:23 2017-11-21 00:18:23 0:30:00 0:21:19 0:08:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869759 2017-11-20 15:04:28 2017-11-20 23:50:21 2017-11-21 11:56:39 12:06:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 1869760 2017-11-20 15:04:28 2017-11-20 23:50:21 2017-11-21 00:24:21 0:34:00 0:24:37 0:09:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
fail 1869761 2017-11-20 15:04:29 2017-11-20 23:52:02 2017-11-21 00:30:01 0:37:59 0:22:58 0:15:01 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869762 2017-11-20 15:04:30 2017-11-20 23:52:18 2017-11-21 11:59:03 12:06:45 smithi master rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
fail 1869763 2017-11-20 15:04:31 2017-11-20 23:52:31 2017-11-21 00:22:30 0:29:59 0:22:54 0:07:05 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869764 2017-11-20 15:04:31 2017-11-20 23:54:21 2017-11-21 00:32:20 0:37:59 0:23:08 0:14:51 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869765 2017-11-20 15:04:32 2017-11-20 23:54:21 2017-11-21 00:06:20 0:11:59 0:07:37 0:04:22 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/dashboard.yaml} 2
pass 1869766 2017-11-20 15:04:33 2017-11-20 23:55:44 2017-11-21 00:11:44 0:16:00 0:11:32 0:04:28 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
fail 1869767 2017-11-20 15:04:33 2017-11-20 23:56:07 2017-11-21 00:26:07 0:30:00 0:20:21 0:09:39 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869768 2017-11-20 15:04:34 2017-11-20 23:58:24 2017-11-21 00:26:23 0:27:59 0:19:49 0:08:10 smithi master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869769 2017-11-20 15:04:35 2017-11-20 23:58:28 2017-11-21 00:36:28 0:38:00 0:31:46 0:06:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.6 restart

fail 1869770 2017-11-20 15:04:36 2017-11-20 23:58:44 2017-11-21 00:30:44 0:32:00 0:20:16 0:11:44 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869771 2017-11-20 15:04:36 2017-11-20 23:59:36 2017-11-21 00:41:36 0:42:00 0:37:19 0:04:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.6 restart

pass 1869772 2017-11-20 15:04:37 2017-11-20 23:59:36 2017-11-21 00:23:35 0:23:59 0:21:18 0:02:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 1869773 2017-11-20 15:04:38 2017-11-20 23:59:57 2017-11-21 00:21:57 0:22:00 0:18:00 0:04:00 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
fail 1869774 2017-11-20 15:04:38 2017-11-21 00:00:05 2017-11-21 01:28:07 1:28:02 1:17:32 0:10:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

fail 1869775 2017-11-20 15:04:39 2017-11-21 00:00:08 2017-11-21 00:30:08 0:30:00 0:20:27 0:09:33 smithi master rados/singleton/{all/rest-api.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869776 2017-11-20 15:04:40 2017-11-21 00:00:21 2017-11-21 00:32:20 0:31:59 0:20:18 0:11:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869777 2017-11-20 15:04:40 2017-11-21 00:00:23 2017-11-21 00:30:23 0:30:00 0:20:14 0:09:46 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869778 2017-11-20 15:04:41 2017-11-21 00:01:02 2017-11-21 00:21:01 0:19:59 0:17:58 0:02:01 smithi master rados/objectstore/objectcacher-stress.yaml 1
fail 1869779 2017-11-20 15:04:42 2017-11-21 00:02:21 2017-11-21 03:36:26 3:34:05 3:25:16 0:08:49 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi036 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 1869780 2017-11-20 15:04:42 2017-11-21 00:02:24 2017-11-21 00:38:24 0:36:00 0:23:16 0:12:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869781 2017-11-20 15:04:43 2017-11-21 00:02:26 2017-11-21 00:56:26 0:54:00 0:45:28 0:08:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1869782 2017-11-20 15:04:44 2017-11-21 00:04:13 2017-11-21 00:18:12 0:13:59 0:12:00 0:01:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 1869783 2017-11-20 15:04:45 2017-11-21 00:04:13 2017-11-21 00:36:13 0:32:00 0:22:24 0:09:36 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869784 2017-11-20 15:04:45 2017-11-21 00:04:24 2017-11-21 00:38:24 0:34:00 0:21:15 0:12:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869785 2017-11-20 15:04:46 2017-11-21 00:06:24 2017-11-21 00:32:24 0:26:00 0:19:59 0:06:01 smithi master rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

"2017-11-21 00:11:35.476031 mon.a mon.0 172.21.15.59:6789/0 82 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 1869786 2017-11-20 15:04:47 2017-11-21 00:06:24 2017-11-21 00:40:24 0:34:00 0:20:37 0:13:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869787 2017-11-20 15:04:48 2017-11-21 00:06:24 2017-11-21 00:28:24 0:22:00 0:15:31 0:06:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 1869788 2017-11-20 15:04:48 2017-11-21 00:06:24 2017-11-21 00:20:23 0:13:59 0:12:04 0:01:55 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml settings/optimized.yaml workloads/fio_4K_rand_rw.yaml} 1
fail 1869789 2017-11-20 15:04:49 2017-11-21 00:08:19 2017-11-21 00:38:19 0:30:00 0:20:49 0:09:11 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869790 2017-11-20 15:04:50 2017-11-21 00:08:19 2017-11-21 00:40:19 0:32:00 0:21:21 0:10:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869791 2017-11-20 15:04:50 2017-11-21 00:10:07 2017-11-21 01:12:07 1:02:00 0:57:37 0:04:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 1869792 2017-11-20 15:04:51 2017-11-21 00:10:07 2017-11-21 00:42:07 0:32:00 0:22:30 0:09:30 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

"2017-11-21 00:20:35.688980 mon.b mon.0 172.21.15.142:6789/0 141 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 1869793 2017-11-20 15:04:52 2017-11-21 00:10:07 2017-11-21 00:40:07 0:30:00 0:20:14 0:09:46 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869794 2017-11-20 15:04:53 2017-11-21 00:10:33 2017-11-21 00:46:33 0:36:00 0:22:53 0:13:07 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml supported/centos_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869795 2017-11-20 15:04:53 2017-11-21 00:11:53 2017-11-21 00:43:53 0:32:00 0:26:37 0:05:23 smithi master rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 2
fail 1869796 2017-11-20 15:04:54 2017-11-21 00:14:00 2017-11-21 00:44:00 0:30:00 0:20:17 0:09:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869797 2017-11-20 15:04:55 2017-11-21 00:14:04 2017-11-21 00:44:04 0:30:00 0:21:54 0:08:06 smithi master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
Failure Reason:

"2017-11-21 00:26:00.754019 mon.a mon.0 172.21.15.31:6789/0 61 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 1869798 2017-11-20 15:04:55 2017-11-21 00:14:18 2017-11-21 00:32:18 0:18:00 0:13:01 0:04:59 smithi master rados/standalone/scrub.yaml 1
Failure Reason:

Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi058 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage2-testing-2017-11-20-0728 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh'

pass 1869799 2017-11-20 15:04:56 2017-11-21 00:14:19 2017-11-21 00:32:19 0:18:00 0:14:08 0:03:52 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 1869800 2017-11-20 15:04:58 2017-11-21 00:14:22 2017-11-21 00:52:22 0:38:00 0:23:16 0:14:44 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869801 2017-11-20 15:05:01 2017-11-21 00:14:22 2017-11-21 00:28:21 0:13:59 0:10:11 0:03:48 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
dead 1869802 2017-11-20 15:05:02 2017-11-21 00:16:15 2017-11-21 12:22:12 12:05:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 1869803 2017-11-20 15:05:02 2017-11-21 00:18:17 2017-11-21 00:50:17 0:32:00 0:21:31 0:10:29 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869804 2017-11-20 15:05:03 2017-11-21 00:18:17 2017-11-21 01:36:18 1:18:01 1:12:31 0:05:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1869805 2017-11-20 15:05:04 2017-11-21 00:18:24 2017-11-21 00:56:24 0:38:00 0:36:32 0:01:28 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
fail 1869806 2017-11-20 15:05:05 2017-11-21 00:20:17 2017-11-21 00:54:17 0:34:00 0:22:56 0:11:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869807 2017-11-20 15:05:05 2017-11-21 00:20:17 2017-11-21 00:48:17 0:28:00 0:21:12 0:06:48 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 1869808 2017-11-20 15:05:06 2017-11-21 00:20:17 2017-11-21 12:25:37 12:05:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 1869809 2017-11-20 15:05:07 2017-11-21 00:20:25 2017-11-21 00:50:24 0:29:59 0:23:04 0:06:55 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869810 2017-11-20 15:05:08 2017-11-21 00:21:03 2017-11-21 00:59:03 0:38:00 0:23:47 0:14:13 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

fail 1869811 2017-11-20 15:05:09 2017-11-21 00:22:10 2017-11-21 00:54:09 0:31:59 0:23:01 0:08:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869812 2017-11-20 15:05:09 2017-11-21 00:22:35 2017-11-21 00:34:33 0:11:58 0:10:35 0:01:23 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml settings/optimized.yaml workloads/fio_4M_rand_read.yaml} 1
fail 1869813 2017-11-20 15:05:10 2017-11-21 00:23:52 2017-11-21 01:17:51 0:53:59 0:44:00 0:09:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.7 restart

fail 1869814 2017-11-20 15:05:11 2017-11-21 00:24:22 2017-11-21 00:52:22 0:28:00 0:20:21 0:07:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869815 2017-11-20 15:05:11 2017-11-21 00:26:20 2017-11-21 00:46:19 0:19:59 0:17:45 0:02:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 1869816 2017-11-20 15:05:12 2017-11-21 00:26:25 2017-11-21 06:24:33 5:58:08 5:51:19 0:06:49 smithi master rados/objectstore/objectstore.yaml 1
pass 1869817 2017-11-20 15:05:13 2017-11-21 00:28:31 2017-11-21 00:50:31 0:22:00 0:20:04 0:01:56 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
fail 1869818 2017-11-20 15:05:13 2017-11-21 00:28:31 2017-11-21 01:36:33 1:08:02 1:04:00 0:04:02 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 1869819 2017-11-20 15:05:14 2017-11-21 00:30:11 2017-11-21 00:40:10 0:09:59 0:08:00 0:01:59 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_striper.yaml} 2
dead 1869820 2017-11-20 15:05:15 2017-11-21 00:30:11 2017-11-21 12:36:40 12:06:29 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 1869821 2017-11-20 15:05:16 2017-11-21 00:30:11 2017-11-21 04:26:18 3:56:07 3:51:33 0:04:34 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

failed to become clean before timeout expired

fail 1869822 2017-11-20 15:05:16 2017-11-21 00:30:24 2017-11-21 01:00:23 0:29:59 0:20:55 0:09:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 1869823 2017-11-20 15:05:17 2017-11-21 00:30:46 2017-11-21 00:58:45 0:27:59 0:20:50 0:07:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 1869824 2017-11-20 15:05:18 2017-11-21 00:31:46 2017-11-21 00:51:45 0:19:59 0:17:44 0:02:15 smithi master rados/multimon/{clusters/9.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3
dead 1869825 2017-11-20 15:05:18 2017-11-21 00:32:20 2017-11-21 12:38:04 12:05:44 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2