Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 2372897 2018-04-09 04:06:37 2018-04-09 04:07:01 2018-04-09 04:45:01 0:38:00 0:21:44 0:16:16 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2372898 2018-04-09 04:06:37 2018-04-09 04:07:40 2018-04-09 04:27:39 0:19:59 0:12:03 0:07:56 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2372899 2018-04-09 04:06:38 2018-04-09 04:07:51 2018-04-09 04:27:50 0:19:59 0:09:13 0:10:46 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/scrub_test.yaml} 2
pass 2372900 2018-04-09 04:06:39 2018-04-09 04:10:21 2018-04-09 04:44:20 0:33:59 0:23:23 0:10:36 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2372901 2018-04-09 04:06:40 2018-04-09 04:11:54 2018-04-09 04:43:54 0:32:00 0:18:32 0:13:28 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2372902 2018-04-09 04:06:40 2018-04-09 04:11:56 2018-04-09 04:51:57 0:40:01 0:25:52 0:14:09 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 2372903 2018-04-09 04:06:41 2018-04-09 04:11:59 2018-04-09 04:47:59 0:36:00 0:27:59 0:08:01 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml supported/centos_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2372904 2018-04-09 04:06:42 2018-04-09 04:12:01 2018-04-09 04:42:01 0:30:00 0:09:57 0:20:03 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2372905 2018-04-09 04:06:42 2018-04-09 04:12:20 2018-04-09 04:36:20 0:24:00 0:10:20 0:13:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
fail 2372906 2018-04-09 04:06:43 2018-04-09 04:14:18 2018-04-09 04:40:18 0:26:00 0:14:52 0:11:08 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/dashboard.yaml} 2
Failure Reason:

Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest)

fail 2372907 2018-04-09 04:06:44 2018-04-09 04:15:50 2018-04-09 04:33:49 0:17:59 0:06:07 0:11:52 smithi master rados/objectstore/alloc-hint.yaml 1
Failure Reason:

Command failed (workunit test rados/test_alloc_hint.sh) on smithi101 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-04-08-2052 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_alloc_hint.sh'

pass 2372908 2018-04-09 04:06:44 2018-04-09 04:15:53 2018-04-09 04:37:53 0:22:00 0:10:53 0:11:07 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
pass 2372909 2018-04-09 04:06:45 2018-04-09 04:16:11 2018-04-09 04:32:11 0:16:00 0:06:23 0:09:37 smithi master rados/rest/mgr-restful.yaml 1
pass 2372910 2018-04-09 04:06:46 2018-04-09 04:16:18 2018-04-09 04:48:18 0:32:00 0:22:15 0:09:45 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2372911 2018-04-09 04:06:46 2018-04-09 04:19:46 2018-04-09 04:37:46 0:18:00 0:09:10 0:08:50 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
fail 2372912 2018-04-09 04:06:47 2018-04-09 04:20:01 2018-04-09 04:34:01 0:14:00 0:05:24 0:08:36 smithi master rados/standalone/crush.yaml 1
Failure Reason:

Command failed (workunit test crush/crush-classes.sh) on smithi203 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-04-08-2052 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh'

fail 2372913 2018-04-09 04:06:48 2018-04-09 04:20:02 2018-04-09 07:52:06 3:32:04 3:21:29 0:10:35 smithi master rados/upgrade/luminous-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/luminous.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-mimic.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} thrashosds-health.yaml} 3
Failure Reason:

failed to recover before timeout expired

pass 2372914 2018-04-09 04:06:49 2018-04-09 04:21:54 2018-04-09 04:41:53 0:19:59 0:11:17 0:08:42 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2372915 2018-04-09 04:06:49 2018-04-09 04:21:54 2018-04-09 04:53:54 0:32:00 0:20:42 0:11:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 2372916 2018-04-09 04:06:50 2018-04-09 04:21:54 2018-04-09 04:55:54 0:34:00 0:23:49 0:10:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 04:37:00.602018 osd.6 osd.6 172.21.15.182:6812/12831 11 : cluster [WRN] pg 30.6 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2372917 2018-04-09 04:06:51 2018-04-09 04:21:54 2018-04-09 04:43:53 0:21:59 0:11:51 0:10:08 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
pass 2372918 2018-04-09 04:06:51 2018-04-09 04:21:55 2018-04-09 04:55:55 0:34:00 0:23:08 0:10:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2372919 2018-04-09 04:06:52 2018-04-09 04:21:55 2018-04-09 04:53:55 0:32:00 0:19:06 0:12:54 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
pass 2372920 2018-04-09 04:06:53 2018-04-09 04:21:59 2018-04-09 04:43:58 0:21:59 0:10:34 0:11:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 2372921 2018-04-09 04:06:53 2018-04-09 04:24:03 2018-04-09 04:44:04 0:20:01 0:09:29 0:10:32 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2372922 2018-04-09 04:06:54 2018-04-09 04:24:03 2018-04-09 04:50:04 0:26:01 0:11:35 0:14:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
fail 2372923 2018-04-09 04:06:55 2018-04-09 04:24:05 2018-04-09 04:56:05 0:32:00 0:20:07 0:11:53 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 04:40:10.819217 mon.b mon.0 172.21.15.7:6789/0 371 : cluster [WRN] Health check failed: Reduced data availability: 11 pgs inactive, 11 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2372924 2018-04-09 04:06:56 2018-04-09 04:24:12 2018-04-09 04:44:12 0:20:00 0:09:55 0:10:05 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2372925 2018-04-09 04:06:56 2018-04-09 04:25:53 2018-04-09 04:53:53 0:28:00 0:17:05 0:10:55 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 3
fail 2372926 2018-04-09 04:06:57 2018-04-09 04:25:53 2018-04-09 04:45:53 0:20:00 0:08:24 0:11:36 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
Failure Reason:

"2018-04-09 04:41:33.159521 mon.a mon.0 172.21.15.44:6789/0 245 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2372927 2018-04-09 04:06:58 2018-04-09 04:25:53 2018-04-09 04:51:53 0:26:00 0:13:56 0:12:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2372928 2018-04-09 04:06:58 2018-04-09 04:27:45 2018-04-09 04:47:44 0:19:59 0:11:13 0:08:46 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_rw.yaml} 1
pass 2372929 2018-04-09 04:06:59 2018-04-09 04:27:45 2018-04-09 04:43:44 0:15:59 0:06:28 0:09:31 smithi master rados/singleton/{all/peer.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2372930 2018-04-09 04:07:00 2018-04-09 04:27:46 2018-04-09 04:57:46 0:30:00 0:19:14 0:10:46 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 2372931 2018-04-09 04:07:00 2018-04-09 04:27:47 2018-04-09 04:41:46 0:13:59 0:06:16 0:07:43 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
Failure Reason:

"2018-04-09 04:39:19.404813 osd.0 osd.0 172.21.15.196:6801/12373 7 : cluster [WRN] pg 4.0 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2372932 2018-04-09 04:07:01 2018-04-09 04:27:51 2018-04-09 05:01:51 0:34:00 0:23:25 0:10:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2372933 2018-04-09 04:07:02 2018-04-09 04:27:58 2018-04-09 04:51:58 0:24:00 0:14:22 0:09:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2372934 2018-04-09 04:07:02 2018-04-09 04:28:12 2018-04-09 04:44:11 0:15:59 0:05:57 0:10:02 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2372935 2018-04-09 04:07:03 2018-04-09 04:29:52 2018-04-09 04:47:51 0:17:59 0:08:38 0:09:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2372936 2018-04-09 04:07:04 2018-04-09 04:29:57 2018-04-09 05:23:58 0:54:01 0:42:18 0:11:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2372937 2018-04-09 04:07:04 2018-04-09 04:30:12 2018-04-09 04:50:12 0:20:00 0:10:19 0:09:41 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
pass 2372938 2018-04-09 04:07:05 2018-04-09 04:31:43 2018-04-09 04:51:43 0:20:00 0:11:18 0:08:42 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 2372939 2018-04-09 04:07:06 2018-04-09 04:31:45 2018-04-09 05:01:45 0:30:00 0:21:19 0:08:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 2372940 2018-04-09 04:07:07 2018-04-09 04:31:45 2018-04-09 04:51:45 0:20:00 0:08:24 0:11:36 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml} 2
Failure Reason:

"2018-04-09 04:47:56.820541 mon.b mon.0 172.21.15.64:6789/0 252 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log

fail 2372941 2018-04-09 04:07:07 2018-04-09 04:32:12 2018-04-09 04:54:12 0:22:00 0:14:35 0:07:25 smithi master rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-04-09 04:43:29.020425 mon.a mon.0 172.21.15.45:6789/0 122 : cluster [WRN] Health check failed: Reduced data availability: 32 pgs inactive, 32 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2372942 2018-04-09 04:07:08 2018-04-09 04:34:01 2018-04-09 04:52:00 0:17:59 0:08:38 0:09:21 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_read.yaml} 1
pass 2372943 2018-04-09 04:07:09 2018-04-09 04:34:02 2018-04-09 05:06:02 0:32:00 0:22:23 0:09:37 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
pass 2372944 2018-04-09 04:07:09 2018-04-09 04:36:06 2018-04-09 05:08:06 0:32:00 0:22:18 0:09:42 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2372945 2018-04-09 04:07:10 2018-04-09 04:36:06 2018-04-09 04:56:06 0:20:00 0:08:59 0:11:01 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
pass 2372946 2018-04-09 04:07:11 2018-04-09 04:36:06 2018-04-09 05:02:06 0:26:00 0:16:53 0:09:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
fail 2372947 2018-04-09 04:07:11 2018-04-09 04:36:21 2018-04-09 04:54:21 0:18:00 0:06:29 0:11:31 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/failover.yaml} 2
Failure Reason:

Test failure: test_explicit_fail (tasks.mgr.test_failover.TestFailover)

pass 2372948 2018-04-09 04:07:12 2018-04-09 04:37:39 2018-04-09 04:57:39 0:20:00 0:09:56 0:10:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2372949 2018-04-09 04:07:13 2018-04-09 04:37:45 2018-04-09 04:51:45 0:14:00 0:06:03 0:07:57 smithi master rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml} 1
fail 2372950 2018-04-09 04:07:13 2018-04-09 04:37:47 2018-04-09 05:25:47 0:48:00 0:36:11 0:11:49 smithi master rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
Failure Reason:

"2018-04-09 04:53:50.125116 osd.2 osd.2 172.21.15.134:6809/12399 6 : cluster [ERR] 2.1 shard 1: soid 2:8007ad8d:::benchmark_data_smithi115_12935_object2439:head candidate had a read error" in cluster log

pass 2372951 2018-04-09 04:07:14 2018-04-09 04:37:54 2018-04-09 04:59:54 0:22:00 0:08:32 0:13:28 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 2372952 2018-04-09 04:07:15 2018-04-09 04:40:09 2018-04-09 05:16:10 0:36:01 0:23:42 0:12:19 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2372953 2018-04-09 04:07:16 2018-04-09 04:40:09 2018-04-09 05:02:10 0:22:01 0:09:43 0:12:18 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2372954 2018-04-09 04:07:16 2018-04-09 04:40:09 2018-04-09 05:16:10 0:36:01 0:25:34 0:10:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 2372955 2018-04-09 04:07:17 2018-04-09 04:40:19 2018-04-09 05:16:19 0:36:00 0:25:49 0:10:11 smithi master rados/standalone/erasure-code.yaml 1
fail 2372956 2018-04-09 04:07:18 2018-04-09 04:41:56 2018-04-09 05:09:56 0:28:00 0:18:49 0:09:11 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 04:56:44.930818 osd.4 osd.4 172.21.15.196:6800/12554 51 : cluster [WRN] pg 71.2 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2372957 2018-04-09 04:07:18 2018-04-09 04:41:56 2018-04-09 05:35:56 0:54:00 0:44:07 0:09:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
fail 2372958 2018-04-09 04:07:19 2018-04-09 04:42:02 2018-04-09 05:00:01 0:17:59 0:08:30 0:09:29 smithi master rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

"2018-04-09 04:54:21.966335 mon.a mon.0 172.21.15.74:6789/0 78 : cluster [WRN] Health check failed: 15/2762 objects misplaced (0.543%) (OBJECT_MISPLACED)" in cluster log

pass 2372959 2018-04-09 04:07:20 2018-04-09 04:42:11 2018-04-09 05:04:13 0:22:02 0:10:10 0:11:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 2372960 2018-04-09 04:07:21 2018-04-09 04:43:51 2018-04-09 05:01:51 0:18:00 0:09:17 0:08:43 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_rw.yaml} 1
pass 2372961 2018-04-09 04:07:21 2018-04-09 04:43:51 2018-04-09 05:05:51 0:22:00 0:12:19 0:09:41 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
pass 2372962 2018-04-09 04:07:22 2018-04-09 04:43:55 2018-04-09 05:03:54 0:19:59 0:10:11 0:09:48 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2372963 2018-04-09 04:07:23 2018-04-09 04:43:55 2018-04-09 05:09:54 0:25:59 0:13:57 0:12:02 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2372964 2018-04-09 04:07:23 2018-04-09 04:43:55 2018-04-09 05:11:55 0:28:00 0:14:11 0:13:49 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2372965 2018-04-09 04:07:24 2018-04-09 04:43:59 2018-04-09 05:05:59 0:22:00 0:13:07 0:08:53 smithi master rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2372966 2018-04-09 04:07:25 2018-04-09 04:44:05 2018-04-09 04:58:05 0:14:00 0:06:18 0:07:42 smithi master rados/objectstore/filejournal.yaml 1
pass 2372967 2018-04-09 04:07:25 2018-04-09 04:44:12 2018-04-09 05:16:13 0:32:01 0:20:02 0:11:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 2372968 2018-04-09 04:07:26 2018-04-09 04:44:12 2018-04-09 05:22:13 0:38:01 0:24:25 0:13:36 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
pass 2372969 2018-04-09 04:07:27 2018-04-09 04:44:13 2018-04-09 04:58:13 0:14:00 0:04:47 0:09:13 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 2372970 2018-04-09 04:07:28 2018-04-09 04:44:22 2018-04-09 05:18:21 0:33:59 0:21:29 0:12:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2372971 2018-04-09 04:07:28 2018-04-09 04:45:13 2018-04-09 05:09:13 0:24:00 0:12:47 0:11:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2372972 2018-04-09 04:07:29 2018-04-09 04:45:54 2018-04-09 05:03:53 0:17:59 0:09:42 0:08:17 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2372973 2018-04-09 04:07:30 2018-04-09 04:46:27 2018-04-09 05:18:27 0:32:00 0:21:07 0:10:53 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 05:03:28.868955 osd.1 osd.1 172.21.15.23:6804/12265 21 : cluster [WRN] pg 71.0 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2372974 2018-04-09 04:07:30 2018-04-09 04:47:51 2018-04-09 05:05:50 0:17:59 0:07:12 0:10:47 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
pass 2372975 2018-04-09 04:07:31 2018-04-09 04:47:51 2018-04-09 05:05:50 0:17:59 0:08:57 0:09:02 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_write.yaml} 1
pass 2372976 2018-04-09 04:07:32 2018-04-09 04:47:51 2018-04-09 05:21:51 0:34:00 0:23:05 0:10:55 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2372977 2018-04-09 04:07:32 2018-04-09 04:47:53 2018-04-09 05:13:52 0:25:59 0:13:51 0:12:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2372978 2018-04-09 04:07:33 2018-04-09 04:47:58 2018-04-09 05:13:58 0:26:00 0:20:00 0:06:00 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
pass 2372979 2018-04-09 04:07:34 2018-04-09 04:48:00 2018-04-09 05:17:59 0:29:59 0:17:46 0:12:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2372980 2018-04-09 04:07:34 2018-04-09 04:48:00 2018-04-09 05:13:59 0:25:59 0:12:40 0:13:19 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
fail 2372981 2018-04-09 04:07:35 2018-04-09 04:48:13 2018-04-09 05:14:13 0:26:00 0:13:48 0:12:12 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

"2018-04-09 05:05:05.982137 mon.b mon.0 172.21.15.173:6789/0 125 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2372982 2018-04-09 04:07:36 2018-04-09 04:48:19 2018-04-09 05:06:18 0:17:59 0:07:13 0:10:46 smithi master rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
pass 2372983 2018-04-09 04:07:37 2018-04-09 04:50:10 2018-04-09 05:16:10 0:26:00 0:16:30 0:09:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2372984 2018-04-09 04:07:37 2018-04-09 04:50:10 2018-04-09 05:20:10 0:30:00 0:19:53 0:10:07 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2372985 2018-04-09 04:07:38 2018-04-09 04:50:10 2018-04-09 05:20:10 0:30:00 0:19:03 0:10:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2372986 2018-04-09 04:07:39 2018-04-09 04:50:13 2018-04-09 05:22:13 0:32:00 0:20:55 0:11:05 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2372987 2018-04-09 04:07:39 2018-04-09 04:51:30 2018-04-09 05:13:30 0:22:00 0:10:55 0:11:05 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml tasks/module_selftest.yaml} 2
pass 2372988 2018-04-09 04:07:40 2018-04-09 04:51:44 2018-04-09 05:11:43 0:19:59 0:10:17 0:09:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2372989 2018-04-09 04:07:41 2018-04-09 04:51:46 2018-04-09 05:11:45 0:19:59 0:10:13 0:09:46 smithi master rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2372990 2018-04-09 04:07:42 2018-04-09 04:51:46 2018-04-09 05:07:45 0:15:59 0:06:25 0:09:34 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
Failure Reason:

"2018-04-09 05:03:27.859007 mon.a mon.0 172.21.15.195:6789/0 120 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2372991 2018-04-09 04:07:42 2018-04-09 04:51:52 2018-04-09 05:11:51 0:19:59 0:12:13 0:07:46 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_rand_read.yaml} 1
pass 2372992 2018-04-09 04:07:43 2018-04-09 04:51:54 2018-04-09 05:31:54 0:40:00 0:28:53 0:11:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 2372993 2018-04-09 04:07:44 2018-04-09 04:51:59 2018-04-09 05:19:59 0:28:00 0:17:41 0:10:19 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 05:06:49.617489 osd.3 osd.3 172.21.15.145:6801/12716 19 : cluster [WRN] pg 62.0 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2372994 2018-04-09 04:07:44 2018-04-09 04:52:00 2018-04-09 05:27:59 0:35:59 0:25:25 0:10:34 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 2372995 2018-04-09 04:07:45 2018-04-09 04:52:01 2018-04-09 05:24:01 0:32:00 0:24:52 0:07:08 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported/centos_latest.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2372996 2018-04-09 04:07:46 2018-04-09 04:54:01 2018-04-09 05:28:01 0:34:00 0:09:49 0:24:11 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2372997 2018-04-09 04:07:47 2018-04-09 04:54:01 2018-04-09 05:38:01 0:44:00 0:35:30 0:08:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2372998 2018-04-09 04:07:47 2018-04-09 04:54:01 2018-04-09 07:30:04 2:36:03 2:28:32 0:07:31 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 2372999 2018-04-09 04:07:48 2018-04-09 04:54:01 2018-04-09 05:14:00 0:19:59 0:11:55 0:08:04 smithi master rados/standalone/misc.yaml 1
pass 2373000 2018-04-09 04:07:49 2018-04-09 04:54:02 2018-04-09 05:36:02 0:42:00 0:29:06 0:12:54 smithi master rados/singleton/{all/thrash-eio.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 2
pass 2373001 2018-04-09 04:07:49 2018-04-09 04:54:14 2018-04-09 05:14:13 0:19:59 0:10:21 0:09:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 2373002 2018-04-09 04:07:50 2018-04-09 04:54:19 2018-04-09 05:18:18 0:23:59 0:13:01 0:10:58 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
fail 2373003 2018-04-09 04:07:51 2018-04-09 04:54:22 2018-04-09 05:12:21 0:17:59 0:07:06 0:10:53 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_striper.yaml} 2
Failure Reason:

"2018-04-09 05:09:15.292535 mon.b mon.0 172.21.15.7:6789/0 179 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2373004 2018-04-09 04:07:52 2018-04-09 04:56:07 2018-04-09 05:20:07 0:24:00 0:11:14 0:12:46 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2373005 2018-04-09 04:07:52 2018-04-09 04:56:07 2018-04-09 06:04:08 1:08:01 0:56:17 0:11:44 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
pass 2373006 2018-04-09 04:07:53 2018-04-09 04:56:07 2018-04-09 05:24:07 0:28:00 0:13:38 0:14:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2373007 2018-04-09 04:07:54 2018-04-09 04:56:07 2018-04-09 05:26:07 0:30:00 0:17:28 0:12:32 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2373008 2018-04-09 04:07:55 2018-04-09 04:57:50 2018-04-09 05:15:50 0:18:00 0:10:09 0:07:51 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_seq_read.yaml} 1
pass 2373009 2018-04-09 04:07:55 2018-04-09 04:57:50 2018-04-09 05:31:50 0:34:00 0:19:17 0:14:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 2373010 2018-04-09 04:07:56 2018-04-09 04:57:52 2018-04-09 05:13:51 0:15:59 0:06:28 0:09:31 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
pass 2373011 2018-04-09 04:07:57 2018-04-09 04:58:06 2018-04-09 05:36:06 0:38:00 0:24:02 0:13:58 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2373012 2018-04-09 04:07:57 2018-04-09 04:58:14 2018-04-09 05:26:13 0:27:59 0:11:52 0:16:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2373013 2018-04-09 04:07:58 2018-04-09 05:00:10 2018-04-09 05:30:09 0:29:59 0:18:48 0:11:11 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
pass 2373014 2018-04-09 04:07:59 2018-04-09 05:00:10 2018-04-09 05:26:09 0:25:59 0:14:02 0:11:57 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2373015 2018-04-09 04:08:00 2018-04-09 05:02:05 2018-04-09 05:28:04 0:25:59 0:13:37 0:12:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2373016 2018-04-09 04:08:00 2018-04-09 05:02:05 2018-04-09 05:24:04 0:21:59 0:10:12 0:11:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 2373017 2018-04-09 04:08:01 2018-04-09 05:02:05 2018-04-09 05:40:04 0:37:59 0:27:09 0:10:50 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
pass 2373018 2018-04-09 04:08:02 2018-04-09 05:02:07 2018-04-09 05:40:07 0:38:00 0:27:15 0:10:45 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 2373019 2018-04-09 04:08:02 2018-04-09 05:02:11 2018-04-09 05:18:11 0:16:00 0:06:37 0:09:23 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2373020 2018-04-09 04:08:03 2018-04-09 05:02:14 2018-04-09 05:32:14 0:30:00 0:20:02 0:09:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 2373021 2018-04-09 04:08:04 2018-04-09 05:02:17 2018-04-09 05:20:16 0:17:59 0:09:17 0:08:42 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi191 with status 1: '/home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml'

pass 2373022 2018-04-09 04:08:05 2018-04-09 05:04:06 2018-04-09 05:36:06 0:32:00 0:19:57 0:12:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2373023 2018-04-09 04:08:05 2018-04-09 05:04:06 2018-04-09 05:24:06 0:20:00 0:06:27 0:13:33 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
fail 2373024 2018-04-09 04:08:06 2018-04-09 05:04:14 2018-04-09 05:32:14 0:28:00 0:16:46 0:11:14 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
Failure Reason:

"2018-04-09 05:18:17.128165 mon.a mon.0 172.21.15.104:6789/0 236 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2373025 2018-04-09 04:08:07 2018-04-09 05:06:00 2018-04-09 07:30:03 2:24:03 2:16:02 0:08:01 smithi master rados/objectstore/filestore-idempotent.yaml 1
pass 2373026 2018-04-09 04:08:07 2018-04-09 05:06:01 2018-04-09 05:36:00 0:29:59 0:19:11 0:10:48 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
pass 2373027 2018-04-09 04:08:08 2018-04-09 05:06:01 2018-04-09 05:44:01 0:38:00 0:23:09 0:14:51 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2373028 2018-04-09 04:08:09 2018-04-09 05:06:00 2018-04-09 05:22:00 0:16:00 0:07:05 0:08:55 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/prometheus.yaml} 2
pass 2373029 2018-04-09 04:08:10 2018-04-09 05:06:00 2018-04-09 05:26:00 0:20:00 0:09:04 0:10:56 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2373030 2018-04-09 04:08:10 2018-04-09 05:06:03 2018-04-09 05:22:02 0:15:59 0:06:19 0:09:40 smithi master rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2373031 2018-04-09 04:08:11 2018-04-09 05:06:20 2018-04-09 05:22:19 0:15:59 0:06:58 0:09:01 smithi master rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml} 1
pass 2373032 2018-04-09 04:08:12 2018-04-09 05:07:39 2018-04-09 05:43:39 0:36:00 0:25:02 0:10:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 2373033 2018-04-09 04:08:12 2018-04-09 05:07:47 2018-04-09 05:45:47 0:38:00 0:25:27 0:12:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 05:24:54.247905 osd.2 osd.2 172.21.15.182:6809/12900 39 : cluster [WRN] pg 70.0 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2373034 2018-04-09 04:08:13 2018-04-09 05:08:07 2018-04-09 05:30:06 0:21:59 0:11:35 0:10:24 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 2373035 2018-04-09 04:08:14 2018-04-09 05:09:23 2018-04-09 05:59:23 0:50:00 0:38:01 0:11:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2373036 2018-04-09 04:08:15 2018-04-09 05:09:56 2018-04-09 05:33:55 0:23:59 0:09:13 0:14:46 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 2373037 2018-04-09 04:08:15 2018-04-09 05:09:57 2018-04-09 05:43:57 0:34:00 0:22:17 0:11:43 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2373038 2018-04-09 04:08:16 2018-04-09 05:11:52 2018-04-09 05:35:52 0:24:00 0:11:23 0:12:37 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2373039 2018-04-09 04:08:17 2018-04-09 05:11:52 2018-04-09 05:27:51 0:15:59 0:08:18 0:07:41 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2373040 2018-04-09 04:08:18 2018-04-09 05:11:52 2018-04-09 05:33:52 0:22:00 0:10:55 0:11:05 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 2373041 2018-04-09 04:08:18 2018-04-09 05:11:57 2018-04-09 05:29:56 0:17:59 0:09:20 0:08:39 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_seq_read.yaml} 1
pass 2373042 2018-04-09 04:08:19 2018-04-09 05:12:23 2018-04-09 05:44:22 0:31:59 0:22:09 0:09:50 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2373043 2018-04-09 04:08:20 2018-04-09 05:13:42 2018-04-09 05:27:41 0:13:59 0:05:40 0:08:19 smithi master rados/standalone/mon.yaml 1
Failure Reason:

Command failed (workunit test mon/misc.sh) on smithi074 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-04-08-2052 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh'

pass 2373044 2018-04-09 04:08:20 2018-04-09 05:13:53 2018-04-09 05:41:52 0:27:59 0:17:25 0:10:34 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 2373045 2018-04-09 04:08:21 2018-04-09 05:13:54 2018-04-09 05:33:53 0:19:59 0:10:06 0:09:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
pass 2373046 2018-04-09 04:08:22 2018-04-09 05:13:59 2018-04-09 05:37:58 0:23:59 0:12:48 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2373047 2018-04-09 04:08:22 2018-04-09 05:14:01 2018-04-09 05:30:00 0:15:59 0:07:57 0:08:02 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2373048 2018-04-09 04:08:23 2018-04-09 05:14:02 2018-04-09 05:38:01 0:23:59 0:13:50 0:10:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2373049 2018-04-09 04:08:24 2018-04-09 05:14:14 2018-04-09 05:44:14 0:30:00 0:17:28 0:12:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 2373050 2018-04-09 04:08:25 2018-04-09 05:14:14 2018-04-09 05:40:14 0:26:00 0:17:21 0:08:39 smithi master rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test rados/test_large_omap_detection.py) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-04-08-2052 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_large_omap_detection.py'

pass 2373051 2018-04-09 04:08:25 2018-04-09 05:15:18 2018-04-09 05:53:17 0:37:59 0:27:52 0:10:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2373052 2018-04-09 04:08:26 2018-04-09 05:15:19 2018-04-09 05:37:19 0:22:00 0:11:55 0:10:05 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2373053 2018-04-09 04:08:27 2018-04-09 05:15:51 2018-04-09 05:33:50 0:17:59 0:08:10 0:09:49 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2373054 2018-04-09 04:08:27 2018-04-09 05:16:11 2018-04-09 05:28:10 0:11:59 0:04:46 0:07:13 smithi master rados/objectstore/fusestore.yaml 1
pass 2373055 2018-04-09 04:08:28 2018-04-09 05:16:12 2018-04-09 05:42:11 0:25:59 0:15:20 0:10:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2373056 2018-04-09 04:08:29 2018-04-09 05:16:12 2018-04-09 05:36:11 0:19:59 0:08:57 0:11:02 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_write.yaml} 1
pass 2373057 2018-04-09 04:08:30 2018-04-09 05:16:14 2018-04-09 05:42:14 0:26:00 0:16:46 0:09:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2373058 2018-04-09 04:08:30 2018-04-09 05:16:31 2018-04-09 05:40:31 0:24:00 0:12:33 0:11:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 2373059 2018-04-09 04:08:31 2018-04-09 05:18:10 2018-04-09 05:50:10 0:32:00 0:22:53 0:09:07 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 2373060 2018-04-09 04:08:32 2018-04-09 05:18:12 2018-04-09 05:50:12 0:32:00 0:22:22 0:09:38 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2373061 2018-04-09 04:08:32 2018-04-09 05:18:20 2018-04-09 05:50:20 0:32:00 0:22:27 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2373062 2018-04-09 04:08:33 2018-04-09 05:18:23 2018-04-09 05:48:22 0:29:59 0:18:05 0:11:54 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2373063 2018-04-09 04:08:34 2018-04-09 05:18:28 2018-04-09 05:54:28 0:36:00 0:26:00 0:10:00 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 2373064 2018-04-09 04:08:35 2018-04-09 05:19:33 2018-04-09 05:35:32 0:15:59 0:06:10 0:09:49 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/workunits.yaml} 2
pass 2373065 2018-04-09 04:08:35 2018-04-09 05:20:00 2018-04-09 05:50:00 0:30:00 0:19:39 0:10:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2373066 2018-04-09 04:08:36 2018-04-09 05:20:08 2018-04-09 06:00:08 0:40:00 0:29:19 0:10:41 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
pass 2373067 2018-04-09 04:08:37 2018-04-09 05:20:11 2018-04-09 05:42:11 0:22:00 0:09:53 0:12:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2373068 2018-04-09 04:08:37 2018-04-09 05:20:11 2018-04-09 05:34:11 0:14:00 0:04:49 0:09:11 smithi master rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2373069 2018-04-09 04:08:38 2018-04-09 05:20:17 2018-04-09 05:52:17 0:32:00 0:22:40 0:09:20 smithi master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
pass 2373070 2018-04-09 04:08:39 2018-04-09 05:22:02 2018-04-09 05:52:01 0:29:59 0:19:40 0:10:19 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
pass 2373071 2018-04-09 04:08:39 2018-04-09 05:22:01 2018-04-09 05:58:01 0:36:00 0:25:44 0:10:16 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 2373072 2018-04-09 04:08:40 2018-04-09 05:22:03 2018-04-09 05:42:03 0:20:00 0:10:42 0:09:18 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/sample_fio.yaml} 1
fail 2373073 2018-04-09 04:08:41 2018-04-09 05:22:14 2018-04-09 05:58:15 0:36:01 0:23:43 0:12:18 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 05:38:31.816976 osd.2 osd.2 172.21.15.156:6809/12769 13 : cluster [WRN] pg 48.6 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2373074 2018-04-09 04:08:42 2018-04-09 05:22:14 2018-04-09 05:42:14 0:20:00 0:09:31 0:10:29 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml} 2
fail 2373075 2018-04-09 04:08:42 2018-04-09 05:22:20 2018-04-09 05:50:20 0:28:00 0:22:09 0:05:51 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 2373076 2018-04-09 04:08:43 2018-04-09 05:24:10 2018-04-09 05:54:09 0:29:59 0:20:00 0:09:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2373077 2018-04-09 04:08:44 2018-04-09 05:24:10 2018-04-09 05:52:09 0:27:59 0:18:41 0:09:18 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2373078 2018-04-09 04:08:44 2018-04-09 05:24:10 2018-04-09 05:46:09 0:21:59 0:10:40 0:11:19 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
fail 2373079 2018-04-09 04:08:45 2018-04-09 05:24:10 2018-04-09 05:46:09 0:21:59 0:11:02 0:10:57 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/readwrite.yaml} 2
Failure Reason:

"2018-04-09 05:39:19.560012 mon.a mon.0 172.21.15.95:6789/0 129 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 8 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2373080 2018-04-09 04:08:46 2018-04-09 05:24:10 2018-04-09 06:00:10 0:36:00 0:25:29 0:10:31 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 2373081 2018-04-09 04:08:46 2018-04-09 05:25:59 2018-04-09 05:55:59 0:30:00 0:22:18 0:07:42 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml supported/centos_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2373082 2018-04-09 04:08:47 2018-04-09 05:26:01 2018-04-09 05:50:01 0:24:00 0:09:39 0:14:21 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2373083 2018-04-09 04:08:48 2018-04-09 05:26:09 2018-04-09 05:48:08 0:21:59 0:12:16 0:09:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
pass 2373084 2018-04-09 04:08:48 2018-04-09 05:26:11 2018-04-09 05:40:10 0:13:59 0:05:24 0:08:35 smithi master rados/objectstore/keyvaluedb.yaml 1
pass 2373085 2018-04-09 04:08:49 2018-04-09 05:26:16 2018-04-09 06:26:15 0:59:59 0:50:42 0:09:17 smithi master rados/standalone/osd.yaml 1
pass 2373086 2018-04-09 04:08:50 2018-04-09 05:27:52 2018-04-09 05:49:52 0:22:00 0:11:42 0:10:18 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2373087 2018-04-09 04:08:51 2018-04-09 05:27:53 2018-04-09 05:53:53 0:26:00 0:18:31 0:07:29 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2373088 2018-04-09 04:08:51 2018-04-09 05:28:01 2018-04-09 05:52:00 0:23:59 0:13:23 0:10:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2373089 2018-04-09 04:08:52 2018-04-09 05:28:02 2018-04-09 05:58:02 0:30:00 0:17:30 0:12:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 2373090 2018-04-09 04:08:53 2018-04-09 05:28:05 2018-04-09 05:50:05 0:22:00 0:10:00 0:12:00 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/sample_radosbench.yaml} 1
pass 2373091 2018-04-09 04:08:53 2018-04-09 05:28:12 2018-04-09 06:04:11 0:35:59 0:24:01 0:11:58 smithi master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
pass 2373092 2018-04-09 04:08:54 2018-04-09 05:30:12 2018-04-09 06:04:12 0:34:00 0:24:28 0:09:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2373093 2018-04-09 04:08:55 2018-04-09 05:30:12 2018-04-09 05:56:12 0:26:00 0:14:13 0:11:47 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
fail 2373094 2018-04-09 04:08:55 2018-04-09 05:30:12 2018-04-09 05:46:11 0:15:59 0:05:58 0:10:01 smithi master rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2373095 2018-04-09 04:08:56 2018-04-09 05:30:12 2018-04-09 05:52:12 0:22:00 0:11:47 0:10:13 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/pool-create-delete.yaml} 2
pass 2373096 2018-04-09 04:08:57 2018-04-09 05:32:02 2018-04-09 05:54:01 0:21:59 0:10:11 0:11:48 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2373097 2018-04-09 04:08:57 2018-04-09 05:32:02 2018-04-09 06:00:02 0:28:00 0:16:43 0:11:17 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2373098 2018-04-09 04:08:58 2018-04-09 05:32:15 2018-04-09 05:58:15 0:26:00 0:14:58 0:11:02 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
pass 2373099 2018-04-09 04:08:59 2018-04-09 05:32:15 2018-04-09 05:52:15 0:20:00 0:10:13 0:09:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 2373100 2018-04-09 04:09:00 2018-04-09 05:34:01 2018-04-09 05:56:01 0:22:00 0:13:24 0:08:36 smithi master rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2373101 2018-04-09 04:09:00 2018-04-09 05:34:01 2018-04-09 06:08:01 0:34:00 0:23:03 0:10:57 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2373102 2018-04-09 04:09:01 2018-04-09 05:34:01 2018-04-09 06:06:01 0:32:00 0:21:07 0:10:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
fail 2373103 2018-04-09 04:09:02 2018-04-09 05:34:01 2018-04-09 06:00:01 0:26:00 0:15:27 0:10:33 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/dashboard.yaml} 2
Failure Reason:

Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest)

pass 2373104 2018-04-09 04:09:02 2018-04-09 05:34:12 2018-04-09 05:56:11 0:21:59 0:10:42 0:11:17 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
pass 2373105 2018-04-09 04:09:03 2018-04-09 05:35:16 2018-04-09 06:07:16 0:32:00 0:21:59 0:10:01 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2373106 2018-04-09 04:09:04 2018-04-09 05:35:33 2018-04-09 06:03:33 0:28:00 0:18:54 0:09:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2373107 2018-04-09 04:09:04 2018-04-09 05:35:53 2018-04-09 05:53:52 0:17:59 0:10:19 0:07:40 smithi master rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2373108 2018-04-09 04:09:05 2018-04-09 05:35:58 2018-04-09 06:11:58 0:36:00 0:24:58 0:11:02 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
pass 2373109 2018-04-09 04:09:06 2018-04-09 05:36:02 2018-04-09 05:58:01 0:21:59 0:09:37 0:12:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2373110 2018-04-09 04:09:07 2018-04-09 05:36:04 2018-04-09 05:50:03 0:13:59 0:05:54 0:08:05 smithi master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
pass 2373111 2018-04-09 04:09:07 2018-04-09 05:36:08 2018-04-09 06:10:08 0:34:00 0:21:53 0:12:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 2373112 2018-04-09 04:09:08 2018-04-09 05:36:08 2018-04-09 06:02:07 0:25:59 0:15:39 0:10:20 smithi master rados/objectstore/objectcacher-stress.yaml 1
fail 2373113 2018-04-09 04:09:09 2018-04-09 05:36:13 2018-04-09 06:16:13 0:40:00 0:25:34 0:14:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 05:54:07.829725 osd.1 osd.1 172.21.15.162:6813/12559 12 : cluster [WRN] pg 28.1 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2373114 2018-04-09 04:09:09 2018-04-09 05:37:28 2018-04-09 06:27:28 0:50:00 0:37:43 0:12:17 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2373115 2018-04-09 04:09:10 2018-04-09 05:38:00 2018-04-09 05:53:59 0:15:59 0:08:23 0:07:36 smithi master rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2373116 2018-04-09 04:09:11 2018-04-09 05:38:02 2018-04-09 06:04:02 0:26:00 0:14:12 0:11:48 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rgw_snaps.yaml} 2
Failure Reason:

"2018-04-09 05:53:13.344930 mon.a mon.0 172.21.15.60:6789/0 166 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY)" in cluster log

pass 2373117 2018-04-09 04:09:12 2018-04-09 05:38:02 2018-04-09 06:00:02 0:22:00 0:10:37 0:11:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 2373118 2018-04-09 04:09:12 2018-04-09 05:39:05 2018-04-09 06:03:05 0:24:00 0:11:46 0:12:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
pass 2373119 2018-04-09 04:09:13 2018-04-09 05:40:14 2018-04-09 06:00:15 0:20:01 0:11:02 0:08:59 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_rw.yaml} 1
pass 2373120 2018-04-09 04:09:14 2018-04-09 05:40:14 2018-04-09 06:12:15 0:32:01 0:20:24 0:11:37 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
pass 2373121 2018-04-09 04:09:15 2018-04-09 05:40:14 2018-04-09 06:02:15 0:22:01 0:10:20 0:11:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 2373122 2018-04-09 04:09:15 2018-04-09 05:40:15 2018-04-09 06:08:15 0:28:00 0:08:51 0:19:09 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 2373123 2018-04-09 04:09:16 2018-04-09 05:40:32 2018-04-09 06:16:33 0:36:01 0:25:25 0:10:36 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2373124 2018-04-09 04:09:17 2018-04-09 05:42:03 2018-04-09 06:12:03 0:30:00 0:10:20 0:19:40 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2373125 2018-04-09 04:09:18 2018-04-09 05:42:04 2018-04-09 05:56:03 0:13:59 0:05:48 0:08:11 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test mon/test_mon_config_key.py) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-04-08-2052 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_config_key.py'

pass 2373126 2018-04-09 04:09:18 2018-04-09 05:42:12 2018-04-09 06:02:12 0:20:00 0:09:18 0:10:42 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
pass 2373127 2018-04-09 04:09:19 2018-04-09 05:42:12 2018-04-09 06:00:12 0:18:00 0:06:41 0:11:19 smithi master rados/multimon/{clusters/9.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
pass 2373128 2018-04-09 04:09:20 2018-04-09 05:42:15 2018-04-09 06:02:15 0:20:00 0:08:40 0:11:20 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
pass 2373129 2018-04-09 04:09:20 2018-04-09 05:42:16 2018-04-09 06:12:15 0:29:59 0:18:45 0:11:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
pass 2373130 2018-04-09 04:09:21 2018-04-09 05:43:49 2018-04-09 06:29:49 0:46:00 0:35:59 0:10:01 smithi master rados/standalone/scrub.yaml 1
pass 2373131 2018-04-09 04:09:22 2018-04-09 05:43:58 2018-04-09 06:13:58 0:30:00 0:19:24 0:10:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 2373132 2018-04-09 04:09:23 2018-04-09 05:44:02 2018-04-09 06:14:01 0:29:59 0:19:23 0:10:36 smithi master rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml} 1
pass 2373133 2018-04-09 04:09:23 2018-04-09 05:44:16 2018-04-09 06:18:15 0:33:59 0:22:32 0:11:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2373134 2018-04-09 04:09:24 2018-04-09 05:44:24 2018-04-09 06:00:23 0:15:59 0:06:08 0:09:51 smithi master rados/singleton/{all/mon-config.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2373135 2018-04-09 04:09:25 2018-04-09 05:45:59 2018-04-09 06:11:58 0:25:59 0:14:00 0:11:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2373136 2018-04-09 04:09:26 2018-04-09 05:46:11 2018-04-09 06:10:10 0:23:59 0:12:04 0:11:55 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2373137 2018-04-09 04:09:26 2018-04-09 05:46:11 2018-04-09 06:06:10 0:19:59 0:08:54 0:11:05 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_read.yaml} 1
pass 2373138 2018-04-09 04:09:27 2018-04-09 05:46:12 2018-04-09 06:16:12 0:30:00 0:17:28 0:12:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 2373139 2018-04-09 04:09:28 2018-04-09 05:48:18 2018-04-09 06:08:18 0:20:00 0:09:23 0:10:37 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/scrub_test.yaml} 2
pass 2373140 2018-04-09 04:09:28 2018-04-09 05:48:24 2018-04-09 06:12:23 0:23:59 0:11:34 0:12:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 2373141 2018-04-09 04:09:29 2018-04-09 05:50:08 2018-04-09 06:06:07 0:15:59 0:06:12 0:09:47 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2373142 2018-04-09 04:09:30 2018-04-09 05:50:08 2018-04-09 11:14:14 5:24:06 5:09:08 0:14:58 smithi master rados/objectstore/objectstore.yaml 1
pass 2373143 2018-04-09 04:09:31 2018-04-09 05:50:07 2018-04-09 06:22:07 0:32:00 0:22:18 0:09:42 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 2373144 2018-04-09 04:09:31 2018-04-09 05:50:08 2018-04-09 06:06:07 0:15:59 0:06:27 0:09:32 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml tasks/failover.yaml} 2
Failure Reason:

Test failure: test_explicit_fail (tasks.mgr.test_failover.TestFailover)

pass 2373145 2018-04-09 04:09:32 2018-04-09 05:50:08 2018-04-09 06:22:07 0:31:59 0:19:59 0:12:00 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 2373146 2018-04-09 04:09:33 2018-04-09 05:50:11 2018-04-09 06:20:11 0:30:00 0:16:28 0:13:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 2373147 2018-04-09 04:09:34 2018-04-09 05:50:13 2018-04-09 06:14:13 0:24:00 0:11:50 0:12:10 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2373148 2018-04-09 04:09:34 2018-04-09 05:50:21 2018-04-09 06:12:20 0:21:59 0:10:03 0:11:56 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 2373149 2018-04-09 04:09:35 2018-04-09 05:50:21 2018-04-09 06:08:21 0:18:00 0:11:38 0:06:22 smithi master centos rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
pass 2373150 2018-04-09 04:09:36 2018-04-09 05:52:11 2018-04-09 06:26:11 0:34:00 0:23:18 0:10:42 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
pass 2373151 2018-04-09 04:09:37 2018-04-09 05:52:11 2018-04-09 06:30:11 0:38:00 0:25:51 0:12:09 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 2373152 2018-04-09 04:09:37 2018-04-09 05:52:12 2018-04-09 06:10:11 0:17:59 0:08:59 0:09:00 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_rw.yaml} 1
fail 2373153 2018-04-09 04:09:38 2018-04-09 05:52:13 2018-04-09 06:30:13 0:38:00 0:19:52 0:18:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 06:14:37.791754 osd.0 osd.0 172.21.15.16:6805/12652 60 : cluster [WRN] pg 71.3 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

fail 2373154 2018-04-09 04:09:39 2018-04-09 05:52:16 2018-04-09 06:28:16 0:36:00 0:23:44 0:12:16 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 06:08:06.645305 osd.4 osd.4 172.21.15.50:6805/12635 7 : cluster [WRN] pg 27.0 has invalid (post-split) stats; must scrub before tier agent can activate" in cluster log

pass 2373155 2018-04-09 04:09:40 2018-04-09 05:52:18 2018-04-09 06:46:20 0:54:02 0:38:18 0:15:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2373156 2018-04-09 04:09:41 2018-04-09 05:53:27 2018-04-09 06:13:27 0:20:00 0:11:36 0:08:24 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 2373157 2018-04-09 04:09:41 2018-04-09 05:53:54 2018-04-09 06:25:53 0:31:59 0:19:42 0:12:17 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

"2018-04-09 06:09:38.821260 mon.a mon.0 172.21.15.103:6789/0 293 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log