Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 2958924 2018-08-30 05:15:36 2018-08-30 07:00:56 2018-08-30 07:36:56 0:36:00 0:22:51 0:13:09 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958925 2018-08-30 05:15:37 2018-08-30 07:02:43 2018-08-30 07:20:42 0:17:59 0:09:46 0:08:13 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi055 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2958926 2018-08-30 05:15:39 2018-08-30 07:02:43 2018-08-30 07:50:43 0:48:00 0:23:35 0:24:25 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958927 2018-08-30 05:15:40 2018-08-30 07:04:43 2018-08-30 07:44:43 0:40:00 0:20:39 0:19:21 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/osd-delay.yaml msgr/simple.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958928 2018-08-30 05:15:41 2018-08-30 07:04:43 2018-08-30 07:44:43 0:40:00 0:19:45 0:20:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958929 2018-08-30 05:15:43 2018-08-30 07:04:43 2018-08-30 07:30:42 0:25:59 0:05:44 0:20:15 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/prometheus.yaml} 2
Failure Reason:

"2018-08-30 07:27:25.120542 mon.b (mon.0) 89 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958930 2018-08-30 05:15:44 2018-08-30 07:04:46 2018-08-30 07:34:46 0:30:00 0:18:48 0:11:12 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958931 2018-08-30 05:15:46 2018-08-30 07:04:52 2018-08-30 07:38:51 0:33:59 0:19:39 0:14:20 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958932 2018-08-30 05:15:47 2018-08-30 07:06:10 2018-08-30 07:38:10 0:32:00 0:22:32 0:09:28 smithi master rhel 7.5 rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958933 2018-08-30 05:15:48 2018-08-30 07:06:19 2018-08-30 07:36:19 0:30:00 0:18:39 0:11:21 smithi master ubuntu 18.04 rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 07:18:52.095024 mon.a (mon.0) 83 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2958934 2018-08-30 05:15:49 2018-08-30 07:06:26 2018-08-30 07:40:26 0:34:00 0:22:05 0:11:55 smithi master centos 7.4 rados/rest/{mgr-restful.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 07:24:51.621147 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

fail 2958935 2018-08-30 05:15:50 2018-08-30 07:08:21 2018-08-30 08:14:22 1:06:01 0:55:59 0:10:02 smithi master centos rados/singleton-flat/valgrind-leaks.yaml 1
Failure Reason:

"2018-08-30 07:45:44.768992 mon.a (mon.0) 313 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958936 2018-08-30 05:15:51 2018-08-30 07:08:41 2018-08-30 07:38:41 0:30:00 0:22:16 0:07:44 smithi master rhel 7.5 rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2018-08-30 07:22:34.413049 mon.a (mon.0) 58 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2958937 2018-08-30 05:15:52 2018-08-30 07:08:43 2018-08-30 07:24:43 0:16:00 0:05:28 0:10:32 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/crush.yaml} 1
Failure Reason:

Command failed (workunit test crush/crush-classes.sh) on smithi151 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-zafman-testing TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh'

fail 2958938 2018-08-30 05:15:53 2018-08-30 07:08:50 2018-08-30 07:46:50 0:38:00 0:20:11 0:17:49 smithi master ubuntu 16.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958939 2018-08-30 05:15:54 2018-08-30 07:10:29 2018-08-30 07:44:29 0:34:00 0:23:29 0:10:31 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958940 2018-08-30 05:15:55 2018-08-30 07:12:45 2018-08-30 09:02:47 1:50:02 0:20:41 1:29:21 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958941 2018-08-30 05:15:57 2018-08-30 07:12:50 2018-08-30 08:22:51 1:10:01 0:55:26 0:14:35 smithi master rhel 7.5 rados/upgrade/luminous-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/luminous.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-mimic.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} supported-random-distro$/{rhel_latest.yaml} thrashosds-health.yaml} 3
Failure Reason:

failed to become clean before timeout expired

fail 2958942 2018-08-30 05:15:58 2018-08-30 07:13:14 2018-08-30 07:45:13 0:31:59 0:19:14 0:12:45 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958943 2018-08-30 05:15:59 2018-08-30 07:14:52 2018-08-30 07:46:52 0:32:00 0:19:13 0:12:47 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958944 2018-08-30 05:16:00 2018-08-30 07:14:52 2018-08-30 07:48:52 0:34:00 0:19:21 0:14:39 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958945 2018-08-30 05:16:01 2018-08-30 07:14:52 2018-08-30 07:48:52 0:34:00 0:19:45 0:14:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958946 2018-08-30 05:16:02 2018-08-30 07:15:46 2018-08-30 07:55:46 0:40:00 0:23:54 0:16:06 smithi master centos 7.4 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958947 2018-08-30 05:16:03 2018-08-30 07:16:33 2018-08-30 07:50:33 0:34:00 0:19:04 0:14:56 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 2958948 2018-08-30 05:16:04 2018-08-30 07:16:42 2018-08-30 07:32:41 0:15:59 0:04:38 0:11:21 smithi master ubuntu 16.04 rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 2958949 2018-08-30 05:16:06 2018-08-30 07:16:44 2018-08-30 07:34:44 0:18:00 0:07:18 0:10:42 smithi master centos 7.4 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi170 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2958950 2018-08-30 05:16:07 2018-08-30 07:18:32 2018-08-30 08:06:32 0:48:00 0:22:08 0:25:52 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958951 2018-08-30 05:16:09 2018-08-30 07:18:37 2018-08-30 07:56:37 0:38:00 0:22:41 0:15:19 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958952 2018-08-30 05:16:10 2018-08-30 07:18:48 2018-08-30 07:58:48 0:40:00 0:23:25 0:16:35 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958953 2018-08-30 05:16:12 2018-08-30 07:18:51 2018-08-30 07:50:51 0:32:00 0:20:05 0:11:55 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_stress_watch.yaml} 2
Failure Reason:

"2018-08-30 07:33:27.204121 mon.b (mon.0) 136 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2958954 2018-08-30 05:16:13 2018-08-30 07:20:16 2018-08-30 08:00:16 0:40:00 0:22:59 0:17:01 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958955 2018-08-30 05:16:14 2018-08-30 07:20:33 2018-08-30 08:34:34 1:14:01 0:48:34 0:25:27 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-08-30 07:59:06.465809 mon.b (mon.0) 194 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2958956 2018-08-30 05:16:16 2018-08-30 07:20:43 2018-08-30 07:54:43 0:34:00 0:19:21 0:14:39 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958957 2018-08-30 05:16:17 2018-08-30 07:20:48 2018-08-30 07:54:48 0:34:00 0:19:56 0:14:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958958 2018-08-30 05:16:18 2018-08-30 07:21:53 2018-08-30 08:17:54 0:56:01 0:22:24 0:33:37 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958959 2018-08-30 05:16:19 2018-08-30 07:22:01 2018-08-30 07:54:01 0:32:00 0:19:47 0:12:13 smithi master ubuntu 16.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-08-30 07:35:34.076109 mon.a (mon.0) 146 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958960 2018-08-30 05:16:20 2018-08-30 07:22:08 2018-08-30 08:10:08 0:48:00 0:19:45 0:28:15 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958961 2018-08-30 05:16:21 2018-08-30 07:24:09 2018-08-30 08:18:10 0:54:01 0:23:54 0:30:07 smithi master centos 7.4 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml msgr/async.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958962 2018-08-30 05:16:22 2018-08-30 08:44:55 2018-08-30 09:22:55 0:38:00 0:19:15 0:18:45 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958963 2018-08-30 05:16:23 2018-08-30 08:44:55 2018-08-30 09:22:55 0:38:00 0:19:07 0:18:53 smithi master ubuntu 18.04 rados/multimon/{clusters/3.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} 2
Failure Reason:

"2018-08-30 09:07:57.933347 mon.a (mon.0) 53 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 2958964 2018-08-30 05:16:24 2018-08-30 08:44:56 2018-08-30 09:08:56 0:24:00 0:09:29 0:14:31 smithi master centos 7.4 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_write.yaml} 1
Failure Reason:

Command failed on smithi100 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2958965 2018-08-30 05:16:25 2018-08-30 08:46:12 2018-08-30 09:24:12 0:38:00 0:23:21 0:14:39 smithi master centos 7.4 rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:05:28.510810 mon.a (mon.0) 82 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958966 2018-08-30 05:16:26 2018-08-30 08:46:43 2018-08-30 09:22:43 0:36:00 0:19:39 0:16:21 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958967 2018-08-30 05:16:27 2018-08-30 08:46:54 2018-08-30 09:26:54 0:40:00 0:22:34 0:17:26 smithi master rhel 7.5 rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958968 2018-08-30 05:16:28 2018-08-30 08:47:11 2018-08-30 09:31:11 0:44:00 0:19:41 0:24:19 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958969 2018-08-30 05:16:29 2018-08-30 08:48:32 2018-08-30 09:26:32 0:38:00 0:20:42 0:17:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958970 2018-08-30 05:16:30 2018-08-30 08:48:46 2018-08-30 09:32:46 0:44:00 0:22:38 0:21:22 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958971 2018-08-30 05:16:31 2018-08-30 08:50:20 2018-08-30 09:26:20 0:36:00 0:19:24 0:16:36 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958972 2018-08-30 05:16:32 2018-08-30 08:50:35 2018-08-30 09:30:35 0:40:00 0:19:38 0:20:22 smithi master ubuntu 16.04 rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958973 2018-08-30 05:16:33 2018-08-30 08:50:44 2018-08-30 09:24:44 0:34:00 0:19:17 0:14:43 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958974 2018-08-30 05:16:34 2018-08-30 08:50:54 2018-08-30 09:26:54 0:36:00 0:24:30 0:11:30 smithi master rhel 7.5 rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats'

fail 2958975 2018-08-30 05:16:35 2018-08-30 08:52:23 2018-08-30 09:22:23 0:30:00 0:08:13 0:21:47 smithi master centos 7.4 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_latest.yaml} tasks/workunits.yaml} 2
Failure Reason:

"2018-08-30 09:19:13.365717 mon.a (mon.0) 75 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958976 2018-08-30 05:16:36 2018-08-30 08:52:23 2018-08-30 09:34:23 0:42:00 0:20:00 0:22:00 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958977 2018-08-30 05:16:37 2018-08-30 08:52:34 2018-08-30 09:26:34 0:34:00 0:23:33 0:10:27 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_striper.yaml} 2
Failure Reason:

"2018-08-30 09:07:47.619966 mon.b (mon.0) 176 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2958978 2018-08-30 05:16:38 2018-08-30 08:52:47 2018-08-30 09:28:47 0:36:00 0:23:00 0:13:00 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958979 2018-08-30 05:16:39 2018-08-30 08:52:54 2018-08-30 09:34:54 0:42:00 0:23:05 0:18:55 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958980 2018-08-30 05:16:40 2018-08-30 08:54:54 2018-08-30 09:16:54 0:22:00 0:08:39 0:13:21 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/sample_fio.yaml} 1
Failure Reason:

Command failed on smithi116 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2958981 2018-08-30 05:16:41 2018-08-30 08:54:54 2018-08-30 09:28:54 0:34:00 0:23:17 0:10:43 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958982 2018-08-30 05:16:42 2018-08-30 08:54:56 2018-08-30 09:30:56 0:36:00 0:22:44 0:13:16 smithi master rhel 7.5 rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
fail 2958983 2018-08-30 05:16:43 2018-08-30 08:56:07 2018-08-30 09:32:07 0:36:00 0:23:19 0:12:41 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958984 2018-08-30 05:16:44 2018-08-30 08:56:26 2018-08-30 09:30:26 0:34:00 0:19:28 0:14:32 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958985 2018-08-30 05:16:45 2018-08-30 08:56:56 2018-08-30 09:46:56 0:50:00 0:19:44 0:30:16 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958986 2018-08-30 05:16:46 2018-08-30 08:57:17 2018-08-30 09:39:17 0:42:00 0:19:32 0:22:28 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958987 2018-08-30 05:16:47 2018-08-30 08:58:26 2018-08-30 09:44:26 0:46:00 0:24:26 0:21:34 smithi master centos 7.4 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml msgr/random.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958988 2018-08-30 05:16:48 2018-08-30 08:58:26 2018-08-30 09:32:26 0:34:00 0:20:56 0:13:04 smithi master centos 7.4 rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:13:53.444092 mon.a (mon.0) 82 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2958989 2018-08-30 05:16:49 2018-08-30 08:58:32 2018-08-30 09:50:32 0:52:00 0:36:38 0:15:22 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/erasure-code.yaml} 1
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-code-plugins.sh) on smithi067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-zafman-testing TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh'

fail 2958990 2018-08-30 05:16:50 2018-08-30 08:58:54 2018-08-30 09:36:54 0:38:00 0:24:13 0:13:47 smithi master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958991 2018-08-30 05:16:52 2018-08-30 09:00:15 2018-08-30 09:38:15 0:38:00 0:23:15 0:14:45 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958992 2018-08-30 05:16:53 2018-08-30 09:00:15 2018-08-30 11:00:17 2:00:02 0:21:33 1:38:29 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958993 2018-08-30 05:16:54 2018-08-30 09:00:46 2018-08-30 09:42:46 0:42:00 0:22:10 0:19:50 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958994 2018-08-30 05:16:55 2018-08-30 09:02:28 2018-08-30 09:42:28 0:40:00 0:19:39 0:20:21 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958995 2018-08-30 05:16:56 2018-08-30 09:02:37 2018-08-30 09:36:37 0:34:00 0:19:38 0:14:22 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958996 2018-08-30 05:16:57 2018-08-30 09:02:48 2018-08-30 09:36:48 0:34:00 0:23:09 0:10:51 smithi master rhel 7.5 rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi004 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats'

fail 2958997 2018-08-30 05:16:58 2018-08-30 09:04:27 2018-08-30 09:40:26 0:35:59 0:22:55 0:13:04 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958998 2018-08-30 05:16:59 2018-08-30 09:04:27 2018-08-30 09:44:27 0:40:00 0:22:08 0:17:52 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2958999 2018-08-30 05:17:00 2018-08-30 09:04:35 2018-08-30 09:38:34 0:33:59 0:23:09 0:10:50 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

"2018-08-30 09:19:32.023361 mon.b (mon.0) 196 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 2959000 2018-08-30 05:17:02 2018-08-30 09:04:36 2018-08-30 09:24:35 0:19:59 0:05:03 0:14:56 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/sample_radosbench.yaml} 1
Failure Reason:

Command failed on smithi169 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959001 2018-08-30 05:17:03 2018-08-30 09:04:44 2018-08-30 09:38:44 0:34:00 0:19:20 0:14:40 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959002 2018-08-30 05:17:04 2018-08-30 09:06:15 2018-08-30 09:42:15 0:36:00 0:19:34 0:16:26 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959003 2018-08-30 05:17:05 2018-08-30 09:06:19 2018-08-30 09:44:19 0:38:00 0:19:23 0:18:37 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

"2018-08-30 09:22:15.615018 mon.a (mon.0) 240 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959004 2018-08-30 05:17:06 2018-08-30 09:06:36 2018-08-30 09:46:36 0:40:00 0:22:27 0:17:33 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959005 2018-08-30 05:17:07 2018-08-30 09:06:54 2018-08-30 09:38:54 0:32:00 0:19:34 0:12:26 smithi master ubuntu 18.04 rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:19:03.753599 mon.a (mon.0) 79 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959006 2018-08-30 05:17:08 2018-08-30 09:08:32 2018-08-30 09:44:32 0:36:00 0:23:07 0:12:53 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959007 2018-08-30 05:17:09 2018-08-30 09:08:48 2018-08-30 09:42:48 0:34:00 0:23:00 0:11:00 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959008 2018-08-30 05:17:10 2018-08-30 09:08:54 2018-08-30 09:38:54 0:30:00 0:18:40 0:11:20 smithi master ubuntu 18.04 rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:20:57.021745 mon.a (mon.0) 61 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959009 2018-08-30 05:17:12 2018-08-30 09:08:57 2018-08-30 09:50:57 0:42:00 0:19:55 0:22:05 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959010 2018-08-30 05:17:13 2018-08-30 09:09:00 2018-08-30 09:49:00 0:40:00 0:19:37 0:20:23 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959011 2018-08-30 05:17:14 2018-08-30 09:10:26 2018-08-30 09:46:26 0:36:00 0:21:26 0:14:34 smithi master centos 7.4 rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:27:39.473326 mon.a (mon.0) 55 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959012 2018-08-30 05:17:15 2018-08-30 09:10:26 2018-08-30 09:50:26 0:40:00 0:22:27 0:17:33 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959013 2018-08-30 05:17:16 2018-08-30 09:10:54 2018-08-30 09:48:54 0:38:00 0:19:50 0:18:10 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959014 2018-08-30 05:17:17 2018-08-30 09:11:00 2018-08-30 09:28:59 0:17:59 0:05:35 0:12:24 smithi master ubuntu 16.04 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/crash.yaml} 2
Failure Reason:

"2018-08-30 09:25:46.425171 mon.b (mon.0) 67 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959015 2018-08-30 05:17:18 2018-08-30 09:14:24 2018-08-30 09:32:23 0:17:59 0:08:52 0:09:07 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/cosbench_64K_read_write.yaml} 1
Failure Reason:

Command failed on smithi182 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959016 2018-08-30 05:17:19 2018-08-30 09:14:24 2018-08-30 09:46:24 0:32:00 0:18:54 0:13:06 smithi master ubuntu 16.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959017 2018-08-30 05:17:21 2018-08-30 09:14:33 2018-08-30 09:48:32 0:33:59 0:19:36 0:14:23 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959018 2018-08-30 05:17:22 2018-08-30 09:14:54 2018-08-30 09:52:54 0:38:00 0:21:08 0:16:52 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/osd-delay.yaml msgr/simple.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959019 2018-08-30 05:17:23 2018-08-30 09:15:04 2018-08-30 09:49:04 0:34:00 0:19:53 0:14:07 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959020 2018-08-30 05:17:24 2018-08-30 09:16:15 2018-08-30 13:30:10 4:13:55 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 2959021 2018-08-30 05:17:25 2018-08-30 09:16:15 2018-08-30 09:52:15 0:36:00 0:19:43 0:16:17 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959022 2018-08-30 05:17:26 2018-08-30 09:16:30 2018-08-30 09:54:30 0:38:00 0:24:28 0:13:32 smithi master centos 7.4 rados/multimon/{clusters/6.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_clock_with_skews.yaml} 2
Failure Reason:

"2018-08-30 09:35:34.781478 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959023 2018-08-30 05:17:27 2018-08-30 09:16:50 2018-08-30 09:52:50 0:36:00 0:23:42 0:12:18 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959024 2018-08-30 05:17:28 2018-08-30 09:16:55 2018-08-30 09:50:55 0:34:00 0:21:34 0:12:26 smithi master centos 7.4 rados/singleton/{all/mon-config.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:31:52.052990 mon.a (mon.0) 90 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959025 2018-08-30 05:17:29 2018-08-30 09:18:32 2018-08-30 09:56:32 0:38:00 0:19:50 0:18:10 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959026 2018-08-30 05:17:30 2018-08-30 09:18:32 2018-08-30 09:58:32 0:40:00 0:24:35 0:15:25 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959027 2018-08-30 05:17:31 2018-08-30 09:18:50 2018-08-30 09:58:50 0:40:00 0:23:47 0:16:13 smithi master centos 7.4 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} 2
Failure Reason:

"2018-08-30 09:37:32.404294 mon.b (mon.0) 140 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959028 2018-08-30 05:17:32 2018-08-30 09:19:00 2018-08-30 09:59:00 0:40:00 0:19:29 0:20:31 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959029 2018-08-30 05:17:33 2018-08-30 09:20:33 2018-08-30 09:54:33 0:34:00 0:23:34 0:10:26 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959030 2018-08-30 05:17:34 2018-08-30 09:20:51 2018-08-30 09:52:51 0:32:00 0:21:45 0:10:15 smithi master centos 7.4 rados/singleton/{all/mon-seesaw.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:35:23.374871 mon.a (mon.0) 93 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959031 2018-08-30 05:17:36 2018-08-30 09:22:34 2018-08-30 10:00:33 0:37:59 0:22:06 0:15:53 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959032 2018-08-30 05:17:37 2018-08-30 09:22:40 2018-08-30 09:56:40 0:34:00 0:23:23 0:10:37 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959033 2018-08-30 05:17:38 2018-08-30 09:22:44 2018-08-30 09:42:44 0:20:00 0:09:33 0:10:27 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/cosbench_64K_write.yaml} 1
Failure Reason:

Command failed on smithi097 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959034 2018-08-30 05:17:39 2018-08-30 09:22:56 2018-08-30 10:00:56 0:38:00 0:19:36 0:18:24 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959035 2018-08-30 05:17:40 2018-08-30 09:22:57 2018-08-30 10:02:56 0:39:59 0:22:10 0:17:49 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959036 2018-08-30 05:17:41 2018-08-30 09:23:59 2018-08-30 09:59:59 0:36:00 0:19:30 0:16:30 smithi master ubuntu 16.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/sync.yaml workloads/rados_5925.yaml} 2
Failure Reason:

"2018-08-30 09:38:57.146313 mon.a (mon.0) 116 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 2959037 2018-08-30 05:17:42 2018-08-30 09:24:13 2018-08-30 10:04:13 0:40:00 0:22:25 0:17:35 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959038 2018-08-30 05:17:43 2018-08-30 09:24:37 2018-08-30 10:04:36 0:39:59 0:20:06 0:19:53 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959039 2018-08-30 05:17:44 2018-08-30 09:24:45 2018-08-30 09:56:45 0:32:00 0:19:01 0:12:59 smithi master ubuntu 16.04 rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959040 2018-08-30 05:17:45 2018-08-30 09:24:46 2018-08-30 10:04:46 0:40:00 0:20:48 0:19:12 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959041 2018-08-30 05:17:46 2018-08-30 09:26:29 2018-08-30 10:06:29 0:40:00 0:21:59 0:18:01 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959042 2018-08-30 05:17:47 2018-08-30 09:26:29 2018-08-30 09:58:29 0:32:00 0:19:01 0:12:59 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:39:53.521851 mon.a (mon.0) 60 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 2959043 2018-08-30 05:17:49 2018-08-30 09:26:34 2018-08-30 10:00:34 0:34:00 0:19:00 0:15:00 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:39:28.173580 mon.a (mon.0) 79 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959044 2018-08-30 05:17:50 2018-08-30 09:26:35 2018-08-30 12:43:47 3:17:12 3:08:47 0:08:25 smithi master rhel 7.5 rados/standalone/{supported-random-distro$/{rhel_latest.yaml} workloads/misc.yaml} 1
Failure Reason:

Command failed (workunit test misc/rados-striper.sh) on smithi046 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-zafman-testing TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh'

fail 2959045 2018-08-30 05:17:51 2018-08-30 09:26:45 2018-08-30 10:02:45 0:36:00 0:24:15 0:11:45 smithi master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959046 2018-08-30 05:17:52 2018-08-30 09:26:56 2018-08-30 10:04:56 0:38:00 0:20:06 0:17:54 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959047 2018-08-30 05:17:53 2018-08-30 09:26:56 2018-08-30 10:14:56 0:48:00 0:23:55 0:24:05 smithi master centos 7.4 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959048 2018-08-30 05:17:54 2018-08-30 09:28:49 2018-08-30 10:08:49 0:40:00 0:22:30 0:17:30 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/fastclose.yaml msgr/async.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959049 2018-08-30 05:17:55 2018-08-30 09:28:56 2018-08-30 10:06:56 0:38:00 0:19:45 0:18:15 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959050 2018-08-30 05:17:56 2018-08-30 09:29:01 2018-08-30 10:07:00 0:37:59 0:23:46 0:14:13 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959051 2018-08-30 05:17:57 2018-08-30 09:29:37 2018-08-30 09:45:36 0:15:59 0:05:08 0:10:51 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/fio_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi184 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959052 2018-08-30 05:17:58 2018-08-30 09:30:36 2018-08-30 10:06:36 0:36:00 0:19:44 0:16:16 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959053 2018-08-30 05:17:59 2018-08-30 09:30:37 2018-08-30 10:06:36 0:35:59 0:23:31 0:12:28 smithi master rhel 7.5 rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959054 2018-08-30 05:18:00 2018-08-30 09:30:51 2018-08-30 10:06:51 0:36:00 0:24:45 0:11:15 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

"2018-08-30 09:46:59.354550 mon.b (mon.0) 188 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959055 2018-08-30 05:18:01 2018-08-30 09:30:57 2018-08-30 10:12:57 0:42:00 0:21:43 0:20:17 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959056 2018-08-30 05:18:02 2018-08-30 09:31:13 2018-08-30 10:07:12 0:35:59 0:19:52 0:16:07 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959057 2018-08-30 05:18:03 2018-08-30 09:32:18 2018-08-30 10:16:18 0:44:00 0:19:43 0:24:17 smithi master ubuntu 16.04 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959058 2018-08-30 05:18:04 2018-08-30 09:32:18 2018-08-30 10:04:18 0:32:00 0:06:28 0:25:32 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} 2
Failure Reason:

"2018-08-30 09:59:31.031609 mon.b (mon.0) 76 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959059 2018-08-30 05:18:05 2018-08-30 09:32:24 2018-08-30 10:08:24 0:36:00 0:23:19 0:12:41 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959060 2018-08-30 05:18:06 2018-08-30 09:32:28 2018-08-30 10:18:28 0:46:00 0:20:01 0:25:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959061 2018-08-30 05:18:07 2018-08-30 09:32:47 2018-08-30 10:04:47 0:32:00 0:18:57 0:13:03 smithi master ubuntu 16.04 rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959062 2018-08-30 05:18:08 2018-08-30 09:34:36 2018-08-30 10:10:35 0:35:59 0:22:04 0:13:55 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959063 2018-08-30 05:18:09 2018-08-30 09:34:55 2018-08-30 10:10:55 0:36:00 0:22:15 0:13:45 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959064 2018-08-30 05:18:10 2018-08-30 09:36:55 2018-08-30 10:18:54 0:41:59 0:23:00 0:18:59 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959065 2018-08-30 05:18:11 2018-08-30 09:36:54 2018-08-30 10:10:54 0:34:00 0:23:52 0:10:08 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959066 2018-08-30 05:18:12 2018-08-30 09:36:56 2018-08-30 09:58:55 0:21:59 0:09:29 0:12:30 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4K_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi094 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959067 2018-08-30 05:18:13 2018-08-30 09:38:27 2018-08-30 10:12:27 0:34:00 0:19:43 0:14:17 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959068 2018-08-30 05:18:14 2018-08-30 09:38:36 2018-08-30 10:08:35 0:29:59 0:19:00 0:10:59 smithi master ubuntu 18.04 rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959069 2018-08-30 05:18:15 2018-08-30 09:38:45 2018-08-30 10:12:45 0:34:00 0:19:47 0:14:13 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959070 2018-08-30 05:18:17 2018-08-30 09:38:56 2018-08-30 10:12:55 0:33:59 0:21:37 0:12:22 smithi master centos 7.4 rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:55:21.168474 mon.a (mon.0) 84 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959071 2018-08-30 05:18:18 2018-08-30 09:38:56 2018-08-30 10:20:55 0:41:59 0:21:51 0:20:08 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/random.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959072 2018-08-30 05:18:19 2018-08-30 09:39:19 2018-08-30 10:19:19 0:40:00 0:22:33 0:17:27 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959073 2018-08-30 05:18:20 2018-08-30 09:40:41 2018-08-30 10:18:40 0:37:59 0:23:27 0:14:32 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959074 2018-08-30 05:18:21 2018-08-30 09:42:27 2018-08-30 10:26:27 0:44:00 0:19:55 0:24:05 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/readwrite.yaml} 2
Failure Reason:

"2018-08-30 10:06:23.612189 mon.b (mon.0) 157 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959075 2018-08-30 05:18:22 2018-08-30 09:42:29 2018-08-30 10:16:29 0:34:00 0:23:30 0:10:30 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-08-30 09:56:35.337413 mon.a (mon.0) 167 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 2959076 2018-08-30 05:18:23 2018-08-30 09:42:45 2018-08-30 10:18:45 0:36:00 0:20:26 0:15:34 smithi master ubuntu 16.04 rados/multimon/{clusters/9.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/mon_recovery.yaml} 3
Failure Reason:

"2018-08-30 10:01:49.331175 mon.b (mon.0) 43 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 2959077 2018-08-30 05:18:24 2018-08-30 09:42:47 2018-08-30 10:26:47 0:44:00 0:24:31 0:19:29 smithi master centos 7.4 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959078 2018-08-30 05:18:25 2018-08-30 09:42:49 2018-08-30 10:47:44 1:04:55 0:53:00 0:11:55 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-08-30 10:08:08.613781 mon.b (mon.0) 187 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959079 2018-08-30 05:18:26 2018-08-30 09:44:07 2018-08-30 10:22:07 0:38:00 0:19:44 0:18:16 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959080 2018-08-30 05:18:27 2018-08-30 09:44:20 2018-08-30 10:20:20 0:36:00 0:20:03 0:15:57 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959081 2018-08-30 05:18:28 2018-08-30 09:44:28 2018-08-30 10:18:28 0:34:00 0:23:17 0:10:43 smithi master rhel 7.5 rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959082 2018-08-30 05:18:29 2018-08-30 09:44:28 2018-08-30 10:18:28 0:34:00 0:21:18 0:12:42 smithi master centos 7.4 rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 09:59:06.429103 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959083 2018-08-30 05:18:30 2018-08-30 09:44:33 2018-08-30 10:20:33 0:36:00 0:20:08 0:15:52 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959084 2018-08-30 05:18:31 2018-08-30 09:45:47 2018-08-30 10:37:47 0:52:00 0:22:20 0:29:40 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959085 2018-08-30 05:18:32 2018-08-30 09:46:20 2018-08-30 10:08:19 0:21:59 0:07:44 0:14:15 smithi master centos 7.4 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/fio_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959086 2018-08-30 05:18:33 2018-08-30 09:46:25 2018-08-30 10:24:25 0:38:00 0:24:17 0:13:43 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959087 2018-08-30 05:18:34 2018-08-30 09:46:27 2018-08-30 10:22:27 0:36:00 0:23:34 0:12:26 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959088 2018-08-30 05:18:35 2018-08-30 09:46:37 2018-08-30 10:18:37 0:32:00 0:19:19 0:12:41 smithi master ubuntu 16.04 rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

"2018-08-30 09:59:23.058594 mon.a (mon.0) 76 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959089 2018-08-30 05:18:36 2018-08-30 09:47:09 2018-08-30 10:41:44 0:54:35 0:20:26 0:34:09 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959090 2018-08-30 05:18:37 2018-08-30 09:48:44 2018-08-30 10:28:44 0:40:00 0:23:57 0:16:03 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959091 2018-08-30 05:18:38 2018-08-30 09:48:56 2018-08-30 10:28:56 0:40:00 0:19:48 0:20:12 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959092 2018-08-30 05:18:39 2018-08-30 09:49:01 2018-08-30 10:25:01 0:36:00 0:20:24 0:15:36 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959093 2018-08-30 05:18:40 2018-08-30 09:49:05 2018-08-30 10:11:05 0:22:00 0:08:51 0:13:09 smithi master centos 7.4 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_latest.yaml} tasks/failover.yaml} 2
Failure Reason:

"2018-08-30 10:07:44.012960 mon.a (mon.0) 72 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959094 2018-08-30 05:18:41 2018-08-30 09:50:37 2018-08-30 10:26:37 0:36:00 0:21:35 0:14:25 smithi master centos 7.4 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959095 2018-08-30 05:18:42 2018-08-30 09:50:37 2018-08-30 10:28:37 0:38:00 0:19:56 0:18:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959096 2018-08-30 05:18:43 2018-08-30 09:50:56 2018-08-30 10:24:56 0:34:00 0:23:07 0:10:53 smithi master rhel 7.5 rados/singleton/{all/random-eio.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 2
Failure Reason:

"2018-08-30 10:06:16.382061 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

fail 2959097 2018-08-30 05:18:44 2018-08-30 09:50:58 2018-08-30 10:31:43 0:40:45 0:22:48 0:17:57 smithi master rhel 7.5 rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959098 2018-08-30 05:18:45 2018-08-30 09:52:31 2018-08-30 13:11:31 3:19:00 3:09:35 0:09:25 smithi master centos 7.4 rados/standalone/{supported-random-distro$/{centos_latest.yaml} workloads/mon.yaml} 1
Failure Reason:

Command failed (workunit test mon/mon-bind.sh) on smithi044 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-zafman-testing TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh'

fail 2959099 2018-08-30 05:18:47 2018-08-30 09:52:51 2018-08-30 10:28:51 0:36:00 0:20:13 0:15:47 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959100 2018-08-30 05:18:48 2018-08-30 09:52:52 2018-08-30 10:31:43 0:38:51 0:19:33 0:19:18 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959101 2018-08-30 05:18:49 2018-08-30 09:52:55 2018-08-30 10:47:44 0:54:49 0:23:26 0:31:23 smithi master centos 7.4 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959102 2018-08-30 05:18:50 2018-08-30 09:54:36 2018-08-30 10:28:36 0:34:00 0:23:35 0:10:25 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959103 2018-08-30 05:18:51 2018-08-30 09:54:36 2018-08-30 10:41:43 0:47:07 0:25:34 0:21:33 smithi master centos 7.4 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml msgr/simple.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959104 2018-08-30 05:18:52 2018-08-30 09:54:36 2018-08-30 10:18:35 0:23:59 0:09:32 0:14:27 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/repair_test.yaml} 2
Failure Reason:

Command failed on smithi187 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959105 2018-08-30 05:18:53 2018-08-30 09:56:47 2018-08-30 10:35:43 0:38:56 0:24:01 0:14:55 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959106 2018-08-30 05:18:54 2018-08-30 09:56:47 2018-08-30 10:18:47 0:22:00 0:09:17 0:12:43 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi027 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959107 2018-08-30 05:18:55 2018-08-30 09:56:47 2018-08-30 10:33:43 0:36:56 0:23:47 0:13:09 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959108 2018-08-30 05:18:56 2018-08-30 09:58:46 2018-08-30 10:33:43 0:34:57 0:19:45 0:15:12 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959109 2018-08-30 05:18:57 2018-08-30 09:58:46 2018-08-30 10:33:43 0:34:57 0:21:49 0:13:08 smithi master centos 7.4 rados/singleton/{all/rebuild-mondb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959110 2018-08-30 05:18:58 2018-08-30 09:58:51 2018-08-30 10:39:43 0:40:52 0:23:36 0:17:16 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959111 2018-08-30 05:18:59 2018-08-30 09:58:58 2018-08-30 10:41:44 0:42:46 0:28:13 0:14:33 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959112 2018-08-30 05:19:00 2018-08-30 09:59:02 2018-08-30 10:45:44 0:46:42 0:27:06 0:19:36 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959113 2018-08-30 05:19:01 2018-08-30 10:00:11 2018-08-30 10:38:10 0:37:59 0:19:50 0:18:09 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959114 2018-08-30 05:19:02 2018-08-30 10:00:36 2018-08-30 10:35:43 0:35:07 0:20:02 0:15:05 smithi master ubuntu 18.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

"2018-08-30 10:15:54.433427 mon.f (mon.0) 133 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

fail 2959115 2018-08-30 05:19:03 2018-08-30 10:00:36 2018-08-30 10:47:43 0:47:07 0:25:45 0:21:22 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 2959116 2018-08-30 05:19:04 2018-08-30 10:00:58 2018-08-30 10:16:57 0:15:59 0:08:32 0:07:27 smithi master rhel 7.5 rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{rhel_latest.yaml}} 1
fail 2959117 2018-08-30 05:19:05 2018-08-30 10:02:36 2018-08-30 10:33:43 0:31:07 0:19:20 0:11:47 smithi master ubuntu 18.04 rados/singleton/{all/recovery-preemption.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959118 2018-08-30 05:19:06 2018-08-30 10:02:46 2018-08-30 10:39:43 0:36:57 0:24:11 0:12:46 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959119 2018-08-30 05:19:07 2018-08-30 10:02:58 2018-08-30 10:47:44 0:44:46 0:27:12 0:17:34 smithi master centos 7.4 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959120 2018-08-30 05:19:08 2018-08-30 10:04:26 2018-08-30 10:24:26 0:20:00 0:11:25 0:08:35 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_write.yaml} 1
Failure Reason:

Command failed on smithi045 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959121 2018-08-30 05:19:09 2018-08-30 10:04:27 2018-08-30 10:40:26 0:35:59 0:19:51 0:16:08 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959122 2018-08-30 05:19:10 2018-08-30 10:04:38 2018-08-30 10:51:43 0:47:05 0:29:32 0:17:33 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959123 2018-08-30 05:19:11 2018-08-30 10:04:48 2018-08-30 10:41:43 0:36:55 0:20:04 0:16:51 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959124 2018-08-30 05:19:12 2018-08-30 10:04:48 2018-08-30 10:39:43 0:34:55 0:20:01 0:14:54 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959125 2018-08-30 05:19:13 2018-08-30 10:04:57 2018-08-30 10:45:44 0:40:47 0:25:48 0:14:59 smithi master centos 7.4 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rgw_snaps.yaml} 2
Failure Reason:

"2018-08-30 10:24:59.724948 mon.b (mon.0) 174 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 2959126 2018-08-30 05:19:14 2018-08-30 10:06:39 2018-08-30 10:37:43 0:31:04 0:19:20 0:11:44 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2018-08-30 10:19:21.729441 mon.a (mon.0) 55 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959127 2018-08-30 05:19:16 2018-08-30 10:06:40 2018-08-30 10:47:43 0:41:03 0:21:56 0:19:07 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959128 2018-08-30 05:19:17 2018-08-30 10:06:40 2018-08-30 10:39:43 0:33:03 0:18:57 0:14:06 smithi master ubuntu 16.04 rados/singleton/{all/reg11184.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959129 2018-08-30 05:19:19 2018-08-30 10:06:52 2018-08-30 10:47:44 0:40:52 0:22:30 0:18:22 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959130 2018-08-30 05:19:20 2018-08-30 10:06:57 2018-08-30 10:45:44 0:38:47 0:22:34 0:16:13 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/fastclose.yaml msgr/async.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959131 2018-08-30 05:19:22 2018-08-30 10:07:02 2018-08-30 10:47:44 0:40:42 0:24:38 0:16:04 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959132 2018-08-30 05:19:23 2018-08-30 10:07:14 2018-08-30 10:43:44 0:36:30 0:20:02 0:16:28 smithi master ubuntu 16.04 rados/multimon/{clusters/21.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

"2018-08-30 10:27:02.112903 mon.b (mon.0) 51 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

fail 2959133 2018-08-30 05:19:24 2018-08-30 10:08:25 2018-08-30 10:58:25 0:50:00 0:23:08 0:26:52 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959134 2018-08-30 05:19:25 2018-08-30 10:08:25 2018-08-30 10:48:25 0:40:00 0:22:50 0:17:10 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959135 2018-08-30 05:19:26 2018-08-30 10:08:26 2018-08-30 10:48:26 0:40:00 0:19:31 0:20:29 smithi master ubuntu 16.04 rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959136 2018-08-30 05:19:27 2018-08-30 10:08:37 2018-08-30 10:53:43 0:45:06 0:08:32 0:36:34 smithi master centos 7.4 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_latest.yaml} tasks/module_selftest.yaml} 2
Failure Reason:

"2018-08-30 10:51:45.680925 mon.b (mon.0) 58 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959137 2018-08-30 05:19:28 2018-08-30 10:08:50 2018-08-30 10:28:50 0:20:00 0:05:29 0:14:31 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi115 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959138 2018-08-30 05:19:29 2018-08-30 10:10:48 2018-08-30 10:53:44 0:42:56 0:20:30 0:22:26 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959139 2018-08-30 05:19:31 2018-08-30 10:10:55 2018-08-30 10:47:44 0:36:49 0:24:06 0:12:43 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959140 2018-08-30 05:19:33 2018-08-30 10:10:56 2018-08-30 10:53:44 0:42:48 0:20:34 0:22:14 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959141 2018-08-30 05:19:34 2018-08-30 10:11:06 2018-08-30 10:53:44 0:42:38 0:22:22 0:20:16 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959142 2018-08-30 05:19:36 2018-08-30 10:12:40 2018-08-30 10:53:44 0:41:04 0:21:57 0:19:07 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959143 2018-08-30 05:19:38 2018-08-30 10:12:46 2018-08-30 10:51:44 0:38:58 0:19:57 0:19:01 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959144 2018-08-30 05:19:39 2018-08-30 10:12:57 2018-08-30 10:49:44 0:36:47 0:22:55 0:13:52 smithi master rhel 7.5 rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959145 2018-08-30 05:19:40 2018-08-30 10:12:59 2018-08-30 10:57:44 0:44:45 0:24:29 0:20:16 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959146 2018-08-30 05:19:41 2018-08-30 10:15:16 2018-08-30 10:51:44 0:36:28 0:19:52 0:16:36 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959147 2018-08-30 05:19:42 2018-08-30 10:16:37 2018-08-30 10:39:43 0:23:06 0:07:05 0:16:01 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/scrub_test.yaml} 2
Failure Reason:

Command failed on smithi097 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959148 2018-08-30 05:19:43 2018-08-30 10:16:38 2018-08-30 10:55:44 0:39:06 0:23:41 0:15:25 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 2959149 2018-08-30 05:19:44 2018-08-30 10:16:58 2018-08-30 10:33:44 0:16:46 0:06:29 0:10:17 smithi master ubuntu 18.04 rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
pass 2959150 2018-08-30 05:19:45 2018-08-30 10:18:38 2018-08-30 10:51:43 0:33:05 0:24:07 0:08:58 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
dead 2959151 2018-08-30 05:19:46 2018-08-30 10:18:38 2018-08-30 15:13:35 4:54:57 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/osd.yaml} 1
fail 2959152 2018-08-30 05:19:47 2018-08-30 10:18:38 2018-08-30 11:23:44 1:05:06 0:21:33 0:43:33 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959153 2018-08-30 05:19:48 2018-08-30 10:18:38 2018-08-30 11:01:44 0:43:06 0:22:34 0:20:32 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959154 2018-08-30 05:19:49 2018-08-30 10:18:38 2018-08-30 15:13:35 4:54:57 smithi master centos 7.4 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml}
fail 2959155 2018-08-30 05:19:50 2018-08-30 10:18:42 2018-08-30 10:53:44 0:35:02 0:24:26 0:10:36 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959156 2018-08-30 05:19:51 2018-08-30 10:18:46 2018-08-30 10:37:43 0:18:57 0:05:57 0:13:00 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_seq_read.yaml} 1
Failure Reason:

Command failed on smithi204 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959157 2018-08-30 05:19:52 2018-08-30 10:18:48 2018-08-30 10:55:44 0:36:56 0:23:10 0:13:46 smithi master centos 7.4 rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

"2018-08-30 10:36:41.447672 mon.b (mon.0) 197 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 2959158 2018-08-30 05:19:53 2018-08-30 10:18:55 2018-08-30 10:57:44 0:38:49 0:20:51 0:17:58 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959159 2018-08-30 05:19:54 2018-08-30 10:19:20 2018-08-30 10:56:02 0:36:42 0:22:47 0:13:55 smithi master centos 7.4 rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2018-08-30 10:35:45.575380 mon.a (mon.0) 75 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959160 2018-08-30 05:19:55 2018-08-30 10:20:30 2018-08-30 11:19:29 0:58:59 0:22:00 0:36:59 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/random.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959161 2018-08-30 05:19:56 2018-08-30 10:20:34 2018-08-30 11:03:45 0:43:11 0:20:11 0:23:00 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959162 2018-08-30 05:19:57 2018-08-30 10:20:57 2018-08-30 10:57:44 0:36:47 0:23:11 0:13:36 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959163 2018-08-30 05:19:58 2018-08-30 10:22:19 2018-08-30 11:02:19 0:40:00 0:24:01 0:15:59 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959164 2018-08-30 05:19:59 2018-08-30 10:22:28 2018-08-30 10:57:29 0:35:01 0:20:25 0:14:36 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959165 2018-08-30 05:20:00 2018-08-30 10:24:36 2018-08-30 11:01:44 0:37:08 0:19:58 0:17:10 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959166 2018-08-30 05:20:01 2018-08-30 10:24:36 2018-08-30 11:05:44 0:41:08 0:24:21 0:16:47 smithi master centos 7.4 rados/singleton/{all/thrash-eio.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959167 2018-08-30 05:20:02 2018-08-30 10:24:57 2018-08-30 11:01:44 0:36:47 0:19:53 0:16:54 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959168 2018-08-30 05:20:03 2018-08-30 10:25:03 2018-08-30 11:01:44 0:36:41 0:23:28 0:13:13 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959169 2018-08-30 05:20:04 2018-08-30 10:26:39 2018-08-30 11:03:44 0:37:05 0:19:46 0:17:19 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959170 2018-08-30 05:20:05 2018-08-30 10:26:40 2018-08-30 10:49:43 0:23:03 0:07:49 0:15:14 smithi master centos 7.4 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi115 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959171 2018-08-30 05:20:06 2018-08-30 10:26:50 2018-08-30 11:13:44 0:46:54 0:22:43 0:24:11 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959172 2018-08-30 05:20:07 2018-08-30 10:28:47 2018-08-30 11:05:44 0:36:57 0:22:25 0:14:32 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959173 2018-08-30 05:20:08 2018-08-30 10:28:48 2018-08-30 11:03:44 0:34:56 0:20:02 0:14:54 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} 2
Failure Reason:

"2018-08-30 10:44:03.446018 mon.a (mon.0) 183 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

fail 2959174 2018-08-30 05:20:09 2018-08-30 10:28:51 2018-08-30 11:05:44 0:36:53 0:23:25 0:13:28 smithi master rhel 7.5 rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959175 2018-08-30 05:20:11 2018-08-30 10:28:52 2018-08-30 11:05:44 0:36:52 0:23:02 0:13:50 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959176 2018-08-30 05:20:12 2018-08-30 10:28:57 2018-08-30 10:45:44 0:16:47 smithi master centos 7.4 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{centos_latest.yaml} tasks/prometheus.yaml}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

fail 2959177 2018-08-30 05:20:13 2018-08-30 10:31:54 2018-08-30 11:03:54 0:32:00 0:19:25 0:12:35 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959178 2018-08-30 05:20:14 2018-08-30 10:31:54 2018-08-30 11:09:54 0:38:00 0:22:37 0:15:23 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959179 2018-08-30 05:20:15 2018-08-30 10:31:54 2018-08-30 11:07:54 0:36:00 0:19:28 0:16:32 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959180 2018-08-30 05:20:16 2018-08-30 10:33:59 2018-08-30 11:13:58 0:39:59 0:19:59 0:20:00 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959181 2018-08-30 05:20:17 2018-08-30 10:33:59 2018-08-30 11:19:58 0:45:59 0:24:26 0:21:33 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959182 2018-08-30 05:20:18 2018-08-30 10:33:59 2018-08-30 11:19:59 0:46:00 0:24:33 0:21:27 smithi master centos 7.4 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959183 2018-08-30 05:20:19 2018-08-30 10:33:59 2018-08-30 11:17:58 0:43:59 0:23:13 0:20:46 smithi master centos 7.4 rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 2
Failure Reason:

"2018-08-30 10:58:03.522721 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 2959184 2018-08-30 05:20:20 2018-08-30 10:33:59 2018-08-30 11:11:59 0:38:00 0:19:42 0:18:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959185 2018-08-30 05:20:21 2018-08-30 10:36:01 2018-08-30 11:30:01 0:54:00 0:21:12 0:32:48 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/osd-delay.yaml msgr/simple.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959186 2018-08-30 05:20:22 2018-08-30 10:36:01 2018-08-30 11:12:00 0:35:59 0:19:41 0:16:18 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959187 2018-08-30 05:20:24 2018-08-30 10:37:58 2018-08-30 11:13:57 0:35:59 0:20:19 0:15:40 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959188 2018-08-30 05:20:25 2018-08-30 10:37:58 2018-08-30 11:11:57 0:33:59 0:24:35 0:09:24 smithi master rhel 7.5 rados/multimon/{clusters/21.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/mon_clock_with_skews.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959189 2018-08-30 05:20:26 2018-08-30 10:37:57 2018-08-30 11:09:57 0:32:00 0:23:25 0:08:35 smithi master rhel 7.5 rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2018-08-30 10:53:30.538844 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959190 2018-08-30 05:20:27 2018-08-30 10:38:12 2018-08-30 10:58:11 0:19:59 0:08:07 0:11:52 smithi master centos 7.4 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi134 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959191 2018-08-30 05:20:28 2018-08-30 10:39:55 2018-08-30 11:17:54 0:37:59 0:19:57 0:18:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959192 2018-08-30 05:20:29 2018-08-30 10:39:55 2018-08-30 11:23:55 0:44:00 0:23:40 0:20:20 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959193 2018-08-30 05:20:30 2018-08-30 10:39:55 2018-08-30 11:17:55 0:38:00 0:23:41 0:14:19 smithi master centos 7.4 rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959194 2018-08-30 05:20:31 2018-08-30 10:39:55 2018-08-30 11:23:55 0:44:00 0:23:19 0:20:41 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-08-30 11:02:02.428741 mon.a (mon.0) 156 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

fail 2959195 2018-08-30 05:20:32 2018-08-30 10:39:56 2018-08-30 11:27:55 0:47:59 0:23:52 0:24:07 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959196 2018-08-30 05:20:33 2018-08-30 10:39:55 2018-08-30 11:17:54 0:37:59 0:23:31 0:14:28 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959197 2018-08-30 05:20:34 2018-08-30 10:40:22 2018-08-30 11:46:23 1:06:01 0:54:55 0:11:06 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-08-30 11:05:13.303088 mon.a (mon.0) 160 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959198 2018-08-30 05:20:35 2018-08-30 10:40:27 2018-08-30 11:14:27 0:34:00 0:19:46 0:14:14 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959199 2018-08-30 05:20:36 2018-08-30 10:41:56 2018-08-30 11:23:55 0:41:59 0:20:02 0:21:57 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} 2
Failure Reason:

"2018-08-30 11:01:08.414329 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959200 2018-08-30 05:20:37 2018-08-30 10:41:56 2018-08-30 11:25:55 0:43:59 0:19:41 0:24:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959201 2018-08-30 05:20:38 2018-08-30 10:41:56 2018-08-30 11:27:56 0:46:00 0:24:34 0:21:26 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959202 2018-08-30 05:20:39 2018-08-30 10:41:56 2018-08-30 11:11:55 0:29:59 0:18:56 0:11:03 smithi master ubuntu 16.04 rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

"2018-08-30 10:53:20.066620 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2959203 2018-08-30 05:20:40 2018-08-30 10:44:08 2018-08-30 11:26:07 0:41:59 0:24:30 0:17:29 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959204 2018-08-30 05:20:41 2018-08-30 10:44:08 2018-08-30 11:02:07 0:17:59 0:09:20 0:08:39 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4M_write.yaml} 1
Failure Reason:

Command failed on smithi016 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959205 2018-08-30 05:20:42 2018-08-30 10:45:59 2018-08-30 11:17:58 0:31:59 0:18:46 0:13:13 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

"2018-08-30 11:00:10.709971 mon.a (mon.0) 60 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

dead 2959206 2018-08-30 05:20:43 2018-08-30 10:46:00 2018-08-30 13:20:01 2:34:01 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/scrub.yaml} 1
fail 2959207 2018-08-30 05:20:44 2018-08-30 10:46:00 2018-08-30 11:27:59 0:41:59 0:20:28 0:21:31 smithi master ubuntu 16.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959208 2018-08-30 05:20:45 2018-08-30 10:45:59 2018-08-30 11:23:58 0:37:59 0:23:24 0:14:35 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959209 2018-08-30 05:20:46 2018-08-30 10:47:57 2018-08-30 13:19:59 2:32:02 smithi master rhel 7.5 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml}
fail 2959210 2018-08-30 05:20:47 2018-08-30 10:47:58 2018-08-30 11:31:57 0:43:59 0:19:41 0:24:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959211 2018-08-30 05:20:48 2018-08-30 10:47:57 2018-08-30 11:27:57 0:40:00 0:23:29 0:16:31 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959212 2018-08-30 05:20:49 2018-08-30 10:47:57 2018-08-30 11:29:57 0:42:00 0:23:05 0:18:55 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959213 2018-08-30 05:20:50 2018-08-30 10:47:57 2018-08-30 11:29:57 0:42:00 0:19:43 0:22:17 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959214 2018-08-30 05:20:51 2018-08-30 10:47:57 2018-08-30 11:31:57 0:44:00 0:24:13 0:19:47 smithi master centos 7.4 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml msgr/async.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959215 2018-08-30 05:20:52 2018-08-30 10:47:57 2018-08-30 11:21:57 0:34:00 0:19:13 0:14:47 smithi master ubuntu 16.04 rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959216 2018-08-30 05:20:53 2018-08-30 10:47:57 2018-08-30 11:31:57 0:44:00 0:24:10 0:19:50 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959217 2018-08-30 05:20:54 2018-08-30 10:48:27 2018-08-30 11:26:27 0:38:00 0:19:41 0:18:19 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959218 2018-08-30 05:20:56 2018-08-30 10:48:27 2018-08-30 11:30:27 0:42:00 0:19:23 0:22:37 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959219 2018-08-30 05:20:57 2018-08-30 10:49:56 2018-08-30 11:09:55 0:19:59 0:08:38 0:11:21 smithi master centos 7.4 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml supported-random-distro$/{centos_latest.yaml} tasks/workunits.yaml} 2
Failure Reason:

"2018-08-30 11:06:59.912901 mon.a (mon.0) 100 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 2959220 2018-08-30 05:20:58 2018-08-30 10:49:56 2018-08-30 11:31:56 0:42:00 0:19:53 0:22:07 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959221 2018-08-30 05:20:59 2018-08-30 10:52:00 2018-08-30 11:34:00 0:42:00 0:23:43 0:18:17 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959222 2018-08-30 05:21:00 2018-08-30 10:52:01 2018-08-30 11:26:00 0:33:59 0:19:00 0:14:59 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959223 2018-08-30 05:21:01 2018-08-30 10:52:01 2018-08-30 11:16:00 0:23:59 0:05:27 0:18:32 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/sample_fio.yaml} 1
Failure Reason:

Command failed on smithi076 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959224 2018-08-30 05:21:02 2018-08-30 10:52:01 2018-08-30 11:32:01 0:40:00 0:19:29 0:20:31 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959225 2018-08-30 05:21:03 2018-08-30 10:53:55 2018-08-30 11:33:54 0:39:59 0:22:07 0:17:52 smithi master centos 7.4 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rados_python.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959226 2018-08-30 05:21:04 2018-08-30 10:53:55 2018-08-30 13:19:57 2:26:02 smithi master ubuntu 18.04 rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 2959227 2018-08-30 05:21:05 2018-08-30 10:53:55 2018-08-30 11:35:54 0:41:59 0:23:16 0:18:43 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959228 2018-08-30 05:21:06 2018-08-30 10:53:55 2018-08-30 11:35:54 0:41:59 0:24:11 0:17:48 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959229 2018-08-30 05:21:07 2018-08-30 10:53:55 2018-08-30 11:33:55 0:40:00 0:23:32 0:16:28 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959230 2018-08-30 05:21:08 2018-08-30 10:53:55 2018-08-30 11:35:55 0:42:00 0:22:33 0:19:27 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959231 2018-08-30 05:21:09 2018-08-30 10:55:57 2018-08-30 11:27:57 0:32:00 0:18:48 0:13:12 smithi master ubuntu 16.04 rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959232 2018-08-30 05:21:10 2018-08-30 10:55:57 2018-08-30 11:31:57 0:36:00 0:19:26 0:16:34 smithi master ubuntu 16.04 rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

"2018-08-30 11:12:48.945622 mon.b (mon.0) 170 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 2959233 2018-08-30 05:21:11 2018-08-30 10:56:03 2018-08-30 11:30:03 0:34:00 0:21:36 0:12:24 smithi master centos 7.4 rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959234 2018-08-30 05:21:12 2018-08-30 10:57:39 2018-08-30 11:39:39 0:42:00 0:20:00 0:22:00 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959235 2018-08-30 05:21:13 2018-08-30 10:57:45 2018-08-30 11:35:45 0:38:00 0:22:35 0:15:25 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959236 2018-08-30 05:21:14 2018-08-30 10:57:45 2018-08-30 11:37:45 0:40:00 0:23:36 0:16:24 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959237 2018-08-30 05:21:15 2018-08-30 10:57:46 2018-08-30 11:37:45 0:39:59 0:22:33 0:17:26 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959238 2018-08-30 05:21:16 2018-08-30 10:58:13 2018-08-30 11:18:12 0:19:59 0:09:13 0:10:46 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/sample_radosbench.yaml} 1
Failure Reason:

Command failed on smithi048 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2959239 2018-08-30 05:21:17 2018-08-30 10:58:27 2018-08-30 11:38:27 0:40:00 0:21:59 0:18:01 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml two-plus-three.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/random.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 3
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959240 2018-08-30 05:21:18 2018-08-30 11:00:19 2018-08-30 11:32:19 0:32:00 0:18:48 0:13:12 smithi master ubuntu 16.04 rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959241 2018-08-30 05:21:20 2018-08-30 11:01:55 2018-08-30 11:39:54 0:37:59 0:22:25 0:15:34 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 2959242 2018-08-30 05:21:21 2018-08-30 11:01:55 2018-08-30 11:13:54 0:11:59 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml}
Failure Reason:

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/task/cancel (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7ff1bd3c81d0>: Failed to establish a new connection: [Errno 113] No route to host',))

dead 2959243 2018-08-30 05:21:22 2018-08-30 11:01:55 2018-08-30 11:13:54 0:11:59 smithi master centos 7.4 rados/multimon/{clusters/3.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_recovery.yaml}
Failure Reason:

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/task/cancel (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f0b7f53bdd0>: Failed to establish a new connection: [Errno 113] No route to host',))

dead 2959244 2018-08-30 05:21:23 2018-08-30 11:01:55 2018-08-30 11:13:54 0:11:59 smithi master centos 7.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml}
Failure Reason:

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/task/cancel (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f5728039a90>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 2959245 2018-08-30 05:21:24 2018-08-30 11:02:08 2018-08-30 11:36:08 0:34:00 0:20:04 0:13:56 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959246 2018-08-30 05:21:27 2018-08-30 11:02:21 2018-08-30 11:36:20 0:33:59 0:23:36 0:10:23 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

fail 2959247 2018-08-30 05:21:28 2018-08-30 11:03:54 2018-08-30 11:39:54 0:36:00 0:19:53 0:16:07 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_stress_watch.yaml} 2
Failure Reason:

"2018-08-30 11:19:54.480011 mon.a (mon.0) 158 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log

fail 2959248 2018-08-30 05:21:29 2018-08-30 11:03:54 2018-08-30 11:39:54 0:36:00 0:23:35 0:12:25 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 2959249 2018-08-30 05:21:30 2018-08-30 11:03:55 2018-08-30 11:19:54 0:15:59 0:07:17 0:08:42 smithi master centos 7.4 rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1