Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 2442995 2018-04-26 20:35:01 2018-04-27 00:06:54 2018-04-27 00:28:54 0:22:00 0:07:39 0:14:21 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi055 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2442996 2018-04-26 20:35:02 2018-04-27 00:06:55 2018-04-27 00:44:55 0:38:00 0:21:15 0:16:45 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

Command failed on smithi203 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2442997 2018-04-26 20:35:02 2018-04-27 00:08:53 2018-04-27 00:26:53 0:18:00 0:06:49 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi061 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2442998 2018-04-26 20:35:03 2018-04-27 00:08:54 2018-04-27 00:44:54 0:36:00 0:23:12 0:12:48 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi171 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2442999 2018-04-26 20:35:04 2018-04-27 00:08:54 2018-04-27 00:28:54 0:20:00 0:12:45 0:07:15 smithi master centos rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
Failure Reason:

"2018-04-27 00:26:57.009905 mon.a mon.0 172.21.15.81:6789/0 72 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2443000 2018-04-26 20:35:04 2018-04-27 00:09:09 2018-04-27 00:27:09 0:18:00 0:06:30 0:11:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi067 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443001 2018-04-26 20:35:05 2018-04-27 00:10:41 2018-04-27 00:28:41 0:18:00 0:06:35 0:11:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi182 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443002 2018-04-26 20:35:06 2018-04-27 00:10:41 2018-04-27 00:24:41 0:14:00 0:05:18 0:08:42 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/rhel_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

{'smithi160.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}}

fail 2443003 2018-04-26 20:35:07 2018-04-27 00:10:41 2018-04-27 00:30:41 0:20:00 0:11:14 0:08:46 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi007 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443004 2018-04-26 20:35:08 2018-04-27 00:10:42 2018-04-27 00:32:41 0:21:59 0:10:38 0:11:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi154 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443005 2018-04-26 20:35:08 2018-04-27 00:10:42 2018-04-27 00:40:41 0:29:59 0:19:23 0:10:36 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi051 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443006 2018-04-26 20:35:09 2018-04-27 00:10:43 2018-04-27 00:30:42 0:19:59 0:06:59 0:13:00 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi137 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443007 2018-04-26 20:35:10 2018-04-27 00:10:44 2018-04-27 00:28:46 0:18:02 0:07:24 0:10:38 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/prometheus.yaml} 2
Failure Reason:

Command failed on smithi170 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443008 2018-04-26 20:35:11 2018-04-27 00:12:48 2018-04-27 00:30:48 0:18:00 0:06:38 0:11:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi200 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443009 2018-04-26 20:35:11 2018-04-27 00:12:49 2018-04-27 00:30:48 0:17:59 0:07:35 0:10:24 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi038 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443010 2018-04-26 20:35:12 2018-04-27 00:12:49 2018-04-27 00:34:48 0:21:59 0:07:48 0:14:11 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi088 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443011 2018-04-26 20:35:13 2018-04-27 00:12:49 2018-04-27 00:34:48 0:21:59 0:08:23 0:13:36 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi129 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443012 2018-04-26 20:35:13 2018-04-27 00:12:49 2018-04-27 00:30:48 0:17:59 0:06:32 0:11:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi165 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443013 2018-04-26 20:35:14 2018-04-27 00:12:49 2018-04-27 00:30:48 0:17:59 0:06:22 0:11:37 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi084 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443014 2018-04-26 20:35:15 2018-04-27 00:12:49 2018-04-27 00:32:48 0:19:59 0:06:41 0:13:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi044 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443015 2018-04-26 20:35:16 2018-04-27 00:12:49 2018-04-27 00:36:48 0:23:59 0:11:43 0:12:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443016 2018-04-26 20:35:16 2018-04-27 00:14:47 2018-04-27 00:38:46 0:23:59 0:12:01 0:11:58 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/readwrite.yaml} 2
Failure Reason:

Command failed on smithi023 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443017 2018-04-26 20:35:17 2018-04-27 00:14:48 2018-04-27 00:32:47 0:17:59 0:06:49 0:11:10 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi005 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443018 2018-04-26 20:35:18 2018-04-27 00:14:48 2018-04-27 00:30:47 0:15:59 0:06:21 0:09:38 smithi master rados/objectstore/alloc-hint.yaml 1
Failure Reason:

Command failed on smithi100 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443019 2018-04-26 20:35:19 2018-04-27 00:14:48 2018-04-27 00:34:47 0:19:59 0:09:41 0:10:18 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi167 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443020 2018-04-26 20:35:19 2018-04-27 00:14:47 2018-04-27 00:30:46 0:15:59 0:06:12 0:09:47 smithi master rados/rest/mgr-restful.yaml 1
Failure Reason:

Command failed on smithi077 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443021 2018-04-26 20:35:20 2018-04-27 00:14:48 2018-04-27 00:30:47 0:15:59 0:06:08 0:09:51 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi197 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuri-testing-2018-04-26-1557 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 2443022 2018-04-26 20:35:21 2018-04-27 00:14:47 2018-04-27 00:32:46 0:17:59 0:10:16 0:07:43 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi009 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443023 2018-04-26 20:35:22 2018-04-27 00:14:47 2018-04-27 00:30:46 0:15:59 0:06:22 0:09:37 smithi master rados/standalone/crush.yaml 1
fail 2443024 2018-04-26 20:35:22 2018-04-27 00:14:49 2018-04-27 00:36:48 0:21:59 0:09:58 0:12:01 smithi master rados/upgrade/luminous-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/luminous.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-mimic.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi037 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

fail 2443025 2018-04-26 20:35:23 2018-04-27 00:16:51 2018-04-27 00:32:50 0:15:59 0:06:18 0:09:41 smithi master rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi086 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443026 2018-04-26 20:35:24 2018-04-27 00:16:51 2018-04-27 00:38:50 0:21:59 0:06:19 0:15:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi072 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443027 2018-04-26 20:35:24 2018-04-27 00:16:50 2018-04-27 00:34:50 0:18:00 0:07:07 0:10:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi161 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443028 2018-04-26 20:35:25 2018-04-27 00:16:51 2018-04-27 00:34:50 0:17:59 0:06:58 0:11:01 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi045 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443029 2018-04-26 20:35:26 2018-04-27 00:16:51 2018-04-27 00:44:50 0:27:59 0:17:36 0:10:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi089 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443030 2018-04-26 20:35:27 2018-04-27 00:16:51 2018-04-27 00:34:50 0:17:59 0:08:45 0:09:14 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi004 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443031 2018-04-26 20:35:27 2018-04-27 00:16:50 2018-04-27 01:26:51 1:10:01 0:59:11 0:10:50 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

Command failed on smithi103 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443032 2018-04-26 20:35:28 2018-04-27 00:16:51 2018-04-27 00:34:50 0:17:59 0:06:46 0:11:13 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi102 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443033 2018-04-26 20:35:29 2018-04-27 00:16:53 2018-04-27 00:38:52 0:21:59 0:06:33 0:15:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi079 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443034 2018-04-26 20:35:29 2018-04-27 00:18:59 2018-04-27 00:36:58 0:17:59 0:06:30 0:11:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi059 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443035 2018-04-26 20:35:30 2018-04-27 00:18:59 2018-04-27 00:36:58 0:17:59 0:06:49 0:11:10 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Command failed on smithi204 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443036 2018-04-26 20:35:31 2018-04-27 00:18:59 2018-04-27 00:36:58 0:17:59 0:08:22 0:09:37 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_write.yaml} 1
Failure Reason:

Command failed on smithi071 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443037 2018-04-26 20:35:32 2018-04-27 00:18:59 2018-04-27 00:36:58 0:17:59 0:07:29 0:10:30 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi074 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443038 2018-04-26 20:35:32 2018-04-27 00:18:58 2018-04-27 00:44:58 0:26:00 0:15:31 0:10:29 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
Failure Reason:

Command failed on smithi080 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443039 2018-04-26 20:35:33 2018-04-27 00:20:42 2018-04-27 00:38:41 0:17:59 0:06:23 0:11:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi145 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443040 2018-04-26 20:35:34 2018-04-27 00:20:52 2018-04-27 00:40:51 0:19:59 0:08:58 0:11:01 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml} 2
Failure Reason:

Command failed on smithi153 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443041 2018-04-26 20:35:35 2018-04-27 00:20:52 2018-04-27 00:46:51 0:25:59 0:19:14 0:06:45 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-04-27 00:44:31.804216 mon.a mon.0 172.21.15.92:6789/0 329 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2443042 2018-04-26 20:35:35 2018-04-27 00:20:52 2018-04-27 00:36:52 0:16:00 0:06:23 0:09:37 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi199 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443043 2018-04-26 20:35:36 2018-04-27 00:22:39 2018-04-27 01:04:39 0:42:00 0:32:11 0:09:49 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi011 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443044 2018-04-26 20:35:37 2018-04-27 00:22:39 2018-04-27 00:38:38 0:15:59 0:06:26 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi112 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443045 2018-04-26 20:35:38 2018-04-27 00:22:43 2018-04-27 00:38:42 0:15:59 0:05:58 0:10:01 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi024 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.0 injectargs -- '--mon-pg-stuck-threshold 10'"

fail 2443046 2018-04-26 20:35:38 2018-04-27 00:22:44 2018-04-27 00:38:43 0:15:59 0:06:28 0:09:31 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443047 2018-04-26 20:35:39 2018-04-27 00:22:44 2018-04-27 00:40:43 0:17:59 0:06:18 0:11:41 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/ubuntu_latest.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi146 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443048 2018-04-26 20:35:40 2018-04-27 00:22:46 2018-04-27 00:40:46 0:18:00 0:06:10 0:11:50 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml tasks/workunits.yaml} 2
Failure Reason:

Command failed on smithi097 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443049 2018-04-26 20:35:40 2018-04-27 00:22:51 2018-04-27 00:38:50 0:15:59 0:06:01 0:09:58 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi162 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443050 2018-04-26 20:35:41 2018-04-27 00:22:51 2018-04-27 00:42:50 0:19:59 0:10:34 0:09:25 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
Failure Reason:

Command failed on smithi056 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443051 2018-04-26 20:35:42 2018-04-27 00:22:51 2018-04-27 00:44:50 0:21:59 0:07:30 0:14:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi061 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443052 2018-04-26 20:35:43 2018-04-27 00:24:41 2018-04-27 00:54:41 0:30:00 0:17:34 0:12:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi067 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443053 2018-04-26 20:35:43 2018-04-27 00:24:41 2018-04-27 00:56:41 0:32:00 0:21:31 0:10:29 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi185 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443054 2018-04-26 20:35:44 2018-04-27 00:24:42 2018-04-27 00:46:42 0:22:00 0:10:56 0:11:04 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/sample_fio.yaml} 1
Failure Reason:

Command failed on smithi194 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443055 2018-04-26 20:35:45 2018-04-27 00:24:43 2018-04-27 00:44:42 0:19:59 0:06:45 0:13:14 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi164 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443056 2018-04-26 20:35:45 2018-04-27 00:26:56 2018-04-27 00:46:55 0:19:59 0:07:33 0:12:26 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi121 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443057 2018-04-26 20:35:46 2018-04-27 00:26:57 2018-04-27 00:44:56 0:17:59 0:06:45 0:11:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi016 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443058 2018-04-26 20:35:47 2018-04-27 00:26:57 2018-04-27 00:50:56 0:23:59 0:13:11 0:10:48 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rgw_snaps.yaml} 2
Failure Reason:

timeout expired in wait_for_pool

fail 2443059 2018-04-26 20:35:48 2018-04-27 00:26:57 2018-04-27 00:42:55 0:15:58 0:06:19 0:09:39 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi170 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443060 2018-04-26 20:35:48 2018-04-27 00:27:11 2018-04-27 00:45:10 0:17:59 0:06:37 0:11:22 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi082 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443061 2018-04-26 20:35:49 2018-04-27 00:28:42 2018-04-27 00:50:42 0:22:00 0:10:44 0:11:16 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Command failed on smithi073 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443062 2018-04-26 20:35:50 2018-04-27 00:28:43 2018-04-27 00:46:42 0:17:59 0:07:27 0:10:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi055 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443063 2018-04-26 20:35:51 2018-04-27 00:28:43 2018-04-27 00:42:42 0:13:59 0:05:46 0:08:13 smithi master rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi033 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443064 2018-04-26 20:35:51 2018-04-27 00:28:44 2018-04-27 00:42:43 0:13:59 0:04:47 0:09:12 smithi master rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 2443065 2018-04-26 20:35:52 2018-04-27 00:28:48 2018-04-27 00:44:47 0:15:59 0:06:39 0:09:20 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi165 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

pass 2443066 2018-04-26 20:35:53 2018-04-27 00:28:48 2018-04-27 01:02:48 0:34:00 0:24:54 0:09:06 smithi master rados/standalone/erasure-code.yaml 1
fail 2443067 2018-04-26 20:35:53 2018-04-27 00:28:51 2018-04-27 00:48:50 0:19:59 0:10:27 0:09:32 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi182 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443068 2018-04-26 20:35:54 2018-04-27 00:28:51 2018-04-27 00:46:50 0:17:59 0:06:51 0:11:08 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi158 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443069 2018-04-26 20:35:55 2018-04-27 00:28:56 2018-04-27 00:56:55 0:27:59 0:18:31 0:09:28 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi175 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443070 2018-04-26 20:35:56 2018-04-27 00:28:56 2018-04-27 00:46:55 0:17:59 0:06:39 0:11:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi064 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443071 2018-04-26 20:35:56 2018-04-27 00:29:01 2018-04-27 00:49:02 0:20:01 0:09:26 0:10:35 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/sample_radosbench.yaml} 1
Failure Reason:

Command failed on smithi084 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443072 2018-04-26 20:35:57 2018-04-27 00:30:52 2018-04-27 00:46:52 0:16:00 0:06:26 0:09:34 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi136 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443073 2018-04-26 20:35:58 2018-04-27 00:30:54 2018-04-27 00:46:52 0:15:58 0:06:22 0:09:36 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi200 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443074 2018-04-26 20:35:59 2018-04-27 00:30:55 2018-04-27 01:02:53 0:31:58 0:21:25 0:10:33 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi100 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443075 2018-04-26 20:35:59 2018-04-27 00:30:56 2018-04-27 00:52:54 0:21:58 0:09:50 0:12:08 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/scrub_test.yaml} 2
Failure Reason:

Command failed on smithi026 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443076 2018-04-26 20:36:00 2018-04-27 00:30:53 2018-04-27 01:02:52 0:31:59 0:23:25 0:08:34 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi137 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443077 2018-04-26 20:36:01 2018-04-27 00:30:54 2018-04-27 00:48:52 0:17:58 0:07:27 0:10:31 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi038 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443078 2018-04-26 20:36:02 2018-04-27 00:30:55 2018-04-27 00:44:52 0:13:57 0:06:20 0:07:37 smithi master rados/objectstore/filejournal.yaml 1
Failure Reason:

Command failed on smithi007 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443079 2018-04-26 20:36:02 2018-04-27 00:30:55 2018-04-27 00:46:53 0:15:58 0:06:36 0:09:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi154 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

pass 2443080 2018-04-26 20:36:03 2018-04-27 00:30:55 2018-04-27 00:46:53 0:15:58 0:05:05 0:10:53 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
fail 2443081 2018-04-26 20:36:04 2018-04-27 00:30:56 2018-04-27 00:48:54 0:17:58 0:06:41 0:11:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi178 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443082 2018-04-26 20:36:04 2018-04-27 00:30:54 2018-04-27 00:46:53 0:15:59 0:06:22 0:09:37 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi197 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443083 2018-04-26 20:36:05 2018-04-27 00:30:55 2018-04-27 00:44:53 0:13:58 0:05:59 0:07:59 smithi master rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi174 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443084 2018-04-26 20:36:06 2018-04-27 00:30:56 2018-04-27 00:48:54 0:17:58 0:06:15 0:11:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi086 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443085 2018-04-26 20:36:07 2018-04-27 00:32:30 2018-04-27 01:00:30 0:28:00 0:17:59 0:10:01 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi044 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443086 2018-04-26 20:36:07 2018-04-27 00:32:42 2018-04-27 00:52:42 0:20:00 0:11:26 0:08:34 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi192 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443087 2018-04-26 20:36:08 2018-04-27 00:32:44 2018-04-27 00:48:43 0:15:59 0:05:50 0:10:09 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuri-testing-2018-04-26-1557 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 2443088 2018-04-26 20:36:09 2018-04-27 00:32:48 2018-04-27 00:50:47 0:17:59 0:09:48 0:08:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi005 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443089 2018-04-26 20:36:10 2018-04-27 00:32:48 2018-04-27 00:46:47 0:13:59 0:08:19 0:05:40 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/centos_latest.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi008 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443090 2018-04-26 20:36:10 2018-04-27 00:32:48 2018-04-27 01:12:48 0:40:00 0:28:29 0:11:31 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi068 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443091 2018-04-26 20:36:11 2018-04-27 00:32:48 2018-04-27 00:50:47 0:17:59 0:06:52 0:11:07 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
Failure Reason:

Command failed on smithi002 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443092 2018-04-26 20:36:12 2018-04-27 00:32:50 2018-04-27 00:50:49 0:17:59 0:06:31 0:11:28 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi045 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443093 2018-04-26 20:36:13 2018-04-27 00:32:51 2018-04-27 00:50:50 0:17:59 0:06:48 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi167 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443094 2018-04-26 20:36:13 2018-04-27 00:34:52 2018-04-27 00:50:51 0:15:59 0:06:26 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi198 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443095 2018-04-26 20:36:14 2018-04-27 00:34:52 2018-04-27 00:58:52 0:24:00 0:14:01 0:09:59 smithi master rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi187 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443096 2018-04-26 20:36:15 2018-04-27 00:34:52 2018-04-27 00:52:52 0:18:00 0:06:54 0:11:06 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi062 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443097 2018-04-26 20:36:15 2018-04-27 00:34:52 2018-04-27 01:04:52 0:30:00 0:19:51 0:10:09 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443098 2018-04-26 20:36:16 2018-04-27 00:34:52 2018-04-27 00:50:51 0:15:59 0:06:21 0:09:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi129 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443099 2018-04-26 20:36:19 2018-04-27 00:34:52 2018-04-27 00:52:51 0:17:59 0:07:25 0:10:34 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi088 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443100 2018-04-26 20:36:20 2018-04-27 00:34:52 2018-04-27 00:56:52 0:22:00 0:08:10 0:13:50 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi102 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443101 2018-04-26 20:36:22 2018-04-27 00:34:52 2018-04-27 00:56:51 0:21:59 0:12:30 0:09:29 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi189 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443102 2018-04-26 20:36:22 2018-04-27 00:34:52 2018-04-27 00:48:52 0:14:00 0:05:54 0:08:06 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi199 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443103 2018-04-26 20:36:23 2018-04-27 00:34:52 2018-04-27 00:54:51 0:19:59 0:10:10 0:09:49 smithi master rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi117 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443104 2018-04-26 20:36:24 2018-04-27 00:34:53 2018-04-27 00:54:53 0:20:00 0:11:18 0:08:42 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi144 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443105 2018-04-26 20:36:25 2018-04-27 00:36:53 2018-04-27 00:54:53 0:18:00 0:06:39 0:11:21 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi074 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443106 2018-04-26 20:36:25 2018-04-27 00:36:54 2018-04-27 00:52:53 0:15:59 0:06:14 0:09:45 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi104 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443107 2018-04-26 20:36:26 2018-04-27 00:36:53 2018-04-27 00:52:53 0:16:00 0:06:32 0:09:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi202 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443108 2018-04-26 20:36:27 2018-04-27 00:36:53 2018-04-27 03:05:00 2:28:07 2:19:36 0:08:31 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
Failure Reason:

Command failed on smithi186 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443109 2018-04-26 20:36:28 2018-04-27 00:36:54 2018-04-27 00:56:53 0:19:59 0:11:21 0:08:38 smithi master rados/standalone/misc.yaml 1
fail 2443110 2018-04-26 20:36:28 2018-04-27 00:36:54 2018-04-27 00:54:53 0:17:59 0:07:58 0:10:01 smithi master rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi111 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443111 2018-04-26 20:36:29 2018-04-27 00:36:55 2018-04-27 00:52:54 0:15:59 0:06:33 0:09:26 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi109 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443112 2018-04-26 20:36:30 2018-04-27 00:36:59 2018-04-27 00:52:59 0:16:00 0:06:53 0:09:07 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443113 2018-04-26 20:36:30 2018-04-27 00:36:59 2018-04-27 01:03:00 0:26:01 0:16:26 0:09:35 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi145 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443114 2018-04-26 20:36:31 2018-04-27 00:36:59 2018-04-27 00:54:59 0:18:00 0:06:24 0:11:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi072 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443115 2018-04-26 20:36:32 2018-04-27 00:37:00 2018-04-27 00:56:59 0:19:59 0:08:47 0:11:12 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_cls_all.yaml} 2
Failure Reason:

Command failed on smithi079 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443116 2018-04-26 20:36:33 2018-04-27 00:38:40 2018-04-27 00:56:39 0:17:59 0:07:41 0:10:18 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi023 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443117 2018-04-26 20:36:33 2018-04-27 00:38:43 2018-04-27 00:56:42 0:17:59 0:10:54 0:07:05 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi003 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443118 2018-04-26 20:36:34 2018-04-27 00:38:44 2018-04-27 00:56:43 0:17:59 0:08:29 0:09:30 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi155 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443119 2018-04-26 20:36:35 2018-04-27 00:38:45 2018-04-27 00:54:44 0:15:59 0:06:46 0:09:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi024 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443120 2018-04-26 20:36:36 2018-04-27 00:38:45 2018-04-27 01:04:45 0:26:00 0:15:51 0:10:09 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443121 2018-04-26 20:36:36 2018-04-27 00:38:48 2018-04-27 00:56:47 0:17:59 0:06:39 0:11:20 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

Command failed on smithi085 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443122 2018-04-26 20:36:37 2018-04-27 00:38:51 2018-04-27 00:52:51 0:14:00 0:06:36 0:07:24 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi132 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443123 2018-04-26 20:36:38 2018-04-27 00:38:52 2018-04-27 00:56:51 0:17:59 0:06:34 0:11:25 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi153 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443124 2018-04-26 20:36:39 2018-04-27 00:38:52 2018-04-27 00:58:51 0:19:59 0:10:40 0:09:19 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi112 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443125 2018-04-26 20:36:39 2018-04-27 00:38:54 2018-04-27 00:54:53 0:15:59 0:06:39 0:09:20 smithi master rados/singleton/{all/mon-config.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi083 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443126 2018-04-26 20:36:40 2018-04-27 00:40:56 2018-04-27 00:58:55 0:17:59 0:08:54 0:09:05 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/failover.yaml} 2
Failure Reason:

Command failed on smithi017 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443127 2018-04-26 20:36:41 2018-04-27 00:40:56 2018-04-27 00:56:55 0:15:59 0:06:30 0:09:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi051 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443128 2018-04-26 20:36:41 2018-04-27 00:40:57 2018-04-27 00:56:56 0:15:59 0:06:29 0:09:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi036 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443129 2018-04-26 20:36:42 2018-04-27 00:40:56 2018-04-27 00:56:55 0:15:59 0:06:47 0:09:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi022 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443130 2018-04-26 20:36:43 2018-04-27 00:40:57 2018-04-27 00:52:56 0:11:59 0:05:23 0:06:36 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/rhel_latest.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

{'smithi146.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}}

fail 2443131 2018-04-26 20:36:44 2018-04-27 00:40:57 2018-04-27 00:56:55 0:15:58 0:06:27 0:09:31 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi190 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443132 2018-04-26 20:36:44 2018-04-27 00:40:57 2018-04-27 00:56:56 0:15:59 0:06:12 0:09:47 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi157 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443133 2018-04-26 20:36:45 2018-04-27 00:40:56 2018-04-27 00:58:55 0:17:59 0:08:59 0:09:00 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi150 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443134 2018-04-26 20:36:46 2018-04-27 00:42:46 2018-04-27 01:12:45 0:29:59 0:20:39 0:09:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi170 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443135 2018-04-26 20:36:47 2018-04-27 00:42:45 2018-04-27 01:02:45 0:20:00 0:10:37 0:09:23 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
Failure Reason:

Command failed on smithi118 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443136 2018-04-26 20:36:47 2018-04-27 00:42:45 2018-04-27 02:56:49 2:14:04 2:05:33 0:08:31 smithi master rados/objectstore/filestore-idempotent.yaml 1
Failure Reason:

Command failed on smithi015 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443137 2018-04-26 20:36:48 2018-04-26 21:37:09 2018-04-26 21:57:08 0:19:59 0:06:41 0:13:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi014 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443138 2018-04-26 20:36:49 2018-04-27 00:42:45 2018-04-27 01:00:45 0:18:00 0:06:37 0:11:23 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
Failure Reason:

Command failed on smithi148 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443139 2018-04-26 20:36:49 2018-04-27 00:42:48 2018-04-27 00:58:47 0:15:59 0:06:26 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi056 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443140 2018-04-26 20:36:50 2018-04-27 00:42:51 2018-04-27 01:18:51 0:36:00 0:29:38 0:06:22 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-04-27 01:15:26.360535 mon.a mon.0 172.21.15.33:6789/0 2410 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2443141 2018-04-26 20:36:51 2018-04-27 00:42:55 2018-04-27 01:02:55 0:20:00 0:11:28 0:08:32 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi171 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443142 2018-04-26 20:36:52 2018-04-27 00:42:57 2018-04-27 00:58:56 0:15:59 0:06:21 0:09:38 smithi master rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi063 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443143 2018-04-26 20:36:52 2018-04-27 00:44:54 2018-04-27 01:04:54 0:20:00 0:07:25 0:12:35 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi164 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443144 2018-04-26 20:36:53 2018-04-27 00:44:55 2018-04-27 01:06:54 0:21:59 0:08:12 0:13:47 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi165 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443145 2018-04-26 20:36:54 2018-04-27 00:44:55 2018-04-27 01:02:54 0:17:59 0:07:09 0:10:50 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi078 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443146 2018-04-26 20:36:55 2018-04-27 00:44:55 2018-04-27 01:02:54 0:17:59 0:06:51 0:11:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi080 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443147 2018-04-26 20:36:55 2018-04-27 00:44:54 2018-04-27 01:12:54 0:28:00 0:17:52 0:10:08 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi016 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443148 2018-04-26 20:36:56 2018-04-27 00:44:55 2018-04-27 01:04:54 0:19:59 0:11:22 0:08:37 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi082 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443149 2018-04-26 20:36:57 2018-04-27 00:44:55 2018-04-27 01:00:55 0:16:00 0:06:27 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi089 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443150 2018-04-26 20:36:58 2018-04-27 00:44:56 2018-04-27 01:02:55 0:17:59 0:07:25 0:10:34 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi061 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443151 2018-04-26 20:36:58 2018-04-27 00:44:57 2018-04-27 01:04:57 0:20:00 0:10:26 0:09:34 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_write.yaml} 1
Failure Reason:

Command failed on smithi055 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443152 2018-04-26 20:36:59 2018-04-27 00:44:59 2018-04-27 01:01:00 0:16:01 0:06:04 0:09:57 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi075 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuri-testing-2018-04-26-1557 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 2443153 2018-04-26 20:37:00 2018-04-27 00:45:11 2018-04-27 01:15:11 0:30:00 0:22:05 0:07:55 smithi master rados/standalone/mon.yaml 1
Failure Reason:

Command failed (workunit test mon/osd-pool-create.sh) on smithi169 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuri-testing-2018-04-26-1557 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh'

fail 2443154 2018-04-26 20:37:01 2018-04-27 00:46:47 2018-04-27 01:02:46 0:15:59 0:06:08 0:09:51 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi136 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443155 2018-04-26 20:37:01 2018-04-27 00:46:47 2018-04-27 01:02:46 0:15:59 0:06:26 0:09:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi200 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443156 2018-04-26 20:37:02 2018-04-27 00:46:47 2018-04-27 01:10:46 0:23:59 0:13:15 0:10:44 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

Command failed on smithi121 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443157 2018-04-26 20:37:03 2018-04-27 00:46:48 2018-04-27 01:04:48 0:18:00 0:09:12 0:08:48 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi172 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443158 2018-04-26 20:37:04 2018-04-27 00:46:53 2018-04-27 01:02:51 0:15:58 0:06:23 0:09:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi197 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443159 2018-04-26 20:37:04 2018-04-27 00:46:53 2018-04-27 01:12:52 0:25:59 0:16:36 0:09:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi077 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443160 2018-04-26 20:37:05 2018-04-27 00:46:55 2018-04-27 01:04:53 0:17:58 0:06:30 0:11:28 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Command failed on smithi064 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443161 2018-04-26 20:37:06 2018-04-27 00:46:53 2018-04-27 01:00:52 0:13:59 0:05:53 0:08:06 smithi master rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi060 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443162 2018-04-26 20:37:07 2018-04-27 00:46:57 2018-04-27 01:02:54 0:15:57 0:06:14 0:09:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi154 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443163 2018-04-26 20:37:07 2018-04-27 00:46:55 2018-04-27 01:02:53 0:15:58 0:06:27 0:09:31 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Command failed on smithi092 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443164 2018-04-26 20:37:08 2018-04-27 00:46:57 2018-04-27 01:04:55 0:17:58 0:07:34 0:10:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi070 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443165 2018-04-26 20:37:09 2018-04-27 00:46:58 2018-04-27 01:08:56 0:21:58 0:11:49 0:10:09 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/module_selftest.yaml} 2
Failure Reason:

Command failed on smithi191 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443166 2018-04-26 20:37:10 2018-04-27 00:46:57 2018-04-27 01:02:56 0:15:59 0:06:01 0:09:58 smithi master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi158 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443167 2018-04-26 20:37:10 2018-04-27 00:48:55 2018-04-27 01:02:54 0:13:59 0:04:49 0:09:10 smithi master rados/objectstore/fusestore.yaml 1
fail 2443168 2018-04-26 20:37:11 2018-04-27 00:48:54 2018-04-27 01:04:54 0:16:00 0:06:18 0:09:42 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi119 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443169 2018-04-26 20:37:12 2018-04-27 00:48:55 2018-04-27 01:08:54 0:19:59 0:11:53 0:08:06 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi199 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443170 2018-04-26 20:37:13 2018-04-27 00:48:55 2018-04-27 01:06:54 0:17:59 0:06:36 0:11:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi095 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443171 2018-04-26 20:37:13 2018-04-27 00:48:55 2018-04-27 01:12:54 0:23:59 0:12:48 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi130 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443172 2018-04-26 20:37:14 2018-04-27 00:48:56 2018-04-27 01:04:55 0:15:59 0:06:50 0:09:09 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi124 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443173 2018-04-26 20:37:15 2018-04-27 00:48:56 2018-04-27 01:06:55 0:17:59 0:07:35 0:10:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi038 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443174 2018-04-26 20:37:16 2018-04-27 00:49:03 2018-04-27 01:21:03 0:32:00 0:21:23 0:10:37 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/ubuntu_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi182 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443175 2018-04-26 20:37:16 2018-04-27 00:50:52 2018-04-27 01:06:52 0:16:00 0:06:51 0:09:09 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_striper.yaml} 2
Failure Reason:

Command failed on smithi129 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443176 2018-04-26 20:37:17 2018-04-27 00:50:52 2018-04-27 01:06:52 0:16:00 0:06:24 0:09:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi198 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443177 2018-04-26 20:37:18 2018-04-27 00:50:53 2018-04-27 01:06:52 0:15:59 0:06:55 0:09:04 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi045 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443178 2018-04-26 20:37:19 2018-04-27 00:50:53 2018-04-27 01:18:52 0:27:59 0:18:00 0:09:59 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi131 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443179 2018-04-26 20:37:20 2018-04-27 00:50:53 2018-04-27 01:04:52 0:13:59 0:06:16 0:07:43 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi002 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443180 2018-04-26 20:37:20 2018-04-27 00:50:52 2018-04-27 01:08:52 0:18:00 0:09:39 0:08:21 smithi master rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi032 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443181 2018-04-26 20:37:21 2018-04-27 00:50:53 2018-04-27 01:22:53 0:32:00 0:23:01 0:08:59 smithi master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
fail 2443182 2018-04-26 20:37:22 2018-04-27 00:50:57 2018-04-27 01:14:57 0:24:00 0:13:04 0:10:56 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi026 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443183 2018-04-26 20:37:23 2018-04-27 00:52:43 2018-04-27 01:10:43 0:18:00 0:10:11 0:07:49 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_seq_read.yaml} 1
Failure Reason:

Command failed on smithi173 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443184 2018-04-26 20:37:24 2018-04-27 00:52:52 2018-04-27 01:08:51 0:15:59 0:06:30 0:09:29 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi202 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443185 2018-04-26 20:37:24 2018-04-27 00:52:52 2018-04-27 01:10:52 0:18:00 0:07:12 0:10:48 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi181 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443186 2018-04-26 20:37:25 2018-04-27 00:52:53 2018-04-27 01:12:53 0:20:00 0:08:10 0:11:50 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi062 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443187 2018-04-26 20:37:26 2018-04-27 00:52:54 2018-04-27 01:08:53 0:15:59 0:06:29 0:09:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi104 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443188 2018-04-26 20:37:27 2018-04-27 00:52:54 2018-04-27 01:20:54 0:28:00 0:18:56 0:09:04 smithi master rados/singleton/{all/random-eio.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
Failure Reason:

"2018-04-27 01:15:10.073283 mon.a mon.0 172.21.15.28:6789/0 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2443189 2018-04-26 20:37:27 2018-04-27 00:52:55 2018-04-27 01:08:55 0:16:00 0:06:19 0:09:41 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi146 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443190 2018-04-26 20:37:28 2018-04-27 00:52:56 2018-04-27 01:14:55 0:21:59 0:11:46 0:10:13 smithi master rados/multimon/{clusters/9.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml} 3
Failure Reason:

Command failed on smithi049 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443191 2018-04-26 20:37:29 2018-04-27 00:52:57 2018-04-27 01:08:56 0:15:59 0:06:30 0:09:29 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi041 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443192 2018-04-26 20:37:30 2018-04-27 00:53:01 2018-04-27 01:09:00 0:15:59 0:06:35 0:09:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

pass 2443193 2018-04-26 20:37:31 2018-04-27 00:54:43 2018-04-27 01:08:42 0:13:59 0:05:35 0:08:24 smithi master rados/objectstore/keyvaluedb.yaml 1
pass 2443194 2018-04-26 20:37:31 2018-04-27 00:54:45 2018-04-27 01:56:46 1:02:01 0:52:27 0:09:34 smithi master rados/standalone/osd.yaml 1
fail 2443195 2018-04-26 20:37:32 2018-04-27 00:54:53 2018-04-27 01:14:52 0:19:59 0:09:13 0:10:46 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi117 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443196 2018-04-26 20:37:33 2018-04-27 00:54:54 2018-04-27 01:32:54 0:38:00 0:27:27 0:10:33 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

Command failed on smithi160 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443197 2018-04-26 20:37:34 2018-04-27 00:54:54 2018-04-27 01:12:54 0:18:00 0:08:49 0:09:11 smithi master rados/singleton/{all/rebuild-mondb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi111 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443198 2018-04-26 20:37:34 2018-04-27 00:54:55 2018-04-27 01:12:54 0:17:59 0:06:48 0:11:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi024 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443199 2018-04-26 20:37:35 2018-04-27 00:54:55 2018-04-27 01:10:54 0:15:59 0:06:19 0:09:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi085 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443200 2018-04-26 20:37:36 2018-04-27 00:55:01 2018-04-27 01:17:00 0:21:59 0:10:57 0:11:02 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi065 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443201 2018-04-26 20:37:37 2018-04-27 00:56:51 2018-04-27 01:28:51 0:32:00 0:22:20 0:09:40 smithi master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi023 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443202 2018-04-26 20:37:37 2018-04-27 00:56:54 2018-04-27 01:12:51 0:15:57 0:07:07 0:08:50 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi004 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443203 2018-04-26 20:37:38 2018-04-27 00:56:52 2018-04-27 01:14:51 0:17:59 0:07:36 0:10:23 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml tasks/prometheus.yaml} 2
Failure Reason:

Command failed on smithi003 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443204 2018-04-26 20:37:39 2018-04-27 00:56:51 2018-04-27 01:12:50 0:15:59 0:06:27 0:09:32 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Command failed on smithi051 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443205 2018-04-26 20:37:40 2018-04-27 00:56:53 2018-04-27 01:14:51 0:17:58 0:06:41 0:11:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi059 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443206 2018-04-26 20:37:40 2018-04-27 00:56:54 2018-04-27 01:18:52 0:21:58 0:13:02 0:08:56 smithi master rados/singleton/{all/recovery-preemption.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi087 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443207 2018-04-26 20:37:41 2018-04-27 00:56:54 2018-04-27 01:16:52 0:19:58 0:10:43 0:09:15 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi176 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443208 2018-04-26 20:37:42 2018-04-27 00:56:54 2018-04-27 01:12:52 0:15:58 0:06:10 0:09:48 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi189 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443209 2018-04-26 20:37:43 2018-04-27 00:56:56 2018-04-27 02:02:55 1:05:59 0:55:24 0:10:35 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

Command failed on smithi083 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443210 2018-04-26 20:37:43 2018-04-27 00:56:56 2018-04-27 01:12:54 0:15:58 0:06:30 0:09:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi190 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443211 2018-04-26 20:37:44 2018-04-27 00:56:57 2018-04-27 01:14:56 0:17:59 0:06:38 0:11:21 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi161 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443212 2018-04-26 20:37:45 2018-04-27 00:56:58 2018-04-27 01:12:56 0:15:58 0:07:23 0:08:35 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi185 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443213 2018-04-26 20:37:46 2018-04-27 00:56:57 2018-04-27 01:12:56 0:15:59 0:06:35 0:09:24 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi036 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443214 2018-04-26 20:37:46 2018-04-27 00:56:58 2018-04-27 01:24:57 0:27:59 0:17:16 0:10:43 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
Failure Reason:

Command failed on smithi134 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443215 2018-04-26 20:37:47 2018-04-27 00:56:58 2018-04-27 01:14:56 0:17:58 0:06:42 0:11:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi067 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443216 2018-04-26 20:37:48 2018-04-27 00:56:58 2018-04-27 01:12:57 0:15:59 0:09:59 0:06:00 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported/centos_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi091 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443217 2018-04-26 20:37:49 2018-04-27 00:57:01 2018-04-27 01:17:00 0:19:59 0:10:05 0:09:54 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi175 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443218 2018-04-26 20:37:49 2018-04-27 00:58:49 2018-04-27 01:14:48 0:15:59 0:06:29 0:09:30 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuri-testing-2018-04-26-1557 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 2443219 2018-04-26 20:37:50 2018-04-27 00:58:52 2018-04-27 01:20:52 0:22:00 0:11:29 0:10:31 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi017 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443220 2018-04-26 20:37:51 2018-04-27 00:58:53 2018-04-27 01:18:53 0:20:00 0:09:49 0:10:11 smithi master rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi112 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443221 2018-04-26 20:37:52 2018-04-27 00:58:56 2018-04-27 01:14:56 0:16:00 0:06:38 0:09:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi056 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443222 2018-04-26 20:37:52 2018-04-27 00:58:57 2018-04-27 01:16:56 0:17:59 0:05:37 0:12:22 smithi master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi063 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443223 2018-04-26 20:37:53 2018-04-27 00:58:58 2018-04-27 01:14:57 0:15:59 0:06:29 0:09:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi178 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443224 2018-04-26 20:37:54 2018-04-27 01:00:40 2018-04-27 01:24:39 0:23:59 0:15:21 0:08:38 smithi master rados/objectstore/objectcacher-stress.yaml 1
Failure Reason:

Command failed on smithi113 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443225 2018-04-26 20:37:55 2018-04-27 01:00:47 2018-04-27 01:16:46 0:15:59 0:06:35 0:09:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Command failed on smithi148 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443226 2018-04-26 20:37:56 2018-04-27 01:00:54 2018-04-27 01:16:53 0:15:59 0:06:04 0:09:55 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi114 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443227 2018-04-26 20:37:56 2018-04-27 01:00:56 2018-04-27 01:18:55 0:17:59 0:09:53 0:08:06 smithi master rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi159 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443228 2018-04-26 20:37:57 2018-04-27 01:01:01 2018-04-27 01:19:00 0:17:59 0:06:50 0:11:09 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi060 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443229 2018-04-26 20:37:58 2018-04-27 01:02:57 2018-04-27 01:22:56 0:19:59 0:07:48 0:12:11 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi118 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443230 2018-04-26 20:37:59 2018-04-27 01:02:57 2018-04-27 01:28:56 0:25:59 0:16:52 0:09:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi145 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443231 2018-04-26 20:38:00 2018-04-27 01:02:59 2018-04-27 01:20:58 0:17:59 0:06:37 0:11:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi154 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443232 2018-04-26 20:38:00 2018-04-27 01:02:58 2018-04-27 01:20:57 0:17:59 0:08:27 0:09:32 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_write.yaml} 1
Failure Reason:

Command failed on smithi120 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443233 2018-04-26 20:38:01 2018-04-27 01:02:59 2018-04-27 01:34:58 0:31:59 0:21:19 0:10:40 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

Command failed on smithi092 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443234 2018-04-26 20:38:02 2018-04-27 01:02:57 2018-04-27 01:18:56 0:15:59 0:06:32 0:09:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi137 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443235 2018-04-26 20:38:03 2018-04-27 01:02:58 2018-04-27 01:18:56 0:15:58 0:06:45 0:09:13 smithi master rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi197 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443236 2018-04-26 20:38:03 2018-04-27 01:02:57 2018-04-27 01:18:56 0:15:59 0:06:19 0:09:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi136 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

pass 2443237 2018-04-26 20:38:04 2018-04-27 01:02:58 2018-04-27 01:48:58 0:46:00 0:36:19 0:09:41 smithi master rados/standalone/scrub.yaml 1
fail 2443238 2018-04-26 20:38:05 2018-04-27 01:02:58 2018-04-27 01:20:56 0:17:58 0:07:30 0:10:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi171 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443239 2018-04-26 20:38:06 2018-04-27 01:02:59 2018-04-27 01:24:58 0:21:59 0:10:49 0:11:10 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Command failed on smithi187 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443240 2018-04-26 20:38:06 2018-04-27 01:02:59 2018-04-27 01:20:57 0:17:58 0:07:15 0:10:43 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

Command failed on smithi194 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443241 2018-04-26 20:38:07 2018-04-27 01:02:58 2018-04-27 01:28:57 0:25:59 0:19:00 0:06:59 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-04-27 01:26:11.977220 mon.b mon.0 172.21.15.73:6789/0 88 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 2443242 2018-04-26 20:38:08 2018-04-27 01:02:59 2018-04-27 01:36:58 0:33:59 0:24:28 0:09:31 smithi master rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi043 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443243 2018-04-26 20:38:09 2018-04-27 01:02:58 2018-04-27 01:50:58 0:48:00 0:36:12 0:11:48 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi080 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443244 2018-04-26 20:38:09 2018-04-27 01:03:01 2018-04-27 01:21:00 0:17:59 0:06:41 0:11:18 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/workunits.yaml} 2
Failure Reason:

Command failed on smithi055 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443245 2018-04-26 20:38:10 2018-04-27 01:04:40 2018-04-27 01:20:40 0:16:00 0:06:22 0:09:38 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443246 2018-04-26 20:38:11 2018-04-27 01:04:46 2018-04-27 01:22:46 0:18:00 0:06:48 0:11:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Command failed on smithi002 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443247 2018-04-26 20:38:12 2018-04-27 01:04:49 2018-04-27 01:20:48 0:15:59 0:06:45 0:09:14 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443248 2018-04-26 20:38:13 2018-04-27 01:04:53 2018-04-27 01:20:53 0:16:00 0:06:05 0:09:55 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi172 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443249 2018-04-26 20:38:13 2018-04-27 01:04:54 2018-04-27 01:22:53 0:17:59 0:10:40 0:07:19 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/sample_fio.yaml} 1
Failure Reason:

Command failed on smithi005 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443250 2018-04-26 20:38:14 2018-04-27 01:04:54 2018-04-27 01:22:53 0:17:59 0:06:39 0:11:20 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi011 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443251 2018-04-26 20:38:15 2018-04-27 01:04:55 2018-04-27 01:22:54 0:17:59 0:06:52 0:11:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi082 with status 1: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0"

fail 2443252 2018-04-26 20:38:16 2018-04-27 01:04:56 2018-04-27 01:34:55 0:29:59 0:18:42 0:11:17 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi070 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

pass 2443253 2018-04-26 20:38:17 2018-04-27 01:04:56 2018-04-27 06:07:04 5:02:08 4:47:38 0:14:30 smithi master rados/objectstore/objectstore.yaml 1
fail 2443254 2018-04-26 20:38:17 2018-04-27 01:04:56 2018-04-27 01:32:56 0:28:00 0:17:02 0:10:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi095 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 2443255 2018-04-26 20:38:18 2018-04-27 01:04:57 2018-04-27 01:26:56 0:21:59 0:11:09 0:10:50 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/readwrite.yaml} 2
Failure Reason:

Command failed on smithi165 with status 1: "sudo ceph --cluster ceph tell 'mon.*' injectargs -- --no-mon-health-to-clog"