Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4748253 2020-02-09 16:27:29 2020-02-09 16:28:05 2020-02-09 17:36:15 1:08:10 1:01:19 0:06:51 smithi master rhel 7.5 rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi205 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748254 2020-02-09 16:27:30 2020-02-09 16:28:06 2020-02-09 17:38:10 1:10:04 1:01:10 0:08:54 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_write.yaml} 1
Failure Reason:

Command failed on smithi150 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748255 2020-02-09 16:27:31 2020-02-09 16:28:20 2020-02-09 16:56:20 0:28:00 0:11:53 0:16:07 smithi master ubuntu 18.04 rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/simple.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} 3
fail 4748256 2020-02-09 16:27:33 2020-02-09 16:28:35 2020-02-09 17:36:37 1:08:02 0:56:48 0:11:14 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748257 2020-02-09 16:27:34 2020-02-09 16:28:37 2020-02-09 18:54:42 2:26:05 0:57:05 1:29:00 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi012 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748258 2020-02-09 16:27:35 2020-02-09 16:29:05 2020-02-09 16:53:05 0:24:00 0:11:44 0:12:16 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 4748259 2020-02-09 16:27:36 2020-02-09 16:29:36 2020-02-09 17:43:37 1:14:01 1:02:18 0:11:43 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_latest.yaml} tasks/orchestrator_cli.yaml} 2
Failure Reason:

Command failed on smithi079 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748260 2020-02-09 16:27:37 2020-02-09 16:29:37 2020-02-09 17:43:38 1:14:01 0:59:28 0:14:33 smithi master centos 7.5 rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 2
Failure Reason:

Command failed on smithi162 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748261 2020-02-09 16:27:38 2020-02-09 16:31:25 2020-02-09 17:15:27 0:44:02 0:30:51 0:13:11 smithi master ubuntu 16.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2020-02-09 16:57:38.542846 mon.g (mon.2) 91 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

fail 4748262 2020-02-09 16:27:40 2020-02-09 16:31:25 2020-02-09 17:41:28 1:10:03 0:56:47 0:13:16 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Command failed on smithi045 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748263 2020-02-09 16:27:41 2020-02-09 16:33:13 2020-02-09 17:39:17 1:06:04 0:55:54 0:10:10 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748264 2020-02-09 16:27:42 2020-02-09 16:33:13 2020-02-09 17:55:17 1:22:04 1:15:52 0:06:12 smithi master rhel 7.5 rados/standalone/{supported-random-distro$/{rhel_latest.yaml} workloads/scrub.yaml} 1
Failure Reason:

Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9352618eb3f0642b157a1c31b63762e416134a37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh'

fail 4748265 2020-02-09 16:27:43 2020-02-09 16:33:29 2020-02-09 17:59:30 1:26:01 1:02:21 0:23:40 smithi master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi110 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748266 2020-02-09 16:27:44 2020-02-09 16:33:39 2020-02-09 17:43:40 1:10:01 0:56:49 0:13:12 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi129 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748267 2020-02-09 16:27:45 2020-02-09 16:34:39 2020-02-09 17:40:41 1:06:02 0:56:19 0:09:43 smithi master ubuntu 18.04 rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi097 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748268 2020-02-09 16:27:46 2020-02-09 16:34:39 2020-02-09 17:42:42 1:08:03 1:01:26 0:06:37 smithi master rhel 7.5 rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi153 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748269 2020-02-09 16:27:47 2020-02-09 16:34:45 2020-02-09 17:42:46 1:08:01 0:57:17 0:10:44 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/repair_test.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748270 2020-02-09 16:27:48 2020-02-09 16:34:50 2020-02-09 17:42:51 1:08:01 0:57:36 0:10:25 smithi master centos 7.5 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi166 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748271 2020-02-09 16:27:49 2020-02-09 16:35:11 2020-02-09 21:31:21 4:56:10 4:40:51 0:15:19 smithi master ubuntu 16.04 rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
pass 4748272 2020-02-09 16:27:51 2020-02-09 16:35:30 2020-02-09 17:03:29 0:27:59 0:18:24 0:09:35 smithi master centos 7.5 rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
fail 4748273 2020-02-09 16:27:52 2020-02-09 16:36:09 2020-02-09 17:48:16 1:12:07 0:59:39 0:12:28 smithi master centos 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748274 2020-02-09 16:27:53 2020-02-09 16:36:09 2020-02-09 17:54:25 1:18:16 0:58:51 0:19:25 smithi master centos 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_latest.yaml} tasks/progress.yaml} 2
Failure Reason:

Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748275 2020-02-09 16:27:54 2020-02-09 16:36:09 2020-02-09 18:00:26 1:24:17 1:01:59 0:22:18 smithi master rhel 7.5 rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 2
Failure Reason:

Command failed on smithi074 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748276 2020-02-09 16:27:55 2020-02-09 16:36:09 2020-02-09 17:44:24 1:08:15 1:01:02 0:07:13 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4K_seq_read.yaml} 1
Failure Reason:

Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748277 2020-02-09 16:27:56 2020-02-09 16:37:29 2020-02-09 20:05:35 3:28:06 0:59:39 2:28:27 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/async.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 4
Failure Reason:

Command failed on smithi129 with status 1: 'sudo ceph --cluster ceph osd crush tunables hammer'

fail 4748278 2020-02-09 16:27:57 2020-02-09 16:37:29 2020-02-09 17:19:29 0:42:00 0:31:37 0:10:23 smithi master rhel 7.5 rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 16:56:18.806496 mon.b (mon.1) 33 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748279 2020-02-09 16:27:58 2020-02-09 16:37:29 2020-02-09 17:49:30 1:12:01 0:56:51 0:15:10 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_snaps.yaml} 2
Failure Reason:

Command failed on smithi095 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748280 2020-02-09 16:27:59 2020-02-09 16:37:38 2020-02-09 17:43:38 1:06:00 0:56:01 0:09:59 smithi master ubuntu 18.04 rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi040 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748281 2020-02-09 16:28:01 2020-02-09 16:37:51 2020-02-09 17:33:55 0:56:04 0:26:26 0:29:38 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

"2020-02-09 17:11:19.207370 mon.a (mon.0) 78 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 4748282 2020-02-09 16:28:02 2020-02-09 16:38:58 2020-02-09 17:20:58 0:42:00 0:30:24 0:11:36 smithi master centos 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

"2020-02-09 16:57:28.855467 mon.b (mon.1) 33 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748283 2020-02-09 16:28:03 2020-02-09 16:40:21 2020-02-09 17:44:26 1:04:05 0:55:18 0:08:47 smithi master ubuntu 16.04 rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi044 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748284 2020-02-09 16:28:04 2020-02-09 16:42:09 2020-02-09 17:50:16 1:08:07 1:01:38 0:06:29 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} 2
Failure Reason:

Command failed on smithi169 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748285 2020-02-09 16:28:05 2020-02-09 16:43:06 2020-02-09 17:51:07 1:08:01 0:58:20 0:09:41 smithi master centos 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi191 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748286 2020-02-09 16:28:07 2020-02-09 16:43:58 2020-02-09 17:54:11 1:10:13 1:01:35 0:08:38 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

Command failed on smithi086 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748287 2020-02-09 16:28:08 2020-02-09 16:43:58 2020-02-09 17:16:08 0:32:10 0:23:23 0:08:47 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 4748288 2020-02-09 16:28:09 2020-02-09 16:45:21 2020-02-09 18:35:23 1:50:02 0:59:02 0:51:00 smithi master centos 7.5 rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748289 2020-02-09 16:28:10 2020-02-09 16:47:37 2020-02-09 18:41:38 1:54:01 0:56:18 0:57:43 smithi master ubuntu 16.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi146 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748290 2020-02-09 16:28:11 2020-02-09 16:49:23 2020-02-09 17:59:24 1:10:01 0:56:08 0:13:53 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi014 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748291 2020-02-09 16:28:12 2020-02-09 16:49:23 2020-02-09 18:05:24 1:16:01 1:02:06 0:13:55 smithi master rhel 7.5 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748292 2020-02-09 16:28:13 2020-02-09 16:52:07 2020-02-09 18:36:12 1:44:05 1:00:55 0:43:10 smithi master centos 7.5 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748293 2020-02-09 16:28:14 2020-02-09 16:53:24 2020-02-09 18:11:29 1:18:05 1:05:31 0:12:34 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

fail 4748294 2020-02-09 16:28:15 2020-02-09 16:55:15 2020-02-09 18:07:18 1:12:03 1:01:48 0:10:15 smithi master rhel 7.5 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_latest.yaml} tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748295 2020-02-09 16:28:16 2020-02-09 17:53:54 2020-02-09 19:11:55 1:18:01 0:59:05 0:18:56 smithi master centos 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_latest.yaml} tasks/prometheus.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748296 2020-02-09 16:28:17 2020-02-09 17:54:12 2020-02-09 19:00:12 1:06:00 0:55:49 0:10:11 smithi master ubuntu 18.04 rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi170 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748297 2020-02-09 16:28:18 2020-02-09 17:54:26 2020-02-09 19:02:28 1:08:02 1:00:50 0:07:12 smithi master rhel 7.5 rados/rest/{mgr-restful.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi163 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748298 2020-02-09 16:28:19 2020-02-09 17:54:33 2020-02-09 19:10:37 1:16:04 1:03:33 0:12:31 smithi master centos rados/singleton-flat/valgrind-leaks.yaml 1
Failure Reason:

Command failed on smithi176 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748299 2020-02-09 16:28:21 2020-02-09 17:55:32 2020-02-09 19:05:34 1:10:02 1:00:34 0:09:28 smithi master rhel 7.5 rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi166 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748300 2020-02-09 16:28:22 2020-02-09 17:55:32 2020-02-09 18:17:31 0:21:59 0:09:21 0:12:38 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/crush.yaml} 1
fail 4748301 2020-02-09 16:28:23 2020-02-09 17:55:32 2020-02-09 19:29:34 1:34:02 0:16:33 1:17:29 smithi master centos 7.5 rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} supported-random-distro$/{centos_latest.yaml} thrashosds-health.yaml} 4
Failure Reason:

Command failed on smithi134 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=true"

pass 4748302 2020-02-09 16:28:24 2020-02-09 17:57:10 2020-02-09 19:21:12 1:24:02 1:12:06 0:11:56 smithi master ubuntu 16.04 rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 2
fail 4748303 2020-02-09 16:28:25 2020-02-09 17:57:31 2020-02-09 19:05:34 1:08:03 0:56:19 0:11:44 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/scrub_test.yaml} 2
Failure Reason:

Command failed on smithi074 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748304 2020-02-09 16:28:26 2020-02-09 17:59:25 2020-02-09 18:45:25 0:46:00 0:33:48 0:12:12 smithi master ubuntu 16.04 rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 2
fail 4748305 2020-02-09 16:28:27 2020-02-09 17:59:46 2020-02-09 18:29:48 0:30:02 0:13:23 0:16:39 smithi master centos 7.5 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi160 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748306 2020-02-09 16:28:28 2020-02-09 17:59:46 2020-02-09 19:21:50 1:22:04 0:56:13 0:25:51 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi084 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748307 2020-02-09 16:28:29 2020-02-09 17:59:53 2020-02-09 19:09:55 1:10:02 0:56:27 0:13:35 smithi master ubuntu 18.04 rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748308 2020-02-09 16:28:30 2020-02-09 18:00:25 2020-02-09 19:06:26 1:06:01 0:55:24 0:10:37 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/balancer.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi044 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748309 2020-02-09 16:28:32 2020-02-09 18:00:28 2020-02-09 19:28:29 1:28:01 1:00:22 0:27:39 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/osd-delay.yaml msgr/random.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 4
Failure Reason:

Command failed on smithi162 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748310 2020-02-09 16:28:33 2020-02-09 18:01:13 2020-02-09 19:11:15 1:10:02 0:55:47 0:14:15 smithi master ubuntu 16.04 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/ssh_orchestrator.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748311 2020-02-09 16:28:34 2020-02-09 18:01:13 2020-02-09 19:15:15 1:14:02 0:56:11 0:17:51 smithi master ubuntu 18.04 rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi169 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748312 2020-02-09 16:28:35 2020-02-09 18:01:13 2020-02-09 19:09:16 1:08:03 0:58:36 0:09:27 smithi master centos 7.5 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_write.yaml} 1
Failure Reason:

Command failed on smithi005 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748313 2020-02-09 16:28:36 2020-02-09 18:01:16 2020-02-09 19:09:17 1:08:01 0:56:11 0:11:50 smithi master ubuntu 16.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi121 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748314 2020-02-09 16:28:37 2020-02-09 18:01:30 2020-02-09 18:41:31 0:40:01 0:28:51 0:11:10 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4748315 2020-02-09 16:28:38 2020-02-09 18:01:30 2020-02-09 19:11:34 1:10:04 1:01:36 0:08:28 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command failed on smithi059 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748316 2020-02-09 16:28:40 2020-02-09 18:01:36 2020-02-09 19:13:37 1:12:01 1:01:38 0:10:23 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748317 2020-02-09 16:28:41 2020-02-09 18:03:16 2020-02-09 19:13:17 1:10:01 0:58:09 0:11:52 smithi master centos 7.5 rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi093 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748318 2020-02-09 16:28:42 2020-02-09 18:03:19 2020-02-09 18:43:19 0:40:00 0:26:18 0:13:42 smithi master ubuntu 16.04 rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

"2020-02-09 18:19:54.913416 mon.b (mon.1) 37 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4748319 2020-02-09 16:28:43 2020-02-09 18:03:39 2020-02-09 18:37:39 0:34:00 0:13:19 0:20:41 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 4748320 2020-02-09 16:28:44 2020-02-09 18:03:39 2020-02-09 19:19:42 1:16:03 0:58:22 0:17:41 smithi master centos 7.5 rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi088 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748321 2020-02-09 16:28:45 2020-02-09 18:03:58 2020-02-09 19:23:58 1:20:00 0:57:02 0:22:58 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi118 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748322 2020-02-09 16:28:46 2020-02-09 18:04:52 2020-02-09 19:16:55 1:12:03 1:01:02 0:11:01 smithi master rhel 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi123 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748323 2020-02-09 16:28:48 2020-02-09 18:05:25 2020-02-09 19:11:26 1:06:01 0:55:46 0:10:15 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/sample_fio.yaml} 1
Failure Reason:

Command failed on smithi042 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748324 2020-02-09 16:28:49 2020-02-09 18:05:40 2020-02-09 18:59:42 0:54:02 0:32:15 0:21:47 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/erasure-code.yaml} 1
fail 4748325 2020-02-09 16:28:50 2020-02-09 18:05:40 2020-02-09 19:23:42 1:18:02 0:55:50 0:22:12 smithi master ubuntu 18.04 rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi049 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748326 2020-02-09 16:28:51 2020-02-09 18:07:19 2020-02-09 19:21:20 1:14:01 0:56:36 0:17:25 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi100 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748327 2020-02-09 16:28:52 2020-02-09 18:07:19 2020-02-09 19:19:20 1:12:01 0:55:32 0:16:29 smithi master ubuntu 16.04 rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/mon_clock_with_skews.yaml} 2
Failure Reason:

Command failed on smithi080 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748328 2020-02-09 16:28:53 2020-02-09 18:09:02 2020-02-09 19:15:02 1:06:00 0:56:12 0:09:48 smithi master ubuntu 16.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi139 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748329 2020-02-09 16:28:54 2020-02-09 18:09:16 2020-02-09 20:57:20 2:48:04 0:59:57 1:48:07 smithi master centos 7.5 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748330 2020-02-09 16:28:55 2020-02-09 18:09:41 2020-02-09 19:21:43 1:12:02 0:56:20 0:15:42 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi140 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748331 2020-02-09 16:28:56 2020-02-09 18:10:55 2020-02-09 19:34:56 1:24:01 1:01:21 0:22:40 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_latest.yaml} tasks/workunits.yaml} 2
Failure Reason:

Command failed on smithi064 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748332 2020-02-09 16:28:58 2020-02-09 18:10:55 2020-02-09 18:32:54 0:21:59 0:10:44 0:11:15 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} 2
pass 4748333 2020-02-09 16:28:59 2020-02-09 18:11:30 2020-02-09 18:33:29 0:21:59 0:07:18 0:14:41 smithi master ubuntu 16.04 rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 4748334 2020-02-09 16:29:00 2020-02-09 18:12:56 2020-02-09 19:20:57 1:08:01 1:00:59 0:07:02 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/sample_radosbench.yaml} 1
Failure Reason:

Command failed on smithi017 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748335 2020-02-09 16:29:01 2020-02-09 18:12:56 2020-02-09 19:24:56 1:12:00 0:55:46 0:16:14 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi072 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748336 2020-02-09 16:29:02 2020-02-09 18:13:43 2020-02-09 19:21:43 1:08:00 0:55:57 0:12:03 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi053 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748337 2020-02-09 16:29:04 2020-02-09 18:14:33 2020-02-09 19:28:42 1:14:09 1:01:07 0:13:02 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi173 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748338 2020-02-09 16:29:05 2020-02-09 18:14:34 2020-02-09 20:42:45 2:28:11 0:58:54 1:29:17 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml msgr/simple.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 4
fail 4748339 2020-02-09 16:29:06 2020-02-09 18:14:34 2020-02-09 18:38:33 0:23:59 0:10:16 0:13:43 smithi master ubuntu 16.04 rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi137 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748340 2020-02-09 16:29:07 2020-02-09 18:16:04 2020-02-09 19:36:05 1:20:01 1:01:00 0:19:01 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

Command failed on smithi104 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748341 2020-02-09 16:29:08 2020-02-09 18:16:28 2020-02-09 19:22:28 1:06:00 0:55:52 0:10:08 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi110 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748342 2020-02-09 16:29:10 2020-02-09 18:17:48 2020-02-09 19:25:50 1:08:02 1:00:55 0:07:07 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_python.yaml} 2
Failure Reason:

Command failed on smithi193 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748343 2020-02-09 16:29:11 2020-02-09 18:17:49 2020-02-09 19:39:51 1:22:02 1:01:07 0:20:55 smithi master rhel 7.5 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi199 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748344 2020-02-09 16:29:12 2020-02-09 18:17:53 2020-02-09 19:31:55 1:14:02 0:58:51 0:15:11 smithi master centos 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_latest.yaml} tasks/crash.yaml} 2
Failure Reason:

Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748345 2020-02-09 16:29:13 2020-02-09 18:18:14 2020-02-09 19:24:15 1:06:01 0:55:17 0:10:44 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/cosbench_64K_read_write.yaml} 1
Failure Reason:

Command failed on smithi144 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748346 2020-02-09 16:29:14 2020-02-09 18:18:18 2020-02-09 19:34:19 1:16:01 0:58:20 0:17:41 smithi master centos 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi183 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748347 2020-02-09 16:29:16 2020-02-09 18:20:07 2020-02-09 18:54:07 0:34:00 0:11:30 0:22:30 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
dead 4748348 2020-02-09 16:29:17 2020-02-09 18:20:48 2020-02-10 06:23:15 12:02:27 smithi master ubuntu 16.04 rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
pass 4748349 2020-02-09 16:29:18 2020-02-09 18:20:56 2020-02-09 18:44:55 0:23:59 0:06:16 0:17:43 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4748350 2020-02-09 16:29:19 2020-02-09 18:21:36 2020-02-09 19:29:37 1:08:01 0:56:17 0:11:44 smithi master ubuntu 18.04 rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi155 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748351 2020-02-09 16:29:21 2020-02-09 18:21:49 2020-02-09 19:45:51 1:24:02 1:02:01 0:22:01 smithi master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748352 2020-02-09 16:29:22 2020-02-09 18:23:47 2020-02-09 19:37:51 1:14:04 0:58:59 0:15:05 smithi master centos 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748353 2020-02-09 16:29:23 2020-02-09 18:27:40 2020-02-09 19:03:42 0:36:02 0:25:46 0:10:16 smithi master ubuntu 16.04 rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

"2020-02-09 18:40:22.078701 mon.a (mon.0) 16 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 4748354 2020-02-09 16:29:24 2020-02-09 18:27:51 2020-02-09 18:49:50 0:21:59 0:13:00 0:08:59 smithi master centos 7.5 rados/standalone/{supported-random-distro$/{centos_latest.yaml} workloads/mgr.yaml} 1
fail 4748355 2020-02-09 16:29:25 2020-02-09 18:28:13 2020-02-09 19:48:14 1:20:01 0:59:22 0:20:39 smithi master centos 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi086 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748356 2020-02-09 16:29:26 2020-02-09 18:29:49 2020-02-09 19:33:51 1:04:02 0:55:18 0:08:44 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/cosbench_64K_write.yaml} 1
Failure Reason:

Command failed on smithi202 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748357 2020-02-09 16:29:27 2020-02-09 18:29:49 2020-02-09 18:45:48 0:15:59 0:06:15 0:09:44 smithi master ubuntu 18.04 rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4748358 2020-02-09 16:29:28 2020-02-09 18:29:49 2020-02-09 19:43:51 1:14:02 1:01:57 0:12:05 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_stress_watch.yaml} 2
Failure Reason:

Command failed on smithi154 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748359 2020-02-09 16:29:29 2020-02-09 18:31:28 2020-02-09 19:15:28 0:44:00 0:31:18 0:12:42 smithi master ubuntu 18.04 rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} 2
Failure Reason:

"2020-02-09 18:57:46.064266 mon.c (mon.2) 39 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

fail 4748360 2020-02-09 16:29:31 2020-02-09 18:33:00 2020-02-09 19:43:00 1:10:00 1:01:25 0:08:35 smithi master rhel 7.5 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748361 2020-02-09 16:29:32 2020-02-09 18:33:00 2020-02-09 20:01:02 1:28:02 1:00:23 0:27:39 smithi master centos 7.5 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi153 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748362 2020-02-09 16:29:33 2020-02-09 18:33:31 2020-02-09 19:51:33 1:18:02 1:05:30 0:12:32 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

fail 4748363 2020-02-09 16:29:34 2020-02-09 18:33:40 2020-02-09 19:43:43 1:10:03 1:01:40 0:08:23 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_latest.yaml} tasks/failover.yaml} 2
Failure Reason:

Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

dead 4748364 2020-02-09 16:29:35 2020-02-09 18:35:29 2020-02-10 06:38:05 12:02:36 smithi master ubuntu 16.04 rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 4748365 2020-02-09 16:29:36 2020-02-09 18:36:13 2020-02-09 18:56:13 0:20:00 0:10:16 0:09:44 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi115 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748366 2020-02-09 16:29:37 2020-02-09 18:37:16 2020-02-09 19:45:18 1:08:02 0:58:03 0:09:59 smithi master centos 7.5 rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi137 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748367 2020-02-09 16:29:38 2020-02-09 18:37:40 2020-02-09 19:49:43 1:12:03 0:58:30 0:13:33 smithi master centos 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

Command failed on smithi146 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748368 2020-02-09 16:29:39 2020-02-09 18:38:51 2020-02-09 19:50:51 1:12:00 0:58:48 0:13:12 smithi master centos 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi116 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748369 2020-02-09 16:29:40 2020-02-09 18:38:51 2020-02-09 20:48:53 2:10:02 1:02:44 1:07:18 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} 4
Failure Reason:

Command failed on smithi183 with status 1: 'sudo ceph --cluster ceph osd crush tunables hammer'

fail 4748370 2020-02-09 16:29:42 2020-02-09 18:41:50 2020-02-09 19:01:50 0:20:00 0:10:21 0:09:39 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/fio_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi095 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748371 2020-02-09 16:29:43 2020-02-09 18:41:50 2020-02-09 19:19:50 0:38:00 0:25:40 0:12:20 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

"2020-02-09 18:56:55.434696 mon.b (mon.1) 33 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748372 2020-02-09 16:29:44 2020-02-09 18:43:37 2020-02-09 19:03:36 0:19:59 0:10:19 0:09:40 smithi master ubuntu 16.04 rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi161 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748373 2020-02-09 16:29:45 2020-02-09 18:45:13 2020-02-09 19:53:13 1:08:00 1:01:02 0:06:58 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_striper.yaml} 2
Failure Reason:

Command failed on smithi083 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748374 2020-02-09 16:29:46 2020-02-09 18:45:27 2020-02-09 19:25:27 0:40:00 0:31:24 0:08:36 smithi master rhel 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 19:03:21.307620 mon.b (mon.1) 37 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748375 2020-02-09 16:29:47 2020-02-09 18:45:50 2020-02-09 19:53:51 1:08:01 1:00:33 0:07:28 smithi master rhel 7.5 rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi120 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748376 2020-02-09 16:29:49 2020-02-09 18:47:16 2020-02-09 19:59:19 1:12:03 0:58:59 0:13:04 smithi master centos 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748377 2020-02-09 16:29:50 2020-02-09 18:47:50 2020-02-09 19:29:51 0:42:01 0:36:03 0:05:58 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

"2020-02-09 19:11:35.678069 mon.g (mon.2) 89 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

fail 4748378 2020-02-09 16:29:51 2020-02-09 19:21:45 2020-02-09 20:29:45 1:08:00 1:00:51 0:07:09 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4K_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi175 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748379 2020-02-09 16:29:52 2020-02-09 19:21:50 2020-02-09 20:37:50 1:16:00 0:57:17 0:18:43 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi162 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748380 2020-02-09 16:29:53 2020-02-09 19:21:52 2020-02-09 20:33:52 1:12:00 0:56:28 0:15:32 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi173 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748381 2020-02-09 16:29:54 2020-02-09 19:22:29 2020-02-09 20:32:29 1:10:00 1:01:48 0:08:12 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/insights.yaml} 2
Failure Reason:

Command failed on smithi118 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748382 2020-02-09 16:29:55 2020-02-09 19:22:29 2020-02-09 19:48:29 0:26:00 0:19:28 0:06:32 smithi master rhel 7.5 rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
fail 4748383 2020-02-09 16:29:57 2020-02-09 19:23:17 2020-02-09 19:43:16 0:19:59 0:10:05 0:09:54 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} 1
Failure Reason:

Command failed (workunit test misc/ok-to-stop.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9352618eb3f0642b157a1c31b63762e416134a37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh'

fail 4748384 2020-02-09 16:29:58 2020-02-09 19:23:59 2020-02-09 20:32:00 1:08:01 0:58:12 0:09:49 smithi master centos 7.5 rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi095 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748385 2020-02-09 16:29:59 2020-02-09 19:23:59 2020-02-09 19:49:59 0:26:00 0:14:57 0:11:03 smithi master centos 7.5 rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
fail 4748386 2020-02-09 16:30:00 2020-02-09 19:24:15 2020-02-09 20:06:15 0:42:00 0:31:36 0:10:24 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

"2020-02-09 19:44:32.179490 mon.b (mon.0) 54 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748387 2020-02-09 16:30:01 2020-02-09 19:24:17 2020-02-09 20:32:18 1:08:01 1:00:40 0:07:21 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi103 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748388 2020-02-09 16:30:02 2020-02-09 19:24:58 2020-02-09 20:32:58 1:08:00 0:58:28 0:09:32 smithi master centos 7.5 rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi193 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748389 2020-02-09 16:30:03 2020-02-09 19:25:44 2020-02-09 20:35:44 1:10:00 0:56:57 0:13:03 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

Command failed on smithi192 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748390 2020-02-09 16:30:06 2020-02-09 19:25:52 2020-02-09 20:33:52 1:08:00 0:56:41 0:11:19 smithi master ubuntu 16.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748391 2020-02-09 16:30:07 2020-02-09 19:26:30 2020-02-09 20:34:30 1:08:00 1:00:50 0:07:10 smithi master rhel 7.5 rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi149 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748392 2020-02-09 16:30:08 2020-02-09 19:27:52 2020-02-09 20:57:53 1:30:01 1:04:01 0:26:00 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml msgr/async.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 4
Failure Reason:

Command failed on smithi002 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748393 2020-02-09 16:30:09 2020-02-09 19:28:30 2020-02-09 20:40:31 1:12:01 0:58:50 0:13:11 smithi master centos 7.5 rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/random.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748394 2020-02-09 16:30:10 2020-02-09 19:28:31 2020-02-09 20:38:31 1:10:00 1:01:29 0:08:31 smithi master rhel 7.5 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Command failed on smithi156 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748395 2020-02-09 16:30:11 2020-02-09 19:28:43 2020-02-09 20:50:46 1:22:03 0:57:07 0:24:56 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748396 2020-02-09 16:30:13 2020-02-09 19:29:47 2020-02-09 20:05:47 0:36:00 0:26:54 0:09:06 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
Failure Reason:

"2020-02-09 19:53:41.291171 mon.a (mon.1) 152 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

fail 4748397 2020-02-09 16:30:14 2020-02-09 19:29:47 2020-02-09 20:39:48 1:10:01 0:59:06 0:10:55 smithi master centos 7.5 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_latest.yaml} tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748398 2020-02-09 16:30:15 2020-02-09 19:29:47 2020-02-09 20:39:48 1:10:01 1:01:12 0:08:49 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_latest.yaml} tasks/module_selftest.yaml} 2
Failure Reason:

Command failed on smithi160 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748399 2020-02-09 16:30:16 2020-02-09 19:29:51 2020-02-09 20:05:50 0:35:59 0:26:38 0:09:21 smithi master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 4748400 2020-02-09 16:30:17 2020-02-09 19:29:52 2020-02-09 20:37:52 1:08:00 0:55:55 0:12:05 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi124 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748401 2020-02-09 16:30:18 2020-02-09 19:31:26 2020-02-09 19:49:26 0:18:00 0:10:36 0:07:24 smithi master ubuntu 16.04 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/fio_4M_rand_rw.yaml} 1
Failure Reason:

Command failed on smithi018 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748402 2020-02-09 16:30:20 2020-02-09 19:31:32 2020-02-09 20:39:33 1:08:01 0:55:46 0:12:15 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748403 2020-02-09 16:30:21 2020-02-09 19:31:34 2020-02-09 20:09:34 0:38:00 0:31:04 0:06:56 smithi master rhel 7.5 rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 19:48:16.159615 mon.b (mon.1) 10 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4748404 2020-02-09 16:30:22 2020-02-09 19:31:52 2020-02-09 20:03:51 0:31:59 0:23:52 0:08:07 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} 2
fail 4748405 2020-02-09 16:30:23 2020-02-09 19:31:56 2020-02-09 20:09:56 0:38:00 0:31:15 0:06:45 smithi master rhel 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 19:47:19.053221 mon.b (mon.1) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

dead 4748406 2020-02-09 16:30:24 2020-02-09 19:32:22 2020-02-10 07:34:57 12:02:35 smithi master rhel 7.5 rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
fail 4748407 2020-02-09 16:30:25 2020-02-09 19:34:08 2020-02-09 20:44:08 1:10:00 1:01:22 0:08:38 smithi master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi104 with status 1: 'sudo ceph --cluster ceph osd crush tunables jewel'

fail 4748408 2020-02-09 16:30:26 2020-02-09 19:34:08 2020-02-09 20:48:08 1:14:00 1:01:38 0:12:22 smithi master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

Command failed on smithi199 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748409 2020-02-09 16:30:27 2020-02-09 19:34:08 2020-02-09 20:44:08 1:10:00 0:58:57 0:11:03 smithi master centos 7.5 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi023 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748410 2020-02-09 16:30:28 2020-02-09 19:34:08 2020-02-09 19:48:07 0:13:59 0:06:21 0:07:38 smithi master ubuntu 18.04 rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4748411 2020-02-09 16:30:29 2020-02-09 19:34:10 2020-02-09 20:44:10 1:10:00 1:01:18 0:08:42 smithi master rhel 7.5 rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

Command failed on smithi064 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748412 2020-02-09 16:30:30 2020-02-09 19:34:14 2020-02-09 19:56:13 0:21:59 0:15:57 0:06:02 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_write.yaml} 1
Failure Reason:

Command failed on smithi016 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

dead 4748413 2020-02-09 16:30:31 2020-02-09 19:34:21 2020-02-10 07:36:52 12:02:31 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/mon.yaml} 1
fail 4748414 2020-02-09 16:30:32 2020-02-09 19:34:57 2020-02-09 20:40:58 1:06:01 0:55:47 0:10:14 smithi master ubuntu 16.04 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/orchestrator_cli.yaml} 2
Failure Reason:

Command failed on smithi178 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748415 2020-02-09 16:30:33 2020-02-09 19:36:10 2020-02-09 20:04:09 0:27:59 0:21:07 0:06:52 smithi master rhel 7.5 rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
fail 4748416 2020-02-09 16:30:34 2020-02-09 19:36:10 2020-02-09 20:40:10 1:04:00 0:55:18 0:08:42 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748417 2020-02-09 16:30:36 2020-02-09 19:36:43 2020-02-09 20:44:44 1:08:01 1:01:24 0:06:37 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} 2
Failure Reason:

Command failed on smithi145 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748418 2020-02-09 16:30:37 2020-02-09 19:37:33 2020-02-09 20:45:33 1:08:00 0:56:35 0:11:25 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi169 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748419 2020-02-09 16:30:38 2020-02-09 19:37:52 2020-02-09 20:41:52 1:04:00 0:55:32 0:08:28 smithi master ubuntu 16.04 rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748420 2020-02-09 16:30:39 2020-02-09 19:37:56 2020-02-09 20:47:57 1:10:01 1:01:29 0:08:32 smithi master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

Command failed on smithi121 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748421 2020-02-09 16:30:41 2020-02-09 19:38:01 2020-02-09 20:46:02 1:08:01 1:00:21 0:07:40 smithi master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4K_rand_read.yaml} 1
Failure Reason:

Command failed on smithi123 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748422 2020-02-09 16:30:42 2020-02-09 19:39:50 2020-02-09 21:21:51 1:42:01 1:03:23 0:38:38 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml msgr/random.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 4
Failure Reason:

Command failed on smithi134 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748423 2020-02-09 16:30:43 2020-02-09 19:39:50 2020-02-09 20:17:50 0:38:00 0:30:29 0:07:31 smithi master rhel 7.5 rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 19:54:59.843995 mon.b (mon.1) 49 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

dead 4748424 2020-02-09 16:30:44 2020-02-09 19:39:52 2020-02-10 07:42:21 12:02:29 smithi master centos 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 4748425 2020-02-09 16:30:45 2020-02-09 20:10:48 2020-02-09 20:48:50 0:38:02 0:10:06 0:27:56 smithi master centos 7.5 rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/simple.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_clock_with_skews.yaml} 3
fail 4748426 2020-02-09 16:30:46 2020-02-09 20:10:48 2020-02-09 21:20:51 1:10:03 1:00:54 0:09:09 smithi master rhel 7.5 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
Failure Reason:

Command failed on smithi102 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748427 2020-02-09 16:30:47 2020-02-09 20:10:48 2020-02-09 21:24:51 1:14:03 0:57:00 0:17:03 smithi master ubuntu 16.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

Command failed on smithi197 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748428 2020-02-09 16:30:48 2020-02-09 20:10:53 2020-02-09 21:14:54 1:04:01 0:41:52 0:22:09 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
fail 4748429 2020-02-09 16:30:49 2020-02-09 20:10:54 2020-02-09 21:28:59 1:18:05 1:01:17 0:16:48 smithi master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_latest.yaml} tasks/progress.yaml} 2
Failure Reason:

Command failed on smithi189 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748430 2020-02-09 16:30:50 2020-02-09 20:10:54 2020-02-09 20:24:53 0:13:59 0:05:57 0:08:02 smithi master ubuntu 16.04 rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 4748431 2020-02-09 16:30:51 2020-02-09 20:10:54 2020-02-09 21:16:54 1:06:00 0:55:56 0:10:04 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi120 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748432 2020-02-09 16:30:52 2020-02-09 20:10:54 2020-02-09 20:48:53 0:37:59 0:30:38 0:07:21 smithi master rhel 7.5 rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

"2020-02-09 20:26:49.337628 mon.b (mon.1) 39 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 4748433 2020-02-09 16:30:54 2020-02-09 20:10:54 2020-02-09 21:16:56 1:06:02 0:55:47 0:10:15 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_seq_read.yaml} 1
Failure Reason:

Command failed on smithi070 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748434 2020-02-09 16:30:55 2020-02-09 20:10:54 2020-02-09 21:30:55 1:20:01 0:56:14 0:23:47 smithi master ubuntu 18.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi080 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748435 2020-02-09 16:30:56 2020-02-09 20:10:54 2020-02-09 21:40:57 1:30:03 0:56:37 0:33:26 smithi master ubuntu 16.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi079 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748436 2020-02-09 16:30:57 2020-02-09 20:10:54 2020-02-09 21:36:57 1:26:03 0:56:26 0:29:37 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command failed on smithi191 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

dead 4748437 2020-02-09 16:30:58 2020-02-09 20:10:55 2020-02-09 20:46:54 0:35:59 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/readwrite.yaml}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

fail 4748438 2020-02-09 16:30:59 2020-02-09 20:11:42 2020-02-09 21:19:43 1:08:01 0:58:15 0:09:46 smithi master centos 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed on smithi131 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748439 2020-02-09 16:31:00 2020-02-09 20:12:43 2020-02-09 20:50:43 0:38:00 0:30:59 0:07:01 smithi master rhel 7.5 rados/singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 2
Failure Reason:

"2020-02-09 20:29:10.610104 mon.a (mon.0) 50 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 4748440 2020-02-09 16:31:01 2020-02-09 20:13:09 2020-02-09 20:53:13 0:40:04 0:26:40 0:13:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

"2020-02-09 20:29:31.340543 mon.a (mon.1) 76 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 4748441 2020-02-09 16:31:02 2020-02-09 20:13:23 2020-02-09 23:17:30 3:04:07 2:56:57 0:07:10 smithi master ubuntu 16.04 rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/osd.yaml} 1
fail 4748442 2020-02-09 16:31:03 2020-02-09 20:14:04 2020-02-09 21:26:08 1:12:04 1:01:22 0:10:42 smithi master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Command failed on smithi140 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748443 2020-02-09 16:31:05 2020-02-09 20:17:52 2020-02-09 20:33:51 0:15:59 0:07:14 0:08:45 smithi master ubuntu 18.04 rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4748444 2020-02-09 16:31:06 2020-02-09 20:17:52 2020-02-09 21:23:55 1:06:03 0:55:45 0:10:18 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4M_rand_read.yaml} 1
Failure Reason:

Command failed on smithi132 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748445 2020-02-09 16:31:07 2020-02-09 20:18:31 2020-02-09 20:50:30 0:31:59 0:23:35 0:08:24 smithi master ubuntu 16.04 rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
fail 4748446 2020-02-09 16:31:08 2020-02-09 20:18:36 2020-02-09 21:38:36 1:20:00 0:55:44 0:24:16 smithi master ubuntu 16.04 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi095 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748447 2020-02-09 16:31:09 2020-02-09 20:19:25 2020-02-09 21:31:26 1:12:01 0:59:09 0:12:52 smithi master centos 7.5 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{centos_latest.yaml} tasks/prometheus.yaml} 2
Failure Reason:

Command failed on smithi062 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748448 2020-02-09 16:31:10 2020-02-09 20:19:41 2020-02-09 20:45:40 0:25:59 0:12:34 0:13:25 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 4748449 2020-02-09 16:31:11 2020-02-09 20:21:35 2020-02-09 21:27:36 1:06:01 0:55:49 0:10:12 smithi master ubuntu 18.04 rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi065 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748450 2020-02-09 16:31:12 2020-02-09 20:21:35 2020-02-09 21:29:36 1:08:01 0:56:35 0:11:26 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/repair_test.yaml} 2
Failure Reason:

Command failed on smithi112 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 4748451 2020-02-09 16:31:13 2020-02-09 20:21:41 2020-02-09 21:13:41 0:52:00 0:28:05 0:23:55 smithi master ubuntu 16.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/simple.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 4
fail 4748452 2020-02-09 16:31:15 2020-02-09 20:22:01 2020-02-09 21:30:02 1:08:01 0:55:44 0:12:17 smithi master ubuntu 18.04 rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed on smithi182 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748453 2020-02-09 16:31:16 2020-02-09 20:23:47 2020-02-09 21:35:48 1:12:01 0:58:19 0:13:42 smithi master centos 7.5 rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_seq_read.yaml} 1
Failure Reason:

Command failed on smithi096 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748454 2020-02-09 16:31:17 2020-02-09 20:25:09 2020-02-09 21:51:14 1:26:05 0:57:48 0:28:17 smithi master ubuntu 18.04 rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi023 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748455 2020-02-09 16:31:18 2020-02-09 20:26:25 2020-02-09 21:34:26 1:08:01 1:01:11 0:06:50 smithi master rhel 7.5 rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 2
Failure Reason:

Command failed on smithi129 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 4748456 2020-02-09 16:31:19 2020-02-09 20:27:52 2020-02-09 21:36:00 1:08:08 0:56:27 0:11:41 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Command failed on smithi092 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'