Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4252641 2019-08-26 03:05:31 2019-08-31 22:45:41 2019-08-31 23:11:40 0:25:59 0:16:07 0:09:52 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

"2019-08-31T23:10:20.936274+0000 mon.b (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252642 2019-08-26 03:05:32 2019-08-31 22:45:41 2019-08-31 23:05:40 0:19:59 0:09:59 0:10:00 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi132 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252643 2019-08-26 03:05:33 2019-08-31 22:47:42 2019-09-01 08:55:53 10:08:11 9:43:40 0:24:31 smithi master centos rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite, rgw multisite pubsub, test failures

fail 4252644 2019-08-26 03:05:33 2019-08-31 22:47:42 2019-08-31 23:25:42 0:38:00 0:09:44 0:28:16 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_7.yaml}} 2
Failure Reason:

Command failed on smithi186 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252645 2019-08-26 03:05:34 2019-08-31 22:49:33 2019-08-31 23:11:32 0:21:59 0:14:16 0:07:43 smithi master rhel 7.6 rgw/tempest/{clusters/fixed-1.yaml distro/supported-random-distro$/{rhel_7.yaml} frontend/beast.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi060 with status 1: 'cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest'

fail 4252646 2019-08-26 03:05:35 2019-08-31 22:49:33 2019-08-31 23:27:32 0:37:59 0:12:31 0:25:28 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi129 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252647 2019-08-26 03:05:36 2019-08-31 22:49:33 2019-09-01 00:39:33 1:50:00 1:17:56 0:32:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

fail 4252648 2019-08-26 03:05:36 2019-08-31 22:51:31 2019-08-31 23:13:30 0:21:59 0:09:56 0:12:03 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252649 2019-08-26 03:05:37 2019-08-31 22:51:31 2019-09-01 00:57:32 2:06:01 1:52:58 0:13:03 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T00:53:40.855630+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252650 2019-08-26 03:05:38 2019-08-31 22:51:32 2019-08-31 23:07:31 0:15:59 0:08:12 0:07:47 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi180 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252651 2019-08-26 03:05:38 2019-08-31 22:51:31 2019-09-01 00:19:32 1:28:01 1:16:30 0:11:31 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi118 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252652 2019-08-26 03:05:39 2019-08-31 22:51:40 2019-08-31 23:13:39 0:21:59 0:14:50 0:07:09 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi036 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252653 2019-08-26 03:05:40 2019-08-31 22:53:42 2019-09-01 01:13:43 2:20:01 1:53:28 0:26:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:10:10.132263+0000 mon.b (mon.0) 394 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252654 2019-08-26 03:05:40 2019-08-31 22:53:42 2019-08-31 23:21:41 0:27:59 0:12:10 0:15:49 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252655 2019-08-26 03:05:41 2019-08-31 22:55:40 2019-08-31 23:09:39 0:13:59 0:07:35 0:06:24 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252656 2019-08-26 03:05:42 2019-08-31 22:55:40 2019-09-01 00:21:40 1:26:00 1:16:46 0:09:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi101 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252657 2019-08-26 03:05:43 2019-08-31 22:55:40 2019-08-31 23:15:39 0:19:59 0:12:55 0:07:04 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi041 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252658 2019-08-26 03:05:43 2019-08-31 22:55:40 2019-09-01 00:55:42 2:00:02 1:51:53 0:08:09 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T00:52:05.102222+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252659 2019-08-26 03:05:44 2019-08-31 22:57:26 2019-08-31 23:27:25 0:29:59 0:08:01 0:21:58 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252660 2019-08-26 03:05:45 2019-08-31 22:57:27 2019-09-01 00:25:27 1:28:00 1:16:39 0:11:21 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi140 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252661 2019-08-26 03:05:45 2019-08-31 22:57:27 2019-08-31 23:27:26 0:29:59 0:17:39 0:12:20 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi008 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252662 2019-08-26 03:05:46 2019-08-31 22:57:32 2019-08-31 23:15:31 0:17:59 0:09:31 0:08:28 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

"2019-08-31T23:12:40.749944+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252663 2019-08-26 03:05:47 2019-08-31 22:57:34 2019-09-01 01:07:35 2:10:01 1:52:19 0:17:42 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:03:55.975154+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252664 2019-08-26 03:05:48 2019-08-31 22:59:35 2019-08-31 23:31:34 0:31:59 0:09:51 0:22:08 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi121 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252665 2019-08-26 03:05:48 2019-08-31 22:59:35 2019-08-31 23:21:34 0:21:59 0:06:54 0:15:05 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi143 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252666 2019-08-26 03:05:49 2019-08-31 22:59:35 2019-09-01 00:27:35 1:28:00 1:18:38 0:09:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T00:25:22.116804+0000 mon.b (mon.0) 316 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 4252667 2019-08-26 03:05:50 2019-08-31 22:59:35 2019-08-31 23:37:35 0:38:00 0:09:11 0:28:49 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi028 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252668 2019-08-26 03:05:51 2019-08-31 22:59:35 2019-09-01 02:23:43 3:24:08 2:59:06 0:25:02 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T02:19:43.099109+0000 mon.b (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252669 2019-08-26 03:05:51 2019-08-31 23:00:22 2019-08-31 23:16:21 0:15:59 0:08:11 0:07:48 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi094 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252670 2019-08-26 03:05:52 2019-08-31 23:01:33 2019-09-01 00:43:33 1:42:00 1:22:07 0:19:53 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi049 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252671 2019-08-26 03:05:53 2019-08-31 23:01:33 2019-08-31 23:19:32 0:17:59 0:10:49 0:07:10 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252672 2019-08-26 03:05:53 2019-08-31 23:01:40 2019-08-31 23:25:39 0:23:59 0:14:51 0:09:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi071 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252673 2019-08-26 03:05:54 2019-08-31 23:03:30 2019-09-01 01:15:31 2:12:01 1:55:08 0:16:53 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:10:47.080097+0000 mon.b (mon.0) 377 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252674 2019-08-26 03:05:55 2019-08-31 23:03:30 2019-08-31 23:19:29 0:15:59 0:08:04 0:07:55 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi136 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252675 2019-08-26 03:05:55 2019-08-31 23:03:30 2019-09-01 00:51:31 1:48:01 1:18:59 0:29:02 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

fail 4252676 2019-08-26 03:05:56 2019-08-31 23:03:30 2019-08-31 23:27:29 0:23:59 0:12:49 0:11:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi180 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252677 2019-08-26 03:05:57 2019-08-31 23:03:30 2019-09-01 01:13:31 2:10:01 1:53:12 0:16:49 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:09:57.767467+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252678 2019-08-26 03:05:58 2019-08-31 23:03:30 2019-08-31 23:29:29 0:25:59 0:16:56 0:09:03 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi025 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252679 2019-08-26 03:05:58 2019-08-31 23:03:33 2019-08-31 23:19:32 0:15:59 0:07:29 0:08:30 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi137 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252680 2019-08-26 03:05:59 2019-08-31 23:05:51 2019-09-01 00:53:51 1:48:00 1:18:42 0:29:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi179 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252681 2019-08-26 03:06:00 2019-08-31 23:05:51 2019-08-31 23:45:50 0:39:59 0:09:34 0:30:25 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi112 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252682 2019-08-26 03:06:01 2019-08-31 23:07:48 2019-09-01 01:07:49 2:00:01 1:52:05 0:07:56 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:02:38.387659+0000 mon.b (mon.0) 391 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252683 2019-08-26 03:06:01 2019-08-31 23:07:48 2019-08-31 23:25:48 0:18:00 0:10:16 0:07:44 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi159 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252684 2019-08-26 03:06:02 2019-08-31 23:09:38 2019-08-31 23:31:37 0:21:59 0:12:56 0:09:03 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
Failure Reason:

Command failed on smithi078 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252685 2019-08-26 03:06:03 2019-08-31 23:09:38 2019-09-01 00:39:39 1:30:01 1:20:20 0:09:41 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi036 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252686 2019-08-26 03:06:04 2019-08-31 23:09:39 2019-08-31 23:35:38 0:25:59 0:09:36 0:16:23 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi063 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252687 2019-08-26 03:06:04 2019-08-31 23:09:39 2019-09-01 01:13:39 2:04:00 1:49:09 0:14:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:10:25.637705+0000 mon.b (mon.0) 296 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252688 2019-08-26 03:06:05 2019-08-31 23:09:40 2019-08-31 23:29:39 0:19:59 0:10:17 0:09:42 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi086 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252689 2019-08-26 03:06:06 2019-08-31 23:11:42 2019-08-31 23:27:41 0:15:59 0:08:26 0:07:33 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi050 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252690 2019-08-26 03:06:07 2019-08-31 23:11:42 2019-09-01 00:51:43 1:40:01 1:19:00 0:21:01 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T00:48:43.250066+0000 mon.a (mon.0) 409 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 4252691 2019-08-26 03:06:07 2019-08-31 23:11:42 2019-08-31 23:49:42 0:38:00 0:13:28 0:24:32 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi202 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252692 2019-08-26 03:06:08 2019-08-31 23:11:43 2019-09-01 02:25:45 3:14:02 2:44:04 0:29:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T02:21:21.962002+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252693 2019-08-26 03:06:09 2019-08-31 23:13:47 2019-08-31 23:29:46 0:15:59 0:07:56 0:08:03 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi041 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252694 2019-08-26 03:06:09 2019-08-31 23:13:47 2019-09-01 00:53:48 1:40:01 1:16:20 0:23:41 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi172 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252695 2019-08-26 03:06:10 2019-08-31 23:13:48 2019-08-31 23:45:47 0:31:59 0:12:34 0:19:25 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi087 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252696 2019-08-26 03:06:11 2019-08-31 23:13:47 2019-08-31 23:39:47 0:26:00 0:12:48 0:13:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252697 2019-08-26 03:06:12 2019-08-31 23:15:25 2019-09-01 01:27:26 2:12:01 1:53:06 0:18:55 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:22:10.018650+0000 mon.b (mon.0) 328 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252698 2019-08-26 03:06:12 2019-08-31 23:15:25 2019-08-31 23:39:24 0:23:59 0:08:01 0:15:58 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252699 2019-08-26 03:06:13 2019-08-31 23:15:25 2019-09-01 00:51:25 1:36:00 1:18:43 0:17:17 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T00:48:49.020293+0000 mon.a (mon.0) 326 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 4252700 2019-08-26 03:06:14 2019-08-31 23:15:33 2019-08-31 23:35:32 0:19:59 0:09:19 0:10:40 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi026 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252701 2019-08-26 03:06:15 2019-08-31 23:15:38 2019-09-01 01:19:39 2:04:01 1:50:31 0:13:30 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:14:28.569854+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252702 2019-08-26 03:06:15 2019-08-31 23:15:40 2019-08-31 23:35:40 0:20:00 0:09:50 0:10:10 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252703 2019-08-26 03:06:16 2019-08-31 23:16:23 2019-08-31 23:32:22 0:15:59 0:06:54 0:09:05 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi174 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252704 2019-08-26 03:06:17 2019-08-31 23:19:40 2019-08-31 23:59:39 0:39:59 0:13:02 0:26:57 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi035 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252705 2019-08-26 03:06:18 2019-08-31 23:19:40 2019-09-01 01:33:41 2:14:01 1:17:21 0:56:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi202 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252706 2019-08-26 03:06:19 2019-08-31 23:19:40 2019-09-01 00:21:40 1:02:00 0:09:46 0:52:14 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi025 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252707 2019-08-26 03:06:19 2019-08-31 23:19:40 2019-09-01 02:03:42 2:44:02 1:54:21 0:49:41 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T02:00:11.027257+0000 mon.a (mon.0) 378 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252708 2019-08-26 03:06:20 2019-08-31 23:19:40 2019-08-31 23:41:39 0:21:59 0:08:24 0:13:35 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252709 2019-08-26 03:06:21 2019-08-31 23:21:50 2019-09-01 01:07:51 1:46:01 1:19:04 0:26:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252710 2019-08-26 03:06:21 2019-08-31 23:21:50 2019-08-31 23:47:50 0:26:00 0:14:31 0:11:29 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi180 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252711 2019-08-26 03:06:22 2019-08-31 23:21:50 2019-09-01 01:45:51 2:24:01 1:56:09 0:27:52 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:40:48.841261+0000 mon.a (mon.0) 379 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252712 2019-08-26 03:06:23 2019-08-31 23:23:48 2019-08-31 23:43:48 0:20:00 0:12:23 0:07:37 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi107 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252713 2019-08-26 03:06:24 2019-08-31 23:25:57 2019-08-31 23:51:56 0:25:59 0:07:47 0:18:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252714 2019-08-26 03:06:24 2019-08-31 23:25:57 2019-09-01 01:59:58 2:34:01 1:21:40 1:12:21 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252715 2019-08-26 03:06:25 2019-08-31 23:25:57 2019-09-01 00:27:57 1:02:00 0:13:25 0:48:35 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi190 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252716 2019-08-26 03:06:26 2019-08-31 23:27:43 2019-09-01 01:57:45 2:30:02 2:19:33 0:10:29 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:53:54.935998+0000 mon.a (mon.0) 388 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252717 2019-08-26 03:06:26 2019-08-31 23:27:44 2019-09-01 00:11:43 0:43:59 0:14:12 0:29:47 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/trunk.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi202 with status 1: 'cd /home/ubuntu/cephtest/hadoop/hadoop-tools/hadoop-aws/ && rm src/test/java/org/apache/hadoop/fs/s3a/ITestS3AAWSCredentialsProvider.java && /home/ubuntu/cephtest/apache-maven-3.6.0/bin/mvn test -Dtest=S3a*,TestS3A*'

fail 4252718 2019-08-26 03:06:27 2019-08-31 23:27:43 2019-08-31 23:43:42 0:15:59 0:08:12 0:07:47 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi086 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252719 2019-08-26 03:06:28 2019-08-31 23:27:44 2019-09-01 00:11:43 0:43:59 0:32:36 0:11:23 smithi master centos rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

"2019-09-01T00:07:59.640165+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252720 2019-08-26 03:06:29 2019-08-31 23:27:44 2019-08-31 23:45:42 0:17:58 0:10:08 0:07:50 smithi master centos rgw/tempest/{clusters/fixed-1.yaml distro/valgrind.yaml frontend/civetweb.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi025 with status 1: 'cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest'

fail 4252721 2019-08-26 03:06:29 2019-08-31 23:29:45 2019-09-01 01:45:47 2:16:02 1:55:05 0:20:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi087 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252722 2019-08-26 03:06:30 2019-08-31 23:29:46 2019-08-31 23:55:45 0:25:59 0:17:08 0:08:51 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi121 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252723 2019-08-26 03:06:31 2019-08-31 23:29:48 2019-09-01 00:35:48 1:06:00 0:09:12 0:56:48 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi162 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252724 2019-08-26 03:06:32 2019-08-31 23:31:47 2019-09-01 01:15:48 1:44:01 1:35:01 0:09:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:11:13.609105+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252725 2019-08-26 03:06:32 2019-08-31 23:31:47 2019-09-01 00:19:47 0:48:00 0:10:07 0:37:53 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi026 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252726 2019-08-26 03:06:33 2019-08-31 23:31:47 2019-09-01 00:07:47 0:36:00 0:06:38 0:29:22 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi180 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252727 2019-08-26 03:06:34 2019-08-31 23:31:47 2019-09-01 02:01:48 2:30:01 1:52:23 0:37:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi184 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252728 2019-08-26 03:06:35 2019-08-31 23:32:24 2019-08-31 23:52:23 0:19:59 0:09:21 0:10:38 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252729 2019-08-26 03:06:35 2019-08-31 23:33:36 2019-09-01 01:27:37 1:54:01 1:29:31 0:24:30 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:22:54.321118+0000 mon.b (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252730 2019-08-26 03:06:36 2019-08-31 23:33:36 2019-09-01 01:05:37 1:32:01 0:07:53 1:24:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi088 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252731 2019-08-26 03:06:37 2019-08-31 23:35:15 2019-09-01 01:41:16 2:06:01 1:52:26 0:13:35 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252732 2019-08-26 03:06:37 2019-08-31 23:35:15 2019-09-01 00:03:14 0:27:59 0:10:12 0:17:47 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi086 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252733 2019-08-26 03:06:38 2019-08-31 23:35:33 2019-09-01 00:05:33 0:30:00 0:14:21 0:15:39 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi025 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252734 2019-08-26 03:06:39 2019-08-31 23:35:39 2019-09-01 01:39:40 2:04:01 1:26:00 0:38:01 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:36:03.876324+0000 mon.b (mon.0) 296 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252735 2019-08-26 03:06:40 2019-08-31 23:35:41 2019-08-31 23:51:40 0:15:59 0:07:41 0:08:18 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi077 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252736 2019-08-26 03:06:40 2019-08-31 23:37:30 2019-09-01 02:59:33 3:22:03 2:02:23 1:19:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi198 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252737 2019-08-26 03:06:41 2019-08-31 23:37:36 2019-09-01 00:05:36 0:28:00 0:12:46 0:15:14 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi112 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252738 2019-08-26 03:06:42 2019-08-31 23:39:41 2019-09-01 01:57:42 2:18:01 1:32:58 0:45:03 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:54:28.161400+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252739 2019-08-26 03:06:42 2019-08-31 23:39:48 2019-09-01 00:03:47 0:23:59 0:15:49 0:08:10 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi184 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252740 2019-08-26 03:06:43 2019-08-31 23:41:57 2019-09-01 00:33:57 0:52:00 0:07:45 0:44:15 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252741 2019-08-26 03:06:44 2019-08-31 23:43:40 2019-09-01 02:03:41 2:20:01 1:52:36 0:27:25 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi112 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252742 2019-08-26 03:06:44 2019-08-31 23:43:44 2019-09-01 00:53:44 1:10:00 0:08:49 1:01:11 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi064 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252743 2019-08-26 03:06:45 2019-08-31 23:43:49 2019-09-01 03:53:52 4:10:03 2:57:02 1:13:01 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:49:20.031433+0000 mon.b (mon.0) 305 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252744 2019-08-26 03:06:46 2019-08-31 23:45:59 2019-09-01 00:55:59 1:10:00 0:10:09 0:59:51 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi036 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252745 2019-08-26 03:06:47 2019-08-31 23:45:59 2019-09-01 01:11:59 1:26:00 0:07:07 1:18:53 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi146 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252746 2019-08-26 03:06:47 2019-08-31 23:45:59 2019-09-01 01:52:00 2:06:01 1:50:10 0:15:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi121 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252747 2019-08-26 03:06:48 2019-08-31 23:48:06 2019-09-01 00:06:05 0:17:59 0:09:16 0:08:43 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi077 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252748 2019-08-26 03:06:49 2019-08-31 23:49:58 2019-09-01 01:35:59 1:46:01 1:28:17 0:17:44 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:32:38.741922+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252749 2019-08-26 03:06:50 2019-08-31 23:51:57 2019-09-01 00:09:56 0:17:59 0:11:03 0:06:56 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252750 2019-08-26 03:06:50 2019-08-31 23:51:57 2019-09-01 00:17:57 0:26:00 0:08:16 0:17:44 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi086 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252751 2019-08-26 03:06:51 2019-08-31 23:52:24 2019-09-01 02:24:26 2:32:02 2:04:58 0:27:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi003 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252752 2019-08-26 03:06:52 2019-08-31 23:56:01 2019-09-01 01:28:01 1:32:00 0:14:40 1:17:20 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi002 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252753 2019-08-26 03:06:53 2019-08-31 23:59:55 2019-09-01 02:05:56 2:06:01 1:39:51 0:26:10 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:57:36.999663+0000 mon.b (mon.0) 304 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252754 2019-08-26 03:06:53 2019-09-01 00:03:30 2019-09-01 00:41:29 0:37:59 0:07:32 0:30:27 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi190 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252755 2019-08-26 03:06:54 2019-09-01 00:03:30 2019-09-01 03:21:32 3:18:02 1:55:56 1:22:06 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi162 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252756 2019-08-26 03:06:55 2019-09-01 00:03:49 2019-09-01 00:45:48 0:41:59 0:12:08 0:29:51 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252757 2019-08-26 03:06:56 2019-09-01 00:05:48 2019-09-01 00:27:47 0:21:59 0:12:42 0:09:17 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi145 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252758 2019-08-26 03:06:56 2019-09-01 00:05:48 2019-09-01 02:01:49 1:56:01 1:32:20 0:23:41 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T01:57:16.476236+0000 mon.b (mon.0) 318 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252759 2019-08-26 03:06:57 2019-09-01 00:06:07 2019-09-01 00:54:06 0:47:59 0:07:58 0:40:01 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi038 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252760 2019-08-26 03:06:58 2019-09-01 00:07:38 2019-09-01 02:19:39 2:12:01 1:56:27 0:15:34 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi086 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252761 2019-08-26 03:06:58 2019-09-01 00:07:48 2019-09-01 00:33:47 0:25:59 0:09:20 0:16:39 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi198 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252762 2019-08-26 03:06:59 2019-09-01 00:10:09 2019-09-01 02:18:10 2:08:01 1:27:29 0:40:32 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T02:13:15.000366+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252763 2019-08-26 03:07:00 2019-09-01 00:10:09 2019-09-01 00:28:08 0:17:59 0:10:05 0:07:54 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi105 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252764 2019-08-26 03:07:01 2019-09-01 00:12:00 2019-09-01 01:14:00 1:02:00 0:09:42 0:52:18 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_7.yaml}} 2
Failure Reason:

Command failed on smithi107 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252765 2019-08-26 03:07:01 2019-09-01 00:12:00 2019-09-01 01:38:00 1:26:00 0:12:24 1:13:36 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi197 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252766 2019-08-26 03:07:02 2019-09-01 02:06:22 2019-09-01 04:08:22 2:02:00 1:54:42 0:07:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi202 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252767 2019-08-26 03:07:03 2019-09-01 02:06:36 2019-09-01 02:22:35 0:15:59 0:09:10 0:06:49 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi118 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252768 2019-08-26 03:07:04 2019-09-01 02:08:13 2019-09-01 04:50:14 2:42:01 2:33:03 0:08:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T04:45:20.909119+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252769 2019-08-26 03:07:04 2019-09-01 02:08:14 2019-09-01 02:34:13 0:25:59 0:08:14 0:17:45 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi171 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252770 2019-08-26 03:07:05 2019-09-01 02:08:13 2019-09-01 04:10:14 2:02:01 1:53:56 0:08:05 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi026 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252771 2019-08-26 03:07:06 2019-09-01 02:08:14 2019-09-01 02:30:12 0:21:58 0:14:48 0:07:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi150 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252772 2019-08-26 03:07:06 2019-09-01 02:08:14 2019-09-01 03:58:14 1:50:00 1:30:25 0:19:35 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:54:20.528427+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252773 2019-08-26 03:07:07 2019-09-01 02:08:14 2019-09-01 02:30:12 0:21:58 0:12:25 0:09:33 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi101 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252774 2019-08-26 03:07:08 2019-09-01 02:08:16 2019-09-01 03:02:16 0:54:00 0:08:01 0:45:59 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252775 2019-08-26 03:07:09 2019-09-01 02:10:03 2019-09-01 04:16:04 2:06:01 1:52:50 0:13:11 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T04:13:26.359160+0000 mon.b (mon.0) 300 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252776 2019-08-26 03:07:09 2019-09-01 02:10:03 2019-09-01 02:32:02 0:21:59 0:12:38 0:09:21 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi114 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252777 2019-08-26 03:07:10 2019-09-01 02:10:03 2019-09-01 03:48:03 1:38:00 1:24:51 0:13:09 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:43:34.004623+0000 mon.b (mon.0) 386 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252778 2019-08-26 03:07:11 2019-09-01 02:10:03 2019-09-01 02:26:02 0:15:59 0:08:22 0:07:37 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252779 2019-08-26 03:07:11 2019-09-01 02:10:04 2019-09-01 04:28:05 2:18:01 1:55:09 0:22:52 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi036 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252780 2019-08-26 03:07:12 2019-09-01 02:10:04 2019-09-01 02:34:03 0:23:59 0:17:26 0:06:33 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi096 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252781 2019-08-26 03:07:13 2019-09-01 02:10:05 2019-09-01 02:26:04 0:15:59 0:09:21 0:06:38 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi036 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252782 2019-08-26 03:07:14 2019-09-01 02:10:07 2019-09-01 03:58:07 1:48:00 1:32:27 0:15:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:53:56.612372+0000 mon.a (mon.0) 382 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252783 2019-08-26 03:07:14 2019-09-01 02:12:03 2019-09-01 02:32:02 0:19:59 0:09:55 0:10:04 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252784 2019-08-26 03:07:15 2019-09-01 02:12:03 2019-09-01 02:36:02 0:23:59 0:15:37 0:08:22 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_7.yaml}} 2
Failure Reason:

Command failed on smithi115 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252785 2019-08-26 03:07:16 2019-09-01 02:12:03 2019-09-01 04:16:04 2:04:01 1:51:47 0:12:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi140 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252786 2019-08-26 03:07:16 2019-09-01 02:12:03 2019-09-01 02:32:02 0:19:59 0:09:34 0:10:25 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi153 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252787 2019-08-26 03:07:17 2019-09-01 02:14:07 2019-09-01 04:02:08 1:48:01 1:32:47 0:15:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:57:46.264686+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252788 2019-08-26 03:07:18 2019-09-01 02:14:07 2019-09-01 02:58:07 0:44:00 0:08:31 0:35:29 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi035 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252789 2019-08-26 03:07:19 2019-09-01 02:14:16 2019-09-01 05:24:18 3:10:02 1:58:39 1:11:23 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi025 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252790 2019-08-26 03:07:19 2019-09-01 02:15:57 2019-09-01 02:35:56 0:19:59 0:11:14 0:08:45 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi038 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252791 2019-08-26 03:07:20 2019-09-01 02:15:57 2019-09-01 02:43:56 0:27:59 0:13:37 0:14:22 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi203 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252792 2019-08-26 03:07:21 2019-09-01 02:16:03 2019-09-01 04:28:05 2:12:02 2:05:29 0:06:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T04:24:52.696707+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252793 2019-08-26 03:07:22 2019-09-01 02:17:36 2019-09-01 02:43:36 0:26:00 0:15:07 0:10:53 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v28.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi041 with status 1: 'cd /home/ubuntu/cephtest/hadoop/hadoop-tools/hadoop-aws/ && rm src/test/java/org/apache/hadoop/fs/s3a/ITestS3AAWSCredentialsProvider.java && /home/ubuntu/cephtest/apache-maven-3.6.0/bin/mvn -Dit.test=ITestS3A* -Dparallel-tests -Dscale -Dfs.s3a.scale.test.timeout=1200 -Dfs.s3a.scale.test.huge.filesize=256M verify'

fail 4252794 2019-08-26 03:07:22 2019-09-01 02:17:36 2019-09-01 02:35:36 0:18:00 0:07:59 0:10:01 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252795 2019-08-26 03:07:23 2019-09-01 02:17:43 2019-09-01 04:55:44 2:38:01 2:02:24 0:35:37 smithi master centos rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite, rgw multisite pubsub, test failures

fail 4252796 2019-08-26 03:07:24 2019-09-01 02:17:48 2019-09-01 02:35:47 0:17:59 0:10:00 0:07:59 smithi master centos rgw/tempest/{clusters/fixed-1.yaml distro/valgrind.yaml frontend/beast.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi092 with status 1: 'cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest'

fail 4252797 2019-08-26 03:07:24 2019-09-01 02:17:53 2019-09-01 03:33:53 1:16:00 0:38:03 0:37:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi174 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252798 2019-08-26 03:07:25 2019-09-01 02:17:53 2019-09-01 02:41:52 0:23:59 0:12:48 0:11:11 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi136 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252799 2019-08-26 03:07:26 2019-09-01 02:18:11 2019-09-01 04:56:13 2:38:02 2:29:56 0:08:06 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T04:50:39.130407+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252800 2019-08-26 03:07:26 2019-09-01 02:19:37 2019-09-01 02:49:37 0:30:00 0:16:08 0:13:52 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi174 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252801 2019-08-26 03:07:27 2019-09-01 02:19:41 2019-09-01 02:39:40 0:19:59 0:07:57 0:12:02 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi002 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252802 2019-08-26 03:07:28 2019-09-01 02:19:45 2019-09-01 03:25:49 1:06:04 0:39:41 0:26:23 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi129 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252803 2019-08-26 03:07:29 2019-09-01 02:19:48 2019-09-01 03:25:48 1:06:00 0:09:10 0:56:50 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi135 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252804 2019-08-26 03:07:30 2019-09-01 02:19:51 2019-09-01 05:05:53 2:46:02 2:31:09 0:14:53 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:02:08.292456+0000 mon.b (mon.0) 297 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252805 2019-08-26 03:07:30 2019-09-01 02:19:58 2019-09-01 02:41:57 0:21:59 0:09:57 0:12:02 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252806 2019-08-26 03:07:31 2019-09-01 02:20:01 2019-09-01 02:50:00 0:29:59 0:09:46 0:20:13 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_7.yaml}} 2
Failure Reason:

Command failed on smithi124 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252807 2019-08-26 03:07:32 2019-09-01 02:20:02 2019-09-01 03:10:01 0:49:59 0:39:20 0:10:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi109 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252808 2019-08-26 03:07:32 2019-09-01 02:22:19 2019-09-01 02:38:18 0:15:59 0:09:38 0:06:21 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi154 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252809 2019-08-26 03:07:33 2019-09-01 02:22:37 2019-09-01 04:58:38 2:36:01 2:24:15 0:11:46 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T04:52:47.250592+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252810 2019-08-26 03:07:34 2019-09-01 02:23:52 2019-09-01 02:47:51 0:23:59 0:10:36 0:13:23 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252811 2019-08-26 03:07:35 2019-09-01 02:23:52 2019-09-01 02:47:52 0:24:00 0:08:41 0:15:19 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi114 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252812 2019-08-26 03:07:35 2019-09-01 02:23:52 2019-09-01 03:15:52 0:52:00 0:38:47 0:13:13 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi153 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252813 2019-08-26 03:07:36 2019-09-01 02:23:52 2019-09-01 02:51:51 0:27:59 0:14:28 0:13:31 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi194 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252814 2019-08-26 03:07:37 2019-09-01 02:23:56 2019-09-01 05:05:58 2:42:02 2:35:44 0:06:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:01:59.045626+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252815 2019-08-26 03:07:37 2019-09-01 02:23:56 2019-09-01 02:45:56 0:22:00 0:07:52 0:14:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi201 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252816 2019-08-26 03:07:38 2019-09-01 02:24:03 2019-09-01 03:34:03 1:10:00 0:38:53 0:31:07 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi125 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252817 2019-08-26 03:07:39 2019-09-01 02:24:27 2019-09-01 02:46:26 0:21:59 0:12:20 0:09:39 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi205 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252818 2019-08-26 03:07:40 2019-09-01 02:25:49 2019-09-01 03:11:49 0:46:00 0:13:58 0:32:02 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi182 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252819 2019-08-26 03:07:40 2019-09-01 02:25:50 2019-09-01 06:07:52 3:42:02 3:32:57 0:09:05 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T06:03:16.041073+0000 mon.b (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252820 2019-08-26 03:07:41 2019-09-01 02:25:49 2019-09-01 03:25:49 1:00:00 0:07:49 0:52:11 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi109 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252821 2019-08-26 03:07:42 2019-09-01 02:25:57 2019-09-01 03:25:56 0:59:59 0:37:33 0:22:26 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi101 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252822 2019-08-26 03:07:43 2019-09-01 02:26:04 2019-09-01 02:48:03 0:21:59 0:09:10 0:12:49 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi171 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252823 2019-08-26 03:07:43 2019-09-01 02:26:06 2019-09-01 05:06:07 2:40:01 2:32:01 0:08:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T04:59:24.210596+0000 mon.b (mon.0) 353 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252824 2019-08-26 03:07:44 2019-09-01 02:28:16 2019-09-01 02:48:15 0:19:59 0:09:57 0:10:02 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi156 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252825 2019-08-26 03:07:45 2019-09-01 02:28:16 2019-09-01 02:42:15 0:13:59 0:06:40 0:07:19 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi088 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252826 2019-08-26 03:07:46 2019-09-01 02:28:57 2019-09-01 03:00:57 0:32:00 0:13:08 0:18:52 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi203 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252827 2019-08-26 03:07:46 2019-09-01 02:30:19 2019-09-01 03:44:19 1:14:00 0:39:23 0:34:37 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252828 2019-08-26 03:07:47 2019-09-01 02:30:20 2019-09-01 02:50:18 0:19:58 0:09:26 0:10:32 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi182 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252829 2019-08-26 03:07:48 2019-09-01 02:30:19 2019-09-01 05:26:21 2:56:02 2:28:26 0:27:36 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:21:18.232727+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252830 2019-08-26 03:07:49 2019-09-01 02:32:05 2019-09-01 02:48:04 0:15:59 0:07:59 0:08:00 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi112 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252831 2019-08-26 03:07:49 2019-09-01 02:32:05 2019-09-01 03:22:05 0:50:00 0:40:14 0:09:46 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi038 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252832 2019-08-26 03:07:50 2019-09-01 02:32:05 2019-09-01 03:12:05 0:40:00 0:14:50 0:25:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252833 2019-08-26 03:07:51 2019-09-01 02:32:05 2019-09-01 05:18:07 2:46:02 2:29:26 0:16:36 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:13:35.708826+0000 mon.b (mon.0) 298 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252834 2019-08-26 03:07:51 2019-09-01 02:32:06 2019-09-01 03:20:05 0:47:59 0:12:05 0:35:54 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi139 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252835 2019-08-26 03:07:52 2019-09-01 02:32:05 2019-09-01 03:04:04 0:31:59 0:08:00 0:23:59 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi169 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252836 2019-08-26 03:07:53 2019-09-01 02:32:05 2019-09-01 03:46:05 1:14:00 0:39:32 0:34:28 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi079 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252837 2019-08-26 03:07:53 2019-09-01 02:32:06 2019-09-01 02:56:05 0:23:59 0:12:32 0:11:27 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252838 2019-08-26 03:07:54 2019-09-01 02:33:52 2019-09-01 05:03:54 2:30:02 2:23:44 0:06:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:00:12.706961+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252839 2019-08-26 03:07:55 2019-09-01 02:33:56 2019-09-01 02:55:55 0:21:59 0:08:08 0:13:51 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi161 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252840 2019-08-26 03:07:56 2019-09-01 02:34:03 2019-09-01 03:20:03 0:46:00 0:38:43 0:07:17 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi193 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252841 2019-08-26 03:07:56 2019-09-01 02:34:03 2019-09-01 02:58:03 0:24:00 0:17:04 0:06:56 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252842 2019-08-26 03:07:57 2019-09-01 02:34:05 2019-09-01 03:02:04 0:27:59 0:08:44 0:19:15 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi205 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252843 2019-08-26 03:07:58 2019-09-01 02:34:14 2019-09-01 06:20:17 3:46:03 3:26:09 0:19:54 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T06:14:57.359648+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252844 2019-08-26 03:07:59 2019-09-01 02:35:52 2019-09-01 02:53:51 0:17:59 0:10:08 0:07:51 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi154 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252845 2019-08-26 03:07:59 2019-09-01 02:35:52 2019-09-01 02:55:52 0:20:00 0:09:47 0:10:13 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_7.yaml}} 2
Failure Reason:

Command failed on smithi113 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252846 2019-08-26 03:08:00 2019-09-01 02:35:57 2019-09-01 03:25:57 0:50:00 0:40:54 0:09:06 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi050 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252847 2019-08-26 03:08:01 2019-09-01 02:36:04 2019-09-01 03:04:03 0:27:59 0:09:42 0:18:17 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

"2019-09-01T03:01:52.439937+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

fail 4252848 2019-08-26 03:08:01 2019-09-01 02:36:05 2019-09-01 05:24:07 2:48:02 2:27:37 0:20:25 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:18:56.579433+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252849 2019-08-26 03:08:02 2019-09-01 02:38:13 2019-09-01 03:00:12 0:21:59 0:08:18 0:13:41 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi133 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252850 2019-08-26 03:08:03 2019-09-01 02:38:13 2019-09-01 03:26:13 0:48:00 0:40:03 0:07:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi002 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252851 2019-08-26 03:08:04 2019-09-01 02:38:20 2019-09-01 03:00:19 0:21:59 0:10:09 0:11:50 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi023 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252852 2019-08-26 03:08:04 2019-09-01 02:39:56 2019-09-01 03:11:56 0:32:00 0:14:50 0:17:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi135 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252853 2019-08-26 03:08:05 2019-09-01 02:39:56 2019-09-01 05:29:58 2:50:02 2:22:04 0:27:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:24:54.308767+0000 mon.b (mon.0) 296 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252854 2019-08-26 03:08:06 2019-09-01 02:39:59 2019-09-01 02:55:58 0:15:59 0:07:57 0:08:02 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

"2019-09-01T02:50:58.440629+0000 mon.a (mon.0) 43 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 4252855 2019-08-26 03:08:06 2019-09-01 02:40:01 2019-09-01 03:32:01 0:52:00 0:40:18 0:11:42 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi201 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252856 2019-08-26 03:08:07 2019-09-01 02:40:02 2019-09-01 03:56:02 1:16:00 0:12:55 1:03:05 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi137 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252857 2019-08-26 03:08:08 2019-09-01 02:42:10 2019-09-01 06:08:12 3:26:02 2:27:11 0:58:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T06:03:48.984634+0000 mon.a (mon.0) 312 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252858 2019-08-26 03:08:09 2019-09-01 02:42:10 2019-09-01 03:06:09 0:23:59 0:15:46 0:08:13 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi073 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252859 2019-08-26 03:08:09 2019-09-01 02:42:10 2019-09-01 02:58:09 0:15:59 0:07:54 0:08:05 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi041 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252860 2019-08-26 03:08:10 2019-09-01 02:42:16 2019-09-01 03:44:16 1:02:00 0:39:27 0:22:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T03:41:30.725112+0000 mon.a (mon.0) 327 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 4252861 2019-08-26 03:08:11 2019-09-01 02:43:53 2019-09-01 03:01:52 0:17:59 0:09:07 0:08:52 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi114 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252862 2019-08-26 03:08:11 2019-09-01 02:43:58 2019-09-01 05:31:59 2:48:01 2:30:29 0:17:32 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:27:27.255854+0000 mon.b (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252863 2019-08-26 03:08:12 2019-09-01 02:45:15 2019-09-01 03:05:14 0:19:59 0:10:02 0:09:57 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi172 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252864 2019-08-26 03:08:13 2019-09-01 02:45:54 2019-09-01 03:01:53 0:15:59 0:07:01 0:08:58 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

Command failed on smithi018 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252865 2019-08-26 03:08:14 2019-09-01 02:45:57 2019-09-01 03:47:57 1:02:00 0:39:03 0:22:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi169 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252866 2019-08-26 03:08:14 2019-09-01 02:46:43 2019-09-01 03:02:42 0:15:59 0:09:02 0:06:57 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi171 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252867 2019-08-26 03:08:15 2019-09-01 02:48:08 2019-09-01 07:06:12 4:18:04 3:06:11 1:11:53 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T07:00:46.584990+0000 mon.b (mon.0) 374 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252868 2019-08-26 03:08:16 2019-09-01 02:48:09 2019-09-01 03:12:08 0:23:59 0:10:37 0:13:22 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi161 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252869 2019-08-26 03:08:17 2019-09-01 02:48:09 2019-09-01 03:14:08 0:25:59 0:14:32 0:11:27 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252870 2019-08-26 03:08:18 2019-09-01 02:48:09 2019-09-01 03:34:08 0:45:59 0:08:16 0:37:43 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi172 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252871 2019-08-26 03:08:18 2019-09-01 02:48:08 2019-09-01 03:38:08 0:50:00 0:33:10 0:16:50 smithi master centos rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

"2019-09-01T03:33:43.696219+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252872 2019-08-26 03:08:19 2019-09-01 02:48:16 2019-09-01 03:12:16 0:24:00 0:10:04 0:13:56 smithi master centos 7.6 rgw/tempest/{clusters/fixed-1.yaml distro/supported-random-distro$/{centos_7.yaml} frontend/civetweb.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi016 with status 1: 'cd /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-venv/bin/activate && tox -e venv --notest'

fail 4252873 2019-08-26 03:08:20 2019-09-01 02:49:54 2019-09-01 04:03:54 1:14:00 1:03:09 0:10:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi071 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252874 2019-08-26 03:08:21 2019-09-01 02:49:54 2019-09-01 03:23:54 0:34:00 0:14:43 0:19:17 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi072 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252875 2019-08-26 03:08:21 2019-09-01 02:50:02 2019-09-01 05:46:04 2:56:02 1:57:54 0:58:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:41:19.821854+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252876 2019-08-26 03:08:22 2019-09-01 02:50:17 2019-09-01 03:14:16 0:23:59 0:08:03 0:15:56 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi156 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252877 2019-08-26 03:08:23 2019-09-01 02:50:20 2019-09-01 04:26:21 1:36:01 1:03:24 0:32:37 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi182 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252878 2019-08-26 03:08:24 2019-09-01 02:51:26 2019-09-01 03:13:25 0:21:59 0:12:12 0:09:47 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252879 2019-08-26 03:08:25 2019-09-01 02:51:44 2019-09-01 03:17:43 0:25:59 0:12:47 0:13:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi133 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252880 2019-08-26 03:08:25 2019-09-01 02:51:53 2019-09-01 05:11:54 2:20:01 2:04:40 0:15:21 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:07:01.346792+0000 mon.a (mon.0) 310 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252881 2019-08-26 03:08:26 2019-09-01 02:54:09 2019-09-01 03:20:08 0:25:59 0:07:59 0:18:00 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi073 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252882 2019-08-26 03:08:27 2019-09-01 02:56:11 2019-09-01 04:24:11 1:28:00 1:02:49 0:25:11 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi153 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252883 2019-08-26 03:08:27 2019-09-01 02:56:11 2019-09-01 03:20:10 0:23:59 0:09:01 0:14:58 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi172 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252884 2019-08-26 03:08:28 2019-09-01 02:56:11 2019-09-01 05:26:13 2:30:02 1:55:47 0:34:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:22:52.079565+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252885 2019-08-26 03:08:29 2019-09-01 02:56:11 2019-09-01 03:52:11 0:56:00 0:09:51 0:46:09 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi151 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252886 2019-08-26 03:08:30 2019-09-01 02:58:22 2019-09-01 03:40:21 0:41:59 0:13:08 0:28:51 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_7.yaml}} 2
Failure Reason:

Command failed on smithi162 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252887 2019-08-26 03:08:30 2019-09-01 02:58:22 2019-09-01 03:20:21 0:21:59 0:12:42 0:09:17 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi205 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252888 2019-08-26 03:08:31 2019-09-01 02:58:22 2019-09-01 04:34:23 1:36:01 1:03:01 0:33:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi101 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252889 2019-08-26 03:08:32 2019-09-01 02:59:49 2019-09-01 03:19:48 0:19:59 0:09:28 0:10:31 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi025 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252890 2019-08-26 03:08:33 2019-09-01 02:59:49 2019-09-01 05:13:50 2:14:01 2:01:14 0:12:47 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:09:14.833389+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252891 2019-08-26 03:08:34 2019-09-01 03:00:13 2019-09-01 03:42:13 0:42:00 0:08:18 0:33:42 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252892 2019-08-26 03:08:35 2019-09-01 03:00:21 2019-09-01 04:10:21 1:10:00 1:02:34 0:07:26 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252893 2019-08-26 03:08:35 2019-09-01 03:01:14 2019-09-01 03:57:13 0:55:59 0:13:33 0:42:26 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252894 2019-08-26 03:08:36 2019-09-01 03:01:53 2019-09-01 06:41:56 3:40:03 3:16:24 0:23:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T06:37:47.353151+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252895 2019-08-26 03:08:37 2019-09-01 03:01:55 2019-09-01 04:01:55 1:00:00 0:11:42 0:48:18 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi080 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252896 2019-08-26 03:08:38 2019-09-01 03:02:06 2019-09-01 03:56:06 0:54:00 0:07:54 0:46:06 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252897 2019-08-26 03:08:39 2019-09-01 03:02:07 2019-09-01 04:14:07 1:12:00 1:04:01 0:07:59 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T04:10:37.224925+0000 mon.b (mon.0) 298 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252898 2019-08-26 03:08:39 2019-09-01 03:02:32 2019-09-01 03:34:31 0:31:59 0:12:50 0:19:09 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi156 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252899 2019-08-26 03:08:40 2019-09-01 03:02:43 2019-09-01 05:18:44 2:16:01 1:52:35 0:23:26 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:14:01.395515+0000 mon.b (mon.0) 381 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252900 2019-08-26 03:08:41 2019-09-01 03:04:19 2019-09-01 03:28:18 0:23:59 0:07:48 0:16:11 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252901 2019-08-26 03:08:42 2019-09-01 03:04:19 2019-09-01 05:24:20 2:20:01 1:02:41 1:17:20 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi197 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252902 2019-08-26 03:08:42 2019-09-01 03:05:15 2019-09-01 03:35:15 0:30:00 0:17:13 0:12:47 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252903 2019-08-26 03:08:43 2019-09-01 03:06:26 2019-09-01 04:10:26 1:04:00 0:09:07 0:54:53 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi117 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252904 2019-08-26 03:08:44 2019-09-01 03:10:18 2019-09-01 05:18:19 2:08:01 1:59:45 0:08:16 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:13:40.033410+0000 mon.b (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252905 2019-08-26 03:08:45 2019-09-01 03:12:05 2019-09-01 03:42:05 0:30:00 0:09:58 0:20:02 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi135 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252906 2019-08-26 03:08:45 2019-09-01 03:12:05 2019-09-01 03:50:05 0:38:00 0:12:47 0:25:13 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_7.yaml}} 2
Failure Reason:

Command failed on smithi107 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252907 2019-08-26 03:08:46 2019-09-01 03:12:06 2019-09-01 04:24:06 1:12:00 1:04:11 0:07:49 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252908 2019-08-26 03:08:47 2019-09-01 03:12:10 2019-09-01 03:36:09 0:23:59 0:09:36 0:14:23 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi099 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252909 2019-08-26 03:08:47 2019-09-01 03:12:17 2019-09-01 06:00:19 2:48:02 1:58:24 0:49:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:56:36.668642+0000 mon.b (mon.0) 388 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252910 2019-08-26 03:08:48 2019-09-01 03:13:41 2019-09-01 04:51:42 1:38:01 0:08:16 1:29:45 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi171 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252911 2019-08-26 03:08:49 2019-09-01 03:14:09 2019-09-01 04:30:10 1:16:01 1:03:54 0:12:07 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi133 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252912 2019-08-26 03:08:50 2019-09-01 03:14:17 2019-09-01 03:42:16 0:27:59 0:10:54 0:17:05 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi109 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252913 2019-08-26 03:08:50 2019-09-01 03:16:08 2019-09-01 04:30:08 1:14:00 0:14:11 0:59:49 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252914 2019-08-26 03:08:51 2019-09-01 03:17:59 2019-09-01 05:18:00 2:00:01 1:52:05 0:07:56 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:14:32.758884+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252915 2019-08-26 03:08:52 2019-09-01 03:19:58 2019-09-01 03:41:57 0:21:59 0:07:51 0:14:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi083 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252916 2019-08-26 03:08:53 2019-09-01 03:19:58 2019-09-01 04:59:59 1:40:01 1:02:30 0:37:31 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi155 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252917 2019-08-26 03:08:53 2019-09-01 03:20:04 2019-09-01 03:46:03 0:25:59 0:13:51 0:12:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi064 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252918 2019-08-26 03:08:54 2019-09-01 03:20:07 2019-09-01 07:06:10 3:46:03 3:12:23 0:33:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T07:01:45.340329+0000 mon.b (mon.0) 300 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252919 2019-08-26 03:08:55 2019-09-01 03:20:09 2019-09-01 03:52:09 0:32:00 0:15:38 0:16:22 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi190 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252920 2019-08-26 03:08:56 2019-09-01 03:20:12 2019-09-01 04:10:12 0:50:00 0:07:56 0:42:04 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi073 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252921 2019-08-26 03:08:56 2019-08-31 06:25:17 2019-08-31 06:37:16 0:11:59 0:03:07 0:08:52 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

80dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.554484', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: packages.oit.ncsu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.teklinks.com', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-08-31 06:36:44.289748', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi110.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-08-31 06:36:50.310397', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: packages.oit.ncsu.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirrors.seas.harvard.edu\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:06.147324', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: packages.oit.ncsu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirrors.seas.harvard.edu', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/37658d9a6ec5c7629883775e20872600df70b7281bb680dc640531db31bb1a3d-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/f6ac21289c4977ad03c2775a68215530c1e749028d7fc7c765bf091bf5c0e6a9-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-08-31 06:36:44.163073', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')

fail 4252922 2019-08-26 03:08:57 2019-09-01 03:20:22 2019-09-01 03:36:22 0:16:00 0:09:13 0:06:47 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi137 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252923 2019-08-26 03:08:58 2019-09-01 03:21:49 2019-09-01 05:37:50 2:16:01 1:57:57 0:18:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:33:56.485766+0000 mon.b (mon.0) 380 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252924 2019-08-26 03:08:59 2019-09-01 03:22:06 2019-09-01 03:38:05 0:15:59 0:09:59 0:06:00 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

Command failed on smithi038 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252925 2019-08-26 03:08:59 2019-09-01 03:24:11 2019-09-01 03:44:10 0:19:59 0:12:41 0:07:18 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
Failure Reason:

Command failed on smithi184 with status 2: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo'

fail 4252926 2019-08-26 03:09:00 2019-09-01 03:26:06 2019-09-01 04:50:06 1:24:00 1:02:27 0:21:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-01T04:46:52.903160+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252927 2019-08-26 03:09:01 2019-09-01 03:26:06 2019-09-01 04:02:05 0:35:59 0:09:44 0:26:15 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

Command failed on smithi064 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252928 2019-08-26 03:09:02 2019-09-01 03:26:06 2019-09-01 05:48:07 2:22:01 1:53:11 0:28:50 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:44:34.483592+0000 mon.b (mon.0) 294 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252929 2019-08-26 03:09:02 2019-09-01 03:26:06 2019-09-01 03:56:05 0:29:59 0:10:25 0:19:34 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi073 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252930 2019-08-26 03:09:03 2019-09-01 03:26:06 2019-09-01 03:54:05 0:27:59 0:08:05 0:19:54 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

Command failed on smithi162 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252931 2019-08-26 03:09:04 2019-09-01 03:26:14 2019-09-01 04:44:14 1:18:00 1:03:21 0:14:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi172 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252932 2019-08-26 03:09:04 2019-09-01 03:27:28 2019-09-01 04:03:27 0:35:59 0:14:16 0:21:43 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

Command failed on smithi129 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252933 2019-08-26 03:09:05 2019-09-01 03:28:20 2019-09-01 05:42:21 2:14:01 2:02:47 0:11:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:33:02.957870+0000 mon.a (mon.0) 312 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252934 2019-08-26 03:09:06 2019-09-01 03:30:23 2019-09-01 04:24:23 0:54:00 0:07:48 0:46:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
Failure Reason:

Command failed on smithi073 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252935 2019-08-26 03:09:07 2019-09-01 03:32:17 2019-09-01 04:44:17 1:12:00 1:04:52 0:07:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi050 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252936 2019-08-26 03:09:07 2019-09-01 03:34:08 2019-09-01 04:10:08 0:36:00 0:11:49 0:24:11 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi197 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252937 2019-08-26 03:09:08 2019-09-01 03:34:08 2019-09-01 03:54:07 0:19:59 0:12:56 0:07:03 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

Command failed on smithi099 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252938 2019-08-26 03:09:09 2019-09-01 03:34:09 2019-09-01 06:06:11 2:32:02 2:01:58 0:30:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T05:59:25.417343+0000 mon.a (mon.0) 408 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4252939 2019-08-26 03:09:10 2019-09-01 03:34:33 2019-09-01 03:58:32 0:23:59 0:07:49 0:16:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

Command failed on smithi079 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252940 2019-08-26 03:09:10 2019-09-01 03:35:31 2019-09-01 05:29:31 1:54:00 1:02:38 0:51:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi162 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252941 2019-08-26 03:09:11 2019-09-01 03:36:10 2019-09-01 04:26:10 0:50:00 0:08:49 0:41:11 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

Command failed on smithi026 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4252942 2019-08-26 03:09:12 2019-09-01 03:36:23 2019-09-01 07:32:26 3:56:03 2:35:28 1:20:35 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-01T07:25:49.949631+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log