Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4326528 2019-09-22 12:06:19 2019-09-22 12:49:15 2019-09-22 13:17:14 0:27:59 0:18:37 0:09:22 smithi master rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/{barbican.yaml} 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} 1
fail 4326530 2019-09-22 12:06:20 2019-09-22 12:49:34 2019-09-22 13:37:34 0:48:00 0:14:35 0:33:25 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi088 with status 8: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.0/binaries/apache-maven-3.6.0-bin.tar.gz && tar -xvf apache-maven-3.6.0-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2'

pass 4326532 2019-09-22 12:06:21 2019-09-22 12:50:04 2019-09-22 13:14:03 0:23:59 0:10:45 0:13:14 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
fail 4326534 2019-09-22 12:06:22 2019-09-22 12:50:30 2019-09-22 17:18:33 4:28:03 4:10:25 0:17:38 smithi master centos rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite, rgw multisite pubsub, test failures

pass 4326536 2019-09-22 12:06:23 2019-09-22 12:51:57 2019-09-22 13:21:56 0:29:59 0:13:22 0:16:37 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_7.yaml}} 2
fail 4326538 2019-09-22 12:06:24 2019-09-22 12:53:54 2019-09-22 13:15:53 0:21:59 0:11:02 0:10:57 smithi master centos 7.6 rgw/tempest/{clusters/fixed-1.yaml distro/supported-random-distro$/{centos_7.yaml} frontend/beast.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi109 with status 1: 'sudo yum -y install python34-devel'

pass 4326540 2019-09-22 12:06:25 2019-09-22 12:55:51 2019-09-22 13:25:50 0:29:59 0:13:57 0:16:02 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
fail 4326542 2019-09-22 12:06:26 2019-09-22 12:56:29 2019-09-22 14:32:30 1:36:01 1:21:03 0:14:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T14:27:55.245531+0000 mon.b (mon.0) 284 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569162473 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326544 2019-09-22 12:06:27 2019-09-22 12:57:44 2019-09-22 13:31:43 0:33:59 0:18:23 0:15:36 smithi master centos rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml} 2
fail 4326546 2019-09-22 12:06:28 2019-09-22 12:58:16 2019-09-22 13:30:16 0:32:00 0:10:24 0:21:36 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
Failure Reason:

"2019-09-22T13:25:58.801158+0000 mon.b (mon.0) 224 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569158756 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

fail 4326548 2019-09-22 12:06:29 2019-09-22 13:01:27 2019-09-22 15:19:29 2:18:02 1:59:12 0:18:50 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:10:24.655102+0000 mon.b (mon.0) 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569161423 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

pass 4326550 2019-09-22 12:06:30 2019-09-22 13:03:10 2019-09-22 13:25:09 0:21:59 0:09:34 0:12:25 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4326552 2019-09-22 12:06:31 2019-09-22 13:03:30 2019-09-22 14:27:30 1:24:00 1:10:49 0:13:11 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326554 2019-09-22 12:06:32 2019-09-22 13:03:41 2019-09-22 14:11:41 1:08:00 0:15:44 0:52:16 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T14:04:16.734555+0000 mon.b (mon.0) 141 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569161054 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

fail 4326556 2019-09-22 12:06:33 2019-09-22 13:05:04 2019-09-22 15:17:05 2:12:01 1:58:39 0:13:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:09:08.849349+0000 mon.b (mon.0) 295 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569161347 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326558 2019-09-22 12:06:34 2019-09-22 13:05:39 2019-09-22 13:47:38 0:41:59 0:12:40 0:29:19 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4326560 2019-09-22 12:06:35 2019-09-22 13:06:20 2019-09-22 13:30:19 0:23:59 0:08:41 0:15:18 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326562 2019-09-22 12:06:36 2019-09-22 13:06:46 2019-09-22 14:30:46 1:24:00 1:08:27 0:15:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T14:23:52.201258+0000 mon.b (mon.0) 358 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569162230 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326564 2019-09-22 12:06:37 2019-09-22 13:07:09 2019-09-22 13:47:08 0:39:59 0:13:40 0:26:19 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
pass 4326566 2019-09-22 12:06:38 2019-09-22 13:09:34 2019-09-22 15:17:35 2:08:01 1:52:59 0:15:02 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326568 2019-09-22 12:06:39 2019-09-22 13:11:02 2019-09-22 14:07:01 0:55:59 0:08:51 0:47:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
fail 4326570 2019-09-22 12:06:40 2019-09-22 13:11:31 2019-09-22 15:07:32 1:56:01 1:09:54 0:46:07 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T14:14:13.179321+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569161650 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4326572 2019-09-22 12:06:41 2019-09-22 13:12:31 2019-09-22 13:46:30 0:33:59 0:18:42 0:15:17 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
pass 4326574 2019-09-22 12:06:42 2019-09-22 13:14:19 2019-09-22 13:38:18 0:23:59 0:09:18 0:14:41 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
fail 4326576 2019-09-22 12:06:43 2019-09-22 13:15:35 2019-09-22 15:57:37 2:42:02 1:56:24 0:45:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:21:29.542372+0000 mon.b (mon.0) 293 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569162086 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326578 2019-09-22 12:06:44 2019-09-22 13:15:54 2019-09-22 13:43:54 0:28:00 0:10:28 0:17:32 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326580 2019-09-22 12:06:45 2019-09-22 13:17:16 2019-09-22 14:23:15 1:05:59 0:16:19 0:49:40 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_7.yaml}} 2
fail 4326582 2019-09-22 12:06:46 2019-09-22 13:17:48 2019-09-22 14:57:48 1:40:00 1:18:28 0:21:32 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326584 2019-09-22 12:06:47 2019-09-22 13:21:28 2019-09-22 13:45:27 0:23:59 0:09:19 0:14:40 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326586 2019-09-22 12:06:48 2019-09-22 13:22:12 2019-09-22 16:34:14 3:12:02 2:55:50 0:16:12 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T13:53:56.144233+0000 mon.b (mon.0) 373 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569160434 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326588 2019-09-22 12:06:49 2019-09-22 13:24:09 2019-09-22 13:48:08 0:23:59 0:09:19 0:14:40 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
fail 4326590 2019-09-22 12:06:50 2019-09-22 13:25:50 2019-09-22 15:17:51 1:52:01 1:11:53 0:40:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326592 2019-09-22 12:06:51 2019-09-22 13:25:56 2019-09-22 13:51:55 0:25:59 0:11:53 0:14:06 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
pass 4326594 2019-09-22 12:06:52 2019-09-22 13:27:08 2019-09-22 13:55:07 0:27:59 0:15:43 0:12:16 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
pass 4326596 2019-09-22 12:06:53 2019-09-22 13:28:19 2019-09-22 15:54:21 2:26:02 1:49:24 0:36:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326598 2019-09-22 12:06:54 2019-09-22 13:30:17 2019-09-22 14:04:17 0:34:00 0:09:21 0:24:39 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326600 2019-09-22 12:06:55 2019-09-22 13:31:58 2019-09-22 15:07:58 1:36:00 1:15:25 0:20:35 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326602 2019-09-22 12:06:56 2019-09-22 13:35:42 2019-09-22 14:35:42 1:00:00 0:13:40 0:46:20 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
fail 4326604 2019-09-22 12:06:57 2019-09-22 13:35:55 2019-09-22 15:53:56 2:18:01 1:58:07 0:19:54 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:26:22.548625+0000 mon.b (mon.0) 291 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569162380 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326606 2019-09-22 12:06:58 2019-09-22 13:37:50 2019-09-22 14:09:49 0:31:59 0:17:25 0:14:34 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4326608 2019-09-22 12:06:59 2019-09-22 13:39:45 2019-09-22 14:07:44 0:27:59 0:08:23 0:19:36 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
fail 4326610 2019-09-22 12:07:01 2019-09-22 13:43:53 2019-09-22 15:49:54 2:06:01 1:26:33 0:39:28 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326612 2019-09-22 12:07:02 2019-09-22 13:43:55 2019-09-22 14:07:54 0:23:59 0:09:23 0:14:36 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
fail 4326614 2019-09-22 12:07:03 2019-09-22 13:45:42 2019-09-22 16:17:43 2:32:01 2:03:42 0:28:19 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:48:56.957395+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569163736 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326616 2019-09-22 12:07:04 2019-09-22 13:46:25 2019-09-22 14:08:24 0:21:59 0:10:23 0:11:36 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326618 2019-09-22 12:07:05 2019-09-22 13:47:24 2019-09-22 14:39:24 0:52:00 0:16:20 0:35:40 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
fail 4326620 2019-09-22 12:07:06 2019-09-22 13:48:10 2019-09-22 15:20:10 1:32:00 1:14:25 0:17:35 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T14:27:02.665655+0000 mon.a (mon.0) 364 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569162421 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326622 2019-09-22 12:07:07 2019-09-22 13:48:47 2019-09-22 14:08:46 0:19:59 0:09:30 0:10:29 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4326624 2019-09-22 12:07:08 2019-09-22 13:50:04 2019-09-22 16:42:06 2:52:02 1:56:24 0:55:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326626 2019-09-22 12:07:09 2019-09-22 13:50:50 2019-09-22 14:36:50 0:46:00 0:11:12 0:34:48 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
pass 4326628 2019-09-22 12:07:10 2019-09-22 13:52:11 2019-09-22 14:54:10 1:01:59 0:10:16 0:51:43 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
fail 4326630 2019-09-22 12:07:11 2019-09-22 13:55:09 2019-09-22 15:57:10 2:02:01 1:15:47 0:46:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T15:30:40.013012+0000 mon.b (mon.0) 357 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569166238 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

fail 4326632 2019-09-22 12:07:12 2019-09-22 13:56:31 2019-09-22 15:00:31 1:04:00 0:14:49 0:49:11 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T14:52:23.969505+0000 mon.b (mon.0) 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569163941 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

fail 4326634 2019-09-22 12:07:13 2019-09-22 13:58:20 2019-09-22 17:40:23 3:42:03 2:53:25 0:48:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:06:22.824456+0000 mon.a (mon.0) 392 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569164781 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4326636 2019-09-22 12:07:14 2019-09-22 14:02:20 2019-09-22 14:52:20 0:50:00 0:09:22 0:40:38 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326638 2019-09-22 12:07:15 2019-09-22 14:04:18 2019-09-22 15:32:19 1:28:01 1:15:01 0:13:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326640 2019-09-22 12:07:16 2019-09-22 14:07:15 2019-09-22 14:45:15 0:38:00 0:11:48 0:26:12 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4326642 2019-09-22 12:07:17 2019-09-22 14:07:45 2019-09-22 14:35:45 0:28:00 0:13:50 0:14:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
fail 4326644 2019-09-22 12:07:18 2019-09-22 14:08:08 2019-09-22 16:24:09 2:16:01 2:06:03 0:09:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T14:47:09.912104+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569163628 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4326646 2019-09-22 12:07:19 2019-09-22 14:08:48 2019-09-22 15:34:48 1:26:00 0:08:45 1:17:15 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
fail 4326648 2019-09-22 12:07:20 2019-09-22 14:09:57 2019-09-22 15:53:58 1:44:01 1:13:59 0:30:02 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326650 2019-09-22 12:07:21 2019-09-22 14:11:55 2019-09-22 14:33:55 0:22:00 0:09:18 0:12:42 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
pass 4326652 2019-09-22 12:07:22 2019-09-22 14:13:36 2019-09-22 16:35:37 2:22:01 2:06:36 0:15:25 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326654 2019-09-22 12:07:23 2019-09-22 14:14:04 2019-09-22 14:54:04 0:40:00 0:09:51 0:30:09 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326656 2019-09-22 12:07:24 2019-09-22 14:15:43 2019-09-22 14:55:42 0:39:59 0:16:37 0:23:22 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_7.yaml}} 2
pass 4326658 2019-09-22 12:07:25 2019-09-22 14:18:12 2019-09-22 14:56:11 0:37:59 0:12:56 0:25:03 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
fail 4326660 2019-09-22 12:07:26 2019-09-22 14:23:30 2019-09-22 14:51:29 0:27:59 0:03:55 0:24:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi068.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-22 14:50:39.939353', '_ansible_no_log': False, u'stdout': u'Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\nCould not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=stock error was\n14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error"\nCannot find a valid baseurl for repo: base/7/x86_64', u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:15.765021', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u'Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=stock error was', u'14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error"', u'Cannot find a valid baseurl for repo: base/7/x86_64'], u'start': u'2019-09-22 14:50:24.174332', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')

pass 4326662 2019-09-22 12:07:27 2019-09-22 14:27:45 2019-09-22 14:47:44 0:19:59 0:09:30 0:10:29 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326664 2019-09-22 12:07:28 2019-09-22 14:27:51 2019-09-22 16:53:52 2:26:01 1:56:37 0:29:24 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:17:48.607242+0000 mon.b (mon.0) 385 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569165465 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326666 2019-09-22 12:07:29 2019-09-22 14:28:04 2019-09-22 15:10:04 0:42:00 0:09:23 0:32:37 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4326668 2019-09-22 12:07:30 2019-09-22 14:29:59 2019-09-22 16:40:01 2:10:02 1:12:22 0:57:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326670 2019-09-22 12:07:31 2019-09-22 14:30:48 2019-09-22 15:00:47 0:29:59 0:16:56 0:13:03 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T14:51:13.365484+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569163870 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

fail 4326672 2019-09-22 12:07:32 2019-09-22 14:32:32 2019-09-22 16:52:33 2:20:01 1:53:03 0:26:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:48:11.438696+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569167290 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326674 2019-09-22 12:07:33 2019-09-22 14:34:09 2019-09-22 15:02:09 0:28:00 0:13:20 0:14:40 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4326676 2019-09-22 12:07:34 2019-09-22 14:35:23 2019-09-22 15:33:22 0:57:59 0:09:04 0:48:55 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326678 2019-09-22 12:07:35 2019-09-22 14:35:43 2019-09-22 16:27:43 1:52:00 1:11:44 0:40:16 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T15:56:08.063568+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569167766 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

pass 4326680 2019-09-22 12:07:36 2019-09-22 14:35:46 2019-09-22 15:11:46 0:36:00 0:14:41 0:21:19 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
pass 4326682 2019-09-22 12:07:37 2019-09-22 14:37:06 2019-09-22 17:21:07 2:44:01 2:33:02 0:10:59 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
fail 4326684 2019-09-22 12:07:38 2019-09-22 14:39:26 2019-09-22 15:17:25 0:37:59 0:15:18 0:22:41 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/trunk.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi162 with status 8: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.0/binaries/apache-maven-3.6.0-bin.tar.gz && tar -xvf apache-maven-3.6.0-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-ceph-trunk'

pass 4326686 2019-09-22 12:07:39 2019-09-22 14:45:31 2019-09-22 15:07:30 0:21:59 0:09:06 0:12:53 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
fail 4326688 2019-09-22 12:07:40 2019-09-22 14:45:47 2019-09-22 15:49:47 1:04:00 0:46:39 0:17:21 smithi master centos rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite pubsub, test failures

fail 4326690 2019-09-22 12:07:41 2019-09-22 14:47:59 2019-09-22 15:11:58 0:23:59 0:12:59 0:11:00 smithi master centos rgw/tempest/{clusters/fixed-1.yaml distro/valgrind.yaml frontend/civetweb.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi104 with status 1: 'sudo yum -y install python34-devel'

pass 4326692 2019-09-22 12:07:43 2019-09-22 14:48:32 2019-09-22 17:12:33 2:24:01 1:45:29 0:38:32 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326694 2019-09-22 12:07:44 2019-09-22 14:49:31 2019-09-22 15:23:31 0:34:00 0:18:09 0:15:51 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
pass 4326696 2019-09-22 12:07:45 2019-09-22 14:50:17 2019-09-22 15:22:16 0:31:59 0:09:15 0:22:44 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
fail 4326698 2019-09-22 12:07:46 2019-09-22 14:50:46 2019-09-22 16:38:47 1:48:01 1:35:39 0:12:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:21:19.501893+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 1569165677 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

pass 4326700 2019-09-22 12:07:47 2019-09-22 14:52:14 2019-09-22 15:54:14 1:02:00 0:10:00 0:52:00 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326702 2019-09-22 12:07:48 2019-09-22 14:53:39 2019-09-22 15:17:39 0:24:00 0:10:25 0:13:35 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4326704 2019-09-22 12:07:49 2019-09-22 14:53:48 2019-09-22 16:43:48 1:50:00 1:37:50 0:12:10 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326706 2019-09-22 12:07:50 2019-09-22 14:54:12 2019-09-22 15:20:11 0:25:59 0:09:33 0:16:26 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326708 2019-09-22 12:07:51 2019-09-22 14:55:51 2019-09-22 17:49:53 2:54:02 1:33:52 1:20:10 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:32:32.804878+0000 mon.b (mon.0) 280 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569169949 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4326710 2019-09-22 12:07:52 2019-09-22 14:56:12 2019-09-22 15:32:12 0:36:00 0:09:01 0:26:59 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
fail 4326712 2019-09-22 12:07:53 2019-09-22 15:00:11 2019-09-22 16:52:11 1:52:00 1:39:01 0:12:59 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T16:05:54.000023+0000 mon.a (mon.0) 295 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569168352 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326714 2019-09-22 12:07:54 2019-09-22 15:00:48 2019-09-22 15:32:48 0:32:00 0:11:46 0:20:14 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
pass 4326716 2019-09-22 12:07:55 2019-09-22 15:04:05 2019-09-22 16:14:05 1:10:00 0:15:17 0:54:43 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
pass 4326718 2019-09-22 12:07:56 2019-09-22 15:04:05 2019-09-22 17:44:07 2:40:02 1:28:15 1:11:47 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326720 2019-09-22 12:07:57 2019-09-22 15:07:45 2019-09-22 16:13:45 1:06:00 0:08:59 0:57:01 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326722 2019-09-22 12:07:58 2019-09-22 15:08:12 2019-09-22 16:54:13 1:46:01 1:34:21 0:11:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326723 2019-09-22 12:07:59 2019-09-22 15:10:19 2019-09-22 15:38:18 0:27:59 0:13:43 0:14:16 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

"2019-09-22T15:32:21.774338+0000 mon.b (mon.0) 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569166339 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

fail 4326725 2019-09-22 12:08:00 2019-09-22 15:10:33 2019-09-22 17:04:34 1:54:01 1:35:09 0:18:52 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:47:25.799765+0000 mon.a (mon.0) 284 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569167242 sec, daemons [osd,0,osd,5] have slow ops. (SLOW_OPS)" in cluster log

pass 4326727 2019-09-22 12:08:01 2019-09-22 15:12:01 2019-09-22 15:44:00 0:31:59 0:17:02 0:14:57 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4326729 2019-09-22 12:08:02 2019-09-22 15:13:55 2019-09-22 15:37:54 0:23:59 0:09:09 0:14:50 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
pass 4326731 2019-09-22 12:08:03 2019-09-22 15:15:41 2019-09-22 17:07:42 1:52:01 1:40:04 0:11:57 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326733 2019-09-22 12:08:04 2019-09-22 15:17:27 2019-09-22 15:37:26 0:19:59 0:09:07 0:10:52 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
fail 4326735 2019-09-22 12:08:05 2019-09-22 15:17:40 2019-09-22 18:17:42 3:00:02 2:47:28 0:12:34 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T15:47:12.147803+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569167229 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4326737 2019-09-22 12:08:06 2019-09-22 15:18:25 2019-09-22 15:40:24 0:21:59 0:10:04 0:11:55 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326739 2019-09-22 12:08:07 2019-09-22 15:19:43 2019-09-22 15:43:42 0:23:59 0:16:13 0:07:46 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
pass 4326741 2019-09-22 12:08:08 2019-09-22 15:20:12 2019-09-22 17:20:12 2:00:00 1:43:46 0:16:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326743 2019-09-22 12:08:09 2019-09-22 15:20:22 2019-09-22 15:44:21 0:23:59 0:09:42 0:14:17 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4326745 2019-09-22 12:08:10 2019-09-22 15:22:18 2019-09-22 17:38:19 2:16:01 1:26:46 0:49:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326747 2019-09-22 12:08:11 2019-09-22 15:23:46 2019-09-22 15:53:46 0:30:00 0:11:36 0:18:24 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
pass 4326749 2019-09-22 12:08:12 2019-09-22 15:26:02 2019-09-22 15:50:01 0:23:59 0:09:15 0:14:44 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
pass 4326751 2019-09-22 12:08:13 2019-09-22 15:26:25 2019-09-22 17:20:26 1:54:01 1:36:47 0:17:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326753 2019-09-22 12:08:14 2019-09-22 15:27:37 2019-09-22 16:17:37 0:50:00 0:15:26 0:34:34 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T16:09:44.911272+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 1569168581 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

fail 4326755 2019-09-22 12:08:15 2019-09-22 15:32:27 2019-09-22 17:18:28 1:46:01 1:29:42 0:16:19 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:33:11.895171+0000 mon.b (mon.0) 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569169991 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

pass 4326757 2019-09-22 12:08:16 2019-09-22 15:32:27 2019-09-22 15:56:26 0:23:59 0:08:41 0:15:18 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326759 2019-09-22 12:08:18 2019-09-22 15:33:24 2019-09-22 17:31:25 1:58:01 1:42:41 0:15:20 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

saw valgrind issues

pass 4326761 2019-09-22 12:08:19 2019-09-22 15:35:03 2019-09-22 16:01:03 0:26:00 0:12:21 0:13:39 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4326763 2019-09-22 12:08:20 2019-09-22 15:37:41 2019-09-22 16:57:41 1:20:00 0:13:48 1:06:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
fail 4326765 2019-09-22 12:08:21 2019-09-22 15:38:01 2019-09-22 17:28:02 1:50:01 1:32:32 0:17:29 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:11:04.498700+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569168661 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326767 2019-09-22 12:08:22 2019-09-22 15:40:20 2019-09-22 17:00:20 1:20:00 0:08:45 1:11:15 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
pass 4326769 2019-09-22 12:08:23 2019-09-22 15:41:47 2019-09-22 17:31:47 1:50:00 1:36:42 0:13:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326771 2019-09-22 12:08:24 2019-09-22 15:43:57 2019-09-22 16:03:56 0:19:59 0:09:21 0:10:38 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
pass 4326773 2019-09-22 12:08:25 2019-09-22 15:44:01 2019-09-22 18:08:03 2:24:02 1:26:29 0:57:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326775 2019-09-22 12:08:26 2019-09-22 15:46:06 2019-09-22 16:08:05 0:21:59 0:10:11 0:11:48 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326777 2019-09-22 12:08:27 2019-09-22 15:46:18 2019-09-22 16:18:18 0:32:00 0:15:18 0:16:42 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_7.yaml}} 2
pass 4326779 2019-09-22 12:08:28 2019-09-22 15:48:15 2019-09-22 16:12:14 0:23:59 0:12:20 0:11:39 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
pass 4326782 2019-09-22 12:08:29 2019-09-22 15:50:03 2019-09-22 17:50:04 2:00:01 1:37:21 0:22:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326783 2019-09-22 12:08:30 2019-09-22 15:52:30 2019-09-22 16:16:29 0:23:59 0:09:14 0:14:45 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326786 2019-09-22 12:08:31 2019-09-22 15:53:55 2019-09-22 18:53:57 3:00:02 2:35:31 0:24:31 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:43:37.866556+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569170614 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4326788 2019-09-22 12:08:32 2019-09-22 15:53:59 2019-09-22 16:19:58 0:25:59 0:09:08 0:16:51 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4326789 2019-09-22 12:08:33 2019-09-22 15:54:15 2019-09-22 17:56:16 2:02:01 1:34:13 0:27:48 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326791 2019-09-22 12:08:34 2019-09-22 15:54:22 2019-09-22 16:58:22 1:04:00 0:15:42 0:48:18 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T16:49:11.396342+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569170949 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

fail 4326794 2019-09-22 12:08:35 2019-09-22 15:57:11 2019-09-22 18:01:13 2:04:02 1:33:13 0:30:49 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:56:31.491796+0000 mon.a (mon.0) 388 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569171388 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326795 2019-09-22 12:08:36 2019-09-22 15:57:52 2019-09-22 16:23:51 0:25:59 0:12:56 0:13:03 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4326797 2019-09-22 12:08:37 2019-09-22 16:01:48 2019-09-22 16:33:47 0:31:59 0:08:55 0:23:04 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326799 2019-09-22 12:08:38 2019-09-22 16:02:40 2019-09-22 18:00:41 1:58:01 1:40:58 0:17:03 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326801 2019-09-22 12:08:39 2019-09-22 16:04:12 2019-09-22 17:08:12 1:04:00 0:13:40 0:50:20 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
pass 4326803 2019-09-22 12:08:40 2019-09-22 16:06:11 2019-09-22 17:46:12 1:40:01 1:22:30 0:17:31 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
fail 4326805 2019-09-22 12:08:41 2019-09-22 16:06:28 2019-09-22 16:34:27 0:27:59 0:08:57 0:19:02 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
Failure Reason:

"2019-09-22T16:30:57.885830+0000 mon.b (mon.0) 145 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569169857 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

fail 4326807 2019-09-22 12:08:42 2019-09-22 16:08:59 2019-09-22 18:07:00 1:58:01 1:36:48 0:21:13 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T17:28:29.241328+0000 mon.b (mon.0) 352 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569173307 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4326809 2019-09-22 12:08:43 2019-09-22 16:12:29 2019-09-22 16:56:29 0:44:00 0:18:44 0:25:16 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
pass 4326811 2019-09-22 12:08:44 2019-09-22 16:13:46 2019-09-22 16:35:45 0:21:59 0:09:39 0:12:20 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
fail 4326813 2019-09-22 12:08:45 2019-09-22 16:14:06 2019-09-22 18:02:07 1:48:01 1:33:05 0:14:56 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T16:47:24.809132+0000 mon.b (mon.0) 369 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569170844 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326815 2019-09-22 12:08:46 2019-09-22 16:16:01 2019-09-22 16:54:00 0:37:59 0:09:56 0:28:03 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326817 2019-09-22 12:08:47 2019-09-22 16:16:31 2019-09-22 17:02:30 0:45:59 0:13:51 0:32:08 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_7.yaml}} 2
pass 4326819 2019-09-22 12:08:48 2019-09-22 16:17:52 2019-09-22 18:35:54 2:18:02 1:36:43 0:41:19 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326821 2019-09-22 12:08:49 2019-09-22 16:18:19 2019-09-22 16:46:19 0:28:00 0:09:30 0:18:30 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326823 2019-09-22 12:08:50 2019-09-22 16:20:13 2019-09-22 18:28:14 2:08:01 1:30:09 0:37:52 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T17:26:32.261583+0000 mon.a (mon.0) 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569173189 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326825 2019-09-22 12:08:51 2019-09-22 16:24:11 2019-09-22 16:48:10 0:23:59 0:09:11 0:14:48 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
pass 4326827 2019-09-22 12:08:52 2019-09-22 16:27:40 2019-09-22 18:25:41 1:58:01 1:35:47 0:22:14 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326829 2019-09-22 12:08:53 2019-09-22 16:28:14 2019-09-22 17:16:14 0:48:00 0:12:00 0:36:00 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
pass 4326831 2019-09-22 12:08:54 2019-09-22 16:28:55 2019-09-22 17:38:55 1:10:00 0:14:34 0:55:26 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
pass 4326833 2019-09-22 12:08:55 2019-09-22 16:30:51 2019-09-22 19:04:52 2:34:01 2:19:35 0:14:26 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
fail 4326835 2019-09-22 12:08:56 2019-09-22 16:33:48 2019-09-22 16:57:48 0:24:00 0:13:31 0:10:29 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v28.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi003 with status 8: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.0/binaries/apache-maven-3.6.0-bin.tar.gz && tar -xvf apache-maven-3.6.0-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.8.5 rel/release-2.8.5'

pass 4326837 2019-09-22 12:08:57 2019-09-22 16:34:16 2019-09-22 17:02:15 0:27:59 0:09:01 0:18:58 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326839 2019-09-22 12:08:58 2019-09-22 16:35:53 2019-09-22 19:43:55 3:08:02 2:36:38 0:31:24 smithi master centos rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite, rgw multisite pubsub, test failures

fail 4326841 2019-09-22 12:08:59 2019-09-22 16:36:23 2019-09-22 17:12:22 0:35:59 0:11:38 0:24:21 smithi master centos rgw/tempest/{clusters/fixed-1.yaml distro/valgrind.yaml frontend/beast.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi130 with status 1: 'sudo yum -y install python34-devel'

pass 4326843 2019-09-22 12:09:00 2019-09-22 16:39:02 2019-09-22 17:39:02 1:00:00 0:43:38 0:16:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326845 2019-09-22 12:09:01 2019-09-22 16:42:01 2019-09-22 17:26:00 0:43:59 0:22:18 0:21:41 smithi master centos rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml} 2
pass 4326847 2019-09-22 12:09:02 2019-09-22 16:42:10 2019-09-22 17:20:10 0:38:00 0:13:53 0:24:07 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
fail 4326849 2019-09-22 12:09:04 2019-09-22 16:44:04 2019-09-22 19:38:05 2:54:01 2:20:30 0:33:31 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:20:46.576987+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569176444 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326851 2019-09-22 12:09:05 2019-09-22 16:44:37 2019-09-22 17:44:37 1:00:00 0:16:49 0:43:11 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4326853 2019-09-22 12:09:06 2019-09-22 16:47:09 2019-09-22 17:31:08 0:43:59 0:09:05 0:34:54 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
pass 4326855 2019-09-22 12:09:07 2019-09-22 16:48:12 2019-09-22 17:54:12 1:06:00 0:45:21 0:20:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326857 2019-09-22 12:09:08 2019-09-22 16:52:12 2019-09-22 17:16:11 0:23:59 0:09:25 0:14:34 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
fail 4326859 2019-09-22 12:09:09 2019-09-22 16:52:34 2019-09-22 19:28:36 2:36:02 2:26:04 0:09:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T17:43:10.638986+0000 mon.b (mon.0) 287 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569174189 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326861 2019-09-22 12:09:10 2019-09-22 16:54:07 2019-09-22 17:50:07 0:56:00 0:09:56 0:46:04 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326863 2019-09-22 12:09:10 2019-09-22 16:54:14 2019-09-22 17:28:14 0:34:00 0:16:27 0:17:33 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_7.yaml}} 2
pass 4326865 2019-09-22 12:09:12 2019-09-22 16:56:13 2019-09-22 18:00:13 1:04:00 0:47:02 0:16:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326867 2019-09-22 12:09:13 2019-09-22 16:57:56 2019-09-22 17:17:55 0:19:59 0:09:35 0:10:24 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4326869 2019-09-22 12:09:14 2019-09-22 16:57:56 2019-09-22 19:43:58 2:46:02 2:19:01 0:27:01 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326871 2019-09-22 12:09:15 2019-09-22 17:00:21 2019-09-22 17:52:21 0:52:00 0:11:21 0:40:39 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
pass 4326873 2019-09-22 12:09:16 2019-09-22 17:02:32 2019-09-22 17:58:32 0:56:00 0:09:51 0:46:09 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
pass 4326875 2019-09-22 12:09:17 2019-09-22 17:04:36 2019-09-22 17:58:35 0:53:59 0:40:35 0:13:24 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326877 2019-09-22 12:09:18 2019-09-22 17:07:58 2019-09-22 17:33:57 0:25:59 0:15:20 0:10:39 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T17:27:14.411074+0000 mon.b (mon.0) 149 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569173231 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

fail 4326879 2019-09-22 12:09:19 2019-09-22 17:08:30 2019-09-22 20:52:32 3:44:02 3:23:24 0:20:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T17:53:22.156323+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569174799 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

pass 4326881 2019-09-22 12:09:20 2019-09-22 17:12:18 2019-09-22 17:36:17 0:23:59 0:08:46 0:15:13 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326883 2019-09-22 12:09:21 2019-09-22 17:12:34 2019-09-22 18:12:34 1:00:00 0:45:45 0:14:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326885 2019-09-22 12:09:22 2019-09-22 17:12:39 2019-09-22 17:52:39 0:40:00 0:12:40 0:27:20 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4326887 2019-09-22 12:09:23 2019-09-22 17:16:26 2019-09-22 17:42:25 0:25:59 0:14:39 0:11:20 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
fail 4326889 2019-09-22 12:09:24 2019-09-22 17:16:26 2019-09-22 21:22:30 4:06:04 3:36:21 0:29:43 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:04:18.841987+0000 mon.a (mon.0) 295 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569175456 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4326891 2019-09-22 12:09:25 2019-09-22 17:18:10 2019-09-22 17:50:10 0:32:00 0:08:37 0:23:23 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
fail 4326893 2019-09-22 12:09:26 2019-09-22 17:18:35 2019-09-22 18:24:35 1:06:00 0:40:20 0:25:40 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T18:08:43.765196+0000 mon.b (mon.0) 285 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569175721 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

pass 4326895 2019-09-22 12:09:27 2019-09-22 17:20:25 2019-09-22 18:08:25 0:48:00 0:09:17 0:38:43 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
pass 4326897 2019-09-22 12:09:28 2019-09-22 17:21:09 2019-09-22 19:47:10 2:26:01 2:13:53 0:12:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326899 2019-09-22 12:09:29 2019-09-22 17:22:23 2019-09-22 17:56:22 0:33:59 0:10:04 0:23:55 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326901 2019-09-22 12:09:30 2019-09-22 17:26:25 2019-09-22 18:02:24 0:35:59 0:15:43 0:20:16 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_7.yaml}} 2
pass 4326903 2019-09-22 12:09:31 2019-09-22 17:28:18 2019-09-22 18:18:17 0:49:59 0:13:12 0:36:47 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
pass 4326905 2019-09-22 12:09:32 2019-09-22 17:30:17 2019-09-22 18:30:17 1:00:00 0:45:04 0:14:56 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326907 2019-09-22 12:09:33 2019-09-22 17:31:10 2019-09-22 18:03:09 0:31:59 0:09:35 0:22:24 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326910 2019-09-22 12:09:34 2019-09-22 17:31:49 2019-09-22 20:17:51 2:46:02 2:24:15 0:21:47 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:11:19.333357+0000 mon.b (mon.0) 293 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569175877 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326912 2019-09-22 12:09:35 2019-09-22 17:34:12 2019-09-22 18:10:11 0:35:59 0:09:05 0:26:54 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4326914 2019-09-22 12:09:36 2019-09-22 17:36:19 2019-09-22 18:56:19 1:20:00 0:44:16 0:35:44 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326916 2019-09-22 12:09:37 2019-09-22 17:38:21 2019-09-22 18:10:21 0:32:00 0:15:46 0:16:14 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T18:00:30.157425+0000 mon.a (mon.0) 157 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569175229 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

fail 4326918 2019-09-22 12:09:38 2019-09-22 17:39:04 2019-09-22 21:15:06 3:36:02 3:20:47 0:15:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:16:56.340171+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569176214 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326920 2019-09-22 12:09:39 2019-09-22 17:42:40 2019-09-22 18:04:39 0:21:59 0:12:36 0:09:23 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4326922 2019-09-22 12:09:40 2019-09-22 17:44:03 2019-09-22 18:10:02 0:25:59 0:08:42 0:17:17 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326924 2019-09-22 12:09:41 2019-09-22 17:44:08 2019-09-22 18:58:08 1:14:00 0:45:11 0:28:49 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326926 2019-09-22 12:09:42 2019-09-22 17:44:30 2019-09-22 18:10:30 0:26:00 0:14:04 0:11:56 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
pass 4326928 2019-09-22 12:09:44 2019-09-22 17:44:39 2019-09-22 20:26:40 2:42:01 2:15:22 0:26:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326930 2019-09-22 12:09:45 2019-09-22 17:46:27 2019-09-22 18:26:27 0:40:00 0:08:50 0:31:10 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
pass 4326932 2019-09-22 12:09:46 2019-09-22 17:46:28 2019-09-22 18:48:28 1:02:00 0:44:19 0:17:41 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326934 2019-09-22 12:09:47 2019-09-22 17:50:08 2019-09-22 18:52:08 1:02:00 0:19:11 0:42:49 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
pass 4326936 2019-09-22 12:09:48 2019-09-22 17:50:08 2019-09-22 19:06:08 1:16:00 0:09:02 1:06:58 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
fail 4326938 2019-09-22 12:09:49 2019-09-22 17:50:11 2019-09-22 21:18:14 3:28:03 3:11:58 0:16:05 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:29:01.565512+0000 mon.a (mon.0) 380 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569176939 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4326940 2019-09-22 12:09:50 2019-09-22 17:52:37 2019-09-22 18:30:36 0:37:59 0:10:08 0:27:51 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326942 2019-09-22 12:09:51 2019-09-22 17:54:26 2019-09-22 18:30:26 0:36:00 0:14:58 0:21:02 smithi master centos 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_7.yaml}} 2
pass 4326944 2019-09-22 12:09:51 2019-09-22 17:56:31 2019-09-22 19:12:32 1:16:01 0:44:46 0:31:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326946 2019-09-22 12:09:53 2019-09-22 17:58:47 2019-09-22 18:24:47 0:26:00 0:09:39 0:16:21 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4326948 2019-09-22 12:09:54 2019-09-22 18:00:29 2019-09-22 20:46:30 2:46:01 2:21:07 0:24:54 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T18:48:38.229126+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569178116 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4326950 2019-09-22 12:09:54 2019-09-22 18:01:14 2019-09-22 18:25:13 0:23:59 0:09:19 0:14:40 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
pass 4326952 2019-09-22 12:09:55 2019-09-22 18:02:21 2019-09-22 19:12:21 1:10:00 0:47:32 0:22:28 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326954 2019-09-22 12:09:56 2019-09-22 18:03:11 2019-09-22 18:25:10 0:21:59 0:11:27 0:10:32 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
pass 4326956 2019-09-22 12:09:57 2019-09-22 18:04:32 2019-09-22 18:42:32 0:38:00 0:15:39 0:22:21 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
pass 4326958 2019-09-22 12:09:58 2019-09-22 18:04:41 2019-09-22 20:24:42 2:20:01 2:10:10 0:09:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326960 2019-09-22 12:09:59 2019-09-22 18:07:15 2019-09-22 19:01:15 0:54:00 0:08:55 0:45:05 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
fail 4326962 2019-09-22 12:10:00 2019-09-22 18:08:39 2019-09-22 19:04:39 0:56:00 0:43:00 0:13:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T18:58:59.286995+0000 mon.b (mon.0) 287 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569178736 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4326964 2019-09-22 12:10:01 2019-09-22 18:10:10 2019-09-22 18:48:09 0:37:59 0:13:37 0:24:22 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
fail 4326966 2019-09-22 12:10:03 2019-09-22 18:10:13 2019-09-22 21:04:15 2:54:02 2:26:38 0:27:24 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:18:46.784870+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569179924 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4326968 2019-09-22 12:10:04 2019-09-22 18:10:31 2019-09-22 20:20:32 2:10:01 0:16:48 1:53:13 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4326969 2019-09-22 12:10:04 2019-09-22 18:12:33 2019-09-22 18:38:32 0:25:59 0:08:46 0:17:13 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
pass 4326971 2019-09-22 12:10:06 2019-09-22 18:14:09 2019-09-22 19:08:09 0:54:00 0:42:44 0:11:16 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326974 2019-09-22 12:10:07 2019-09-22 18:17:55 2019-09-22 18:45:54 0:27:59 0:09:25 0:18:34 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
fail 4326976 2019-09-22 12:10:08 2019-09-22 18:18:10 2019-09-22 21:02:12 2:44:02 2:21:06 0:22:56 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:20:23.443331+0000 mon.b (mon.0) 300 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569180022 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4326978 2019-09-22 12:10:09 2019-09-22 18:18:32 2019-09-22 18:50:31 0:31:59 0:10:07 0:21:52 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4326980 2019-09-22 12:10:10 2019-09-22 18:24:23 2019-09-22 18:48:22 0:23:59 0:16:03 0:07:56 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
pass 4326982 2019-09-22 12:10:11 2019-09-22 18:24:48 2019-09-22 19:38:48 1:14:00 0:45:12 0:28:48 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326984 2019-09-22 12:10:12 2019-09-22 18:25:11 2019-09-22 19:13:11 0:48:00 0:09:13 0:38:47 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4326986 2019-09-22 12:10:13 2019-09-22 18:25:21 2019-09-22 21:31:23 3:06:02 2:55:47 0:10:15 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
pass 4326987 2019-09-22 12:10:14 2019-09-22 18:25:56 2019-09-22 18:51:55 0:25:59 0:11:34 0:14:25 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
fail 4326988 2019-09-22 12:10:15 2019-09-22 18:26:07 2019-09-22 19:12:06 0:45:59 0:15:50 0:30:09 smithi master centos 7.6 rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml s3a-hadoop.yaml supported-distros/centos_latest.yaml} 2
Failure Reason:

Command failed on smithi044 with status 8: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.0/binaries/apache-maven-3.6.0-bin.tar.gz && tar -xvf apache-maven-3.6.0-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0'

pass 4326989 2019-09-22 12:10:16 2019-09-22 18:26:26 2019-09-22 18:48:25 0:21:59 0:09:13 0:12:46 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
fail 4326990 2019-09-22 12:10:17 2019-09-22 18:26:28 2019-09-22 19:38:28 1:12:00 0:43:09 0:28:51 smithi master centos rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
Failure Reason:

rgw multisite pubsub, test failures

fail 4326991 2019-09-22 12:10:18 2019-09-22 18:28:29 2019-09-22 18:56:29 0:28:00 0:12:47 0:15:13 smithi master centos 7.6 rgw/tempest/{clusters/fixed-1.yaml distro/supported-random-distro$/{centos_7.yaml} frontend/civetweb.yaml tasks/rgw_tempest.yaml} 1
Failure Reason:

Command failed on smithi150 with status 1: 'sudo yum -y install python34-devel'

pass 4326992 2019-09-22 12:10:19 2019-09-22 18:28:40 2019-09-22 19:52:40 1:24:00 1:05:02 0:18:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4326993 2019-09-22 12:10:21 2019-09-22 18:28:54 2019-09-22 19:04:53 0:35:59 0:15:59 0:20:00 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T18:54:32.750094+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569178471 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

fail 4326994 2019-09-22 12:10:22 2019-09-22 18:28:58 2019-09-22 20:34:59 2:06:01 1:53:48 0:12:13 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:13:46.248103+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569179624 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4326995 2019-09-22 12:10:23 2019-09-22 18:30:32 2019-09-22 19:38:32 1:08:00 0:08:47 0:59:13 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
pass 4326996 2019-09-22 12:10:24 2019-09-22 18:30:33 2019-09-22 21:08:34 2:38:01 1:06:23 1:31:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4326997 2019-09-22 12:10:25 2019-09-22 18:30:38 2019-09-22 19:10:37 0:39:59 0:12:00 0:27:59 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4326998 2019-09-22 12:10:26 2019-09-22 18:32:43 2019-09-22 20:14:43 1:42:00 0:13:47 1:28:13 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
fail 4326999 2019-09-22 12:10:27 2019-09-22 18:34:36 2019-09-22 20:50:37 2:16:01 1:53:14 0:22:47 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:34:20.811164+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180858 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4327000 2019-09-22 12:10:28 2019-09-22 18:34:36 2019-09-22 19:02:35 0:27:59 0:08:47 0:19:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
pass 4327001 2019-09-22 12:10:29 2019-09-22 18:36:09 2019-09-22 20:22:09 1:46:00 1:09:31 0:36:29 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327002 2019-09-22 12:10:30 2019-09-22 18:38:29 2019-09-22 19:20:29 0:42:00 0:09:14 0:32:46 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
fail 4327003 2019-09-22 12:10:31 2019-09-22 18:38:33 2019-09-22 22:10:36 3:32:03 1:52:03 1:40:00 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 4327004 2019-09-22 12:10:32 2019-09-22 18:42:33 2019-09-22 19:06:32 0:23:59 0:10:08 0:13:51 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4327005 2019-09-22 12:10:33 2019-09-22 18:42:33 2019-09-22 19:08:32 0:25:59 0:10:39 0:15:20 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
fail 4327006 2019-09-22 12:10:34 2019-09-22 18:42:33 2019-09-22 19:06:33 0:24:00 0:03:11 0:20:49 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
Failure Reason:

t_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'force-confdef,force-confold')

pass 4327007 2019-09-22 12:10:35 2019-09-22 18:42:43 2019-09-22 20:30:44 1:48:01 1:06:03 0:41:58 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327008 2019-09-22 12:10:36 2019-09-22 18:44:23 2019-09-22 19:36:23 0:52:00 0:09:26 0:42:34 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4327009 2019-09-22 12:10:37 2019-09-22 18:46:09 2019-09-22 20:52:10 2:06:01 1:50:28 0:15:33 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:33:27.049631+0000 mon.b (mon.0) 292 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180806 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4327010 2019-09-22 12:10:38 2019-09-22 18:47:33 2019-09-22 19:25:33 0:38:00 0:09:21 0:28:39 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4327011 2019-09-22 12:10:39 2019-09-22 18:48:11 2019-09-22 20:22:11 1:34:00 1:08:47 0:25:13 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
fail 4327012 2019-09-22 12:10:41 2019-09-22 18:48:23 2019-09-22 19:36:23 0:48:00 0:14:38 0:33:22 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T19:27:39.353080+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180457 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

fail 4327013 2019-09-22 12:10:42 2019-09-22 18:48:27 2019-09-22 22:32:29 3:44:02 3:14:00 0:30:02 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:59:11.686222+0000 mon.b (mon.0) 289 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569182350 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4327014 2019-09-22 12:10:43 2019-09-22 18:48:30 2019-09-22 19:14:29 0:25:59 0:12:22 0:13:37 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4327015 2019-09-22 12:10:44 2019-09-22 18:48:33 2019-09-22 19:14:32 0:25:59 0:08:50 0:17:09 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_roundtrip.yaml} 2
pass 4327016 2019-09-22 12:10:45 2019-09-22 18:50:46 2019-09-22 20:16:46 1:26:00 1:08:43 0:17:17 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327017 2019-09-22 12:10:46 2019-09-22 18:52:10 2019-09-22 19:20:09 0:27:59 0:14:07 0:13:52 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
fail 4327018 2019-09-22 12:10:47 2019-09-22 18:52:10 2019-09-22 20:54:11 2:02:01 1:48:53 0:13:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 4327019 2019-09-22 12:10:48 2019-09-22 18:54:12 2019-09-22 19:24:11 0:29:59 0:08:47 0:21:12 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_swift.yaml} 2
fail 4327020 2019-09-22 12:10:49 2019-09-22 18:56:16 2019-09-22 20:14:16 1:18:00 1:05:51 0:12:09 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T19:22:54.369963+0000 mon.b (mon.0) 358 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180173 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4327021 2019-09-22 12:10:50 2019-09-22 18:56:20 2019-09-22 19:28:20 0:32:00 0:18:54 0:13:06 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_readwrite.yaml} 2
pass 4327022 2019-09-22 12:10:51 2019-09-22 18:56:27 2019-09-22 19:26:26 0:29:59 0:09:17 0:20:42 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
fail 4327023 2019-09-22 12:10:52 2019-09-22 18:56:30 2019-09-22 21:04:31 2:08:01 1:53:51 0:14:10 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:25:19.093979+0000 mon.b (mon.0) 287 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180316 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4327024 2019-09-22 12:10:53 2019-09-22 18:58:23 2019-09-22 19:24:23 0:26:00 0:10:02 0:15:58 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4327025 2019-09-22 12:10:54 2019-09-22 19:00:58 2019-09-22 19:24:57 0:23:59 0:10:38 0:13:21 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4327026 2019-09-22 12:10:55 2019-09-22 19:01:29 2019-09-22 20:27:29 1:26:00 1:12:53 0:13:07 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327027 2019-09-22 12:10:56 2019-09-22 19:02:50 2019-09-22 19:30:49 0:27:59 0:09:36 0:18:23 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4327028 2019-09-22 12:10:57 2019-09-22 19:02:50 2019-09-22 21:16:51 2:14:01 1:53:37 0:20:24 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:44:40.619010+0000 mon.b (mon.0) 298 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569181479 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4327029 2019-09-22 12:10:58 2019-09-22 19:02:50 2019-09-22 19:22:49 0:19:59 0:09:26 0:10:33 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
pass 4327030 2019-09-22 12:10:59 2019-09-22 19:04:23 2019-09-22 20:26:23 1:22:00 1:08:52 0:13:08 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327031 2019-09-22 12:11:00 2019-09-22 19:04:40 2019-09-22 19:32:40 0:28:00 0:11:27 0:16:33 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-comp.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_roundtrip.yaml} 2
pass 4327032 2019-09-22 12:11:01 2019-09-22 19:04:47 2019-09-22 19:30:46 0:25:59 0:15:17 0:10:42 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_readwrite.yaml} 2
fail 4327033 2019-09-22 12:11:02 2019-09-22 19:04:53 2019-09-22 21:34:55 2:30:02 1:56:16 0:33:46 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 4327034 2019-09-22 12:11:03 2019-09-22 19:04:55 2019-09-22 19:24:54 0:19:59 0:08:52 0:11:07 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_roundtrip.yaml} 2
fail 4327035 2019-09-22 12:11:04 2019-09-22 19:06:23 2019-09-22 20:28:23 1:22:00 1:09:41 0:12:19 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T20:00:29.832305+0000 mon.b (mon.0) 356 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569182427 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

fail 4327036 2019-09-22 12:11:05 2019-09-22 19:06:33 2019-09-22 19:36:33 0:30:00 0:14:21 0:15:39 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
Failure Reason:

"2019-09-22T19:28:27.020529+0000 mon.b (mon.0) 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180505 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

fail 4327037 2019-09-22 12:11:06 2019-09-22 19:06:33 2019-09-22 22:34:36 3:28:03 3:00:12 0:27:51 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:52:18.611491+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569181937 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4327038 2019-09-22 12:11:08 2019-09-22 19:06:34 2019-09-22 19:54:34 0:48:00 0:16:51 0:31:09 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-low-osd-mem-target.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4327039 2019-09-22 12:11:09 2019-09-22 19:08:23 2019-09-22 19:30:22 0:21:59 0:08:51 0:13:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_swift.yaml} 2
pass 4327040 2019-09-22 12:11:10 2019-09-22 19:08:26 2019-09-22 21:00:27 1:52:01 1:05:43 0:46:18 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327041 2019-09-22 12:11:11 2019-09-22 19:08:34 2019-09-22 19:48:33 0:39:59 0:09:22 0:30:37 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
fail 4327042 2019-09-22 12:11:12 2019-09-22 19:10:52 2019-09-22 21:24:53 2:14:01 1:56:36 0:17:25 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T20:26:22.967104+0000 mon.b (mon.0) 333 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569183981 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4327043 2019-09-22 12:11:13 2019-09-22 19:12:13 2019-09-22 19:44:12 0:31:59 0:10:18 0:21:41 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4327044 2019-09-22 12:11:14 2019-09-22 19:12:13 2019-09-22 19:52:13 0:40:00 0:16:16 0:23:44 smithi master rhel 7.6 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_7.yaml}} 2
pass 4327045 2019-09-22 12:11:15 2019-09-22 19:12:22 2019-09-22 20:38:23 1:26:01 1:06:48 0:19:13 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327046 2019-09-22 12:11:16 2019-09-22 19:12:33 2019-09-22 19:44:32 0:31:59 0:10:02 0:21:57 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
fail 4327047 2019-09-22 12:11:17 2019-09-22 19:13:13 2019-09-22 21:31:14 2:18:01 1:56:22 0:21:39 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 4327048 2019-09-22 12:11:18 2019-09-22 19:14:34 2019-09-22 19:46:33 0:31:59 0:11:10 0:20:49 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-stupid.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_swift.yaml} 2
pass 4327049 2019-09-22 12:11:19 2019-09-22 19:14:34 2019-09-22 19:46:33 0:31:59 0:09:03 0:22:56 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
fail 4327050 2019-09-22 12:11:20 2019-09-22 19:14:34 2019-09-22 20:56:34 1:42:00 1:06:38 0:35:22 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2019-09-22T20:48:55.696855+0000 mon.b (mon.0) 360 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569185334 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

fail 4327051 2019-09-22 12:11:21 2019-09-22 19:16:56 2019-09-22 19:44:55 0:27:59 0:15:18 0:12:41 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_readwrite.yaml} 2
Failure Reason:

"2019-09-22T19:35:39.816958+0000 mon.b (mon.0) 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569180938 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

fail 4327052 2019-09-22 12:11:22 2019-09-22 19:18:37 2019-09-22 21:28:38 2:10:01 1:53:54 0:16:07 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T19:53:25.879900+0000 mon.a (mon.0) 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569182002 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4327053 2019-09-22 12:11:23 2019-09-22 19:20:24 2019-09-22 19:58:24 0:38:00 0:08:45 0:29:15 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-comp.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_roundtrip.yaml} 2
pass 4327054 2019-09-22 12:11:24 2019-09-22 19:20:24 2019-09-22 21:04:25 1:44:01 1:14:08 0:29:53 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327055 2019-09-22 12:11:25 2019-09-22 19:20:27 2019-09-22 20:10:27 0:50:00 0:11:59 0:38:01 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4327056 2019-09-22 12:11:26 2019-09-22 19:20:30 2019-09-22 19:46:29 0:25:59 0:13:46 0:12:13 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
fail 4327057 2019-09-22 12:11:27 2019-09-22 19:23:05 2019-09-22 21:53:06 2:30:01 1:56:58 0:33:03 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

"2019-09-22T20:50:28.665207+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569185427 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4327058 2019-09-22 12:11:28 2019-09-22 19:24:26 2019-09-22 19:48:26 0:24:00 0:08:55 0:15:05 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-stupid.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_swift.yaml} 2
pass 4327059 2019-09-22 12:11:29 2019-09-22 19:24:26 2019-09-22 21:02:27 1:38:01 1:08:57 0:29:04 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml} 2
pass 4327060 2019-09-22 12:11:30 2019-09-22 19:24:55 2019-09-22 19:50:55 0:26:00 0:08:55 0:17:05 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
fail 4327061 2019-09-22 12:11:31 2019-09-22 19:24:59 2019-09-22 22:17:00 2:52:01 2:35:23 0:16:38 smithi master centos rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues