Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 2529091 2018-05-14 02:00:45 2018-05-16 14:47:29 2018-05-16 15:13:29 0:26:00 0:12:07 0:13:53 ovh master rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2529092 2018-05-14 02:00:46 2018-05-16 14:52:20 2018-05-16 16:02:20 1:10:00 1:02:15 0:07:45 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-16 15:10:20.312753 osd.0 158.69.86.178:6800/8806 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.950222 secs" in cluster log

fail 2529093 2018-05-14 02:00:47 2018-05-16 14:52:20 2018-05-16 15:56:20 1:04:00 0:52:51 0:11:09 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-16 15:20:40.566699 osd.4 158.69.86.22:6804/8781 30 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.052915 secs" in cluster log

pass 2529094 2018-05-14 02:00:47 2018-05-16 14:57:37 2018-05-16 15:13:36 0:15:59 0:10:45 0:05:14 ovh master rados/objectstore/alloc-hint.yaml 1
pass 2529095 2018-05-14 02:00:48 2018-05-16 14:58:18 2018-05-16 16:04:19 1:06:01 1:00:45 0:05:16 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/16113.yaml rados.yaml} 1
pass 2529096 2018-05-14 02:00:49 2018-05-16 14:59:39 2018-05-16 15:43:39 0:44:00 0:35:36 0:08:24 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 2529097 2018-05-14 02:00:49 2018-05-16 15:01:00 2018-05-16 15:45:00 0:44:00 0:34:37 0:09:23 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 15:36:31.905396 osd.4 158.69.86.66:6804/26959 171 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.003316 secs" in cluster log

pass 2529098 2018-05-14 02:00:50 2018-05-16 15:03:30 2018-05-16 17:23:32 2:20:02 0:16:36 2:03:26 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2529099 2018-05-14 02:00:51 2018-05-16 15:04:03 2018-05-16 17:22:05 2:18:02 1:16:41 1:01:21 ovh master centos rados/upgrade/{hammer-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{ec-rados-plugin=jerasure-k=3-m=1.yaml rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml test_cache-pool-snaps.yaml}} rados.yaml} 3
Failure Reason:

Command failed on ovh013 with status 1: "SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw'"

pass 2529100 2018-05-14 02:00:51 2018-05-16 15:04:39 2018-05-16 15:28:39 0:24:00 0:14:25 0:09:35 ovh master centos rados/singleton/{all/ec-lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2529101 2018-05-14 02:00:52 2018-05-16 15:04:47 2018-05-16 15:54:47 0:50:00 0:41:17 0:08:43 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 2529102 2018-05-14 02:00:52 2018-05-16 15:05:28 2018-05-16 15:29:28 0:24:00 0:16:22 0:07:38 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2529103 2018-05-14 02:00:53 2018-05-16 15:06:08 2018-05-16 15:50:08 0:44:00 0:27:35 0:16:25 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2529104 2018-05-14 02:00:54 2018-05-16 15:07:02 2018-05-16 15:49:02 0:42:00 0:29:21 0:12:39 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-16 15:32:02.119196 osd.1 158.69.87.138:6804/8927 2 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.694507 secs" in cluster log

fail 2529105 2018-05-14 02:00:54 2018-05-16 15:13:16 2018-05-16 15:27:15 0:13:59 0:09:17 0:04:42 ovh master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on ovh039 with status 100: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=10.2.10-487-ga4b9544-1xenial ceph-mds=10.2.10-487-ga4b9544-1xenial ceph-common=10.2.10-487-ga4b9544-1xenial ceph-fuse=10.2.10-487-ga4b9544-1xenial ceph-test=10.2.10-487-ga4b9544-1xenial radosgw=10.2.10-487-ga4b9544-1xenial python-ceph=10.2.10-487-ga4b9544-1xenial libcephfs1=10.2.10-487-ga4b9544-1xenial libcephfs-java=10.2.10-487-ga4b9544-1xenial libcephfs-jni=10.2.10-487-ga4b9544-1xenial librados2=10.2.10-487-ga4b9544-1xenial librbd1=10.2.10-487-ga4b9544-1xenial rbd-fuse=10.2.10-487-ga4b9544-1xenial'

pass 2529106 2018-05-14 02:00:55 2018-05-16 15:13:16 2018-05-16 15:45:16 0:32:00 0:24:16 0:07:44 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 2529107 2018-05-14 02:00:56 2018-05-16 15:13:30 2018-05-16 16:07:30 0:54:00 0:22:44 0:31:16 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2529108 2018-05-14 02:00:56 2018-05-16 15:13:46 2018-05-16 15:49:46 0:36:00 0:17:17 0:18:43 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
fail 2529109 2018-05-14 02:00:57 2018-05-16 15:15:31 2018-05-16 15:55:31 0:40:00 0:25:25 0:14:35 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

"2018-05-16 15:47:23.687625 osd.5 158.69.87.194:6808/8900 17 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.920996 secs" in cluster log

fail 2529110 2018-05-14 02:00:57 2018-05-16 15:22:41 2018-05-16 16:12:41 0:50:00 0:16:59 0:33:01 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
Failure Reason:

"2018-05-16 16:08:09.212690 osd.1 158.69.87.68:6804/8856 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.026374 secs" in cluster log

fail 2529111 2018-05-14 02:00:58 2018-05-16 15:24:28 2018-05-16 15:58:27 0:33:59 0:24:14 0:09:45 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-05-16 15:46:19.956678 osd.3 158.69.87.210:6800/8661 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.101753 secs" in cluster log

fail 2529112 2018-05-14 02:00:59 2018-05-16 15:27:25 2018-05-16 15:57:25 0:30:00 0:16:39 0:13:21 ovh master centos rados/singleton/{all/lost-unfound-delete-upgrade.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-16 15:54:28.967995 osd.0 158.69.87.216:6800/32031 35 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.511074 secs" in cluster log

fail 2529113 2018-05-14 02:00:59 2018-05-16 15:28:58 2018-05-16 16:14:58 0:46:00 0:37:55 0:08:05 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 16:05:02.875480 osd.3 158.69.87.227:6800/8703 329 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.779900 secs" in cluster log

pass 2529114 2018-05-14 02:01:00 2018-05-16 15:29:29 2018-05-16 15:49:28 0:19:59 0:11:25 0:08:34 ovh master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
pass 2529115 2018-05-14 02:01:00 2018-05-16 15:36:47 2018-05-16 16:14:47 0:38:00 0:29:57 0:08:03 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2529116 2018-05-14 02:01:01 2018-05-16 15:43:58 2018-05-16 16:17:57 0:33:59 0:22:04 0:11:55 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
pass 2529117 2018-05-14 02:01:02 2018-05-16 15:44:33 2018-05-16 16:14:33 0:30:00 0:12:21 0:17:39 ovh master rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
pass 2529118 2018-05-14 02:01:02 2018-05-16 15:45:19 2018-05-16 16:11:19 0:26:00 0:21:43 0:04:17 ovh master rados/objectstore/ceph_objectstore_tool.yaml 1
pass 2529119 2018-05-14 02:01:03 2018-05-16 15:45:19 2018-05-16 16:15:19 0:30:00 0:22:35 0:07:25 ovh master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529120 2018-05-14 02:01:03 2018-05-16 15:45:19 2018-05-16 16:21:19 0:36:00 0:17:50 0:18:10 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2529121 2018-05-14 02:01:04 2018-05-16 15:49:12 2018-05-16 16:31:12 0:42:00 0:31:11 0:10:49 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
fail 2529122 2018-05-14 02:01:05 2018-05-16 15:49:29 2018-05-16 17:35:30 1:46:01 1:38:39 0:07:22 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-16 16:09:38.798520 osd.2 158.69.88.144:6808/8913 5 : cluster [WRN] 29 slow requests, 5 included below; oldest blocked for > 30.811937 secs" in cluster log

fail 2529123 2018-05-14 02:01:05 2018-05-16 15:49:56 2018-05-16 16:45:56 0:56:00 0:46:36 0:09:24 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-16 16:15:50.706830 osd.5 158.69.88.151:6808/8571 32 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.129402 secs" in cluster log

fail 2529124 2018-05-14 02:01:06 2018-05-16 15:50:09 2018-05-16 16:12:09 0:22:00 0:14:45 0:07:15 ovh master centos rados/singleton/{all/lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-16 16:09:03.120377 osd.0 158.69.88.164:6801/726 21 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.326272 secs" in cluster log

pass 2529125 2018-05-14 02:01:06 2018-05-16 15:52:46 2018-05-16 17:10:47 1:18:01 1:07:37 0:10:24 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 2529126 2018-05-14 02:01:07 2018-05-16 15:54:58 2018-05-16 17:08:58 1:14:00 1:04:32 0:09:28 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-16 16:25:37.078792 osd.1 158.69.88.202:6804/8838 68 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.665075 secs" in cluster log

fail 2529127 2018-05-14 02:01:08 2018-05-16 15:55:42 2018-05-16 16:45:42 0:50:00 0:42:05 0:07:55 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 16:16:11.573300 osd.4 158.69.88.198:6804/11514 17 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.015008 secs" in cluster log

fail 2529128 2018-05-14 02:01:08 2018-05-16 15:56:30 2018-05-16 17:12:30 1:16:00 0:57:41 0:18:19 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

pass 2529129 2018-05-14 02:01:09 2018-05-16 15:57:26 2018-05-16 16:23:26 0:26:00 0:21:09 0:04:51 ovh master rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529130 2018-05-14 02:01:10 2018-05-16 15:58:46 2018-05-16 16:12:45 0:13:59 0:09:36 0:04:23 ovh master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 2529131 2018-05-14 02:01:10 2018-05-16 15:58:48 2018-05-16 16:42:48 0:44:00 0:34:03 0:09:57 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 2529132 2018-05-14 02:01:11 2018-05-16 16:02:43 2018-05-16 16:50:42 0:47:59 0:40:17 0:07:42 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 16:35:40.992455 osd.4 158.69.88.251:6812/16552 31 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.774727 secs" in cluster log

pass 2529133 2018-05-14 02:01:11 2018-05-16 16:02:59 2018-05-16 16:50:59 0:48:00 0:39:35 0:08:25 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 2529134 2018-05-14 02:01:12 2018-05-16 16:04:34 2018-05-16 16:46:34 0:42:00 0:24:07 0:17:53 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-small-objects.yaml} 2
fail 2529135 2018-05-14 02:01:13 2018-05-16 16:07:40 2018-05-16 18:05:42 1:58:02 0:16:28 1:41:34 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
Failure Reason:

"2018-05-16 18:02:10.413623 osd.8 158.69.91.80:6808/8894 21 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.763933 secs" in cluster log

pass 2529136 2018-05-14 02:01:13 2018-05-16 16:11:00 2018-05-16 16:55:00 0:44:00 0:35:51 0:08:09 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 2529137 2018-05-14 02:01:14 2018-05-16 16:11:20 2018-05-16 16:49:20 0:38:00 0:28:36 0:09:24 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
pass 2529138 2018-05-14 02:01:14 2018-05-16 16:12:25 2018-05-16 16:34:25 0:22:00 0:17:22 0:04:38 ovh master rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529139 2018-05-14 02:01:15 2018-05-16 16:12:26 2018-05-16 16:26:25 0:13:59 0:10:02 0:03:57 ovh master rados/objectstore/filejournal.yaml 1
fail 2529140 2018-05-14 02:01:16 2018-05-16 16:12:42 2018-05-16 16:50:42 0:38:00 0:30:13 0:07:47 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-16 16:38:55.822470 osd.1 158.69.88.73:6804/8735 67 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.622142 secs" in cluster log

fail 2529141 2018-05-14 02:01:16 2018-05-16 16:12:46 2018-05-16 16:54:46 0:42:00 0:33:03 0:08:57 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-16 16:43:30.522385 osd.4 158.69.88.76:6804/12820 7 : cluster [WRN] 7 slow requests, 5 included below; oldest blocked for > 30.992547 secs" in cluster log

pass 2529142 2018-05-14 02:01:17 2018-05-16 16:14:18 2018-05-16 16:48:18 0:34:00 0:27:35 0:06:25 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
pass 2529143 2018-05-14 02:01:18 2018-05-16 16:14:34 2018-05-16 16:42:34 0:28:00 0:22:47 0:05:13 ovh master rados/singleton/{all/mon-thrasher.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
dead 2529144 2018-05-14 02:01:18 2018-05-16 16:14:48 2018-05-17 04:17:19 12:02:31 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
fail 2529145 2018-05-14 02:01:19 2018-05-16 16:14:59 2018-05-16 17:22:59 1:08:00 0:39:26 0:28:34 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 16:57:10.275208 osd.0 158.69.89.180:6800/8693 83 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 30.393424 secs" in cluster log

pass 2529146 2018-05-14 02:01:19 2018-05-16 16:15:37 2018-05-16 16:33:36 0:17:59 0:11:27 0:06:32 ovh master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
fail 2529147 2018-05-14 02:01:20 2018-05-16 16:18:15 2018-05-16 17:10:16 0:52:01 0:29:25 0:22:36 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --write-fadvise-dontneed --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op write_excl 50 --op delete 10 --pool unique_pool_0'

pass 2529148 2018-05-14 02:01:21 2018-05-16 16:21:29 2018-05-16 16:41:28 0:19:59 0:13:56 0:06:03 ovh master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529149 2018-05-14 02:01:21 2018-05-16 16:23:45 2018-05-16 17:15:45 0:52:00 0:26:37 0:25:23 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 2529150 2018-05-14 02:01:22 2018-05-16 16:26:46 2018-05-16 17:16:46 0:50:00 0:13:36 0:36:24 ovh master rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3
pass 2529151 2018-05-14 02:01:23 2018-05-16 16:31:21 2018-05-16 16:55:21 0:24:00 0:16:01 0:07:59 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2529152 2018-05-14 02:01:23 2018-05-16 16:33:46 2018-05-16 18:13:47 1:40:01 1:24:05 0:15:56 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-16 17:13:44.590256 osd.5 158.69.89.52:6808/9027 26 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.856833 secs" in cluster log

pass 2529153 2018-05-14 02:01:24 2018-05-16 16:34:34 2018-05-16 16:56:33 0:21:59 0:15:24 0:06:35 ovh master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2529154 2018-05-14 02:01:24 2018-05-16 16:41:38 2018-05-16 17:35:38 0:54:00 0:40:58 0:13:02 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-16 17:19:44.236159 osd.2 158.69.90.116:6808/8964 31 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.161954 secs" in cluster log

pass 2529155 2018-05-14 02:01:25 2018-05-16 16:42:54 2018-05-16 17:16:54 0:34:00 0:23:57 0:10:03 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
pass 2529156 2018-05-14 02:01:26 2018-05-16 16:42:54 2018-05-16 17:24:54 0:42:00 0:37:01 0:04:59 ovh master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
fail 2529157 2018-05-14 02:01:26 2018-05-16 16:46:01 2018-05-16 18:08:01 1:22:00 1:12:00 0:10:00 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-16 17:18:50.908532 osd.5 158.69.90.140:6812/9736 114 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.254085 secs" in cluster log

fail 2529158 2018-05-14 02:01:27 2018-05-16 16:46:01 2018-05-16 17:44:01 0:58:00 0:45:31 0:12:29 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 17:15:58.060518 osd.2 158.69.90.150:6812/10503 65 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.950000 secs" in cluster log

pass 2529159 2018-05-14 02:01:28 2018-05-16 16:46:35 2018-05-16 17:50:36 1:04:01 0:16:12 0:47:49 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2529160 2018-05-14 02:01:28 2018-05-16 16:48:36 2018-05-16 17:34:36 0:46:00 0:38:04 0:07:56 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/default.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 17:27:29.948183 osd.0 158.69.90.149:6801/23069 69 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.520654 secs" in cluster log

pass 2529161 2018-05-14 02:01:29 2018-05-16 16:49:21 2018-05-16 17:39:21 0:50:00 0:15:50 0:34:10 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2529162 2018-05-14 02:01:29 2018-05-16 16:51:00 2018-05-16 17:17:00 0:26:00 0:15:46 0:10:14 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
fail 2529163 2018-05-14 02:01:30 2018-05-16 16:51:00 2018-05-16 17:17:00 0:26:00 0:17:26 0:08:34 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

fail 2529164 2018-05-14 02:01:31 2018-05-16 16:51:00 2018-05-16 17:06:59 0:15:59 0:12:20 0:03:39 ovh master rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-05-16 17:03:58.330709 osd.0 158.69.90.161:6800/8848 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.703383 secs" in cluster log

fail 2529165 2018-05-14 02:01:31 2018-05-16 16:53:04 2018-05-16 18:09:05 1:16:01 1:05:50 0:10:11 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-16 17:15:28.204997 osd.5 158.69.90.185:6808/8951 11 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.710778 secs" in cluster log

fail 2529166 2018-05-14 02:01:32 2018-05-16 16:54:56 2018-05-16 17:12:56 0:18:00 0:12:35 0:05:25 ovh master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2018-05-16 17:09:51.254749 osd.1 158.69.90.194:6804/8539 9 : cluster [WRN] 16 slow requests, 5 included below; oldest blocked for > 30.613454 secs" in cluster log

pass 2529167 2018-05-14 02:01:33 2018-05-16 16:55:01 2018-05-16 17:45:01 0:50:00 0:34:34 0:15:26 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 2529168 2018-05-14 02:01:33 2018-05-16 16:55:22 2018-05-16 17:39:22 0:44:00 0:23:53 0:20:07 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 2529169 2018-05-14 02:01:34 2018-05-16 16:56:44 2018-05-16 18:28:45 1:32:01 1:17:08 0:14:53 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 2529170 2018-05-14 02:01:34 2018-05-16 17:04:35 2018-05-16 17:20:34 0:15:59 0:11:51 0:04:08 ovh master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529171 2018-05-14 02:01:35 2018-05-16 17:07:09 2018-05-16 17:41:08 0:33:59 0:24:45 0:09:14 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
fail 2529172 2018-05-14 02:01:36 2018-05-16 17:09:07 2018-05-16 17:47:07 0:38:00 0:30:14 0:07:46 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-16 17:41:28.103289 osd.5 158.69.90.41:6808/8861 167 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.261597 secs" in cluster log

pass 2529173 2018-05-14 02:01:36 2018-05-16 17:10:34 2018-05-16 17:52:34 0:42:00 0:29:53 0:12:07 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 2529174 2018-05-14 02:01:37 2018-05-16 17:10:48 2018-05-16 17:28:47 0:17:59 0:12:24 0:05:35 ovh master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529175 2018-05-14 02:01:38 2018-05-16 17:10:51 2018-05-16 17:42:51 0:32:00 0:22:09 0:09:51 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
pass 2529177 2018-05-14 02:01:38 2018-05-16 17:12:51 2018-05-16 18:00:51 0:48:00 0:34:45 0:13:15 ovh master rados/objectstore/filestore-idempotent.yaml 1
pass 2529179 2018-05-14 02:01:39 2018-05-16 17:12:57 2018-05-16 17:46:57 0:34:00 0:24:31 0:09:29 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 2529181 2018-05-14 02:01:39 2018-05-16 17:15:55 2018-05-16 17:35:55 0:20:00 0:15:24 0:04:36 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-hammer.yaml rados.yaml} 1
fail 2529183 2018-05-14 02:01:40 2018-05-16 17:16:49 2018-05-16 17:58:48 0:41:59 0:34:12 0:07:47 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 17:44:28.514073 osd.0 158.69.91.11:6800/8734 256 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.452811 secs" in cluster log

pass 2529185 2018-05-14 02:01:41 2018-05-16 17:16:55 2018-05-16 17:34:54 0:17:59 0:12:44 0:05:15 ovh master rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529187 2018-05-14 02:01:41 2018-05-16 17:17:09 2018-05-16 17:43:08 0:25:59 0:14:11 0:11:48 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
fail 2529189 2018-05-14 02:01:42 2018-05-16 17:17:09 2018-05-16 18:13:09 0:56:00 0:42:44 0:13:16 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

"2018-05-16 17:50:17.921207 osd.3 158.69.91.135:6800/8656 55 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.240196 secs" in cluster log

pass 2529191 2018-05-14 02:01:43 2018-05-16 17:20:54 2018-05-16 18:40:55 1:20:01 0:17:27 1:02:34 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2529193 2018-05-14 02:01:43 2018-05-16 17:22:23 2018-05-16 18:10:24 0:48:01 0:33:21 0:14:40 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-05-16 17:41:02.499465 osd.1 158.69.91.130:6804/8866 1 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.478639 secs" in cluster log

pass 2529195 2018-05-14 02:01:44 2018-05-16 17:23:01 2018-05-16 17:51:00 0:27:59 0:20:14 0:07:45 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
pass 2529197 2018-05-14 02:01:45 2018-05-16 17:23:40 2018-05-16 18:15:40 0:52:00 0:28:21 0:23:39 ovh master rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 3
fail 2529199 2018-05-14 02:01:45 2018-05-16 17:23:40 2018-05-16 17:47:39 0:23:59 0:17:09 0:06:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

"2018-05-16 17:42:08.314858 osd.0 158.69.91.193:6800/8713 11 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.446327 secs" in cluster log

pass 2529201 2018-05-14 02:01:46 2018-05-16 17:25:04 2018-05-16 17:45:03 0:19:59 0:15:11 0:04:48 ovh master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2529203 2018-05-14 02:01:46 2018-05-16 17:28:58 2018-05-16 18:52:58 1:24:00 1:17:08 0:06:52 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-16 18:06:19.462552 osd.1 158.69.91.233:6804/8893 36 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.538609 secs" in cluster log

fail 2529205 2018-05-14 02:01:47 2018-05-16 17:34:32 2018-05-16 18:16:32 0:42:00 0:33:07 0:08:53 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 17:56:07.974916 osd.1 158.69.91.47:6804/11582 75 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.574865 secs" in cluster log

pass 2529207 2018-05-14 02:01:48 2018-05-16 17:34:38 2018-05-16 18:32:38 0:58:00 0:49:33 0:08:27 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 2529209 2018-05-14 02:01:48 2018-05-16 17:34:56 2018-05-16 18:52:56 1:18:00 1:05:55 0:12:05 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2529211 2018-05-14 02:01:49 2018-05-16 17:35:49 2018-05-16 17:55:49 0:20:00 0:14:00 0:06:00 ovh master rados/singleton/{all/rest-api.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2529213 2018-05-14 02:01:50 2018-05-16 17:35:49 2018-05-16 18:45:50 1:10:01 1:01:45 0:08:16 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-16 17:55:10.525808 osd.3 158.69.91.86:6800/8595 1 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.930891 secs" in cluster log

fail 2529215 2018-05-14 02:01:50 2018-05-16 17:35:56 2018-05-16 18:41:56 1:06:00 0:53:05 0:12:55 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-16 18:01:23.145286 osd.5 158.69.92.107:6808/8924 9 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.390132 secs" in cluster log

pass 2529217 2018-05-14 02:01:51 2018-05-16 17:36:27 2018-05-16 17:56:27 0:20:00 0:15:23 0:04:37 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-infernalis.yaml rados.yaml} 1
pass 2529219 2018-05-14 02:01:51 2018-05-16 17:39:31 2018-05-16 17:53:30 0:13:59 0:09:13 0:04:46 ovh master rados/objectstore/fusestore.yaml 1
pass 2529221 2018-05-14 02:01:52 2018-05-16 17:39:31 2018-05-16 18:31:32 0:52:01 0:34:09 0:17:52 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
fail 2529223 2018-05-14 02:01:53 2018-05-16 17:41:19 2018-05-16 18:39:19 0:58:00 0:50:24 0:07:36 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

"2018-05-16 18:03:40.851722 osd.1 158.69.92.12:6800/8933 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.317795 secs" in cluster log

pass 2529225 2018-05-14 02:01:53 2018-05-16 17:43:01 2018-05-16 18:15:00 0:31:59 0:23:35 0:08:24 ovh master rados/singleton/{all/thrash-rados.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
fail 2529227 2018-05-14 02:01:54 2018-05-16 17:43:10 2018-05-16 18:45:10 1:02:00 0:54:28 0:07:32 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 18:00:14.561779 osd.1 158.69.92.130:6804/8801 13 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.345802 secs" in cluster log

pass 2529229 2018-05-14 02:01:55 2018-05-16 17:44:22 2018-05-16 18:08:21 0:23:59 0:16:08 0:07:51 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/scrub_test.yaml} 2
pass 2529231 2018-05-14 02:01:55 2018-05-16 17:45:03 2018-05-16 18:17:02 0:31:59 0:24:41 0:07:18 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
pass 2529233 2018-05-14 02:01:56 2018-05-16 17:45:04 2018-05-16 18:23:04 0:38:00 0:29:45 0:08:15 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 2529235 2018-05-14 02:01:57 2018-05-16 17:47:07 2018-05-16 18:41:07 0:54:00 0:45:21 0:08:39 ovh master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2529237 2018-05-14 02:01:57 2018-05-16 17:47:08 2018-05-16 18:25:08 0:38:00 0:27:40 0:10:20 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
fail 2529239 2018-05-14 02:01:58 2018-05-16 17:47:40 2018-05-16 18:27:40 0:40:00 0:30:28 0:09:32 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

"2018-05-16 18:11:33.142640 osd.1 158.69.92.171:6804/8892 23 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.400209 secs" in cluster log

pass 2529241 2018-05-14 02:01:59 2018-05-16 17:50:55 2018-05-16 18:48:55 0:58:00 0:17:58 0:40:02 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2529243 2018-05-14 02:02:00 2018-05-16 17:51:01 2018-05-16 18:39:01 0:48:00 0:39:52 0:08:08 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-16 18:11:29.827083 osd.3 158.69.92.183:6808/9851 27 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.603469 secs" in cluster log

pass 2529245 2018-05-14 02:02:00 2018-05-16 17:53:05 2018-05-16 18:25:03 0:31:58 0:23:12 0:08:46 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
fail 2529247 2018-05-14 02:02:01 2018-05-16 17:53:33 2018-05-16 18:15:31 0:21:58 0:15:04 0:06:54 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op rmattr 25 --op delete 50 --pool unique_pool_0'

pass 2529249 2018-05-14 02:02:02 2018-05-16 17:55:59 2018-05-16 18:11:58 0:15:59 0:11:55 0:04:04 ovh master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529251 2018-05-14 02:02:02 2018-05-16 17:56:12 2018-05-16 18:24:11 0:27:59 0:23:41 0:04:18 ovh master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
fail 2529253 2018-05-14 02:02:03 2018-05-16 17:56:28 2018-05-16 18:40:28 0:44:00 0:37:14 0:06:46 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 18:22:59.857225 osd.4 158.69.92.2:6804/9322 197 : cluster [WRN] 13 slow requests, 5 included below; oldest blocked for > 30.550463 secs" in cluster log

pass 2529255 2018-05-14 02:02:04 2018-05-16 17:58:58 2018-05-16 18:40:58 0:42:00 0:33:09 0:08:51 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2529257 2018-05-14 02:02:04 2018-05-16 18:01:04 2018-05-16 18:39:03 0:37:59 0:25:05 0:12:54 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml} 2
pass 2529259 2018-05-14 02:02:05 2018-05-16 18:06:02 2018-05-16 18:30:01 0:23:59 0:12:54 0:11:05 ovh master rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 1
pass 2529261 2018-05-14 02:02:05 2018-05-16 18:08:11 2018-05-16 18:32:11 0:24:00 0:09:14 0:14:46 ovh master rados/objectstore/keyvaluedb.yaml 1
pass 2529263 2018-05-14 02:02:06 2018-05-16 18:08:33 2018-05-16 18:32:33 0:24:00 0:10:30 0:13:30 ovh master rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529265 2018-05-14 02:02:07 2018-05-16 18:09:06 2018-05-16 18:39:06 0:30:00 0:16:50 0:13:10 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2529267 2018-05-14 02:02:07 2018-05-16 18:10:34 2018-05-16 18:56:33 0:45:59 0:36:28 0:09:31 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 18:37:09.038995 osd.2 158.69.93.143:6808/27425 25 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.912569 secs" in cluster log

pass 2529269 2018-05-14 02:02:08 2018-05-16 18:12:18 2018-05-16 18:46:18 0:34:00 0:17:06 0:16:54 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2529271 2018-05-14 02:02:09 2018-05-16 18:13:30 2018-05-16 19:39:31 1:26:01 1:18:38 0:07:23 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-16 18:35:16.816671 osd.5 158.69.93.182:6808/8801 1 : cluster [WRN] 30 slow requests, 5 included below; oldest blocked for > 30.703753 secs" in cluster log

pass 2529273 2018-05-14 02:02:09 2018-05-16 18:13:48 2018-05-16 19:05:48 0:52:00 0:43:33 0:08:27 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 2529275 2018-05-14 02:02:10 2018-05-16 18:15:10 2018-05-16 18:51:10 0:36:00 0:30:17 0:05:43 ovh master rados/singleton/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2529277 2018-05-14 02:02:11 2018-05-16 18:15:33 2018-05-16 18:41:32 0:25:59 0:15:13 0:10:46 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

fail 2529279 2018-05-14 02:02:11 2018-05-16 18:15:42 2018-05-16 19:43:43 1:28:01 1:18:31 0:09:30 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-16 18:37:18.921940 osd.5 158.69.93.228:6808/8858 13 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.519686 secs" in cluster log

pass 2529281 2018-05-14 02:02:12 2018-05-16 18:16:53 2018-05-16 18:50:52 0:33:59 0:19:48 0:14:11 ovh master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
fail 2529283 2018-05-14 02:02:13 2018-05-16 18:17:04 2018-05-16 18:49:03 0:31:59 0:16:53 0:15:06 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

pass 2529285 2018-05-14 02:02:13 2018-05-16 18:19:57 2018-05-16 18:53:57 0:34:00 0:19:07 0:14:53 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
fail 2529287 2018-05-14 02:02:14 2018-05-16 18:23:14 2018-05-16 18:49:13 0:25:59 0:15:18 0:10:41 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-small-objects-fast-read.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op append_excl 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op write_excl 0 --op rmattr 25 --op append 50 --op delete 50 --pool unique_pool_0'

pass 2529289 2018-05-14 02:02:15 2018-05-16 18:24:34 2018-05-16 19:08:33 0:43:59 0:16:03 0:27:56 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2529291 2018-05-14 02:02:15 2018-05-16 18:25:04 2018-05-16 18:45:04 0:20:00 0:14:16 0:05:44 ovh master rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529293 2018-05-14 02:02:16 2018-05-16 18:25:09 2018-05-16 19:15:09 0:50:00 0:29:23 0:20:37 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 2529295 2018-05-14 02:02:17 2018-05-16 18:27:50 2018-05-16 19:31:51 1:04:01 0:53:06 0:10:55 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 18:48:51.796485 osd.1 158.69.93.91:6804/8791 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.673074 secs" in cluster log

pass 2529297 2018-05-14 02:02:17 2018-05-16 18:29:11 2018-05-16 19:01:10 0:31:59 0:13:57 0:18:02 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml} 2
pass 2529299 2018-05-14 02:02:18 2018-05-16 18:30:23 2018-05-16 19:14:22 0:43:59 0:27:59 0:16:00 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
pass 2529301 2018-05-14 02:02:19 2018-05-16 18:31:41 2018-05-16 19:05:41 0:34:00 0:14:31 0:19:29 ovh master rados/singleton/{all/divergent_priors2.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529303 2018-05-14 02:02:19 2018-05-16 18:32:12 2018-05-16 19:04:12 0:32:00 0:21:53 0:10:07 ovh master rados/objectstore/objectcacher-stress.yaml 1
fail 2529305 2018-05-14 02:02:20 2018-05-16 18:32:51 2018-05-16 19:14:51 0:42:00 0:28:44 0:13:16 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-16 19:01:59.036752 osd.1 158.69.94.161:6804/8735 24 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.878562 secs" in cluster log

pass 2529307 2018-05-14 02:02:21 2018-05-16 18:32:51 2018-05-16 19:00:51 0:28:00 0:15:04 0:12:56 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
pass 2529309 2018-05-14 02:02:21 2018-05-16 18:39:16 2018-05-16 19:15:15 0:35:59 0:28:06 0:07:53 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 2529311 2018-05-14 02:02:22 2018-05-16 18:39:16 2018-05-16 19:11:15 0:31:59 0:23:31 0:08:28 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2529313 2018-05-14 02:02:23 2018-05-16 18:39:16 2018-05-16 18:57:15 0:17:59 0:12:10 0:05:49 ovh master rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529315 2018-05-14 02:02:23 2018-05-16 18:39:20 2018-05-16 19:09:20 0:30:00 0:23:19 0:06:41 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
pass 2529317 2018-05-14 02:02:24 2018-05-16 18:40:57 2018-05-16 18:54:56 0:13:59 0:09:43 0:04:16 ovh master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
fail 2529319 2018-05-14 02:02:25 2018-05-16 18:40:57 2018-05-16 19:26:56 0:45:59 0:35:42 0:10:17 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 19:03:47.313154 osd.4 158.69.94.249:6804/8835 23 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.047865 secs" in cluster log

fail 2529321 2018-05-14 02:02:25 2018-05-16 18:41:00 2018-05-16 19:28:59 0:47:59 0:40:55 0:07:04 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-16 19:05:39.126956 osd.2 158.69.94.236:6808/11633 31 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.172643 secs" in cluster log

pass 2529323 2018-05-14 02:02:26 2018-05-16 18:41:09 2018-05-16 19:21:08 0:39:59 0:29:02 0:10:57 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2529325 2018-05-14 02:02:27 2018-05-16 18:41:34 2018-05-16 19:05:34 0:24:00 0:14:31 0:09:29 ovh master centos rados/singleton/{all/ec-lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2529327 2018-05-14 02:02:27 2018-05-16 18:42:18 2018-05-16 19:08:18 0:26:00 0:16:14 0:09:46 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2529329 2018-05-14 02:02:28 2018-05-16 18:45:15 2018-05-16 19:07:14 0:21:59 0:14:01 0:07:58 ovh master rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
fail 2529331 2018-05-14 02:02:29 2018-05-16 18:45:15 2018-05-16 19:09:14 0:23:59 0:15:30 0:08:29 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

"2018-05-16 19:03:57.194260 osd.0 158.69.94.29:6800/8701 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.436041 secs" in cluster log

fail 2529333 2018-05-14 02:02:29 2018-05-16 18:45:51 2018-05-16 19:51:51 1:06:00 0:56:00 0:10:00 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-16 19:26:09.735047 osd.5 158.69.94.93:6812/9725 4 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.853890 secs" in cluster log

pass 2529335 2018-05-14 02:02:30 2018-05-16 18:46:05 2018-05-16 19:50:05 1:04:00 0:48:24 0:15:36 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
fail 2529337 2018-05-14 02:02:31 2018-05-16 18:46:40 2018-05-16 19:10:38 0:23:58 0:15:53 0:08:05 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op append_excl 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op write_excl 0 --op rmattr 25 --op append 50 --op delete 50 --pool unique_pool_0'

fail 2529339 2018-05-14 02:02:31 2018-05-16 18:49:15 2018-05-16 19:21:15 0:32:00 0:17:22 0:14:38 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
Failure Reason:

"2018-05-16 19:16:58.872687 osd.8 158.69.95.131:6808/8853 27 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.084888 secs" in cluster log

pass 2529341 2018-05-14 02:02:32 2018-05-16 18:49:15 2018-05-16 19:23:15 0:34:00 0:27:49 0:06:11 ovh master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529343 2018-05-14 02:02:33 2018-05-16 18:49:15 2018-05-16 19:37:15 0:48:00 0:39:49 0:08:11 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
fail 2529345 2018-05-14 02:02:33 2018-05-16 18:51:11 2018-05-16 19:05:10 0:13:59 0:09:58 0:04:01 ovh master rados/objectstore/objectstore.yaml 1
Failure Reason:

Command failed on ovh061 with status 139: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/ostest && cd $TESTDIR/ostest && ceph_test_objectstore --gtest_filter=-*/2:-*/3'"

fail 2529347 2018-05-14 02:02:34 2018-05-16 18:51:11 2018-05-16 20:01:12 1:10:01 1:01:02 0:08:59 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-16 19:12:42.198983 osd.5 158.69.95.122:6808/8819 23 : cluster [WRN] 12 slow requests, 5 included below; oldest blocked for > 30.843285 secs" in cluster log

fail 2529349 2018-05-14 02:02:35 2018-05-16 18:53:16 2018-05-16 20:07:16 1:14:00 1:06:29 0:07:31 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-16 19:14:44.840084 osd.5 158.69.95.143:6808/8906 3 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.100872 secs" in cluster log

pass 2529351 2018-05-14 02:02:35 2018-05-16 18:53:16 2018-05-16 19:13:15 0:19:59 0:16:03 0:03:56 ovh master rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
fail 2529353 2018-05-14 02:02:36 2018-05-16 18:53:58 2018-05-16 19:19:57 0:25:59 0:16:40 0:09:19 ovh master centos rados/singleton/{all/lost-unfound-delete-upgrade.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-16 19:14:53.372147 osd.0 158.69.95.13:6800/750 21 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.673124 secs" in cluster log

fail 2529355 2018-05-14 02:02:37 2018-05-16 18:55:14 2018-05-16 19:57:14 1:02:00 0:54:54 0:07:06 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-16 19:15:21.410364 osd.0 158.69.95.201:6800/8689 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.129791 secs" in cluster log

pass 2529357 2018-05-14 02:02:37 2018-05-16 18:56:51 2018-05-16 19:44:51 0:48:00 0:38:32 0:09:28 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 2529359 2018-05-14 02:02:38 2018-05-16 18:57:16 2018-05-16 20:03:16 1:06:00 0:49:10 0:16:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-16 19:24:34.514615 osd.3 158.69.95.237:6800/8710 71 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.207669 secs" in cluster log

pass 2529361 2018-05-14 02:02:39 2018-05-16 19:01:01 2018-05-16 19:43:01 0:42:00 0:23:22 0:18:38 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
pass 2529363 2018-05-14 02:02:39 2018-05-16 19:01:11 2018-05-16 19:27:11 0:26:00 0:22:01 0:03:59 ovh master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2529365 2018-05-14 02:02:40 2018-05-16 19:04:30 2018-05-16 19:42:30 0:38:00 0:28:58 0:09:02 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2529367 2018-05-14 02:02:41 2018-05-16 19:05:11 2018-05-16 19:41:11 0:36:00 0:28:53 0:07:07 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-16 19:23:15.580854 osd.1 158.69.95.249:6804/9000 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.642821 secs" in cluster log

fail 2529369 2018-05-14 02:02:41 2018-05-16 19:05:54 2018-05-16 19:47:54 0:42:00 0:33:55 0:08:05 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-16 19:34:34.981519 osd.4 158.69.95.251:6801/10948 51 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.654750 secs" in cluster log

fail 2529371 2018-05-14 02:02:42 2018-05-16 19:05:54 2018-05-16 19:29:54 0:24:00 0:15:57 0:08:03 ovh master centos rados/singleton/{all/lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-16 19:25:29.942796 osd.0 158.69.95.30:6800/32642 23 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.107194 secs" in cluster log