Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 2578981 2018-05-24 02:00:50 2018-05-28 14:10:58 2018-05-28 14:46:58 0:36:00 0:16:06 0:19:54 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2578982 2018-05-24 02:00:51 2018-05-28 14:12:27 2018-05-28 16:42:29 2:30:02 2:21:42 0:08:20 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 2578983 2018-05-24 02:00:52 2018-05-28 14:12:27 2018-05-28 14:32:26 0:19:59 0:14:43 0:05:16 ovh master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2578984 2018-05-24 02:00:52 2018-05-28 14:15:05 2018-05-28 15:29:05 1:14:00 0:56:47 0:17:13 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-28 14:43:44.613264 osd.2 158.69.71.220:6808/8924 3 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.805335 secs" in cluster log

pass 2578985 2018-05-24 02:00:53 2018-05-28 14:15:05 2018-05-28 14:35:04 0:19:59 0:11:14 0:08:45 ovh master rados/objectstore/alloc-hint.yaml 1
pass 2578986 2018-05-24 02:00:54 2018-05-28 14:16:34 2018-05-28 15:32:34 1:16:00 1:08:40 0:07:20 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/16113.yaml rados.yaml} 1
pass 2578987 2018-05-24 02:00:55 2018-05-28 14:20:46 2018-05-28 15:38:47 1:18:01 1:06:52 0:11:09 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
fail 2578988 2018-05-24 02:00:55 2018-05-28 14:24:52 2018-05-28 14:58:51 0:33:59 0:24:48 0:09:11 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2578989 2018-05-24 02:00:56 2018-05-28 14:24:53 2018-05-28 15:02:52 0:37:59 0:16:21 0:21:38 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2578990 2018-05-24 02:00:57 2018-05-28 14:25:44 2018-05-28 16:31:45 2:06:01 1:51:50 0:14:11 ovh master centos rados/upgrade/{hammer-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{ec-rados-plugin=jerasure-k=3-m=1.yaml rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml test_cache-pool-snaps.yaml}} rados.yaml} 3
Failure Reason:

"2018-05-28 15:25:55.604505 osd.4 158.69.71.25:6804/8573 1022 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.979835 secs" in cluster log

fail 2578991 2018-05-24 02:00:57 2018-05-28 14:26:21 2018-05-28 15:44:22 1:18:01 1:09:38 0:08:23 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-28 14:45:51.274188 osd.1 158.69.71.244:6804/8772 7 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 30.773964 secs" in cluster log

fail 2578992 2018-05-24 02:00:58 2018-05-28 14:26:30 2018-05-28 14:44:29 0:17:59 0:14:00 0:03:59 ovh master rados/singleton/{all/osd-recovery.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-05-28 14:41:04.506144 osd.1 158.69.71.240:6810/9445 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.747187 secs" in cluster log

fail 2578993 2018-05-24 02:00:59 2018-05-28 14:29:10 2018-05-28 15:37:11 1:08:01 1:00:24 0:07:37 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 14:50:40.338350 osd.5 158.69.71.249:6808/8822 18 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.036532 secs" in cluster log

pass 2578994 2018-05-24 02:00:59 2018-05-28 14:30:49 2018-05-28 15:10:49 0:40:00 0:29:49 0:10:11 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
fail 2578995 2018-05-24 02:01:00 2018-05-28 14:30:49 2018-05-28 15:38:49 1:08:00 0:49:15 0:18:45 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 15:12:27.310543 osd.3 158.69.71.71:6804/9187 119 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.988689 secs" in cluster log

pass 2578996 2018-05-24 02:01:01 2018-05-28 14:30:49 2018-05-28 15:52:50 1:22:01 1:12:53 0:09:08 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 2578997 2018-05-24 02:01:02 2018-05-28 14:32:08 2018-05-28 14:52:08 0:20:00 0:13:11 0:06:49 ovh master rados/singleton/{all/peer.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2578998 2018-05-24 02:01:02 2018-05-28 14:32:27 2018-05-28 15:14:27 0:42:00 0:25:19 0:16:41 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
pass 2578999 2018-05-24 02:01:03 2018-05-28 14:32:45 2018-05-28 15:06:45 0:34:00 0:17:43 0:16:17 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/rados_mon_workunits.yaml} 2
pass 2579000 2018-05-24 02:01:04 2018-05-28 14:34:45 2018-05-28 15:14:45 0:40:00 0:23:54 0:16:06 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2579001 2018-05-24 02:01:04 2018-05-28 14:35:06 2018-05-28 15:15:05 0:39:59 0:16:47 0:23:12 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2579002 2018-05-24 02:01:05 2018-05-28 14:42:34 2018-05-28 15:28:34 0:46:00 0:28:35 0:17:25 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-28 15:14:16.056580 osd.2 158.69.71.74:6804/14201 39 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.278983 secs" in cluster log

fail 2579003 2018-05-24 02:01:06 2018-05-28 14:44:21 2018-05-28 15:28:20 0:43:59 0:34:39 0:09:20 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-28 15:13:41.711575 osd.2 158.69.71.85:6808/8904 81 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.003006 secs" in cluster log

pass 2579004 2018-05-24 02:01:07 2018-05-28 14:44:21 2018-05-28 15:04:20 0:19:59 0:13:14 0:06:45 ovh master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579005 2018-05-24 02:01:07 2018-05-28 14:44:21 2018-05-28 15:02:20 0:17:59 0:11:10 0:06:49 ovh master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
pass 2579006 2018-05-24 02:01:08 2018-05-28 14:44:31 2018-05-28 15:18:30 0:33:59 0:22:37 0:11:22 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2579007 2018-05-24 02:01:09 2018-05-28 14:47:08 2018-05-28 15:17:08 0:30:00 0:24:15 0:05:45 ovh master rados/objectstore/ceph_objectstore_tool.yaml 1
fail 2579008 2018-05-24 02:01:10 2018-05-28 14:48:51 2018-05-28 15:24:50 0:35:59 0:24:16 0:11:43 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-05-28 15:10:05.864943 osd.1 158.69.72.127:6804/8853 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.246642 secs" in cluster log

pass 2579009 2018-05-24 02:01:11 2018-05-28 14:52:29 2018-05-28 15:20:29 0:28:00 0:15:49 0:12:11 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 2579010 2018-05-24 02:01:11 2018-05-28 14:59:01 2018-05-28 15:43:01 0:44:00 0:34:43 0:09:17 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 15:19:59.999374 osd.1 158.69.72.208:6804/8869 37 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.300516 secs" in cluster log

pass 2579011 2018-05-24 02:01:12 2018-05-28 15:02:31 2018-05-28 15:22:29 0:19:58 0:15:09 0:04:49 ovh master rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579012 2018-05-24 02:01:13 2018-05-28 15:02:53 2018-05-28 15:38:53 0:36:00 0:28:29 0:07:31 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-05-28 15:28:52.619529 osd.4 158.69.72.22:6804/8776 53 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.060379 secs" in cluster log

pass 2579013 2018-05-24 02:01:13 2018-05-28 15:04:58 2018-05-28 15:34:56 0:29:58 0:20:44 0:09:14 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
pass 2579014 2018-05-24 02:01:14 2018-05-28 15:06:59 2018-05-28 15:26:55 0:19:56 0:15:23 0:04:33 ovh master rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 1
pass 2579015 2018-05-24 02:01:15 2018-05-28 15:11:00 2018-05-28 15:34:59 0:23:59 0:16:09 0:07:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2579016 2018-05-24 02:01:16 2018-05-28 15:14:38 2018-05-28 15:32:37 0:17:59 0:13:07 0:04:52 ovh master rados/singleton/{all/reg11184.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579017 2018-05-24 02:01:16 2018-05-28 15:14:46 2018-05-28 16:50:47 1:36:01 1:27:28 0:08:33 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-28 15:42:14.851363 osd.0 158.69.72.82:6800/14726 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.895602 secs" in cluster log

fail 2579018 2018-05-24 02:01:17 2018-05-28 15:15:06 2018-05-28 16:07:07 0:52:01 0:40:30 0:11:31 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-28 15:42:11.474007 osd.5 158.69.73.114:6808/27027 35 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.105063 secs" in cluster log

fail 2579019 2018-05-24 02:01:18 2018-05-28 15:17:19 2018-05-28 16:09:19 0:52:00 0:42:15 0:09:45 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-28 15:41:32.353085 osd.3 158.69.73.115:6800/8793 9 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.394794 secs" in cluster log

pass 2579020 2018-05-24 02:01:18 2018-05-28 15:18:53 2018-05-28 15:34:52 0:15:59 0:10:31 0:05:28 ovh master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
fail 2579021 2018-05-24 02:01:19 2018-05-28 15:20:41 2018-05-28 16:36:41 1:16:00 1:03:46 0:12:14 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-28 16:10:22.192625 osd.1 158.69.73.137:6812/16278 208 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.406313 secs" in cluster log

pass 2579022 2018-05-24 02:01:20 2018-05-28 15:22:40 2018-05-28 15:40:40 0:18:00 0:13:14 0:04:46 ovh master rados/singleton/{all/rest-api.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579023 2018-05-24 02:01:20 2018-05-28 15:25:01 2018-05-28 16:51:02 1:26:01 1:15:11 0:10:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-28 15:48:29.386185 osd.3 158.69.73.140:6800/8755 7 : cluster [WRN] 12 slow requests, 5 included below; oldest blocked for > 30.666689 secs" in cluster log

pass 2579024 2018-05-24 02:01:21 2018-05-28 15:27:06 2018-05-28 16:17:06 0:50:00 0:34:54 0:15:06 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 2579025 2018-05-24 02:01:22 2018-05-28 15:28:38 2018-05-28 16:02:38 0:34:00 0:24:47 0:09:13 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-small-objects.yaml} 2
fail 2579026 2018-05-24 02:01:23 2018-05-28 15:28:38 2018-05-28 16:38:39 1:10:01 0:15:34 0:54:27 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
Failure Reason:

"2018-05-28 16:34:41.427633 osd.4 158.69.73.80:6804/8790 21 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.131013 secs" in cluster log

fail 2579027 2018-05-24 02:01:23 2018-05-28 15:29:06 2018-05-28 16:35:07 1:06:01 0:54:54 0:11:07 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 15:52:41.081768 osd.3 158.69.73.156:6800/8767 1 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.784854 secs" in cluster log

pass 2579028 2018-05-24 02:01:24 2018-05-28 15:32:45 2018-05-28 15:50:44 0:17:59 0:11:35 0:06:24 ovh master rados/objectstore/filejournal.yaml 1
fail 2579029 2018-05-24 02:01:25 2018-05-28 15:32:45 2018-05-28 16:12:45 0:40:00 0:30:37 0:09:23 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
Failure Reason:

"2018-05-28 16:00:01.952260 osd.1 158.69.73.164:6804/8851 32 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.616685 secs" in cluster log

fail 2579030 2018-05-24 02:01:25 2018-05-28 15:35:13 2018-05-28 16:07:12 0:31:59 0:24:45 0:07:14 ovh master rados/singleton/{all/thrash-rados.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-28 16:00:32.467533 osd.0 158.69.73.165:6800/8721 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.682343 secs" in cluster log

fail 2579031 2018-05-24 02:01:26 2018-05-28 15:35:13 2018-05-28 16:37:13 1:02:00 0:50:57 0:11:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 16:06:12.089992 osd.1 158.69.73.180:6804/8880 243 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.896849 secs" in cluster log

pass 2579032 2018-05-24 02:01:27 2018-05-28 15:35:13 2018-05-28 16:03:12 0:27:59 0:17:55 0:10:04 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/scrub_test.yaml} 2
pass 2579033 2018-05-24 02:01:28 2018-05-28 15:37:45 2018-05-28 16:11:45 0:34:00 0:26:07 0:07:53 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2579034 2018-05-24 02:01:28 2018-05-28 15:39:14 2018-05-28 16:17:13 0:37:59 0:30:37 0:07:22 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-28 16:04:09.604249 osd.0 158.69.73.182:6800/8853 31 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.102686 secs" in cluster log

pass 2579035 2018-05-24 02:01:29 2018-05-28 15:39:14 2018-05-28 17:13:15 1:34:01 1:21:03 0:12:58 ovh master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
fail 2579036 2018-05-24 02:01:30 2018-05-28 15:39:14 2018-05-28 16:21:14 0:42:00 0:31:19 0:10:41 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-28 16:02:10.964218 osd.0 158.69.73.195:6800/8706 53 : cluster [WRN] 9 slow requests, 5 included below; oldest blocked for > 30.827483 secs" in cluster log

pass 2579037 2018-05-24 02:01:30 2018-05-28 15:41:03 2018-05-28 15:57:02 0:15:59 0:11:06 0:04:53 ovh master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
pass 2579038 2018-05-24 02:01:31 2018-05-28 15:43:29 2018-05-28 16:31:28 0:47:59 0:22:47 0:25:12 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
fail 2579039 2018-05-24 02:01:32 2018-05-28 15:44:45 2018-05-28 16:24:44 0:39:59 0:24:54 0:15:05 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-05-28 16:11:59.863551 osd.1 158.69.73.24:6804/8796 1 : cluster [WRN] 7 slow requests, 5 included below; oldest blocked for > 30.949932 secs" in cluster log

pass 2579040 2018-05-24 02:01:33 2018-05-28 15:51:03 2018-05-28 16:09:03 0:18:00 0:11:53 0:06:07 ovh master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579041 2018-05-24 02:01:33 2018-05-28 15:53:11 2018-05-28 16:55:11 1:02:00 0:41:43 0:20:17 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 16:32:16.258752 osd.2 158.69.73.7:6808/8980 146 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.954046 secs" in cluster log

fail 2579042 2018-05-24 02:01:34 2018-05-28 15:57:27 2018-05-28 16:39:26 0:41:59 0:30:05 0:11:54 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-05-28 16:19:49.426369 osd.4 158.69.73.64:6804/8815 3 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.585056 secs" in cluster log

pass 2579043 2018-05-24 02:01:35 2018-05-28 16:02:57 2018-05-28 16:36:57 0:34:00 0:23:59 0:10:01 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml} 2
pass 2579044 2018-05-24 02:01:35 2018-05-28 16:03:14 2018-05-28 16:41:13 0:37:59 0:26:28 0:11:31 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/pool-create-delete.yaml} 2
pass 2579045 2018-05-24 02:01:36 2018-05-28 16:07:29 2018-05-28 16:29:28 0:21:59 0:11:44 0:10:15 ovh master rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
pass 2579046 2018-05-24 02:01:37 2018-05-28 16:07:29 2018-05-28 16:47:28 0:39:59 0:36:15 0:03:44 ovh master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 2579047 2018-05-24 02:01:38 2018-05-28 16:07:51 2018-05-28 16:23:51 0:16:00 0:10:26 0:05:34 ovh master rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579048 2018-05-24 02:01:38 2018-05-28 16:09:23 2018-05-28 16:37:23 0:28:00 0:16:29 0:11:31 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

"2018-05-28 16:31:17.455239 osd.0 158.69.73.97:6800/8831 9 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.784857 secs" in cluster log

fail 2579049 2018-05-24 02:01:39 2018-05-28 16:09:23 2018-05-28 16:57:23 0:48:00 0:38:54 0:09:06 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-28 16:45:48.070772 osd.0 158.69.73.10:6800/8733 59 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.894602 secs" in cluster log

fail 2579050 2018-05-24 02:01:40 2018-05-28 16:12:04 2018-05-28 17:08:04 0:56:00 0:16:25 0:39:35 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

fail 2579051 2018-05-24 02:01:40 2018-05-28 16:12:46 2018-05-28 17:16:46 1:04:00 0:41:14 0:22:46 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/default.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-28 16:56:04.926809 osd.4 158.69.74.129:6809/16708 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.888855 secs" in cluster log

pass 2579052 2018-05-24 02:01:41 2018-05-28 16:17:29 2018-05-28 17:03:29 0:46:00 0:16:37 0:29:23 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2579053 2018-05-24 02:01:42 2018-05-28 16:17:29 2018-05-28 16:51:29 0:34:00 0:26:41 0:07:19 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
fail 2579054 2018-05-24 02:01:43 2018-05-28 16:21:33 2018-05-28 17:41:34 1:20:01 1:12:07 0:07:54 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-28 17:08:46.100653 osd.5 158.69.74.132:6808/8901 17 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.100296 secs" in cluster log

pass 2579055 2018-05-24 02:01:43 2018-05-28 16:24:11 2018-05-28 17:26:11 1:02:00 0:54:15 0:07:45 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
fail 2579056 2018-05-24 02:01:44 2018-05-28 16:24:45 2018-05-28 16:40:45 0:16:00 0:11:24 0:04:36 ovh master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2018-05-28 16:38:04.514908 osd.1 158.69.74.150:6804/8710 9 : cluster [WRN] 16 slow requests, 5 included below; oldest blocked for > 30.965591 secs" in cluster log

pass 2579057 2018-05-24 02:01:45 2018-05-28 16:29:01 2018-05-28 17:13:00 0:43:59 0:37:17 0:06:42 ovh master rados/singleton/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579058 2018-05-24 02:01:45 2018-05-28 16:29:30 2018-05-28 17:31:30 1:02:00 0:51:57 0:10:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-28 16:53:59.839337 osd.5 158.69.74.31:6808/8904 32 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.939490 secs" in cluster log

fail 2579059 2018-05-24 02:01:46 2018-05-28 16:31:51 2018-05-28 18:07:51 1:36:00 1:25:19 0:10:41 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-28 16:51:57.589626 osd.5 158.69.74.45:6808/8819 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.089473 secs" in cluster log

fail 2579060 2018-05-24 02:01:47 2018-05-28 16:31:51 2018-05-28 17:41:51 1:10:00 0:58:36 0:11:24 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 17:03:09.895456 osd.1 158.69.74.41:6804/8878 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.579792 secs" in cluster log

pass 2579061 2018-05-24 02:01:47 2018-05-28 16:35:28 2018-05-28 16:53:27 0:17:59 0:13:24 0:04:35 ovh master rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579062 2018-05-24 02:01:48 2018-05-28 16:37:03 2018-05-28 17:19:03 0:42:00 0:33:16 0:08:44 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 2579063 2018-05-24 02:01:49 2018-05-28 16:37:03 2018-05-28 17:23:03 0:46:00 0:37:58 0:08:02 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 16:57:58.946143 osd.1 158.69.74.46:6804/8832 66 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.984490 secs" in cluster log

pass 2579064 2018-05-24 02:01:50 2018-05-28 16:37:14 2018-05-28 17:03:14 0:26:00 0:14:43 0:11:17 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml} 2
pass 2579065 2018-05-24 02:01:50 2018-05-28 16:37:24 2018-05-28 17:15:24 0:38:00 0:28:46 0:09:14 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
pass 2579066 2018-05-24 02:01:51 2018-05-28 16:39:00 2018-05-28 16:56:59 0:17:59 0:13:43 0:04:16 ovh master rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579067 2018-05-24 02:01:52 2018-05-28 16:39:28 2018-05-28 17:17:27 0:37:59 0:33:45 0:04:14 ovh master rados/objectstore/filestore-idempotent.yaml 1
fail 2579068 2018-05-24 02:01:52 2018-05-28 16:41:04 2018-05-28 17:33:05 0:52:01 0:35:19 0:16:42 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-28 17:08:41.205824 osd.4 158.69.74.78:6804/8814 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.206890 secs" in cluster log

pass 2579069 2018-05-24 02:01:53 2018-05-28 16:41:15 2018-05-28 17:03:14 0:21:59 0:16:19 0:05:40 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-hammer.yaml rados.yaml} 1
fail 2579070 2018-05-24 02:01:54 2018-05-28 16:42:49 2018-05-28 17:36:49 0:54:00 0:42:11 0:11:49 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-28 17:06:42.371604 osd.4 158.69.74.73:6804/8688 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.849719 secs" in cluster log

pass 2579071 2018-05-24 02:01:54 2018-05-28 16:47:50 2018-05-28 17:09:50 0:22:00 0:13:29 0:08:31 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/rados_5925.yaml} 2
fail 2579072 2018-05-24 02:01:55 2018-05-28 16:51:09 2018-05-28 17:41:09 0:50:00 0:41:34 0:08:26 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

"2018-05-28 17:13:42.336178 osd.3 158.69.74.85:6800/8676 35 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.610612 secs" in cluster log

pass 2579073 2018-05-24 02:01:56 2018-05-28 16:51:09 2018-05-28 17:33:09 0:42:00 0:15:34 0:26:26 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2579074 2018-05-24 02:01:56 2018-05-28 16:51:30 2018-05-28 17:29:30 0:38:00 0:25:58 0:12:02 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
pass 2579075 2018-05-24 02:01:57 2018-05-28 16:54:06 2018-05-28 17:12:03 0:17:57 0:12:43 0:05:14 ovh master rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579076 2018-05-24 02:01:58 2018-05-28 16:56:40 2018-05-28 17:32:35 0:35:55 0:23:07 0:12:48 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
pass 2579077 2018-05-24 02:01:58 2018-05-28 16:57:01 2018-05-28 17:45:01 0:48:00 0:39:35 0:08:25 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
fail 2579078 2018-05-24 02:01:59 2018-05-28 16:57:53 2018-05-28 17:41:52 0:43:59 0:31:23 0:12:36 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-05-28 17:36:23.705627 osd.5 158.69.75.118:6808/5697 47 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.007331 secs" in cluster log

pass 2579079 2018-05-24 02:02:00 2018-05-28 17:03:38 2018-05-28 17:49:37 0:45:59 0:34:37 0:11:22 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2579080 2018-05-24 02:02:01 2018-05-28 17:03:38 2018-05-28 17:33:37 0:29:59 0:13:34 0:16:25 ovh master centos rados/singleton/{all/ec-lost-unfound-upgrade.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2579081 2018-05-24 02:02:01 2018-05-28 17:03:38 2018-05-28 17:31:37 0:27:59 0:16:34 0:11:25 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2579082 2018-05-24 02:02:02 2018-05-28 17:08:24 2018-05-28 17:40:24 0:32:00 0:12:15 0:19:45 ovh master rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3
pass 2579083 2018-05-24 02:02:03 2018-05-28 17:10:10 2018-05-28 17:36:09 0:25:59 0:16:11 0:09:48 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2579084 2018-05-24 02:02:03 2018-05-28 17:12:23 2018-05-28 18:18:23 1:06:00 0:56:33 0:09:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-28 17:46:31.097913 osd.5 158.69.75.166:6808/8744 40 : cluster [WRN] 11 slow requests, 5 included below; oldest blocked for > 30.329921 secs" in cluster log

pass 2579085 2018-05-24 02:02:04 2018-05-28 17:13:01 2018-05-28 17:45:01 0:32:00 0:27:25 0:04:35 ovh master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579086 2018-05-24 02:02:05 2018-05-28 17:13:35 2018-05-28 18:07:35 0:54:00 0:47:01 0:06:59 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-28 17:34:29.065475 osd.0 158.69.75.170:6800/10477 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.552035 secs" in cluster log

pass 2579087 2018-05-24 02:02:05 2018-05-28 17:15:46 2018-05-28 17:43:45 0:27:59 0:15:54 0:12:05 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-infernalis.yaml rados.yaml} 1
pass 2579088 2018-05-24 02:02:06 2018-05-28 17:17:08 2018-05-28 17:33:07 0:15:59 0:10:05 0:05:54 ovh master rados/objectstore/fusestore.yaml 1
fail 2579089 2018-05-24 02:02:07 2018-05-28 17:17:29 2018-05-28 18:31:29 1:14:00 1:05:33 0:08:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-28 17:58:10.377212 osd.5 158.69.75.202:6800/13553 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.095466 secs" in cluster log

pass 2579090 2018-05-24 02:02:08 2018-05-28 17:19:24 2018-05-28 18:05:24 0:46:00 0:26:26 0:19:34 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
fail 2579091 2018-05-24 02:02:08 2018-05-28 17:21:12 2018-05-28 18:31:12 1:10:00 0:59:58 0:10:02 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-28 17:45:29.749271 osd.1 158.69.75.209:6804/8893 25 : cluster [WRN] 11 slow requests, 5 included below; oldest blocked for > 30.076320 secs" in cluster log

fail 2579092 2018-05-24 02:02:09 2018-05-28 17:23:22 2018-05-28 17:49:21 0:25:59 0:15:24 0:10:35 ovh master centos rados/singleton/{all/lost-unfound-delete-upgrade.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-28 17:44:53.255118 osd.0 158.69.75.221:6800/31968 23 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.577617 secs" in cluster log

fail 2579093 2018-05-24 02:02:10 2018-05-28 17:26:32 2018-05-28 18:56:33 1:30:01 1:21:03 0:08:58 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 17:48:48.758420 osd.1 158.69.75.224:6804/8916 7 : cluster [WRN] 13 slow requests, 5 included below; oldest blocked for > 30.095967 secs" in cluster log

pass 2579094 2018-05-24 02:02:10 2018-05-28 17:29:48 2018-05-28 18:15:48 0:46:00 0:37:09 0:08:51 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 2579095 2018-05-24 02:02:11 2018-05-28 17:31:50 2018-05-28 18:11:50 0:40:00 0:31:42 0:08:18 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-05-28 18:05:07.648061 osd.0 158.69.75.24:6800/8809 21 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.723504 secs" in cluster log

pass 2579096 2018-05-24 02:02:12 2018-05-28 17:31:50 2018-05-28 18:11:50 0:40:00 0:30:50 0:09:10 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml} 2
pass 2579097 2018-05-24 02:02:12 2018-05-28 17:32:36 2018-05-28 18:46:37 1:14:01 0:16:29 0:57:32 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2579098 2018-05-24 02:02:13 2018-05-28 17:33:24 2018-05-28 18:33:24 1:00:00 0:51:52 0:08:08 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 18:13:21.578869 osd.0 158.69.75.249:6801/16646 43 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.404476 secs" in cluster log

pass 2579099 2018-05-24 02:02:14 2018-05-28 17:33:24 2018-05-28 18:07:24 0:34:00 0:22:49 0:11:11 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
pass 2579100 2018-05-24 02:02:14 2018-05-28 17:33:24 2018-05-28 18:01:24 0:28:00 0:23:16 0:04:44 ovh master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579101 2018-05-24 02:02:15 2018-05-28 17:33:38 2018-05-28 18:11:38 0:38:00 0:24:02 0:13:58 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
fail 2579102 2018-05-24 02:02:16 2018-05-28 17:36:30 2018-05-28 18:22:30 0:46:00 0:34:48 0:11:12 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-28 17:58:24.724121 osd.1 158.69.75.50:6804/8913 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.305933 secs" in cluster log

fail 2579103 2018-05-24 02:02:16 2018-05-28 17:36:50 2018-05-28 18:00:50 0:24:00 0:16:23 0:07:37 ovh master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_msgr'

fail 2579104 2018-05-24 02:02:17 2018-05-28 17:40:46 2018-05-28 18:28:46 0:48:00 0:39:26 0:08:34 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-28 18:00:06.481231 osd.2 158.69.75.49:6808/8911 13 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.071384 secs" in cluster log

fail 2579105 2018-05-24 02:02:18 2018-05-28 17:41:11 2018-05-28 18:05:10 0:23:59 0:15:41 0:08:18 ovh master centos rados/singleton/{all/lost-unfound-upgrade.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-05-28 18:01:46.874394 osd.0 158.69.75.53:6800/330 25 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.602609 secs" in cluster log

pass 2579106 2018-05-24 02:02:18 2018-05-28 17:41:35 2018-05-28 18:11:35 0:30:00 0:22:59 0:07:01 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
pass 2579107 2018-05-24 02:02:19 2018-05-28 17:42:13 2018-05-28 18:06:10 0:23:57 0:08:51 0:15:06 ovh master rados/objectstore/keyvaluedb.yaml 1
pass 2579108 2018-05-24 02:02:20 2018-05-28 17:42:13 2018-05-28 18:16:11 0:33:58 0:23:57 0:10:01 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
fail 2579109 2018-05-24 02:02:20 2018-05-28 17:44:06 2018-05-28 18:34:06 0:50:00 0:36:11 0:13:49 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2579110 2018-05-24 02:02:21 2018-05-28 17:45:20 2018-05-28 19:31:22 1:46:02 0:17:53 1:28:09 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2579111 2018-05-24 02:02:22 2018-05-28 17:45:20 2018-05-28 18:15:20 0:30:00 0:19:08 0:10:52 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 2579112 2018-05-24 02:02:22 2018-05-28 17:49:40 2018-05-28 18:15:40 0:26:00 0:21:15 0:04:45 ovh master rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579113 2018-05-24 02:02:23 2018-05-28 17:49:40 2018-05-28 18:45:41 0:56:01 0:36:19 0:19:42 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2579114 2018-05-24 02:02:24 2018-05-28 18:01:11 2018-05-28 18:47:11 0:46:00 0:34:40 0:11:20 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 2579115 2018-05-24 02:02:25 2018-05-28 18:01:25 2018-05-28 18:51:25 0:50:00 0:28:15 0:21:45 ovh master rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 3
pass 2579116 2018-05-24 02:02:25 2018-05-28 18:05:30 2018-05-28 18:29:30 0:24:00 0:14:33 0:09:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2579117 2018-05-24 02:02:26 2018-05-28 18:05:30 2018-05-28 18:27:30 0:22:00 0:16:19 0:05:41 ovh master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579118 2018-05-24 02:02:27 2018-05-28 18:06:12 2018-05-28 19:46:13 1:40:01 1:31:46 0:08:15 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-28 18:51:39.465965 osd.5 158.69.76.152:6808/8749 29 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.086642 secs" in cluster log

pass 2579119 2018-05-24 02:02:27 2018-05-28 18:07:42 2018-05-28 18:37:42 0:30:00 0:18:25 0:11:35 ovh master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
fail 2579120 2018-05-24 02:02:28 2018-05-28 18:07:43 2018-05-28 19:23:44 1:16:01 1:04:36 0:11:25 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-28 18:34:17.913679 osd.1 158.69.76.180:6804/8851 9 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.601118 secs" in cluster log

pass 2579121 2018-05-24 02:02:29 2018-05-28 18:07:52 2018-05-28 18:35:52 0:28:00 0:17:36 0:10:24 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 2579122 2018-05-24 02:02:29 2018-05-28 18:11:56 2018-05-28 18:43:55 0:31:59 0:24:05 0:07:54 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2579123 2018-05-24 02:02:30 2018-05-28 18:11:56 2018-05-28 19:25:57 1:14:01 0:17:02 0:56:59 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2579125 2018-05-24 02:02:31 2018-05-28 18:11:56 2018-05-28 19:21:57 1:10:01 0:59:05 0:10:56 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-28 18:32:19.817689 osd.0 158.69.76.194:6800/8841 12 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.526116 secs" in cluster log

pass 2579127 2018-05-24 02:02:31 2018-05-28 18:11:56 2018-05-28 18:37:55 0:25:59 0:22:20 0:03:39 ovh master rados/singleton/{all/mon-thrasher.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579129 2018-05-24 02:02:32 2018-05-28 18:15:39 2018-05-28 19:09:40 0:54:01 0:35:13 0:18:48 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

fail 2579131 2018-05-24 02:02:33 2018-05-28 18:15:41 2018-05-28 19:09:41 0:54:00 0:44:15 0:09:45 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 18:50:49.977382 osd.3 158.69.76.244:6800/8629 23 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.302502 secs" in cluster log

pass 2579133 2018-05-24 02:02:34 2018-05-28 18:15:49 2018-05-28 18:41:48 0:25:59 0:21:23 0:04:36 ovh master rados/objectstore/objectcacher-stress.yaml 1
pass 2579135 2018-05-24 02:02:34 2018-05-28 18:15:49 2018-05-28 19:07:49 0:52:00 0:33:38 0:18:22 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 2579137 2018-05-24 02:02:35 2018-05-28 18:16:12 2018-05-28 19:08:12 0:52:00 0:25:00 0:27:00 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
pass 2579139 2018-05-24 02:02:36 2018-05-28 18:18:44 2018-05-28 18:40:43 0:21:59 0:13:35 0:08:24 ovh master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579141 2018-05-24 02:02:36 2018-05-28 18:22:50 2018-05-28 18:46:50 0:24:00 0:11:55 0:12:05 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 2579143 2018-05-24 02:02:37 2018-05-28 18:27:48 2018-05-28 19:03:48 0:36:00 0:25:55 0:10:05 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 2579145 2018-05-24 02:02:38 2018-05-28 18:29:07 2018-05-28 19:05:06 0:35:59 0:27:13 0:08:46 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
fail 2579147 2018-05-24 02:02:39 2018-05-28 18:29:31 2018-05-28 19:05:31 0:36:00 0:26:18 0:09:42 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-05-28 18:51:54.486324 osd.1 158.69.76.71:6804/8782 31 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.009039 secs" in cluster log

pass 2579149 2018-05-24 02:02:39 2018-05-28 18:31:30 2018-05-28 18:45:30 0:14:00 0:10:43 0:03:17 ovh master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
pass 2579151 2018-05-24 02:02:40 2018-05-28 18:31:30 2018-05-28 18:51:30 0:20:00 0:15:06 0:04:54 ovh master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579153 2018-05-24 02:02:41 2018-05-28 18:33:44 2018-05-28 19:23:45 0:50:01 0:39:15 0:10:46 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-05-28 18:58:29.551896 osd.3 158.69.76.93:6800/8710 43 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.313453 secs" in cluster log

fail 2579155 2018-05-24 02:02:41 2018-05-28 18:33:44 2018-05-28 19:29:45 0:56:01 0:34:36 0:21:25 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2579157 2018-05-24 02:02:42 2018-05-28 18:34:07 2018-05-28 19:04:07 0:30:00 0:22:21 0:07:39 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2579159 2018-05-24 02:02:43 2018-05-28 18:36:12 2018-05-28 19:10:12 0:34:00 0:23:13 0:10:47 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
fail 2579161 2018-05-24 02:02:44 2018-05-28 18:38:01 2018-05-28 18:58:00 0:19:59 0:13:14 0:06:45 ovh master rados/singleton/{all/osd-recovery.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-05-28 18:55:11.571057 osd.1 158.69.77.114:6805/9885 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.853169 secs" in cluster log

fail 2579163 2018-05-24 02:02:44 2018-05-28 18:38:01 2018-05-28 19:24:01 0:46:00 0:33:22 0:12:38 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 19:03:55.262601 osd.2 158.69.77.134:6808/8809 15 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.110000 secs" in cluster log

pass 2579165 2018-05-24 02:02:45 2018-05-28 18:41:02 2018-05-28 19:31:02 0:50:00 0:39:15 0:10:45 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
pass 2579167 2018-05-24 02:02:46 2018-05-28 18:41:50 2018-05-28 19:17:49 0:35:59 0:24:45 0:11:14 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml} 2
pass 2579169 2018-05-24 02:02:46 2018-05-28 18:44:15 2018-05-28 19:18:15 0:34:00 0:17:12 0:16:48 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2579171 2018-05-24 02:02:47 2018-05-28 18:45:50 2018-05-28 19:23:50 0:38:00 0:31:05 0:06:55 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-05-28 19:16:48.702373 osd.0 158.69.77.155:6800/8734 53 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.088566 secs" in cluster log

pass 2579173 2018-05-24 02:02:48 2018-05-28 18:45:50 2018-05-28 20:03:51 1:18:01 1:09:55 0:08:06 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 2579175 2018-05-24 02:02:48 2018-05-28 18:46:38 2018-05-28 19:04:37 0:17:59 0:11:49 0:06:10 ovh master rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 1
dead 2579177 2018-05-24 02:02:49 2018-05-28 18:47:10 2018-05-29 06:49:46 12:02:36 ovh master rados/objectstore/objectstore.yaml 1
pass 2579179 2018-05-24 02:02:50 2018-05-28 18:47:12 2018-05-28 19:05:11 0:17:59 0:11:12 0:06:47 ovh master rados/singleton/{all/peer.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579181 2018-05-24 02:02:51 2018-05-28 18:51:45 2018-05-28 19:17:45 0:26:00 0:14:59 0:11:01 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2579183 2018-05-24 02:02:51 2018-05-28 18:51:45 2018-05-28 20:51:47 2:00:02 1:45:19 0:14:43 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-05-28 19:15:26.659531 osd.5 158.69.77.178:6808/8888 23 : cluster [WRN] 23 slow requests, 5 included below; oldest blocked for > 30.873692 secs" in cluster log

pass 2579185 2018-05-24 02:02:52 2018-05-28 18:54:21 2018-05-28 19:16:21 0:22:00 0:16:02 0:05:58 ovh master rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
fail 2579187 2018-05-24 02:02:53 2018-05-28 18:56:52 2018-05-28 19:56:53 1:00:01 0:51:51 0:08:10 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-05-28 19:20:00.073079 osd.3 158.69.77.195:6800/8647 19 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.973696 secs" in cluster log

pass 2579189 2018-05-24 02:02:53 2018-05-28 18:58:19 2018-05-28 19:20:18 0:21:59 0:12:26 0:09:33 ovh master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2579191 2018-05-24 02:02:54 2018-05-28 18:58:56 2018-05-28 20:12:58 1:14:02 1:01:31 0:12:31 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-05-28 19:44:06.415562 osd.5 158.69.77.216:6812/9728 84 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.378425 secs" in cluster log

fail 2579193 2018-05-24 02:02:55 2018-05-28 19:03:58 2018-05-28 20:38:00 1:34:02 1:26:14 0:07:48 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-05-28 19:22:04.863158 osd.5 158.69.77.215:6808/8898 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.027066 secs" in cluster log

fail 2579195 2018-05-24 02:02:55 2018-05-28 19:04:08 2018-05-28 20:28:09 1:24:01 1:15:23 0:08:38 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-05-28 19:24:00.136708 osd.2 158.69.77.222:6808/8871 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.196533 secs" in cluster log

pass 2579197 2018-05-24 02:02:56 2018-05-28 19:04:39 2018-05-28 19:22:39 0:18:00 0:13:54 0:04:06 ovh master rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2579199 2018-05-24 02:02:57 2018-05-28 19:05:29 2018-05-28 19:45:29 0:40:00 0:30:46 0:09:14 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 2579201 2018-05-24 02:02:57 2018-05-28 19:05:29 2018-05-28 20:17:30 1:12:01 1:02:41 0:09:20 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-05-28 19:29:05.762425 osd.0 158.69.77.236:6800/8731 51 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.933898 secs" in cluster log

pass 2579203 2018-05-24 02:02:58 2018-05-28 19:05:32 2018-05-28 19:37:32 0:32:00 0:22:16 0:09:44 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2