Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 2655468 2018-06-12 02:00:53 2018-06-12 02:01:13 2018-06-12 02:39:13 0:38:00 0:26:17 0:11:43 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
pass 2655469 2018-06-12 02:00:53 2018-06-12 02:01:13 2018-06-12 02:55:18 0:54:05 0:33:06 0:20:59 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/pool-create-delete.yaml} 2
pass 2655470 2018-06-12 02:00:54 2018-06-12 02:01:14 2018-06-12 02:31:13 0:29:59 0:14:06 0:15:53 ovh master rados/objectstore/alloc-hint.yaml 1
pass 2655471 2018-06-12 02:00:55 2018-06-12 02:01:13 2018-06-12 03:13:13 1:12:00 1:02:06 0:09:54 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/16113.yaml rados.yaml} 1
fail 2655472 2018-06-12 02:00:56 2018-06-12 02:01:15 2018-06-12 02:47:15 0:46:00 0:27:17 0:18:43 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-06-12 02:26:09.128898 osd.0 158.69.81.85:6800/8840 1 : cluster [WRN] 22 slow requests, 5 included below; oldest blocked for > 30.327477 secs" in cluster log

fail 2655473 2018-06-12 02:00:57 2018-06-12 02:01:15 2018-06-12 02:51:15 0:50:00 0:38:25 0:11:35 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

"2018-06-12 02:34:22.638307 osd.1 158.69.81.88:6804/8848 57 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.164526 secs" in cluster log

pass 2655474 2018-06-12 02:00:57 2018-06-12 02:01:15 2018-06-12 02:43:15 0:42:00 0:17:44 0:24:16 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2655475 2018-06-12 02:00:58 2018-06-12 02:01:15 2018-06-12 02:55:15 0:54:00 0:40:01 0:13:59 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/default.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2655476 2018-06-12 02:00:59 2018-06-12 02:01:13 2018-06-12 02:43:13 0:42:00 0:22:21 0:19:39 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2655477 2018-06-12 02:00:59 2018-06-12 02:01:13 2018-06-12 04:03:15 2:02:02 1:47:57 0:14:05 ovh master centos rados/upgrade/{hammer-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{ec-rados-plugin=jerasure-k=3-m=1.yaml rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml test_cache-pool-snaps.yaml}} rados.yaml} 3
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op write 100 --op delete 50 --pool unique_pool_8'

pass 2655478 2018-06-12 02:01:00 2018-06-12 02:01:14 2018-06-12 02:55:14 0:54:00 0:32:30 0:21:30 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
fail 2655479 2018-06-12 02:01:01 2018-06-12 02:01:15 2018-06-12 03:07:16 1:06:01 0:45:31 0:20:30 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 02:40:26.658854 osd.1 158.69.82.182:6804/8819 67 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.490773 secs" in cluster log

pass 2655480 2018-06-12 02:01:02 2018-06-12 02:01:13 2018-06-12 02:47:13 0:46:00 0:28:51 0:17:09 ovh master rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655481 2018-06-12 02:01:02 2018-06-12 02:01:14 2018-06-12 02:59:14 0:58:00 0:38:15 0:19:45 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2655482 2018-06-12 02:01:03 2018-06-12 02:01:13 2018-06-12 02:57:13 0:56:00 0:35:32 0:20:28 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 2655483 2018-06-12 02:01:04 2018-06-12 02:01:14 2018-06-12 02:45:14 0:44:00 0:19:46 0:24:14 ovh master rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 3
pass 2655484 2018-06-12 02:01:05 2018-06-12 02:01:15 2018-06-12 02:43:14 0:41:59 0:22:10 0:19:49 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2655485 2018-06-12 02:01:05 2018-06-12 02:01:15 2018-06-12 02:37:14 0:35:59 0:19:11 0:16:48 ovh master rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655486 2018-06-12 02:01:06 2018-06-12 02:01:14 2018-06-12 03:13:15 1:12:01 0:52:01 0:20:00 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-06-12 02:42:38.434500 osd.1 158.69.81.93:6804/8896 8 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.032644 secs" in cluster log

fail 2655487 2018-06-12 02:01:07 2018-06-12 02:01:14 2018-06-12 03:09:14 1:08:00 0:48:22 0:19:38 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-06-12 02:56:56.178044 osd.5 158.69.82.56:6812/17095 19 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.069926 secs" in cluster log

fail 2655488 2018-06-12 02:01:08 2018-06-12 02:01:14 2018-06-12 02:53:14 0:52:00 0:32:33 0:19:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

pass 2655489 2018-06-12 02:01:09 2018-06-12 02:01:13 2018-06-12 02:35:14 0:34:01 0:23:48 0:10:13 ovh master rados/singleton/{all/mon-thrasher.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655490 2018-06-12 02:01:09 2018-06-12 02:01:14 2018-06-12 03:35:14 1:34:00 1:12:54 0:21:06 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-06-12 03:06:26.048717 osd.5 158.69.82.19:6808/14413 137 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.080299 secs" in cluster log

pass 2655491 2018-06-12 02:01:10 2018-06-12 02:01:16 2018-06-12 02:21:15 0:19:59 0:11:56 0:08:03 ovh master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
fail 2655492 2018-06-12 02:01:11 2018-06-12 02:01:15 2018-06-12 03:03:15 1:02:00 0:50:35 0:11:25 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

pass 2655493 2018-06-12 02:01:12 2018-06-12 02:01:15 2018-06-12 02:45:14 0:43:59 0:26:08 0:17:51 ovh master rados/objectstore/ceph_objectstore_tool.yaml 1
pass 2655494 2018-06-12 02:01:12 2018-06-12 02:01:15 2018-06-12 02:53:14 0:51:59 0:32:38 0:19:21 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
pass 2655495 2018-06-12 02:01:14 2018-06-12 02:01:15 2018-06-12 02:27:15 0:26:00 0:14:57 0:11:03 ovh master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655496 2018-06-12 02:01:15 2018-06-12 02:01:16 2018-06-12 03:05:17 1:04:01 0:45:14 0:18:47 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 02:43:24.817448 osd.1 158.69.82.5:6804/8881 107 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.124926 secs" in cluster log

pass 2655497 2018-06-12 02:01:16 2018-06-12 02:01:17 2018-06-12 02:51:18 0:50:01 0:30:07 0:19:54 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 2655498 2018-06-12 02:01:16 2018-06-12 02:01:18 2018-06-12 02:31:18 0:30:00 0:17:20 0:12:40 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_5925.yaml} 2
fail 2655499 2018-06-12 02:01:17 2018-06-12 02:01:18 2018-06-12 03:07:19 1:06:01 0:45:59 0:20:02 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

"2018-06-12 02:47:03.952246 osd.1 158.69.82.53:6804/8880 47 : cluster [WRN] 7 slow requests, 5 included below; oldest blocked for > 30.221668 secs" in cluster log

pass 2655500 2018-06-12 02:01:18 2018-06-12 02:01:19 2018-06-12 02:45:19 0:44:00 0:18:15 0:25:45 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2655501 2018-06-12 02:01:19 2018-06-12 02:01:20 2018-06-12 02:51:20 0:50:00 0:31:09 0:18:51 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
fail 2655502 2018-06-12 02:01:20 2018-06-12 02:01:21 2018-06-12 02:47:21 0:46:00 0:34:58 0:11:02 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-06-12 02:27:44.837264 osd.2 158.69.81.70:6812/9795 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.918796 secs" in cluster log

pass 2655503 2018-06-12 02:01:20 2018-06-12 02:01:22 2018-06-12 02:37:21 0:35:59 0:17:57 0:18:02 ovh master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655504 2018-06-12 02:01:21 2018-06-12 02:01:22 2018-06-12 02:49:23 0:48:01 0:33:51 0:14:10 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-06-12 02:38:05.335395 osd.1 158.69.81.95:6812/12750 51 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.965477 secs" in cluster log

fail 2655505 2018-06-12 02:01:22 2018-06-12 02:01:23 2018-06-12 02:51:23 0:50:00 0:37:40 0:12:20 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-06-12 02:22:15.819578 osd.3 158.69.82.137:6800/26862 3 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.528877 secs" in cluster log

pass 2655506 2018-06-12 02:01:23 2018-06-12 02:01:24 2018-06-12 02:39:25 0:38:01 0:26:15 0:11:46 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
pass 2655507 2018-06-12 02:01:24 2018-06-12 02:01:25 2018-06-12 02:27:24 0:25:59 0:11:07 0:14:52 ovh master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
fail 2655508 2018-06-12 02:01:24 2018-06-12 02:01:25 2018-06-12 02:49:26 0:48:01 0:29:44 0:18:17 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-06-12 02:36:11.652105 osd.4 158.69.82.191:6804/8766 5 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.326363 secs" in cluster log

fail 2655509 2018-06-12 02:01:25 2018-06-12 02:01:26 2018-06-12 02:31:26 0:30:00 0:14:58 0:15:02 ovh master rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-06-12 02:28:09.058519 osd.0 158.69.82.2:6800/8738 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.278125 secs" in cluster log

fail 2655510 2018-06-12 02:01:26 2018-06-12 02:01:27 2018-06-12 02:57:28 0:56:01 0:46:08 0:09:53 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 02:26:27.737138 osd.4 158.69.81.78:6804/8774 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.501054 secs" in cluster log

fail 2655511 2018-06-12 02:01:27 2018-06-12 02:01:28 2018-06-12 02:47:28 0:46:00 0:33:38 0:12:22 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-12 02:26:32.786874 osd.1 158.69.82.124:6804/8846 1 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.871184 secs" in cluster log

pass 2655512 2018-06-12 02:01:27 2018-06-12 02:01:28 2018-06-12 03:25:30 1:24:02 1:13:27 0:10:35 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 2655513 2018-06-12 02:01:28 2018-06-12 02:01:29 2018-06-12 02:33:29 0:32:00 0:18:08 0:13:52 ovh master rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
pass 2655514 2018-06-12 02:01:29 2018-06-12 02:21:37 2018-06-12 02:37:34 0:15:57 0:11:00 0:04:57 ovh master rados/objectstore/filejournal.yaml 1
pass 2655515 2018-06-12 02:01:30 2018-06-12 02:45:38 2018-06-12 03:03:37 0:17:59 0:12:49 0:05:10 ovh master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655516 2018-06-12 02:01:30 2018-06-12 02:45:38 2018-06-12 03:09:37 0:23:59 0:14:56 0:09:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

"2018-06-12 03:05:24.328553 osd.3 158.69.84.118:6800/8381 5 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.833669 secs" in cluster log

pass 2655517 2018-06-12 02:01:31 2018-06-12 02:47:37 2018-06-12 03:27:37 0:40:00 0:22:58 0:17:02 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
pass 2655518 2018-06-12 02:01:32 2018-06-12 02:47:37 2018-06-12 04:27:38 1:40:01 1:27:26 0:12:35 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
fail 2655519 2018-06-12 02:01:33 2018-06-12 02:47:38 2018-06-12 03:53:38 1:06:00 0:55:48 0:10:12 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-06-12 03:21:27.578002 osd.1 158.69.84.170:6804/8812 47 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.697050 secs" in cluster log

pass 2655520 2018-06-12 02:01:33 2018-06-12 02:47:37 2018-06-12 03:05:36 0:17:59 0:12:13 0:05:46 ovh master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655521 2018-06-12 02:01:34 2018-06-12 02:49:41 2018-06-12 04:03:42 1:14:01 1:04:11 0:09:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-06-12 03:18:16.271331 osd.2 158.69.84.183:6800/18927 39 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.191917 secs" in cluster log

pass 2655522 2018-06-12 02:01:35 2018-06-12 02:49:41 2018-06-12 03:23:41 0:34:00 0:24:42 0:09:18 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
fail 2655523 2018-06-12 02:01:36 2018-06-12 02:51:41 2018-06-12 03:29:39 0:37:58 0:30:21 0:07:37 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

"2018-06-12 03:11:43.608250 osd.3 158.69.84.202:6800/8630 9 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.128249 secs" in cluster log

pass 2655524 2018-06-12 02:01:36 2018-06-12 02:51:41 2018-06-12 04:31:41 1:40:00 0:17:06 1:22:54 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2655525 2018-06-12 02:01:37 2018-06-12 02:51:41 2018-06-12 03:59:41 1:08:00 0:57:45 0:10:15 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-06-12 03:13:04.804593 osd.2 158.69.84.21:6808/8619 13 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.346181 secs" in cluster log

pass 2655526 2018-06-12 02:01:38 2018-06-12 02:51:41 2018-06-12 03:07:39 0:15:58 0:10:47 0:05:11 ovh master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
fail 2655527 2018-06-12 02:01:39 2018-06-12 02:53:25 2018-06-12 03:53:25 1:00:00 0:50:09 0:09:51 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-06-12 03:14:56.204890 osd.5 158.69.84.219:6808/8879 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.397724 secs" in cluster log

pass 2655528 2018-06-12 02:01:39 2018-06-12 02:53:25 2018-06-12 03:19:24 0:25:59 0:14:21 0:11:38 ovh master rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655529 2018-06-12 02:01:40 2018-06-12 02:55:25 2018-06-12 03:35:25 0:40:00 0:31:59 0:08:01 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
Failure Reason:

"2018-06-12 03:13:51.055552 osd.3 158.69.84.211:6800/8723 1 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.756679 secs" in cluster log

fail 2655530 2018-06-12 02:01:41 2018-06-12 02:55:25 2018-06-12 03:39:25 0:44:00 0:32:53 0:11:07 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 2655531 2018-06-12 02:01:42 2018-06-12 02:55:25 2018-06-12 03:29:25 0:34:00 0:22:32 0:11:28 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
pass 2655532 2018-06-12 02:01:42 2018-06-12 02:57:24 2018-06-12 03:41:24 0:44:00 0:28:37 0:15:23 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
pass 2655533 2018-06-12 02:01:43 2018-06-12 02:57:29 2018-06-12 03:23:28 0:25:59 0:13:55 0:12:04 ovh master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655535 2018-06-12 02:01:44 2018-06-12 02:59:25 2018-06-12 03:47:25 0:48:00 0:38:52 0:09:08 ovh master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 2655537 2018-06-12 02:01:45 2018-06-12 03:03:42 2018-06-12 03:41:42 0:38:00 0:29:23 0:08:37 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
fail 2655539 2018-06-12 02:01:45 2018-06-12 03:03:42 2018-06-12 03:59:43 0:56:01 0:43:48 0:12:13 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-06-12 03:32:36.113173 osd.2 158.69.84.47:6808/11726 7 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.377683 secs" in cluster log

pass 2655541 2018-06-12 02:01:46 2018-06-12 03:05:39 2018-06-12 05:05:41 2:00:02 0:18:11 1:41:51 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2655543 2018-06-12 02:01:47 2018-06-12 03:05:39 2018-06-12 03:45:39 0:40:00 0:31:47 0:08:13 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 2655545 2018-06-12 02:01:48 2018-06-12 03:07:36 2018-06-12 03:39:36 0:32:00 0:24:01 0:07:59 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2655547 2018-06-12 02:01:48 2018-06-12 03:07:36 2018-06-12 03:25:35 0:17:59 0:13:09 0:04:50 ovh master rados/singleton/{all/rest-api.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655549 2018-06-12 02:01:49 2018-06-12 03:07:40 2018-06-12 03:25:40 0:18:00 0:13:04 0:04:56 ovh master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2018-06-12 03:21:32.043469 osd.1 158.69.84.69:6804/8603 2 : cluster [WRN] 16 slow requests, 5 included below; oldest blocked for > 30.977159 secs" in cluster log

pass 2655551 2018-06-12 02:01:50 2018-06-12 03:09:25 2018-06-12 03:53:25 0:44:00 0:24:17 0:19:43 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
fail 2655553 2018-06-12 02:01:51 2018-06-12 03:09:39 2018-06-12 04:05:39 0:56:00 0:31:50 0:24:10 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 2655556 2018-06-12 02:01:51 2018-06-12 03:13:34 2018-06-12 04:05:35 0:52:01 0:35:34 0:16:27 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2655558 2018-06-12 02:01:52 2018-06-12 03:13:35 2018-06-12 04:01:34 0:47:59 0:24:09 0:23:50 ovh master rados/singleton/{all/thrash-rados.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2655560 2018-06-12 02:01:53 2018-06-12 03:19:41 2018-06-12 04:01:41 0:42:00 0:19:39 0:22:21 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
pass 2655562 2018-06-12 02:01:54 2018-06-12 03:23:51 2018-06-12 03:57:51 0:34:00 0:24:35 0:09:25 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2655564 2018-06-12 02:01:54 2018-06-12 03:23:51 2018-06-12 05:05:52 1:42:01 0:19:09 1:22:52 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2655566 2018-06-12 02:01:55 2018-06-12 03:25:41 2018-06-12 03:55:40 0:29:59 0:17:45 0:12:14 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/scrub_test.yaml} 2
pass 2655568 2018-06-12 02:01:56 2018-06-12 03:25:41 2018-06-12 03:51:40 0:25:59 0:12:55 0:13:04 ovh master rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 1
pass 2655569 2018-06-12 02:01:56 2018-06-12 03:25:41 2018-06-12 03:59:41 0:34:00 0:17:05 0:16:55 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 2655571 2018-06-12 02:01:57 2018-06-12 03:27:57 2018-06-12 04:45:57 1:18:00 1:08:33 0:09:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 2655573 2018-06-12 02:01:58 2018-06-12 03:29:42 2018-06-12 04:21:43 0:52:01 0:40:29 0:11:32 ovh master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2655576 2018-06-12 02:01:59 2018-06-12 03:29:42 2018-06-12 04:25:43 0:56:01 0:42:35 0:13:26 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
pass 2655577 2018-06-12 02:01:59 2018-06-12 03:35:25 2018-06-12 04:29:25 0:54:00 0:44:54 0:09:06 ovh master rados/objectstore/filestore-idempotent.yaml 1
fail 2655579 2018-06-12 02:02:00 2018-06-12 03:35:26 2018-06-12 04:35:27 1:00:01 0:48:58 0:11:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

"2018-06-12 03:56:57.252962 osd.0 158.69.85.205:6800/8703 1 : cluster [WRN] 12 slow requests, 5 included below; oldest blocked for > 30.952250 secs" in cluster log

pass 2655582 2018-06-12 02:02:01 2018-06-12 03:39:47 2018-06-12 04:17:47 0:38:00 0:30:09 0:07:51 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
pass 2655584 2018-06-12 02:02:02 2018-06-12 03:39:47 2018-06-12 04:01:46 0:21:59 0:16:13 0:05:46 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-hammer.yaml rados.yaml} 1
fail 2655586 2018-06-12 02:02:03 2018-06-12 03:39:47 2018-06-12 05:05:48 1:26:01 1:07:58 0:18:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-06-12 04:05:31.988173 osd.5 158.69.85.220:6808/8791 61 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.152358 secs" in cluster log

pass 2655588 2018-06-12 02:02:03 2018-06-12 03:41:36 2018-06-12 04:01:34 0:19:58 0:13:04 0:06:54 ovh master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655590 2018-06-12 02:02:04 2018-06-12 03:41:36 2018-06-12 04:47:36 1:06:00 0:54:10 0:11:50 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-06-12 04:04:43.123407 osd.0 158.69.85.238:6800/8848 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.414942 secs" in cluster log

pass 2655592 2018-06-12 02:02:05 2018-06-12 03:41:44 2018-06-12 04:29:49 0:48:05 0:36:34 0:11:31 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 2655594 2018-06-12 02:02:06 2018-06-12 03:45:37 2018-06-12 04:47:37 1:02:00 0:52:35 0:09:25 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 04:20:04.528604 osd.0 158.69.85.237:6812/11599 192 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.239895 secs" in cluster log

pass 2655596 2018-06-12 02:02:06 2018-06-12 03:45:40 2018-06-12 04:33:40 0:48:00 0:26:22 0:21:38 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml} 2
pass 2655598 2018-06-12 02:02:07 2018-06-12 03:47:36 2018-06-12 04:13:35 0:25:59 0:10:12 0:15:47 ovh master rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655600 2018-06-12 02:02:08 2018-06-12 03:51:54 2018-06-12 04:37:54 0:46:00 0:36:28 0:09:32 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-06-12 04:13:14.016675 osd.3 158.69.85.26:6800/26869 5 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.016713 secs" in cluster log

pass 2655602 2018-06-12 02:02:08 2018-06-12 03:53:36 2018-06-12 04:31:35 0:37:59 0:28:02 0:09:57 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2655604 2018-06-12 02:02:09 2018-06-12 03:53:36 2018-06-12 04:37:35 0:43:59 0:33:47 0:10:12 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-06-12 04:18:18.755346 osd.0 158.69.85.36:6800/8749 19 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.425789 secs" in cluster log

pass 2655606 2018-06-12 02:02:10 2018-06-12 03:53:39 2018-06-12 04:31:39 0:38:00 0:27:57 0:10:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 2655608 2018-06-12 02:02:11 2018-06-12 03:55:50 2018-06-12 04:55:51 1:00:01 0:48:47 0:11:14 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
pass 2655610 2018-06-12 02:02:12 2018-06-12 03:57:47 2018-06-12 04:31:47 0:34:00 0:25:07 0:08:53 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-small-objects.yaml} 2
pass 2655612 2018-06-12 02:02:12 2018-06-12 03:57:52 2018-06-12 05:29:53 1:32:01 0:16:59 1:15:02 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2655614 2018-06-12 02:02:13 2018-06-12 03:59:52 2018-06-12 04:29:51 0:29:59 0:24:59 0:05:00 ovh master rados/singleton/{all/cephtool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655616 2018-06-12 02:02:14 2018-06-12 03:59:52 2018-06-12 04:31:51 0:31:59 0:22:49 0:09:10 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
pass 2655618 2018-06-12 02:02:14 2018-06-12 03:59:52 2018-06-12 04:21:51 0:21:59 0:16:35 0:05:24 ovh master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-infernalis.yaml rados.yaml} 1
pass 2655620 2018-06-12 02:02:15 2018-06-12 04:01:50 2018-06-12 04:25:50 0:24:00 0:09:57 0:14:03 ovh master rados/objectstore/fusestore.yaml 1
pass 2655622 2018-06-12 02:02:16 2018-06-12 04:01:50 2018-06-12 04:33:50 0:32:00 0:23:54 0:08:06 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
fail 2655624 2018-06-12 02:02:17 2018-06-12 04:01:51 2018-06-12 04:45:50 0:43:59 0:33:37 0:10:22 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 04:23:30.669772 osd.1 158.69.86.133:6804/8811 29 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.823050 secs" in cluster log

pass 2655626 2018-06-12 02:02:17 2018-06-12 04:01:51 2018-06-12 04:21:50 0:19:59 0:13:13 0:06:46 ovh master rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655628 2018-06-12 02:02:18 2018-06-12 04:03:38 2018-06-12 04:47:38 0:44:00 0:34:33 0:09:27 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2655630 2018-06-12 02:02:19 2018-06-12 04:03:43 2018-06-12 04:27:42 0:23:59 0:14:37 0:09:22 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml} 2
pass 2655632 2018-06-12 02:02:20 2018-06-12 04:05:56 2018-06-12 04:45:56 0:40:00 0:16:57 0:23:03 ovh master rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 2
fail 2655634 2018-06-12 02:02:20 2018-06-12 04:05:56 2018-06-12 04:47:56 0:42:00 0:17:21 0:24:39 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

"2018-06-12 04:41:21.853566 osd.1 158.69.86.182:6804/8873 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.518038 secs" in cluster log

pass 2655636 2018-06-12 02:02:21 2018-06-12 04:13:56 2018-06-12 04:33:56 0:20:00 0:13:03 0:06:57 ovh master rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655638 2018-06-12 02:02:22 2018-06-12 04:17:57 2018-06-12 05:35:58 1:18:01 1:07:53 0:10:08 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
fail 2655640 2018-06-12 02:02:23 2018-06-12 04:21:53 2018-06-12 05:27:53 1:06:00 0:47:05 0:18:55 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-06-12 04:46:25.916271 osd.5 158.69.86.188:6808/8732 5 : cluster [WRN] 8 slow requests, 5 included below; oldest blocked for > 30.556894 secs" in cluster log

pass 2655642 2018-06-12 02:02:23 2018-06-12 04:21:53 2018-06-12 05:27:54 1:06:01 0:54:36 0:11:25 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2655644 2018-06-12 02:02:24 2018-06-12 04:21:53 2018-06-12 04:49:52 0:27:59 0:23:09 0:04:50 ovh master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
pass 2655646 2018-06-12 02:02:25 2018-06-12 04:25:53 2018-06-12 04:45:53 0:20:00 0:13:26 0:06:34 ovh master rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655648 2018-06-12 02:02:25 2018-06-12 04:25:53 2018-06-12 05:37:54 1:12:01 1:02:58 0:09:03 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-06-12 04:48:53.136456 osd.3 158.69.86.199:6800/8789 3 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.454618 secs" in cluster log

fail 2655650 2018-06-12 02:02:26 2018-06-12 04:27:50 2018-06-12 05:51:50 1:24:00 1:13:54 0:10:06 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-06-12 04:49:41.386910 osd.5 158.69.86.205:6808/8909 2 : cluster [WRN] 5 slow requests, 5 included below; oldest blocked for > 30.677810 secs" in cluster log

pass 2655652 2018-06-12 02:02:27 2018-06-12 04:27:50 2018-06-12 05:13:49 0:45:59 0:37:57 0:08:02 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/pool-create-delete.yaml} 2
pass 2655654 2018-06-12 02:02:28 2018-06-12 04:29:36 2018-06-12 04:43:35 0:13:59 0:09:59 0:04:00 ovh master rados/objectstore/keyvaluedb.yaml 1
pass 2655656 2018-06-12 02:02:28 2018-06-12 04:29:50 2018-06-12 05:11:50 0:42:00 0:32:38 0:09:22 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 2655658 2018-06-12 02:02:29 2018-06-12 04:29:53 2018-06-12 04:57:53 0:28:00 0:18:45 0:09:15 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2655660 2018-06-12 02:02:30 2018-06-12 04:31:51 2018-06-12 05:37:52 1:06:01 0:17:56 0:48:05 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
dead 2655662 2018-06-12 02:02:31 2018-06-12 04:31:51 2018-06-12 16:34:28 12:02:37 ovh master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/default.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2655664 2018-06-12 02:02:32 2018-06-12 04:31:52 2018-06-12 05:47:52 1:16:00 0:18:33 0:57:27 ovh master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2655666 2018-06-12 02:02:32 2018-06-12 04:31:52 2018-06-12 05:07:51 0:35:59 0:17:06 0:18:53 ovh master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
pass 2655668 2018-06-12 02:02:33 2018-06-12 04:31:52 2018-06-12 04:57:52 0:26:00 0:14:44 0:11:16 ovh master centos rados/singleton/{all/ec-lost-unfound-upgrade.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
fail 2655670 2018-06-12 02:02:34 2018-06-12 04:34:04 2018-06-12 05:28:04 0:54:00 0:43:39 0:10:21 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 05:12:19.715975 osd.5 158.69.86.29:6808/8728 123 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.469487 secs" in cluster log

pass 2655672 2018-06-12 02:02:35 2018-06-12 04:34:04 2018-06-12 05:10:04 0:36:00 0:17:55 0:18:05 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2655674 2018-06-12 02:02:35 2018-06-12 04:34:04 2018-06-12 05:16:04 0:42:00 0:28:50 0:13:10 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2655676 2018-06-12 02:02:36 2018-06-12 04:35:37 2018-06-12 05:13:37 0:38:00 0:29:45 0:08:15 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-06-12 04:53:24.355595 osd.4 158.69.86.248:6804/8801 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.694629 secs" in cluster log

pass 2655678 2018-06-12 02:02:37 2018-06-12 04:37:49 2018-06-12 05:15:49 0:38:00 0:31:00 0:07:00 ovh master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655680 2018-06-12 02:02:38 2018-06-12 04:37:56 2018-06-12 05:21:55 0:43:59 0:29:34 0:14:25 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 2655682 2018-06-12 02:02:38 2018-06-12 04:40:39 2018-06-12 05:20:39 0:40:00 0:17:50 0:22:10 ovh master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
pass 2655684 2018-06-12 02:02:39 2018-06-12 04:43:46 2018-06-12 05:19:46 0:36:00 0:28:30 0:07:30 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
fail 2655686 2018-06-12 02:02:40 2018-06-12 04:46:02 2018-06-12 05:18:01 0:31:59 0:24:53 0:07:06 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

"2018-06-12 05:04:32.027760 osd.4 158.69.87.107:6804/8806 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.248013 secs" in cluster log

fail 2655688 2018-06-12 02:02:41 2018-06-12 04:46:02 2018-06-12 05:08:00 0:21:58 0:15:29 0:06:29 ovh master centos rados/singleton/{all/lost-unfound-delete-upgrade.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-06-12 05:04:52.705303 osd.0 158.69.87.112:6800/32407 37 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.673200 secs" in cluster log

fail 2655690 2018-06-12 02:02:42 2018-06-12 04:46:02 2018-06-12 05:36:02 0:50:00 0:41:41 0:08:19 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 05:13:48.842774 osd.0 158.69.86.71:6800/8623 107 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.363394 secs" in cluster log

fail 2655692 2018-06-12 02:02:42 2018-06-12 04:46:02 2018-06-12 05:34:02 0:48:00 0:40:47 0:07:13 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-12 05:04:31.639912 osd.1 158.69.87.113:6804/8809 1 : cluster [WRN] 12 slow requests, 5 included below; oldest blocked for > 30.479921 secs" in cluster log

pass 2655694 2018-06-12 02:02:43 2018-06-12 04:47:46 2018-06-12 05:25:46 0:38:00 0:23:04 0:14:56 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
pass 2655696 2018-06-12 02:02:44 2018-06-12 04:47:46 2018-06-12 05:27:46 0:40:00 0:13:13 0:26:47 ovh master rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
pass 2655698 2018-06-12 02:02:45 2018-06-12 04:47:46 2018-06-12 05:15:46 0:28:00 0:22:19 0:05:41 ovh master rados/objectstore/objectcacher-stress.yaml 1
pass 2655700 2018-06-12 02:02:45 2018-06-12 04:47:57 2018-06-12 05:21:57 0:34:00 0:26:31 0:07:29 ovh master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655702 2018-06-12 02:02:46 2018-06-12 04:50:03 2018-06-12 05:14:03 0:24:00 0:16:25 0:07:35 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2655704 2018-06-12 02:02:47 2018-06-12 04:51:49 2018-06-12 06:25:51 1:34:02 1:24:24 0:09:38 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

"2018-06-12 05:12:00.474385 osd.1 158.69.87.127:6804/8838 15 : cluster [WRN] 16 slow requests, 5 included below; oldest blocked for > 30.413053 secs" in cluster log

pass 2655706 2018-06-12 02:02:48 2018-06-12 04:53:46 2018-06-12 05:17:46 0:24:00 0:13:57 0:10:03 ovh master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/rados_5925.yaml} 2
fail 2655708 2018-06-12 02:02:49 2018-06-12 04:55:57 2018-06-12 05:39:57 0:44:00 0:33:55 0:10:05 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2655710 2018-06-12 02:02:49 2018-06-12 04:55:57 2018-06-12 08:08:06 3:12:09 0:18:50 2:53:19 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2655712 2018-06-12 02:02:50 2018-06-12 04:58:05 2018-06-12 05:48:04 0:49:59 0:40:43 0:09:16 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

"2018-06-12 05:24:14.561872 osd.3 158.69.87.159:6800/9489 25 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.236467 secs" in cluster log

fail 2655714 2018-06-12 02:02:51 2018-06-12 04:58:05 2018-06-12 05:34:04 0:35:59 0:15:07 0:20:52 ovh master centos rados/singleton/{all/lost-unfound-upgrade.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

"2018-06-12 05:22:24.682998 osd.0 158.69.87.169:6800/31905 21 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.624816 secs" in cluster log

pass 2655716 2018-06-12 02:02:52 2018-06-12 06:04:29 2018-06-12 07:10:28 1:05:59 0:56:35 0:09:24 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 2655718 2018-06-12 02:02:53 2018-06-12 06:04:29 2018-06-12 06:22:27 0:17:58 0:12:02 0:05:56 ovh master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
fail 2655720 2018-06-12 02:02:54 2018-06-12 06:06:07 2018-06-12 07:10:06 1:03:59 0:56:27 0:07:32 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

"2018-06-12 06:38:35.470364 osd.2 158.69.89.202:6812/15127 3 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.655630 secs" in cluster log

pass 2655722 2018-06-12 02:02:54 2018-06-12 06:06:07 2018-06-12 06:50:06 0:43:59 0:34:56 0:09:03 ovh master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
fail 2655724 2018-06-12 02:02:55 2018-06-12 06:10:40 2018-06-12 07:32:24 1:21:44 1:03:33 0:18:11 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-06-12 06:44:29.639436 osd.4 158.69.90.5:6804/8780 1 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.981314 secs" in cluster log

pass 2655726 2018-06-12 02:02:56 2018-06-12 06:10:41 2018-06-12 06:40:23 0:29:42 0:24:19 0:05:23 ovh master rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655728 2018-06-12 02:02:57 2018-06-12 06:10:25 2018-06-12 06:48:22 0:37:57 0:20:07 0:17:50 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base'

fail 2655730 2018-06-12 02:02:57 2018-06-12 06:10:41 2018-06-12 07:06:25 0:55:44 0:46:35 0:09:09 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 06:33:51.995449 osd.3 158.69.89.33:6800/17647 9 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.675970 secs" in cluster log

pass 2655732 2018-06-12 02:02:58 2018-06-12 06:14:15 2018-06-12 07:02:04 0:47:49 0:36:50 0:10:59 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 2655734 2018-06-12 02:02:59 2018-06-12 06:14:16 2018-06-12 06:56:04 0:41:48 0:30:07 0:11:41 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
pass 2655736 2018-06-12 02:03:00 2018-06-12 06:14:16 2018-06-12 06:40:04 0:25:48 0:18:17 0:07:31 ovh master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2655738 2018-06-12 02:03:00 2018-06-12 06:19:25 2018-06-12 06:35:20 0:15:55 0:10:27 0:05:28 ovh master rados/objectstore/objectstore.yaml 1
Failure Reason:

Command failed on ovh073 with status 139: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/ostest && cd $TESTDIR/ostest && ceph_test_objectstore --gtest_filter=-*/2:-*/3'"

fail 2655740 2018-06-12 02:03:01 2018-06-12 06:19:26 2018-06-12 06:57:21 0:37:55 0:30:21 0:07:34 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

"2018-06-12 06:39:01.078032 osd.1 158.69.90.250:6804/8869 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.655415 secs" in cluster log

fail 2655741 2018-06-12 02:03:02 2018-06-12 06:23:01 2018-06-12 07:36:59 1:13:58 1:00:43 0:13:15 ovh master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on ovh053 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=jewel TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 2655742 2018-06-12 02:03:03 2018-06-12 06:23:02 2018-06-12 07:12:59 0:49:57 0:33:22 0:16:35 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

"2018-06-12 07:02:22.163926 osd.4 158.69.91.128:6804/8888 9 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.395763 secs" in cluster log

pass 2655743 2018-06-12 02:03:04 2018-06-12 06:23:02 2018-06-12 06:48:58 0:25:56 0:18:09 0:07:47 ovh master rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
pass 2655744 2018-06-12 02:03:04 2018-06-12 06:24:48 2018-06-12 07:32:44 1:07:56 0:24:16 0:43:40 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
pass 2655745 2018-06-12 02:03:05 2018-06-12 06:26:43 2018-06-12 06:56:37 0:29:54 0:25:27 0:04:27 ovh master rados/singleton/{all/mon-thrasher.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655746 2018-06-12 02:03:06 2018-06-12 06:29:00 2018-06-12 07:32:58 1:03:58 0:24:34 0:39:24 ovh master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 2655747 2018-06-12 02:03:06 2018-06-12 06:32:16 2018-06-12 07:32:15 0:59:59 0:35:13 0:24:46 ovh master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
fail 2655748 2018-06-12 02:03:07 2018-06-12 06:32:39 2018-06-12 07:24:44 0:52:05 0:42:08 0:09:57 ovh master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-radosbench.yaml} 2
Failure Reason:

"2018-06-12 07:04:14.018364 osd.2 158.69.91.145:6808/9005 3 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.717333 secs" in cluster log

pass 2655749 2018-06-12 02:03:08 2018-06-12 06:35:32 2018-06-12 10:57:36 4:22:04 0:17:24 4:04:40 ovh master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2655750 2018-06-12 02:03:09 2018-06-12 06:36:18 2018-06-12 07:46:19 1:10:01 0:46:34 0:23:27 ovh master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2018-06-12 07:18:09.521962 osd.3 158.69.91.44:6804/9512 47 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.391075 secs" in cluster log

fail 2655751 2018-06-12 02:03:10 2018-06-12 06:40:06 2018-06-12 08:38:07 1:58:01 0:36:13 1:21:48 ovh master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-12 08:11:56.406857 osd.2 158.69.91.214:6808/8612 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.343090 secs" in cluster log

pass 2655752 2018-06-12 02:03:10 2018-06-12 06:40:06 2018-06-12 07:06:05 0:25:59 0:19:48 0:06:11 ovh master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2655753 2018-06-12 02:03:11 2018-06-12 06:40:37 2018-06-12 07:50:37 1:10:00 0:26:05 0:43:55 ovh master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 2655754 2018-06-12 02:03:12 2018-06-12 06:40:37 2018-06-12 07:26:36 0:45:59 0:16:09 0:29:50 ovh master rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 3