Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 2713949 2018-06-27 16:36:28 2018-06-28 01:45:46 2018-06-28 02:11:45 0:25:59 0:13:24 0:12:35 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
fail 2713950 2018-06-27 16:36:30 2018-06-28 01:45:46 2018-06-28 02:19:45 0:33:59 0:15:45 0:18:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi011 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713951 2018-06-27 16:36:33 2018-06-28 01:45:46 2018-06-28 01:59:44 0:13:58 0:05:34 0:08:24 smithi master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
pass 2713952 2018-06-27 16:36:35 2018-06-28 01:45:55 2018-06-28 02:03:54 0:17:59 0:07:18 0:10:41 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2713953 2018-06-27 16:36:37 2018-06-28 01:47:46 2018-06-28 02:13:46 0:26:00 0:09:27 0:16:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi055 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2713954 2018-06-27 16:36:38 2018-06-28 01:47:46 2018-06-28 02:29:46 0:42:00 0:25:37 0:16:23 smithi master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 2713955 2018-06-27 16:36:40 2018-06-28 01:47:47 2018-06-28 02:21:46 0:33:59 0:18:08 0:15:51 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
fail 2713956 2018-06-27 16:36:42 2018-06-28 01:49:42 2018-06-28 02:15:42 0:26:00 0:15:00 0:11:00 smithi master rados/singleton/{all/rest-api.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi168 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713957 2018-06-27 16:36:43 2018-06-28 01:49:42 2018-06-28 02:17:42 0:28:00 0:15:53 0:12:07 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi023 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713958 2018-06-27 16:36:45 2018-06-28 01:49:45 2018-06-28 02:17:45 0:28:00 0:15:20 0:12:40 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
Failure Reason:

Command failed on smithi024 with status 1: 'sudo ceph --cluster ceph osd crush tunables optimal'

pass 2713959 2018-06-27 16:36:46 2018-06-28 01:49:52 2018-06-28 02:31:51 0:41:59 0:32:06 0:09:53 smithi master rados/objectstore/objectstore.yaml 1
fail 2713960 2018-06-27 16:36:48 2018-06-28 01:51:40 2018-06-28 02:19:40 0:28:00 0:16:46 0:11:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
Failure Reason:

"2018-06-28 02:10:07.342027 osd.1 172.21.15.97:6804/17191 20 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.947296 secs" in cluster log

pass 2713961 2018-06-27 16:36:50 2018-06-28 01:51:40 2018-06-28 02:07:40 0:16:00 0:05:56 0:10:04 smithi master rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 1
dead 2713962 2018-06-27 16:36:52 2018-06-28 01:51:40 2018-06-28 13:54:10 12:02:30 smithi master rados/singleton/{all/thrash-rados.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
fail 2713963 2018-06-27 16:36:53 2018-06-28 01:51:40 2018-06-28 02:19:40 0:28:00 0:15:33 0:12:27 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/scrub_test.yaml} 2
Failure Reason:

Command failed on smithi110 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713964 2018-06-27 16:36:56 2018-06-28 01:51:40 2018-06-28 02:21:40 0:30:00 0:15:46 0:14:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi050 with status 1: 'sudo ceph --cluster ceph osd crush tunables legacy'

pass 2713965 2018-06-27 16:36:58 2018-06-28 01:51:48 2018-06-28 02:11:48 0:20:00 0:10:20 0:09:40 smithi master rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
fail 2713966 2018-06-27 16:37:00 2018-06-28 01:53:56 2018-06-28 02:15:54 0:21:58 0:09:22 0:12:36 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi173 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2713967 2018-06-27 16:37:02 2018-06-28 01:53:56 2018-06-28 02:23:54 0:29:58 0:17:46 0:12:12 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2713968 2018-06-27 16:37:04 2018-06-28 01:53:57 2018-06-28 02:29:55 0:35:58 0:21:13 0:14:45 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-radosbench.yaml} 2
pass 2713969 2018-06-27 16:37:06 2018-06-28 01:53:56 2018-06-28 03:09:55 1:15:59 0:09:39 1:06:20 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2713970 2018-06-27 16:37:07 2018-06-28 01:53:56 2018-06-28 02:33:54 0:39:58 0:30:26 0:09:32 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2018-06-28 02:17:14.474228 osd.2 172.21.15.154:6808/30408 41 : cluster [WRN] 6 slow requests, 5 included below; oldest blocked for > 30.530552 secs" in cluster log

fail 2713971 2018-06-27 16:37:09 2018-06-28 01:53:57 2018-06-28 02:19:54 0:25:57 0:13:19 0:12:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-28 02:10:43.125028 osd.4 172.21.15.64:6804/11041 1 : cluster [WRN] 21 slow requests, 5 included below; oldest blocked for > 30.683424 secs" in cluster log

fail 2713972 2018-06-27 16:37:11 2018-06-28 01:53:56 2018-06-28 02:21:54 0:27:58 0:15:55 0:12:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713973 2018-06-27 16:37:13 2018-06-28 01:55:41 2018-06-28 02:33:40 0:37:59 0:27:07 0:10:52 smithi master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
fail 2713974 2018-06-27 16:37:14 2018-06-28 01:55:43 2018-06-28 02:21:40 0:25:57 0:14:53 0:11:04 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi144 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713975 2018-06-27 16:37:16 2018-06-28 01:55:43 2018-06-28 02:41:40 0:45:57 0:25:58 0:19:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi078 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph pg dump --format=json'

pass 2713976 2018-06-27 16:37:18 2018-06-28 01:55:43 2018-06-28 02:23:39 0:27:56 0:11:54 0:16:02 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
fail 2713977 2018-06-27 16:37:20 2018-06-28 01:55:43 2018-06-28 02:35:41 0:39:58 0:14:59 0:24:59 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi062 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713978 2018-06-27 16:37:22 2018-06-28 01:55:42 2018-06-28 02:33:40 0:37:58 0:15:58 0:22:00 smithi master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713979 2018-06-27 16:37:23 2018-06-28 01:55:44 2018-06-28 02:11:41 0:15:57 0:05:35 0:10:22 smithi master rados/objectstore/alloc-hint.yaml 1
fail 2713980 2018-06-27 16:37:25 2018-06-28 01:56:02 2018-06-28 02:18:01 0:21:59 0:06:35 0:15:24 smithi master rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi063 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2713981 2018-06-27 16:37:26 2018-06-28 01:58:35 2018-06-28 03:10:36 1:12:01 1:00:42 0:11:19 smithi master ubuntu 14.04 rados/singleton-nomsgr/{all/16113.yaml rados.yaml} 1
fail 2713982 2018-06-27 16:37:28 2018-06-28 01:59:31 2018-06-28 02:29:31 0:30:00 0:15:29 0:14:31 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi153 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713983 2018-06-27 16:37:29 2018-06-28 01:59:36 2018-06-28 03:01:36 1:02:00 0:08:55 0:53:05 smithi master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2713984 2018-06-27 16:37:31 2018-06-28 01:59:43 2018-06-28 03:37:45 1:38:02 1:13:03 0:24:59 smithi master centos rados/upgrade/{hammer-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{ec-rados-plugin=jerasure-k=3-m=1.yaml rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml test_cache-pool-snaps.yaml}} rados.yaml} 3
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 45 --op write 45 --op delete 10 --pool unique_pool_0'

fail 2713985 2018-06-27 16:37:32 2018-06-28 01:59:46 2018-06-28 02:33:45 0:33:59 0:16:21 0:17:38 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi149 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713986 2018-06-27 16:37:34 2018-06-28 02:01:52 2018-06-28 02:37:51 0:35:59 0:22:14 0:13:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool base'

fail 2713987 2018-06-27 16:37:35 2018-06-28 02:03:53 2018-06-28 02:27:51 0:23:58 0:14:50 0:09:08 smithi master rados/singleton/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi181 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713988 2018-06-27 16:37:37 2018-06-28 02:03:54 2018-06-28 02:31:51 0:27:57 0:16:04 0:11:53 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713989 2018-06-27 16:37:39 2018-06-28 02:03:55 2018-06-28 02:35:52 0:31:57 0:14:58 0:16:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi072 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713990 2018-06-27 16:37:41 2018-06-28 02:03:54 2018-06-28 02:33:52 0:29:58 0:18:36 0:11:22 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2713991 2018-06-27 16:37:43 2018-06-28 02:03:55 2018-06-28 03:13:53 1:09:58 0:10:00 0:59:58 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2713992 2018-06-27 16:37:45 2018-06-28 02:03:54 2018-06-28 02:33:52 0:29:58 0:16:05 0:13:53 smithi master rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
Failure Reason:

Command failed on smithi150 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713993 2018-06-27 16:37:47 2018-06-28 02:03:54 2018-06-28 02:19:51 0:15:57 0:07:38 0:08:19 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2713994 2018-06-27 16:37:50 2018-06-28 02:03:54 2018-06-28 02:31:51 0:27:57 0:17:10 0:10:47 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
pass 2713995 2018-06-27 16:37:51 2018-06-28 02:03:57 2018-06-28 02:21:55 0:17:58 0:06:42 0:11:16 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
fail 2713996 2018-06-27 16:37:53 2018-06-28 02:16:09 2018-06-28 02:42:05 0:25:56 0:15:29 0:10:27 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml} 2
Failure Reason:

Command failed on smithi184 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2713997 2018-06-27 16:37:55 2018-06-28 02:16:13 2018-06-28 02:44:07 0:27:54 0:15:22 0:12:32 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi011 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2713998 2018-06-27 16:37:57 2018-06-28 02:16:13 2018-06-28 02:58:09 0:41:56 0:25:52 0:16:04 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
fail 2713999 2018-06-27 16:37:58 2018-06-28 02:16:11 2018-06-28 02:36:06 0:19:55 0:07:05 0:12:50 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi105 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2714000 2018-06-27 16:38:00 2018-06-28 02:16:13 2018-06-28 02:58:08 0:41:55 0:29:11 0:12:44 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 2714001 2018-06-27 16:38:01 2018-06-28 02:16:13 2018-06-28 02:36:09 0:19:56 0:10:17 0:09:39 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
fail 2714002 2018-06-27 16:38:03 2018-06-28 02:16:09 2018-06-28 02:46:07 0:29:58 0:15:48 0:14:10 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
Failure Reason:

"2018-06-28 02:36:09.380860 osd.5 172.21.15.205:6808/11057 64 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.016709 secs" in cluster log

fail 2714003 2018-06-27 16:38:04 2018-06-28 02:16:10 2018-06-28 02:36:05 0:19:55 0:06:59 0:12:56 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi083 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2714004 2018-06-27 16:38:06 2018-06-28 02:16:12 2018-06-28 02:50:08 0:33:56 0:15:57 0:17:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi175 with status 1: 'sudo ceph --cluster ceph osd crush tunables legacy'

fail 2714005 2018-06-27 16:38:07 2018-06-28 02:16:11 2018-06-28 03:02:06 0:45:55 0:28:42 0:17:13 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 2714006 2018-06-27 16:38:08 2018-06-28 02:16:06 2018-06-28 02:36:05 0:19:59 0:07:49 0:12:10 smithi master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi202 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714007 2018-06-27 16:38:10 2018-06-28 02:16:10 2018-06-28 02:46:06 0:29:56 0:16:14 0:13:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-28 02:38:16.023242 osd.1 172.21.15.110:6815/13727 17 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.171398 secs" in cluster log

pass 2714008 2018-06-27 16:38:11 2018-06-28 02:16:12 2018-06-28 02:40:08 0:23:56 0:11:57 0:11:59 smithi master centos rados/singleton/{all/ec-lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
pass 2714009 2018-06-27 16:38:12 2018-06-28 02:16:10 2018-06-28 02:30:06 0:13:56 0:04:29 0:09:27 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 2714010 2018-06-27 16:38:13 2018-06-28 02:16:09 2018-06-28 02:38:05 0:21:56 0:10:26 0:11:30 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_python.yaml} 2
fail 2714011 2018-06-27 16:38:15 2018-06-28 02:17:46 2018-06-28 03:01:45 0:43:59 0:15:59 0:28:00 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi117 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714012 2018-06-27 16:38:16 2018-06-28 02:17:47 2018-06-28 02:59:45 0:41:58 0:15:39 0:26:19 smithi master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714013 2018-06-27 16:38:18 2018-06-28 02:17:46 2018-06-28 02:49:45 0:31:59 0:19:43 0:12:16 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-small-objects.yaml} 2
pass 2714014 2018-06-27 16:38:19 2018-06-28 02:17:46 2018-06-28 02:41:45 0:23:59 0:10:09 0:13:50 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2714015 2018-06-27 16:38:21 2018-06-28 02:17:47 2018-06-28 02:47:46 0:29:59 0:15:48 0:14:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi155 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714016 2018-06-27 16:38:23 2018-06-28 02:17:48 2018-06-28 02:43:48 0:26:00 0:14:51 0:11:09 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi063 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714017 2018-06-27 16:38:24 2018-06-28 02:18:03 2018-06-28 02:44:02 0:25:59 0:13:01 0:12:58 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-agent-small.yaml} 2
pass 2714018 2018-06-27 16:38:26 2018-06-28 02:19:46 2018-06-28 02:35:45 0:15:59 0:06:04 0:09:55 smithi master rados/objectstore/filejournal.yaml 1
fail 2714019 2018-06-27 16:38:27 2018-06-28 02:19:46 2018-06-28 02:55:46 0:36:00 0:15:25 0:20:35 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi104 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714020 2018-06-27 16:38:28 2018-06-28 02:19:46 2018-06-28 02:51:45 0:31:59 0:08:30 0:23:29 smithi master rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 3
Failure Reason:

Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2714021 2018-06-27 16:38:30 2018-06-28 02:19:46 2018-06-28 03:07:46 0:48:00 0:28:21 0:19:39 smithi master centos rados/singleton/{all/lost-unfound-delete-upgrade.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi153 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd down 0'

fail 2714022 2018-06-27 16:38:31 2018-06-28 02:19:46 2018-06-28 03:15:47 0:56:01 0:29:34 0:26:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 2714023 2018-06-27 16:38:33 2018-06-28 02:19:52 2018-06-28 02:59:52 0:40:00 0:26:37 0:13:23 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/default.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2714024 2018-06-27 16:38:34 2018-06-28 02:19:55 2018-06-28 02:55:55 0:36:00 0:23:49 0:12:11 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 2714025 2018-06-27 16:38:36 2018-06-28 02:21:53 2018-06-28 02:37:52 0:15:59 0:06:22 0:09:37 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
fail 2714026 2018-06-27 16:38:37 2018-06-28 02:21:53 2018-06-28 02:49:52 0:27:59 0:16:16 0:11:43 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
Failure Reason:

Command failed on smithi089 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714027 2018-06-27 16:38:39 2018-06-28 02:21:53 2018-06-28 02:53:53 0:32:00 0:21:17 0:10:43 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2714028 2018-06-27 16:38:40 2018-06-28 02:21:55 2018-06-28 02:55:55 0:34:00 0:15:01 0:18:59 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi098 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714029 2018-06-27 16:38:42 2018-06-28 02:21:57 2018-06-28 02:57:57 0:36:00 0:15:25 0:20:35 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi181 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714030 2018-06-27 16:38:43 2018-06-28 02:23:06 2018-06-28 02:59:06 0:36:00 0:17:24 0:18:36 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
fail 2714031 2018-06-27 16:38:44 2018-06-28 02:23:17 2018-06-28 03:13:17 0:50:00 0:28:31 0:21:29 smithi master centos rados/singleton/{all/lost-unfound-upgrade.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi049 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd down 0'

fail 2714032 2018-06-27 16:38:45 2018-06-28 02:23:41 2018-06-28 02:55:40 0:31:59 0:15:19 0:16:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi061 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714033 2018-06-27 16:38:47 2018-06-28 02:23:55 2018-06-28 02:57:55 0:34:00 0:18:33 0:15:27 smithi master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-06-28 02:47:11.129747 osd.1 172.21.15.86:6804/11326 16 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.211128 secs" in cluster log

pass 2714034 2018-06-27 16:38:48 2018-06-28 02:25:50 2018-06-28 06:21:54 3:56:04 3:47:16 0:08:48 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 2714035 2018-06-27 16:38:50 2018-06-28 02:28:12 2018-06-28 03:10:11 0:41:59 0:25:49 0:16:10 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
pass 2714036 2018-06-27 16:38:51 2018-06-28 02:28:12 2018-06-28 02:58:11 0:29:59 0:08:39 0:21:20 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2714037 2018-06-27 16:38:52 2018-06-28 02:29:45 2018-06-28 02:53:44 0:23:59 0:08:51 0:15:08 smithi master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2714038 2018-06-27 16:38:54 2018-06-28 02:29:46 2018-06-28 02:53:46 0:24:00 0:08:47 0:15:13 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714039 2018-06-27 16:38:55 2018-06-28 02:29:48 2018-06-28 02:47:47 0:17:59 0:07:33 0:10:26 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi027 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2714040 2018-06-27 16:38:56 2018-06-28 02:29:56 2018-06-28 02:59:56 0:30:00 0:15:50 0:14:10 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
Failure Reason:

"2018-06-28 02:50:38.705731 osd.0 172.21.15.201:6800/11116 64 : cluster [WRN] 4 slow requests, 4 included below; oldest blocked for > 30.176142 secs" in cluster log

fail 2714041 2018-06-27 16:38:57 2018-06-28 02:30:07 2018-06-28 02:48:06 0:17:59 0:08:02 0:09:57 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2018-06-28 02:44:08.759820 osd.1 172.21.15.161:6800/11072 2 : cluster [WRN] 16 slow requests, 5 included below; oldest blocked for > 30.623976 secs" in cluster log

fail 2714042 2018-06-27 16:38:59 2018-06-28 02:32:01 2018-06-28 03:05:58 0:33:57 0:15:14 0:18:43 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

Command failed on smithi187 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714043 2018-06-27 16:39:01 2018-06-28 02:32:01 2018-06-28 03:07:59 0:35:58 0:16:02 0:19:56 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi039 with status 1: 'sudo ceph --cluster ceph osd crush tunables legacy'

pass 2714044 2018-06-27 16:39:02 2018-06-28 02:32:00 2018-06-28 02:53:58 0:21:58 0:11:47 0:10:11 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2714045 2018-06-27 16:39:03 2018-06-28 02:32:01 2018-06-28 02:59:59 0:27:58 0:15:56 0:12:02 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi148 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714046 2018-06-27 16:39:05 2018-06-28 02:32:01 2018-06-28 03:01:59 0:29:58 0:14:04 0:15:54 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-06-28 02:56:20.712523 osd.1 172.21.15.77:6804/11120 42 : cluster [WRN] 13 slow requests, 5 included below; oldest blocked for > 30.205166 secs" in cluster log

fail 2714047 2018-06-27 16:39:06 2018-06-28 02:34:00 2018-06-28 02:57:58 0:23:58 0:08:30 0:15:28 smithi master rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
Failure Reason:

Command failed on smithi062 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714048 2018-06-27 16:39:07 2018-06-28 02:34:00 2018-06-28 02:59:58 0:25:58 0:15:09 0:10:49 smithi master rados/singleton/{all/mon-thrasher.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi092 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714049 2018-06-27 16:39:08 2018-06-28 02:34:00 2018-06-28 03:01:59 0:27:59 0:15:15 0:12:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi024 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714050 2018-06-27 16:39:10 2018-06-28 02:34:00 2018-06-28 02:57:59 0:23:59 0:11:31 0:12:28 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

fail 2714051 2018-06-27 16:39:10 2018-06-28 02:34:00 2018-06-28 03:05:59 0:31:59 0:19:25 0:12:34 smithi master rados/verify/{1thrash/none.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

dead 2714052 2018-06-27 16:39:12 2018-06-28 02:34:00 2018-06-28 14:36:33 12:02:33 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 2714053 2018-06-27 16:39:13 2018-06-28 02:34:01 2018-06-28 06:30:03 3:56:02 3:46:28 0:09:34 smithi master rados/objectstore/filestore-idempotent.yaml 1
pass 2714054 2018-06-27 16:39:14 2018-06-28 02:35:54 2018-06-28 02:59:53 0:23:59 0:11:20 0:12:39 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
fail 2714055 2018-06-27 16:39:15 2018-06-28 02:35:54 2018-06-28 03:19:54 0:44:00 0:27:39 0:16:21 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 2714056 2018-06-27 16:39:17 2018-06-28 02:35:54 2018-06-28 03:01:53 0:25:59 0:09:03 0:16:56 smithi master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-hammer.yaml rados.yaml} 1
pass 2714057 2018-06-27 16:39:18 2018-06-28 02:35:54 2018-06-28 03:11:53 0:35:59 0:17:06 0:18:53 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
fail 2714058 2018-06-27 16:39:20 2018-06-28 02:36:06 2018-06-28 03:22:06 0:46:00 0:15:43 0:30:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi098 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714059 2018-06-27 16:39:21 2018-06-28 02:36:06 2018-06-28 03:28:07 0:52:01 0:28:18 0:23:43 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

"2018-06-28 03:17:25.881301 osd.0 172.21.15.89:6808/11124 53 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.012760 secs" in cluster log

pass 2714060 2018-06-27 16:39:22 2018-06-28 02:36:07 2018-06-28 03:02:07 0:26:00 0:09:11 0:16:49 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2714061 2018-06-27 16:39:24 2018-06-28 02:36:10 2018-06-28 02:58:09 0:21:59 0:07:50 0:14:09 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi158 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2714062 2018-06-27 16:39:25 2018-06-28 02:37:33 2018-06-28 02:59:32 0:21:59 0:09:55 0:12:04 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2714063 2018-06-27 16:39:27 2018-06-28 02:37:33 2018-06-28 03:17:33 0:40:00 0:26:34 0:13:26 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
fail 2714064 2018-06-27 16:39:28 2018-06-28 02:37:53 2018-06-28 03:07:52 0:29:59 0:15:29 0:14:30 smithi master rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Command failed on smithi184 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714065 2018-06-27 16:39:29 2018-06-28 02:37:53 2018-06-28 03:11:53 0:34:00 0:15:37 0:18:23 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi066 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714066 2018-06-27 16:39:31 2018-06-28 02:38:06 2018-06-28 03:06:06 0:28:00 0:14:45 0:13:15 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi109 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714067 2018-06-27 16:39:32 2018-06-28 02:39:18 2018-06-28 02:59:17 0:19:59 0:07:43 0:12:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi168 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3'

fail 2714068 2018-06-27 16:39:33 2018-06-28 02:39:38 2018-06-28 03:09:37 0:29:59 0:19:47 0:10:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

"2018-06-28 02:58:05.641625 osd.5 172.21.15.57:6800/11012 43 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.204292 secs" in cluster log

pass 2714069 2018-06-27 16:39:35 2018-06-28 02:39:52 2018-06-28 03:01:51 0:21:59 0:09:25 0:12:34 smithi master ubuntu 14.04 rados/singleton-nomsgr/{all/lfn-upgrade-infernalis.yaml rados.yaml} 1
fail 2714070 2018-06-27 16:39:36 2018-06-28 02:40:10 2018-06-28 03:08:09 0:27:59 0:15:30 0:12:29 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

Command failed on smithi190 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714071 2018-06-27 16:39:37 2018-06-28 02:41:42 2018-06-28 02:57:41 0:15:59 0:04:52 0:11:07 smithi master rados/objectstore/fusestore.yaml 1
fail 2714072 2018-06-27 16:39:39 2018-06-28 02:41:43 2018-06-28 02:59:42 0:17:59 0:07:03 0:10:56 smithi master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi011 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714073 2018-06-27 16:39:40 2018-06-28 02:41:46 2018-06-28 03:09:46 0:28:00 0:15:35 0:12:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi046 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714074 2018-06-27 16:39:42 2018-06-28 02:41:57 2018-06-28 03:27:57 0:46:00 0:29:41 0:16:19 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 2714075 2018-06-27 16:39:43 2018-06-28 02:42:06 2018-06-28 03:22:06 0:40:00 0:26:35 0:13:25 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml supported/centos_latest.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
fail 2714076 2018-06-27 16:39:44 2018-06-28 02:44:07 2018-06-28 03:14:06 0:29:59 0:18:44 0:11:15 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
Failure Reason:

"2018-06-28 03:05:10.322865 osd.5 172.21.15.3:6812/12437 111 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.701348 secs" in cluster log

pass 2714077 2018-06-27 16:39:46 2018-06-28 02:44:07 2018-06-28 03:02:06 0:17:59 0:06:03 0:11:56 smithi master rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 1
pass 2714078 2018-06-27 16:39:47 2018-06-28 02:44:07 2018-06-28 03:02:06 0:17:59 0:06:08 0:11:51 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2714079 2018-06-27 16:39:49 2018-06-28 02:44:09 2018-06-28 03:18:08 0:33:59 0:22:34 0:11:25 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/ec-radosbench.yaml} 2
pass 2714080 2018-06-27 16:39:50 2018-06-28 02:46:04 2018-06-28 03:18:04 0:32:00 0:12:11 0:19:49 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
fail 2714081 2018-06-27 16:39:51 2018-06-28 02:46:05 2018-06-28 03:14:04 0:27:59 0:15:07 0:12:52 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

Command failed on smithi175 with status 1: 'sudo ceph --cluster ceph osd crush tunables legacy'

fail 2714082 2018-06-27 16:39:52 2018-06-28 02:46:08 2018-06-28 03:32:08 0:46:00 0:26:30 0:19:30 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 2714083 2018-06-27 16:39:53 2018-06-28 02:46:08 2018-06-28 03:04:07 0:17:59 0:06:49 0:11:10 smithi master rados/singleton/{all/radostool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi161 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2714084 2018-06-27 16:39:54 2018-06-28 02:47:59 2018-06-28 03:11:58 0:23:59 0:11:36 0:12:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2714085 2018-06-27 16:39:56 2018-06-28 02:47:59 2018-06-28 03:19:59 0:32:00 0:24:03 0:07:57 smithi master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
fail 2714086 2018-06-27 16:39:58 2018-06-28 02:48:00 2018-06-28 03:15:59 0:27:59 0:08:59 0:19:00 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/repair_test.yaml} 2
Failure Reason:

Command failed on smithi093 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5'

fail 2714087 2018-06-27 16:40:00 2018-06-28 02:47:59 2018-06-28 03:17:58 0:29:59 0:15:34 0:14:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

Command failed on smithi037 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714088 2018-06-27 16:40:02 2018-06-28 02:48:08 2018-06-28 03:10:07 0:21:59 0:08:03 0:13:56 smithi master rados/verify/{1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi097 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714089 2018-06-27 16:40:04 2018-06-28 02:49:57 2018-06-28 03:07:56 0:17:59 0:06:42 0:11:17 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi125 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 2714090 2018-06-27 16:40:05 2018-06-28 02:49:57 2018-06-28 03:11:56 0:21:59 0:08:04 0:13:55 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command failed on smithi069 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 2714091 2018-06-27 16:40:07 2018-06-28 02:50:09 2018-06-28 03:16:08 0:25:59 0:08:53 0:17:06 smithi master rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi133 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3'

pass 2714092 2018-06-27 16:40:09 2018-06-28 02:52:06 2018-06-28 03:08:04 0:15:58 0:05:15 0:10:43 smithi master rados/objectstore/keyvaluedb.yaml 1
pass 2714093 2018-06-27 16:40:11 2018-06-28 02:52:06 2018-06-28 03:20:05 0:27:59 0:09:05 0:18:54 smithi master rados/thrash-erasure-code-shec/{clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2714094 2018-06-27 16:40:13 2018-06-28 02:52:06 2018-06-28 03:16:05 0:23:59 0:11:25 0:12:34 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 2714095 2018-06-27 16:40:15 2018-06-28 02:53:51 2018-06-28 03:09:50 0:15:59 0:07:08 0:08:51 smithi master rados/singleton/{all/rest-api.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2714096 2018-06-27 16:40:17 2018-06-28 02:53:51 2018-06-28 03:23:51 0:30:00 0:16:38 0:13:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Command failed on smithi172 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714097 2018-06-27 16:40:19 2018-06-28 02:53:51 2018-06-28 03:25:51 0:32:00 0:15:31 0:16:29 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Command failed on smithi158 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714098 2018-06-27 16:40:20 2018-06-28 02:53:54 2018-06-28 03:37:54 0:44:00 0:31:17 0:12:43 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

"2018-06-28 03:14:49.484236 osd.5 172.21.15.52:6808/11026 13 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.653227 secs" in cluster log

pass 2714099 2018-06-27 16:40:22 2018-06-28 02:53:59 2018-06-28 03:23:59 0:30:00 0:16:34 0:13:26 smithi master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
fail 2714100 2018-06-27 16:40:24 2018-06-28 02:55:58 2018-06-28 03:17:57 0:21:59 0:08:25 0:13:34 smithi master rados/singleton/{all/thrash-rados.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

Command failed on smithi062 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

pass 2714101 2018-06-27 16:40:25 2018-06-28 02:55:59 2018-06-28 03:25:58 0:29:59 0:18:19 0:11:40 smithi master rados/thrash-erasure-code/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2714102 2018-06-27 16:40:27 2018-06-28 02:55:58 2018-06-28 04:03:59 1:08:01 0:09:01 0:59:00 smithi master rados/thrash-erasure-code-big/{cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 2714103 2018-06-27 16:40:29 2018-06-28 02:55:59 2018-06-28 03:35:58 0:39:59 0:27:32 0:12:27 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_14.04.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2714104 2018-06-27 16:40:30 2018-06-28 02:57:56 2018-06-28 03:19:55 0:21:59 0:10:50 0:11:09 smithi master rados/basic/{clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/scrub_test.yaml} 2
fail 2714105 2018-06-27 16:40:32 2018-06-28 02:57:57 2018-06-28 03:23:56 0:25:59 0:15:19 0:10:40 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/cache.yaml} 2
Failure Reason:

Command failed on smithi143 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714106 2018-06-27 16:40:39 2018-06-28 02:57:59 2018-06-28 03:37:58 0:39:59 0:27:33 0:12:26 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 2714107 2018-06-27 16:40:40 2018-06-28 02:58:00 2018-06-28 03:25:59 0:27:59 0:15:24 0:12:35 smithi master rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml} 2
Failure Reason:

Command failed on smithi201 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

fail 2714108 2018-06-27 16:40:42 2018-06-28 02:58:00 2018-06-28 03:36:00 0:38:00 0:26:04 0:11:56 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 2
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

pass 2714109 2018-06-27 16:40:44 2018-06-28 02:58:10 2018-06-28 03:28:09 0:29:59 0:18:58 0:11:01 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
pass 2714110 2018-06-27 16:40:46 2018-06-28 02:58:11 2018-06-28 03:24:10 0:25:59 0:15:28 0:10:31 smithi master rados/objectstore/objectcacher-stress.yaml 1
fail 2714111 2018-06-27 16:40:47 2018-06-28 02:58:11 2018-06-28 03:26:10 0:27:59 0:15:42 0:12:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

Command failed on smithi092 with status 1: 'sudo ceph --cluster ceph osd crush tunables default'

pass 2714112 2018-06-27 16:40:49 2018-06-28 02:58:13 2018-06-28 03:14:12 0:15:59 0:06:53 0:09:06 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2714113 2018-06-27 16:40:51 2018-06-28 02:59:21 2018-06-28 03:25:20 0:25:59 0:16:06 0:09:53 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} hobj-sort.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
Failure Reason:

Command failed on smithi148 with status 1: 'sudo ceph --cluster ceph osd crush tunables optimal'