Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 2169718 2018-02-08 12:56:27 2018-02-08 12:56:35 2018-02-08 16:32:39 3:36:04 3:22:02 0:14:02 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/many.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi131 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 2169719 2018-02-08 12:56:28 2018-02-08 12:57:56 2018-02-08 13:15:55 0:17:59 0:08:14 0:09:45 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 2169720 2018-02-08 12:56:29 2018-02-08 12:57:56 2018-02-08 13:35:56 0:38:00 0:23:52 0:14:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169721 2018-02-08 12:56:30 2018-02-08 12:59:57 2018-02-08 13:23:59 0:24:02 0:09:20 0:14:42 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_cls_all.yaml} 2
dead 2169722 2018-02-08 12:56:30 2018-02-08 13:01:37 2018-02-08 23:33:51 10:32:14 10:21:26 0:10:48 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op append_excl 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op rmattr 25 --op append 50 --op delete 50 --pool unique_pool_0'

pass 2169723 2018-02-08 12:56:31 2018-02-08 13:01:57 2018-02-08 14:21:57 1:20:00 0:24:15 0:55:45 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 2169724 2018-02-08 12:56:32 2018-02-08 13:01:57 2018-02-08 16:38:05 3:36:08 3:22:23 0:13:45 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi147 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

dead 2169725 2018-02-08 12:56:32 2018-02-08 13:03:51 2018-02-08 23:32:05 10:28:14 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
dead 2169726 2018-02-08 12:56:33 2018-02-08 13:03:51 2018-02-08 23:32:05 10:28:14 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml supported/centos_latest.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2169727 2018-02-08 12:56:34 2018-02-08 13:03:56 2018-02-08 13:31:56 0:28:00 0:11:09 0:16:51 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2169728 2018-02-08 12:56:34 2018-02-08 13:03:57 2018-02-08 13:19:57 0:16:00 0:06:33 0:09:27 smithi master rados/objectstore/alloc-hint.yaml 1
pass 2169729 2018-02-08 12:56:35 2018-02-08 13:05:49 2018-02-08 13:27:48 0:21:59 0:10:29 0:11:30 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/fio_4M_rand_write.yaml} 1
fail 2169730 2018-02-08 12:56:36 2018-02-08 13:05:49 2018-02-08 13:35:48 0:29:59 0:21:18 0:08:41 smithi master rados/rest/mgr-restful.yaml 1
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169731 2018-02-08 12:56:36 2018-02-08 13:05:49 2018-02-08 13:39:48 0:33:59 0:23:09 0:10:50 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2169732 2018-02-08 12:56:37 2018-02-08 13:05:49 2018-02-08 13:39:49 0:34:00 0:23:54 0:10:06 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169733 2018-02-08 12:56:38 2018-02-08 13:07:52 2018-02-08 13:31:51 0:23:59 0:07:35 0:16:24 smithi master rados/standalone/crush.yaml 1
dead 2169734 2018-02-08 12:56:38 2018-02-08 13:07:52 2018-02-08 23:32:05 10:24:13 smithi master rados/upgrade/luminous-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/luminous.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-mimic.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} thrashosds-health.yaml} 3
pass 2169735 2018-02-08 12:56:39 2018-02-08 13:07:52 2018-02-08 13:47:52 0:40:00 0:23:39 0:16:21 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 2169736 2018-02-08 12:56:40 2018-02-08 13:07:52 2018-02-08 13:31:54 0:24:02 0:09:14 0:14:48 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2169737 2018-02-08 12:56:40 2018-02-08 13:07:54 2018-02-08 14:05:55 0:58:01 0:33:38 0:24:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169738 2018-02-08 12:56:41 2018-02-08 13:07:56 2018-02-08 13:59:56 0:52:00 0:25:57 0:26:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169739 2018-02-08 12:56:42 2018-02-08 13:10:07 2018-02-08 14:04:07 0:54:00 0:28:18 0:25:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169740 2018-02-08 12:56:42 2018-02-08 13:11:57 2018-02-08 13:31:57 0:20:00 0:08:25 0:11:35 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 2169741 2018-02-08 12:56:43 2018-02-08 13:11:57 2018-02-08 14:23:58 1:12:01 0:44:58 0:27:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169742 2018-02-08 12:56:44 2018-02-08 13:14:02 2018-02-08 13:36:02 0:22:00 0:11:13 0:10:47 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/module_selftest.yaml} 2
fail 2169743 2018-02-08 12:56:45 2018-02-08 13:15:57 2018-02-08 13:53:57 0:38:00 0:18:12 0:19:48 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

ceph-objectstore-tool: import failure with status -1

pass 2169744 2018-02-08 12:56:45 2018-02-08 13:15:57 2018-02-08 13:45:57 0:30:00 0:11:40 0:18:20 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_python.yaml} 2
pass 2169745 2018-02-08 12:56:46 2018-02-08 13:17:57 2018-02-08 13:59:57 0:42:00 0:25:42 0:16:18 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2169746 2018-02-08 12:56:47 2018-02-08 13:19:56 2018-02-08 13:41:56 0:22:00 0:12:37 0:09:23 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_rand_read.yaml} 1
fail 2169747 2018-02-08 12:56:48 2018-02-08 13:19:58 2018-02-08 14:07:58 0:48:00 0:33:00 0:15:00 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 13:49:00.276700 mon.a mon.0 172.21.15.163:6789/0 324 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 147 sec (SLOW_OPS)" in cluster log

pass 2169748 2018-02-08 12:56:48 2018-02-08 13:21:53 2018-02-08 13:45:52 0:23:59 0:12:36 0:11:23 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
fail 2169749 2018-02-08 12:56:49 2018-02-08 13:21:53 2018-02-08 13:53:52 0:31:59 0:21:23 0:10:36 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 13:37:54.672565 mon.a mon.0 172.21.15.156:6789/0 170 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 2169750 2018-02-08 12:56:50 2018-02-08 13:21:53 2018-02-08 13:47:52 0:25:59 0:11:05 0:14:54 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2169751 2018-02-08 12:56:50 2018-02-08 13:23:54 2018-02-08 14:15:54 0:52:00 0:40:18 0:11:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169752 2018-02-08 12:56:51 2018-02-08 13:23:55 2018-02-08 14:05:55 0:42:00 0:29:36 0:12:24 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169753 2018-02-08 12:56:52 2018-02-08 13:23:55 2018-02-08 13:41:54 0:17:59 0:05:47 0:12:12 smithi master rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
fail 2169754 2018-02-08 12:56:53 2018-02-08 13:24:00 2018-02-08 15:58:04 2:34:04 2:00:43 0:33:21 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169755 2018-02-08 12:56:53 2018-02-08 13:25:47 2018-02-08 13:49:47 0:24:00 0:12:40 0:11:20 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 2169756 2018-02-08 12:56:54 2018-02-08 13:25:47 2018-02-08 13:45:47 0:20:00 0:11:21 0:08:39 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
fail 2169757 2018-02-08 12:56:55 2018-02-08 13:25:47 2018-02-08 14:13:47 0:48:00 0:30:38 0:17:22 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169758 2018-02-08 12:56:55 2018-02-08 13:25:50 2018-02-08 14:21:51 0:56:01 0:24:20 0:31:41 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
fail 2169759 2018-02-08 12:56:56 2018-02-08 13:25:55 2018-02-08 14:19:55 0:54:00 0:42:44 0:11:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169760 2018-02-08 12:56:57 2018-02-08 13:26:00 2018-02-08 13:46:00 0:20:00 0:10:56 0:09:04 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4K_seq_read.yaml} 1
fail 2169761 2018-02-08 12:56:58 2018-02-08 13:26:04 2018-02-08 14:14:04 0:48:00 0:38:27 0:09:33 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 13:51:43.541534 mon.a mon.0 172.21.15.43:6789/0 397 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 31 sec (SLOW_OPS)" in cluster log

pass 2169762 2018-02-08 12:56:58 2018-02-08 13:26:59 2018-02-08 14:19:00 0:52:01 0:14:25 0:37:36 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
fail 2169763 2018-02-08 12:56:59 2018-02-08 13:27:18 2018-02-08 14:19:18 0:52:00 0:24:41 0:27:19 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169764 2018-02-08 12:57:00 2018-02-08 13:27:47 2018-02-08 14:03:47 0:36:00 0:22:54 0:13:06 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

ceph-objectstore-tool: import failure with status -1

fail 2169765 2018-02-08 12:57:01 2018-02-08 13:27:49 2018-02-08 17:27:53 4:00:04 3:22:00 0:38:04 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi145 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 2169766 2018-02-08 12:57:02 2018-02-08 13:27:49 2018-02-08 13:43:49 0:16:00 0:06:33 0:09:27 smithi master rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml} 1
pass 2169767 2018-02-08 12:57:02 2018-02-08 13:28:08 2018-02-08 14:04:08 0:36:00 0:07:24 0:28:36 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
pass 2169768 2018-02-08 12:57:03 2018-02-08 13:28:09 2018-02-08 14:24:09 0:56:00 0:10:03 0:45:57 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
fail 2169769 2018-02-08 12:57:04 2018-02-08 13:29:57 2018-02-08 14:17:57 0:48:00 0:37:48 0:10:12 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 13:55:17.657095 mon.a mon.0 172.21.15.141:6789/0 388 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec (SLOW_OPS)" in cluster log

pass 2169770 2018-02-08 12:57:05 2018-02-08 13:31:55 2018-02-08 14:17:55 0:46:00 0:35:34 0:10:26 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
fail 2169771 2018-02-08 12:57:05 2018-02-08 13:31:55 2018-02-08 14:35:56 1:04:01 0:52:15 0:11:46 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
Failure Reason:

failed to become clean before timeout expired

dead 2169772 2018-02-08 12:57:06 2018-02-08 13:31:55 2018-02-08 23:32:07 10:00:12 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2169773 2018-02-08 12:57:07 2018-02-08 13:31:57 2018-02-08 15:39:59 2:08:02 0:11:08 1:56:54 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2169774 2018-02-08 12:57:07 2018-02-08 13:31:58 2018-02-08 14:05:57 0:33:59 0:24:57 0:09:02 smithi master rados/standalone/erasure-code.yaml 1
fail 2169775 2018-02-08 12:57:08 2018-02-08 13:33:53 2018-02-08 14:09:53 0:36:00 0:24:44 0:11:16 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

dead 2169776 2018-02-08 12:57:09 2018-02-08 13:33:53 2018-02-08 23:32:06 9:58:13 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
fail 2169777 2018-02-08 12:57:09 2018-02-08 13:33:55 2018-02-08 14:13:55 0:40:00 0:26:36 0:13:24 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169778 2018-02-08 12:57:10 2018-02-08 13:35:59 2018-02-08 13:55:58 0:19:59 0:11:28 0:08:31 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_rand_read.yaml} 1
fail 2169779 2018-02-08 12:57:11 2018-02-08 13:35:59 2018-02-08 14:35:59 1:00:00 0:31:43 0:28:17 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169780 2018-02-08 12:57:12 2018-02-08 13:35:59 2018-02-08 13:53:58 0:17:59 0:07:01 0:10:58 smithi master rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
fail 2169781 2018-02-08 12:57:12 2018-02-08 13:35:59 2018-02-08 14:39:59 1:04:00 0:51:33 0:12:27 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169782 2018-02-08 12:57:13 2018-02-08 13:36:03 2018-02-08 13:58:03 0:22:00 0:07:46 0:14:14 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/prometheus.yaml} 2
pass 2169783 2018-02-08 12:57:14 2018-02-08 13:37:58 2018-02-08 14:05:57 0:27:59 0:18:02 0:09:57 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 2169784 2018-02-08 12:57:14 2018-02-08 13:37:59 2018-02-08 13:59:59 0:22:00 0:07:24 0:14:36 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_striper.yaml} 2
dead 2169785 2018-02-08 12:57:15 2018-02-08 13:39:50 2018-02-08 23:32:02 9:52:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 2169786 2018-02-08 12:57:16 2018-02-08 13:39:50 2018-02-08 14:01:50 0:22:00 0:10:58 0:11:02 smithi master rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2169787 2018-02-08 12:57:17 2018-02-08 13:39:50 2018-02-08 13:55:50 0:16:00 0:06:53 0:09:07 smithi master rados/objectstore/filejournal.yaml 1
pass 2169788 2018-02-08 12:57:17 2018-02-08 13:42:08 2018-02-08 14:04:07 0:21:59 0:12:46 0:09:13 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 2169789 2018-02-08 12:57:18 2018-02-08 13:42:08 2018-02-08 13:58:07 0:15:59 0:05:32 0:10:27 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 2169790 2018-02-08 12:57:19 2018-02-08 13:42:08 2018-02-08 14:06:07 0:23:59 0:13:43 0:10:16 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2169791 2018-02-08 12:57:19 2018-02-08 13:42:08 2018-02-08 14:28:08 0:46:00 0:32:35 0:13:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169792 2018-02-08 12:57:20 2018-02-08 13:43:58 2018-02-08 14:29:58 0:46:00 0:27:38 0:18:22 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 2169793 2018-02-08 12:57:21 2018-02-08 13:43:58 2018-02-08 14:01:58 0:18:00 0:09:10 0:08:50 smithi master rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_seq_read.yaml} 1
pass 2169794 2018-02-08 12:57:22 2018-02-08 13:44:01 2018-02-08 14:18:01 0:34:00 0:23:23 0:10:37 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2169795 2018-02-08 12:57:22 2018-02-08 13:44:04 2018-02-08 14:06:03 0:21:59 0:13:08 0:08:51 smithi master rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2169796 2018-02-08 12:57:23 2018-02-08 13:45:57 2018-02-08 14:19:57 0:34:00 0:24:10 0:09:50 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169797 2018-02-08 12:57:24 2018-02-08 13:45:57 2018-02-08 14:43:57 0:58:00 0:45:26 0:12:34 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169798 2018-02-08 12:57:24 2018-02-08 13:45:57 2018-02-08 14:39:57 0:54:00 0:43:48 0:10:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169799 2018-02-08 12:57:25 2018-02-08 13:45:58 2018-02-08 14:31:58 0:46:00 0:31:24 0:14:36 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

ceph-objectstore-tool: import failure with status -1

pass 2169800 2018-02-08 12:57:26 2018-02-08 13:46:01 2018-02-08 14:48:02 1:02:01 0:19:30 0:42:31 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 2169801 2018-02-08 12:57:26 2018-02-08 13:47:50 2018-02-08 14:05:50 0:18:00 0:07:13 0:10:47 smithi master rados/singleton/{all/mon-auth-caps.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml} 1
fail 2169802 2018-02-08 12:57:27 2018-02-08 13:47:51 2018-02-08 14:45:51 0:58:00 0:41:42 0:16:18 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
Failure Reason:

"2018-02-08 14:31:21.989176 mon.a mon.0 172.21.15.70:6789/0 103 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 76 sec (SLOW_OPS)" in cluster log

fail 2169803 2018-02-08 12:57:28 2018-02-08 13:47:53 2018-02-08 14:55:53 1:08:00 0:57:08 0:10:52 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169804 2018-02-08 12:57:29 2018-02-08 13:47:53 2018-02-08 14:45:54 0:58:01 0:32:00 0:26:01 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

Found coredumps on ubuntu@smithi146.front.sepia.ceph.com

fail 2169805 2018-02-08 12:57:29 2018-02-08 13:47:55 2018-02-08 17:29:59 3:42:04 3:23:22 0:18:42 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi026 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 2169806 2018-02-08 12:57:30 2018-02-08 13:47:56 2018-02-08 14:19:56 0:32:00 0:20:39 0:11:21 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 14:03:28.273987 mon.a mon.0 172.21.15.30:6789/0 106 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec (SLOW_OPS)" in cluster log

pass 2169807 2018-02-08 12:57:31 2018-02-08 13:47:57 2018-02-08 14:11:57 0:24:00 0:11:55 0:12:05 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 2169808 2018-02-08 12:57:31 2018-02-08 13:49:56 2018-02-08 14:09:56 0:20:00 0:09:22 0:10:38 smithi master rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml workloads/radosbench_4M_write.yaml} 1
pass 2169809 2018-02-08 12:57:32 2018-02-08 13:52:02 2018-02-08 15:02:03 1:10:01 0:38:31 0:31:30 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
fail 2169810 2018-02-08 12:57:33 2018-02-08 13:52:02 2018-02-08 15:04:03 1:12:01 0:40:02 0:31:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

"2018-02-08 14:27:34.580293 mon.b mon.1 172.21.15.163:6789/0 2 : cluster [WRN] message from mon.0 was stamped 0.824735s in the future, clocks not synchronized" in cluster log

dead 2169811 2018-02-08 12:57:34 2018-02-08 13:52:02 2018-02-08 23:32:20 9:40:18 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
dead 2169812 2018-02-08 12:57:35 2018-02-08 13:54:06 2018-02-08 23:32:20 9:38:14 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported/centos_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 2169813 2018-02-08 12:57:35 2018-02-08 13:54:06 2018-02-08 14:18:06 0:24:00 0:10:34 0:13:26 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
fail 2169814 2018-02-08 12:57:36 2018-02-08 13:54:06 2018-02-08 14:36:06 0:42:00 0:27:36 0:14:24 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169815 2018-02-08 12:57:37 2018-02-08 13:55:53 2018-02-08 14:27:53 0:32:00 0:21:49 0:10:11 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
Failure Reason:

./run_seed_to_range.sh errored out

pass 2169816 2018-02-08 12:57:37 2018-02-08 13:55:53 2018-02-08 14:23:53 0:28:00 0:11:56 0:16:04 smithi master rados/standalone/misc.yaml 1
fail 2169817 2018-02-08 12:57:38 2018-02-08 13:55:53 2018-02-08 14:41:54 0:46:01 0:25:06 0:20:55 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169818 2018-02-08 12:57:39 2018-02-08 13:55:58 2018-02-08 14:13:57 0:17:59 0:07:02 0:10:57 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2169819 2018-02-08 12:57:39 2018-02-08 13:55:59 2018-02-08 14:17:59 0:22:00 0:07:36 0:14:24 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
fail 2169820 2018-02-08 12:57:40 2018-02-08 13:58:00 2018-02-08 20:38:13 6:40:13 6:30:11 0:10:02 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi049 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 2169821 2018-02-08 12:57:41 2018-02-08 13:58:04 2018-02-08 14:26:04 0:28:00 0:06:53 0:21:07 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/workunits.yaml} 2
pass 2169822 2018-02-08 12:57:41 2018-02-08 13:58:09 2018-02-08 14:26:08 0:27:59 0:15:09 0:12:50 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
fail 2169823 2018-02-08 12:57:42 2018-02-08 14:00:11 2018-02-08 14:42:11 0:42:00 0:31:36 0:10:24 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

dead 2169824 2018-02-08 12:57:43 2018-02-08 14:00:11 2018-02-08 23:32:23 9:32:12 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
fail 2169825 2018-02-08 12:57:44 2018-02-08 14:00:11 2018-02-08 14:48:11 0:48:00 0:35:46 0:12:14 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

ceph-objectstore-tool: import failure with status -1

pass 2169826 2018-02-08 12:57:44 2018-02-08 14:01:59 2018-02-08 15:22:01 1:20:02 1:09:28 0:10:34 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
dead 2169827 2018-02-08 12:57:45 2018-02-08 14:01:59 2018-02-08 23:32:17 9:30:18 smithi master rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
pass 2169828 2018-02-08 12:57:46 2018-02-08 14:01:59 2018-02-08 14:21:59 0:20:00 0:12:12 0:07:48 smithi master rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml workloads/sample_fio.yaml} 1
fail 2169829 2018-02-08 12:57:46 2018-02-08 14:02:00 2018-02-08 14:40:00 0:38:00 0:17:32 0:20:28 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
Failure Reason:

"2018-02-08 14:25:19.638757 mon.b mon.1 172.21.15.161:6789/0 2 : cluster [WRN] message from mon.0 was stamped 0.677686s in the future, clocks not synchronized" in cluster log

fail 2169830 2018-02-08 12:57:47 2018-02-08 14:02:00 2018-02-08 14:36:02 0:34:02 0:21:05 0:12:57 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
Failure Reason:

"2018-02-08 14:32:59.222713 mon.a mon.0 172.21.15.175:6789/0 149 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 2169831 2018-02-08 12:57:48 2018-02-08 14:03:57 2018-02-08 14:27:56 0:23:59 0:14:25 0:09:34 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
pass 2169832 2018-02-08 12:57:49 2018-02-08 14:04:08 2018-02-08 14:28:08 0:24:00 0:12:57 0:11:03 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 2169833 2018-02-08 12:57:50 2018-02-08 14:04:08 2018-02-08 15:00:09 0:56:01 0:44:42 0:11:19 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169834 2018-02-08 12:57:50 2018-02-08 14:04:10 2018-02-08 15:46:11 1:42:01 1:33:10 0:08:51 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml} 1
pass 2169835 2018-02-08 12:57:51 2018-02-08 14:06:01 2018-02-08 14:40:02 0:34:01 0:13:34 0:20:27 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
fail 2169836 2018-02-08 12:57:52 2018-02-08 14:06:01 2018-02-08 15:04:02 0:58:01 0:33:07 0:24:54 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

ceph-objectstore-tool: import failure with status -1

fail 2169837 2018-02-08 12:57:52 2018-02-08 14:06:01 2018-02-08 15:50:03 1:44:02 1:15:46 0:28:16 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169838 2018-02-08 12:57:53 2018-02-08 14:06:01 2018-02-08 15:06:03 1:00:02 0:36:24 0:23:38 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
Failure Reason:

"2018-02-08 14:33:55.506382 mon.a mon.0 172.21.15.95:6789/0 13 : cluster [WRN] mon.1 172.21.15.189:6789/0 clock skew 0.523282s > max 0.5s" in cluster log

fail 2169839 2018-02-08 12:57:54 2018-02-08 14:06:01 2018-02-08 15:10:03 1:04:02 0:36:40 0:27:22 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169840 2018-02-08 12:57:54 2018-02-08 14:06:01 2018-02-08 14:42:02 0:36:01 0:26:21 0:09:40 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169841 2018-02-08 12:57:55 2018-02-08 14:06:05 2018-02-08 14:28:04 0:21:59 0:11:30 0:10:29 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/sample_radosbench.yaml} 1
dead 2169842 2018-02-08 12:57:56 2018-02-08 14:06:09 2018-02-08 23:32:23 9:26:14 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
fail 2169843 2018-02-08 12:57:57 2018-02-08 14:08:06 2018-02-08 14:52:06 0:44:00 0:24:51 0:19:09 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169844 2018-02-08 12:57:57 2018-02-08 14:08:06 2018-02-08 21:20:17 7:12:11 7:02:38 0:09:33 smithi master rados/objectstore/filestore-idempotent.yaml 1
pass 2169845 2018-02-08 12:57:58 2018-02-08 14:10:04 2018-02-08 14:52:04 0:42:00 0:26:10 0:15:50 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 2169846 2018-02-08 12:57:59 2018-02-08 14:10:04 2018-02-08 17:52:12 3:42:08 3:24:02 0:18:06 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi023 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-sage-testing-2018-02-07-2035 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 2169847 2018-02-08 12:58:00 2018-02-08 14:11:57 2018-02-08 14:27:56 0:15:59 0:07:23 0:08:36 smithi master rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml} 1
pass 2169848 2018-02-08 12:58:00 2018-02-08 14:11:58 2018-02-08 14:27:57 0:15:59 0:06:57 0:09:02 smithi master rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 2169849 2018-02-08 12:58:01 2018-02-08 14:11:59 2018-02-08 14:59:59 0:48:00 0:37:05 0:10:55 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
fail 2169850 2018-02-08 12:58:02 2018-02-08 14:13:49 2018-02-08 14:49:49 0:36:00 0:24:48 0:11:12 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

fail 2169851 2018-02-08 12:58:02 2018-02-08 14:14:05 2018-02-08 15:22:07 1:08:02 0:49:03 0:18:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169852 2018-02-08 12:58:03 2018-02-08 14:14:05 2018-02-08 14:30:05 0:16:00 0:07:11 0:08:49 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
fail 2169853 2018-02-08 12:58:04 2018-02-08 14:14:08 2018-02-08 15:02:08 0:48:00 0:33:35 0:14:25 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169854 2018-02-08 12:58:05 2018-02-08 14:16:08 2018-02-08 14:50:08 0:34:00 0:09:53 0:24:07 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
dead 2169855 2018-02-08 12:58:06 2018-02-08 14:16:08 2018-02-08 23:34:20 9:18:12 9:06:40 0:11:32 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 0 --op rmattr 25 --op append 100 --op delete 50 --pool unique_pool_0'

pass 2169856 2018-02-08 12:58:06 2018-02-08 14:17:54 2018-02-08 16:23:56 2:06:02 0:10:55 1:55:07 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 2169857 2018-02-08 12:58:07 2018-02-08 14:17:56 2018-02-08 14:39:56 0:22:00 0:07:54 0:14:06 smithi master rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml tasks/dashboard.yaml} 2
pass 2169858 2018-02-08 12:58:08 2018-02-08 14:17:58 2018-02-08 14:37:58 0:20:00 0:11:37 0:08:23 smithi master rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml workloads/fio_4K_rand_read.yaml} 1
fail 2169859 2018-02-08 12:58:09 2018-02-08 14:18:00 2018-02-08 14:51:59 0:33:59 0:23:07 0:10:52 smithi master rados/rest/rest_test.yaml 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 2169860 2018-02-08 12:58:09 2018-02-08 14:18:02 2018-02-08 14:52:02 0:34:00 0:23:40 0:10:20 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 2169861 2018-02-08 12:58:10 2018-02-08 14:18:07 2018-02-08 14:40:06 0:21:59 0:11:44 0:10:15 smithi master rados/standalone/mon.yaml 1
fail 2169862 2018-02-08 12:58:11 2018-02-08 14:19:09 2018-02-08 14:59:09 0:40:00 0:28:00 0:12:00 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.