Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 3612072 2019-02-19 07:38:14 2019-02-19 07:38:44 2019-02-19 08:22:44 0:44:00 0:30:51 0:13:09 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

Command failed on smithi041 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 3612073 2019-02-19 07:38:15 2019-02-19 07:38:44 2019-02-19 08:20:43 0:41:59 0:27:36 0:14:23 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
dead 3612074 2019-02-19 07:38:16 2019-02-19 07:38:44 2019-02-19 10:24:46 2:46:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/sync.yaml workloads/rados_api_tests.yaml} 2
dead 3612075 2019-02-19 07:38:17 2019-02-19 07:38:44 2019-02-19 10:24:46 2:46:02 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
dead 3612076 2019-02-19 07:38:17 2019-02-19 07:40:43 2019-02-19 10:26:45 2:46:02 2:33:58 0:12:04 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/sync.yaml workloads/rados_5925.yaml} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

dead 3612077 2019-02-19 07:38:18 2019-02-19 07:41:15 2019-02-19 10:25:17 2:44:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
dead 3612078 2019-02-19 07:38:19 2019-02-19 07:42:32 2019-02-19 10:24:34 2:42:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} 2
dead 3612079 2019-02-19 07:38:20 2019-02-19 07:42:32 2019-02-19 10:26:34 2:44:02 2:31:36 0:12:26 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

dead 3612080 2019-02-19 07:38:20 2019-02-19 07:42:32 2019-02-19 10:24:34 2:42:02 smithi master rhel 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/sync.yaml workloads/snaps-few-objects.yaml} 2
fail 3612081 2019-02-19 07:38:21 2019-02-19 07:42:39 2019-02-19 08:14:38 0:31:59 0:21:56 0:10:03 smithi master rhel 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/force-sync-many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

Command failed on smithi105 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel'

fail 3612082 2019-02-19 07:38:22 2019-02-19 07:44:37 2019-02-19 08:32:37 0:48:00 0:30:57 0:17:03 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612083 2019-02-19 07:38:23 2019-02-19 07:44:38 2019-02-19 10:24:39 2:40:01 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} 2
dead 3612084 2019-02-19 07:38:23 2019-02-19 07:44:50 2019-02-19 10:24:52 2:40:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} 2
dead 3612085 2019-02-19 07:38:24 2019-02-19 07:46:36 2019-02-19 10:24:38 2:38:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} 2
fail 3612086 2019-02-19 07:38:25 2019-02-19 07:46:36 2019-02-19 08:44:36 0:58:00 0:46:08 0:11:52 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

Command failed on smithi175 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

fail 3612087 2019-02-19 07:38:26 2019-02-19 07:48:41 2019-02-19 08:42:41 0:54:00 0:37:31 0:16:29 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
Failure Reason:

Command failed on smithi145 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612088 2019-02-19 07:38:27 2019-02-19 07:48:41 2019-02-19 10:24:43 2:36:02 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
dead 3612089 2019-02-19 07:38:27 2019-02-19 07:48:42 2019-02-19 10:24:43 2:36:01 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
dead 3612090 2019-02-19 07:38:28 2019-02-19 07:48:42 2019-02-19 10:24:43 2:36:01 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
fail 3612091 2019-02-19 07:38:29 2019-02-19 07:48:43 2019-02-19 08:38:43 0:50:00 0:42:25 0:07:35 smithi master rhel 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi200 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612092 2019-02-19 07:38:30 2019-02-19 07:50:16 2019-02-19 10:26:18 2:36:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_api_tests.yaml} 2
fail 3612093 2019-02-19 07:38:30 2019-02-19 07:50:27 2019-02-19 08:34:27 0:44:00 0:33:21 0:10:39 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/many.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi051 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612094 2019-02-19 07:38:31 2019-02-19 07:50:29 2019-02-19 10:26:31 2:36:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/rados_api_tests.yaml} 2
fail 3612095 2019-02-19 07:38:32 2019-02-19 07:50:30 2019-02-19 08:34:29 0:43:59 0:34:21 0:09:38 smithi master rhel 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

"2019-02-19 08:20:18.266047 mon.b (mon.1) 68 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 3612096 2019-02-19 07:38:33 2019-02-19 07:50:34 2019-02-19 08:38:33 0:47:59 0:36:54 0:11:05 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/rados_5925.yaml} 2
Failure Reason:

Command failed on smithi053 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612097 2019-02-19 07:38:34 2019-02-19 07:50:38 2019-02-19 10:24:40 2:34:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} 2
fail 3612098 2019-02-19 07:38:35 2019-02-19 07:52:17 2019-02-19 08:32:16 0:39:59 0:26:02 0:13:57 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

"2019-02-19 08:19:14.753291 mon.b (mon.0) 440 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 3612099 2019-02-19 07:38:36 2019-02-19 07:52:22 2019-02-19 08:44:21 0:51:59 0:39:40 0:12:19 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Command failed on smithi060 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

dead 3612100 2019-02-19 07:38:37 2019-02-19 07:52:32 2019-02-19 10:24:34 2:32:02 smithi master ubuntu 16.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} 2
dead 3612101 2019-02-19 07:38:37 2019-02-19 07:54:44 2019-02-19 10:24:46 2:30:02 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
fail 3612102 2019-02-19 07:38:38 2019-02-19 07:55:19 2019-02-19 08:37:19 0:42:00 0:28:12 0:13:48 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
Failure Reason:

Found coredumps on ubuntu@smithi083.front.sepia.ceph.com

dead 3612103 2019-02-19 07:38:39 2019-02-19 07:56:38 2019-02-19 10:24:40 2:28:02 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/many.yaml workloads/rados_api_tests.yaml} 2
dead 3612104 2019-02-19 07:38:40 2019-02-19 07:56:38 2019-02-19 10:24:40 2:28:02 smithi master centos 7.5 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/one.yaml workloads/rados_mon_osdmap_prune.yaml} 2
dead 3612105 2019-02-19 07:38:41 2019-02-19 07:56:38 2019-02-19 10:24:40 2:28:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_api_tests.yaml} 2
dead 3612106 2019-02-19 07:38:41 2019-02-19 07:58:14 2019-02-19 10:26:16 2:28:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} 2
pass 3612107 2019-02-19 07:38:42 2019-02-19 07:58:33 2019-02-19 08:18:32 0:19:59 0:09:06 0:10:53 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_5925.yaml} 2
dead 3612108 2019-02-19 07:38:43 2019-02-19 08:00:23 2019-02-19 10:26:25 2:26:02 smithi master ubuntu 18.04 rados:monthrash/{ceph.yaml clusters/3-mons.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2