| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| nojha | 2019-12-14 10:35:49 | 2019-12-14 10:36:39 | 2019-12-15 00:25:30 | 13:48:51 | rados | wip-43308 | smithi | bd5b94a | 9 | 125 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| dead | 4603024 |
|
2019-12-14 10:36:07 | 2019-12-14 10:36:39 | 2019-12-14 22:39:02 | 12:02:23 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | ||
| pass | 4603025 |
|
2019-12-14 10:36:07 | 2019-12-14 10:36:50 | 2019-12-14 10:56:50 | 0:20:00 | 0:06:41 | 0:13:19 | smithi | master | ubuntu | 18.04 | rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} | 3 |
| fail | 4603026 |
|
2019-12-14 10:36:08 | 2019-12-14 10:39:35 | 2019-12-14 11:27:35 | 0:48:00 | 0:31:15 | 0:16:45 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_stress_watch.yaml} | 2 |
Failure Reason:
"2019-12-14T11:03:18.799288+0000 mon.b (mon.0) 285 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603027 |
|
2019-12-14 10:36:09 | 2019-12-14 10:43:17 | 2019-12-14 11:21:17 | 0:38:00 | 0:24:58 | 0:13:02 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 |
Failure Reason:
"2019-12-14T11:06:13.283453+0000 mon.b (mon.0) 228 : cluster [WRN] Health check failed: 5 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603028 |
|
2019-12-14 10:36:10 | 2019-12-14 10:43:21 | 2019-12-14 11:07:20 | 0:23:59 | 0:16:21 | 0:07:38 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_write.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603029 |
|
2019-12-14 10:36:11 | 2019-12-14 10:46:49 | 2019-12-14 11:20:48 | 0:33:59 | 0:24:17 | 0:09:42 | smithi | master | ubuntu | 18.04 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:06:21.843019+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603030 |
|
2019-12-14 10:36:12 | 2019-12-14 10:48:23 | 2019-12-14 11:00:22 | 0:11:59 | 0:05:26 | 0:06:33 | smithi | master | ubuntu | 18.04 | rados/ssh/{fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} | 2 |
Failure Reason:
__init__() got an unexpected keyword argument 'use_ceph_daemon' |
||||||||||||||
| fail | 4603031 |
|
2019-12-14 10:36:13 | 2019-12-14 10:48:40 | 2019-12-14 12:02:40 | 1:14:00 | 1:04:33 | 0:09:27 | smithi | master | centos | rados/singleton-flat/valgrind-leaks.yaml | 1 | |
Failure Reason:
"2019-12-14T11:33:51.183156+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603032 |
|
2019-12-14 10:36:13 | 2019-12-14 10:48:54 | 2019-12-14 11:20:53 | 0:31:59 | 0:24:10 | 0:07:49 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T10:58:20.727818+0000 mon.a (mon.0) 66 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603033 |
|
2019-12-14 10:36:14 | 2019-12-14 10:49:54 | 2019-12-14 14:09:57 | 3:20:03 | 3:13:31 | 0:06:32 | smithi | master | rhel | 7.7 | rados/standalone/{supported-random-distro$/{rhel_7.yaml} workloads/crush.yaml} | 1 |
Failure Reason:
Command failed (workunit test crush/crush-classes.sh) on smithi202 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd5b94a874de7e7c16190a45d8ed7011095a2a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh' |
||||||||||||||
| fail | 4603034 |
|
2019-12-14 10:36:15 | 2019-12-14 10:51:24 | 2019-12-14 11:59:24 | 1:08:00 | 0:53:05 | 0:14:55 | smithi | master | ubuntu | 18.04 | rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashosds-health.yaml} | 4 |
Failure Reason:
failed to become clean before timeout expired |
||||||||||||||
| fail | 4603035 |
|
2019-12-14 10:36:16 | 2019-12-14 10:51:26 | 2019-12-14 11:47:26 | 0:56:00 | 0:47:53 | 0:08:07 | smithi | master | rhel | 7.7 | rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:13:56.504696+0000 mon.a (mon.0) 124 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603036 |
|
2019-12-14 10:36:17 | 2019-12-14 10:51:31 | 2019-12-14 11:27:31 | 0:36:00 | 0:25:02 | 0:10:58 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 |
Failure Reason:
"2019-12-14T11:11:58.868116+0000 mon.b (mon.0) 258 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603037 |
|
2019-12-14 10:36:17 | 2019-12-14 10:51:42 | 2019-12-14 11:15:42 | 0:24:00 | 0:10:29 | 0:13:31 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_omap_write.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603038 |
|
2019-12-14 10:36:18 | 2019-12-14 10:53:12 | 2019-12-14 11:35:11 | 0:41:59 | 0:31:26 | 0:10:33 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_striper.yaml} | 2 |
Failure Reason:
"2019-12-14T11:13:12.994014+0000 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603039 |
|
2019-12-14 10:36:19 | 2019-12-14 10:53:12 | 2019-12-14 11:29:11 | 0:35:59 | 0:24:19 | 0:11:40 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:15:21.344764+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603040 |
|
2019-12-14 10:36:20 | 2019-12-14 10:56:52 | 2019-12-14 11:38:51 | 0:41:59 | 0:31:35 | 0:10:24 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 |
Failure Reason:
"2019-12-14T11:22:41.323700+0000 mon.a (mon.0) 612 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603041 |
|
2019-12-14 10:36:21 | 2019-12-14 10:57:02 | 2019-12-14 11:31:02 | 0:34:00 | 0:25:04 | 0:08:56 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} | 2 | ||
Failure Reason:
"2019-12-14T11:16:30.583399+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603042 |
|
2019-12-14 10:36:22 | 2019-12-14 10:57:05 | 2019-12-14 11:21:04 | 0:23:59 | 0:16:54 | 0:07:05 | smithi | master | rhel | 7.7 | rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} tasks/prometheus.yaml} | 2 |
Failure Reason:
"2019-12-14T11:14:15.342994+0000 mon.b (mon.0) 83 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603043 |
|
2019-12-14 10:36:23 | 2019-12-14 10:58:41 | 2019-12-14 11:30:40 | 0:31:59 | 0:24:09 | 0:07:50 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/balancer.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:07:28.120945+0000 mon.a (mon.0) 74 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603044 |
|
2019-12-14 10:36:23 | 2019-12-14 10:59:11 | 2019-12-14 11:39:11 | 0:40:00 | 0:26:29 | 0:13:31 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T11:24:28.797153+0000 mon.b (mon.0) 512 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603045 |
|
2019-12-14 10:36:24 | 2019-12-14 10:59:11 | 2019-12-14 11:39:11 | 0:40:00 | 0:31:19 | 0:08:41 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} | 2 |
Failure Reason:
"2019-12-14T11:16:04.520209+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603046 |
|
2019-12-14 10:36:25 | 2019-12-14 10:59:13 | 2019-12-14 11:19:12 | 0:19:59 | 0:10:28 | 0:09:31 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/sample_fio.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603047 |
|
2019-12-14 10:36:26 | 2019-12-14 11:00:40 | 2019-12-14 11:34:39 | 0:33:59 | 0:25:07 | 0:08:52 | smithi | master | rhel | 7.7 | rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
| fail | 4603048 |
|
2019-12-14 10:36:27 | 2019-12-14 11:01:32 | 2019-12-14 11:41:31 | 0:39:59 | 0:24:58 | 0:15:01 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:16:52.934809+0000 mon.a (mon.0) 74 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603049 |
|
2019-12-14 10:36:28 | 2019-12-14 11:02:25 | 2019-12-14 11:40:24 | 0:37:59 | 0:25:06 | 0:12:53 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 |
Failure Reason:
"2019-12-14T11:23:43.246656+0000 mon.a (mon.0) 232 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603050 |
|
2019-12-14 10:36:29 | 2019-12-14 11:03:02 | 2019-12-14 11:43:02 | 0:40:00 | 0:25:02 | 0:14:58 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_big.yaml} | 2 |
Failure Reason:
"2019-12-14T11:17:55.071299+0000 mon.b (mon.0) 155 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603051 |
|
2019-12-14 10:36:29 | 2019-12-14 11:04:23 | 2019-12-14 14:20:26 | 3:16:03 | 3:06:09 | 0:09:54 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/erasure-code.yaml} | 1 |
Failure Reason:
Command failed (workunit test erasure-code/test-erasure-code-plugins.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd5b94a874de7e7c16190a45d8ed7011095a2a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh' |
||||||||||||||
| fail | 4603052 |
|
2019-12-14 10:36:30 | 2019-12-14 11:04:30 | 2019-12-14 11:26:29 | 0:21:59 | 0:10:31 | 0:11:28 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/sample_radosbench.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603053 |
|
2019-12-14 10:36:31 | 2019-12-14 11:07:39 | 2019-12-14 11:49:38 | 0:41:59 | 0:30:58 | 0:11:01 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 |
Failure Reason:
"2019-12-14T11:32:48.109016+0000 mon.b (mon.0) 229 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603054 |
|
2019-12-14 10:36:32 | 2019-12-14 11:08:13 | 2019-12-14 11:32:12 | 0:23:59 | 0:11:11 | 0:12:48 | smithi | master | ubuntu | 18.04 | rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} | 2 |
Failure Reason:
"2019-12-14T11:24:52.489887+0000 mon.a (mon.0) 123 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 4603055 |
|
2019-12-14 10:36:33 | 2019-12-14 11:08:32 | 2019-12-14 11:26:31 | 0:17:59 | 0:06:09 | 0:11:50 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/ceph-daemon.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
Command failed (workunit test test_ceph_daemon.sh) on smithi190 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd5b94a874de7e7c16190a45d8ed7011095a2a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/test_ceph_daemon.sh' |
||||||||||||||
| fail | 4603056 |
|
2019-12-14 10:36:33 | 2019-12-14 11:09:05 | 2019-12-14 11:51:05 | 0:42:00 | 0:30:15 | 0:11:45 | smithi | master | rhel | 7.7 | rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:29:26.825797+0000 mon.a (mon.0) 80 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603057 |
|
2019-12-14 10:36:34 | 2019-12-14 11:09:05 | 2019-12-14 12:23:06 | 1:14:01 | 0:57:24 | 0:16:37 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} | 2 | |
Failure Reason:
"2019-12-14T11:40:44.818982+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603058 |
|
2019-12-14 10:36:35 | 2019-12-14 11:09:08 | 2019-12-14 11:53:08 | 0:44:00 | 0:31:32 | 0:12:28 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} | 2 |
Failure Reason:
"2019-12-14T11:37:37.866960+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603059 |
|
2019-12-14 10:36:36 | 2019-12-14 11:12:38 | 2019-12-14 12:08:38 | 0:56:00 | 0:32:04 | 0:23:56 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T11:50:37.550181+0000 mon.b (mon.0) 594 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603060 |
|
2019-12-14 10:36:37 | 2019-12-14 11:14:55 | 2019-12-14 11:48:54 | 0:33:59 | 0:25:04 | 0:08:55 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} | 2 |
Failure Reason:
"2019-12-14T11:25:10.265348+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603061 |
|
2019-12-14 10:36:38 | 2019-12-14 11:14:56 | 2019-12-14 11:40:55 | 0:25:59 | 0:16:20 | 0:09:39 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_read_write.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603062 |
|
2019-12-14 10:36:39 | 2019-12-14 11:14:59 | 2019-12-14 11:54:58 | 0:39:59 | 0:30:14 | 0:09:45 | smithi | master | rhel | 7.7 | rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:32:18.595950+0000 mon.a (mon.0) 66 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603063 |
|
2019-12-14 10:36:39 | 2019-12-14 11:15:43 | 2019-12-14 11:49:43 | 0:34:00 | 0:24:17 | 0:09:43 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:25:10.267612+0000 mon.a (mon.0) 90 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603064 |
|
2019-12-14 10:36:40 | 2019-12-14 11:15:52 | 2019-12-14 12:01:52 | 0:46:00 | 0:31:21 | 0:14:39 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} | 2 |
Failure Reason:
"2019-12-14T11:37:57.942721+0000 mon.f (mon.0) 150 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603065 |
|
2019-12-14 10:36:41 | 2019-12-14 11:18:14 | 2019-12-14 12:08:14 | 0:50:00 | 0:41:28 | 0:08:32 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/mon-config.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:28:59.019100+0000 mon.a (mon.0) 76 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 4603066 |
|
2019-12-14 10:36:42 | 2019-12-14 11:19:32 | 2019-12-14 12:01:31 | 0:41:59 | 0:31:08 | 0:10:51 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 |
Failure Reason:
"2019-12-14T11:44:22.831797+0000 mon.a (mon.0) 330 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603067 |
|
2019-12-14 10:36:43 | 2019-12-14 11:21:06 | 2019-12-14 11:53:05 | 0:31:59 | 0:24:17 | 0:07:42 | smithi | master | ubuntu | 18.04 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:39:20.764364+0000 mon.a (mon.0) 104 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603068 |
|
2019-12-14 10:36:44 | 2019-12-14 11:21:06 | 2019-12-14 11:35:05 | 0:13:59 | 0:05:28 | 0:08:31 | smithi | master | ubuntu | 18.04 | rados/ssh/{fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} | 2 |
Failure Reason:
__init__() got an unexpected keyword argument 'use_ceph_daemon' |
||||||||||||||
| fail | 4603069 |
|
2019-12-14 10:36:44 | 2019-12-14 11:21:06 | 2019-12-14 11:47:05 | 0:25:59 | 0:16:23 | 0:09:36 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_write.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| pass | 4603070 |
|
2019-12-14 10:36:45 | 2019-12-14 11:21:18 | 2019-12-14 11:35:17 | 0:13:59 | 0:06:19 | 0:07:40 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
| fail | 4603071 |
|
2019-12-14 10:36:46 | 2019-12-14 11:23:45 | 2019-12-14 12:05:44 | 0:41:59 | 0:31:09 | 0:10:50 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 |
Failure Reason:
"2019-12-14T11:47:56.820933+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603072 |
|
2019-12-14 10:36:47 | 2019-12-14 11:26:35 | 2019-12-14 12:24:35 | 0:58:00 | 0:47:27 | 0:10:33 | smithi | master | rhel | 7.7 | rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:50:08.993265+0000 mon.a (mon.0) 132 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603073 |
|
2019-12-14 10:36:48 | 2019-12-14 11:26:35 | 2019-12-14 11:46:34 | 0:19:59 | 0:10:28 | 0:09:31 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4K_rand_read.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603074 |
|
2019-12-14 10:36:48 | 2019-12-14 11:26:43 | 2019-12-14 12:04:42 | 0:37:59 | 0:25:39 | 0:12:20 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 |
Failure Reason:
"2019-12-14T11:47:48.726617+0000 mon.b (mon.0) 446 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603075 |
|
2019-12-14 10:36:49 | 2019-12-14 11:27:32 | 2019-12-14 12:03:32 | 0:36:00 | 0:25:08 | 0:10:52 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-avl.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} | 2 | ||
Failure Reason:
"2019-12-14T11:47:22.159227+0000 mon.a (mon.0) 217 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603076 |
|
2019-12-14 10:36:50 | 2019-12-14 11:27:55 | 2019-12-14 12:03:55 | 0:36:00 | 0:25:00 | 0:11:00 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 |
Failure Reason:
"2019-12-14T11:47:11.970271+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603077 |
|
2019-12-14 10:36:51 | 2019-12-14 11:29:40 | 2019-12-14 11:49:38 | 0:19:58 | 0:11:20 | 0:08:38 | smithi | master | ubuntu | 18.04 | rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} | 2 |
Failure Reason:
"2019-12-14T11:41:36.713221+0000 mon.a (mon.0) 116 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 4603078 |
|
2019-12-14 10:36:51 | 2019-12-14 11:29:40 | 2019-12-14 12:07:39 | 0:37:59 | 0:30:39 | 0:07:20 | smithi | master | rhel | 7.7 | rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:45:21.862447+0000 mon.a (mon.0) 64 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603079 |
|
2019-12-14 10:36:52 | 2019-12-14 11:31:00 | 2019-12-14 12:20:59 | 0:49:59 | 0:41:21 | 0:08:38 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:40:37.936382+0000 mon.a (mon.0) 75 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 4603080 |
|
2019-12-14 10:36:53 | 2019-12-14 11:31:03 | 2019-12-14 12:09:03 | 0:38:00 | 0:25:03 | 0:12:57 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} | 2 |
Failure Reason:
"2019-12-14T11:53:51.452941+0000 mon.b (mon.0) 257 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603081 |
|
2019-12-14 10:36:54 | 2019-12-14 11:32:30 | 2019-12-14 12:22:29 | 0:49:59 | 0:33:11 | 0:16:48 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T12:03:55.071899+0000 mon.b (mon.0) 623 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603082 |
|
2019-12-14 10:36:55 | 2019-12-14 11:32:30 | 2019-12-14 12:14:29 | 0:41:59 | 0:31:13 | 0:10:46 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 |
Failure Reason:
"2019-12-14T11:57:17.762889+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: 5 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| dead | 4603083 |
|
2019-12-14 10:36:55 | 2019-12-14 11:33:51 | 2019-12-14 23:36:15 | 12:02:24 | 11:52:55 | 0:09:29 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} | 2 |
Failure Reason:
psutil.NoSuchProcess process no longer exists (pid=27639) |
||||||||||||||
| fail | 4603084 |
|
2019-12-14 10:36:56 | 2019-12-14 11:34:41 | 2019-12-14 12:16:41 | 0:42:00 | 0:31:39 | 0:10:21 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 |
Failure Reason:
"2019-12-14T11:59:07.852966+0000 mon.a (mon.0) 279 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603085 |
|
2019-12-14 10:36:57 | 2019-12-14 11:35:23 | 2019-12-14 12:15:22 | 0:39:59 | 0:30:25 | 0:09:34 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:51:54.250985+0000 mon.a (mon.0) 87 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603086 |
|
2019-12-14 10:36:58 | 2019-12-14 11:35:23 | 2019-12-14 12:11:22 | 0:35:59 | 0:25:01 | 0:10:58 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:57:10.019366+0000 mon.a (mon.0) 190 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603087 |
|
2019-12-14 10:36:59 | 2019-12-14 11:35:23 | 2019-12-14 12:03:22 | 0:27:59 | 0:16:29 | 0:11:30 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4M_rand_read.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603088 |
|
2019-12-14 10:36:59 | 2019-12-14 11:35:23 | 2019-12-14 12:05:22 | 0:29:59 | 0:17:46 | 0:12:13 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/repair_test.yaml} | 2 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603089 |
|
2019-12-14 10:37:00 | 2019-12-14 11:37:29 | 2019-12-14 11:59:28 | 0:21:59 | 0:13:04 | 0:08:55 | smithi | master | rhel | 7.7 | rados/standalone/{supported-random-distro$/{rhel_7.yaml} workloads/misc.yaml} | 1 |
Failure Reason:
Command failed (workunit test misc/network-ping.sh) on smithi197 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd5b94a874de7e7c16190a45d8ed7011095a2a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh' |
||||||||||||||
| fail | 4603090 |
|
2019-12-14 10:37:01 | 2019-12-14 11:38:24 | 2019-12-14 12:16:24 | 0:38:00 | 0:30:11 | 0:07:49 | smithi | master | rhel | 7.7 | rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:54:47.652860+0000 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603091 |
|
2019-12-14 10:37:02 | 2019-12-14 11:39:11 | 2019-12-14 12:17:11 | 0:38:00 | 0:24:36 | 0:13:24 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T11:57:36.747491+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603092 |
|
2019-12-14 10:37:02 | 2019-12-14 11:39:12 | 2019-12-14 12:21:12 | 0:42:00 | 0:32:24 | 0:09:36 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 |
Failure Reason:
"2019-12-14T12:03:57.987713+0000 mon.b (mon.0) 448 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603093 |
|
2019-12-14 10:37:03 | 2019-12-14 11:39:12 | 2019-12-14 12:47:12 | 1:08:00 | 0:57:21 | 0:10:39 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} | 2 | |
Failure Reason:
"2019-12-14T12:06:14.071879+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603094 |
|
2019-12-14 10:37:04 | 2019-12-14 11:40:43 | 2019-12-14 12:16:42 | 0:35:59 | 0:25:02 | 0:10:57 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 |
Failure Reason:
"2019-12-14T12:00:39.296229+0000 mon.b (mon.0) 231 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603095 |
|
2019-12-14 10:37:05 | 2019-12-14 11:40:56 | 2019-12-14 12:28:56 | 0:48:00 | 0:31:08 | 0:16:52 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} | 2 |
Failure Reason:
"2019-12-14T12:12:23.305599+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603096 |
|
2019-12-14 10:37:06 | 2019-12-14 11:41:33 | 2019-12-14 12:17:32 | 0:35:59 | 0:24:16 | 0:11:43 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/rebuild-mondb.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:03:46.625989+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603097 |
|
2019-12-14 10:37:06 | 2019-12-14 11:43:04 | 2019-12-14 12:29:03 | 0:45:59 | 0:31:48 | 0:14:11 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} | 2 |
Failure Reason:
"2019-12-14T12:11:35.836905+0000 mon.b (mon.0) 293 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603098 |
|
2019-12-14 10:37:07 | 2019-12-14 11:44:35 | 2019-12-14 12:24:34 | 0:39:59 | 0:30:26 | 0:09:33 | smithi | master | rhel | 7.7 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:08:44.374441+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603099 |
|
2019-12-14 10:37:08 | 2019-12-14 11:46:55 | 2019-12-14 12:00:54 | 0:13:59 | 0:05:22 | 0:08:37 | smithi | master | ubuntu | 18.04 | rados/ssh/{fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} | 2 |
Failure Reason:
__init__() got an unexpected keyword argument 'use_ceph_daemon' |
||||||||||||||
| fail | 4603100 |
|
2019-12-14 10:37:09 | 2019-12-14 11:47:07 | 2019-12-14 12:13:06 | 0:25:59 | 0:17:13 | 0:08:46 | smithi | master | rhel | 7.7 | rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_7.yaml} tasks/dashboard.yaml} | 2 |
Failure Reason:
"2019-12-14T12:06:16.232858+0000 mon.b (mon.0) 140 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 4603101 |
|
2019-12-14 10:37:10 | 2019-12-14 11:47:27 | 2019-12-14 12:39:27 | 0:52:00 | 0:32:17 | 0:19:43 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rgw_snaps.yaml} | 2 |
Failure Reason:
"2019-12-14T12:15:19.711628+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603102 |
|
2019-12-14 10:37:11 | 2019-12-14 11:48:56 | 2019-12-14 12:38:56 | 0:50:00 | 0:32:47 | 0:17:13 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} | 2 |
Failure Reason:
"2019-12-14T12:13:47.920667+0000 mon.f (mon.0) 149 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603103 |
|
2019-12-14 10:37:11 | 2019-12-14 11:49:57 | 2019-12-14 12:23:57 | 0:34:00 | 0:18:42 | 0:15:18 | smithi | master | rhel | 7.7 | rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-avl.yaml supported-random-distro$/{rhel_7.yaml} tasks/insights.yaml} | 2 |
Failure Reason:
"2019-12-14T12:13:40.607807+0000 mon.b (mon.0) 112 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603104 |
|
2019-12-14 10:37:12 | 2019-12-14 11:49:57 | 2019-12-14 12:29:57 | 0:40:00 | 0:24:42 | 0:15:18 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 |
Failure Reason:
"2019-12-14T12:14:47.262377+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4603105 |
|
2019-12-14 10:37:13 | 2019-12-14 11:49:57 | 2019-12-14 12:03:56 | 0:13:59 | 0:06:10 | 0:07:49 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
| fail | 4603106 |
|
2019-12-14 10:37:14 | 2019-12-14 11:51:24 | 2019-12-14 12:27:23 | 0:35:59 | 0:25:23 | 0:10:36 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 |
Failure Reason:
"2019-12-14T12:12:05.698587+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603107 |
|
2019-12-14 10:37:14 | 2019-12-14 11:53:24 | 2019-12-14 12:31:23 | 0:37:59 | 0:30:37 | 0:07:22 | smithi | master | rhel | 7.7 | rados/standalone/{supported-random-distro$/{rhel_7.yaml} workloads/mon.yaml} | 1 |
Failure Reason:
Command failed (workunit test mon/health-mute.sh) on smithi035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd5b94a874de7e7c16190a45d8ed7011095a2a8e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh' |
||||||||||||||
| fail | 4603108 |
|
2019-12-14 10:37:15 | 2019-12-14 11:53:24 | 2019-12-14 12:35:23 | 0:41:59 | 0:32:44 | 0:09:15 | smithi | master | rhel | 7.7 | rados/singleton/{all/test-crash.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
Scrubbing terminated -- not all pgs were active and clean. |
||||||||||||||
| fail | 4603109 |
|
2019-12-14 10:37:16 | 2019-12-14 11:55:16 | 2019-12-14 12:23:15 | 0:27:59 | 0:17:31 | 0:10:28 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4K_rand_read.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603110 |
|
2019-12-14 10:37:17 | 2019-12-14 11:56:00 | 2019-12-14 12:25:59 | 0:29:59 | 0:18:04 | 0:11:55 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/scrub_test.yaml} | 2 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603111 |
|
2019-12-14 10:37:17 | 2019-12-14 11:57:59 | 2019-12-14 12:39:59 | 0:42:00 | 0:31:38 | 0:10:22 | smithi | master | rhel | 7.7 | rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:15:04.131898+0000 mon.a (mon.0) 85 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603112 |
|
2019-12-14 10:37:18 | 2019-12-14 11:59:54 | 2019-12-14 12:49:52 | 0:49:58 | 0:32:17 | 0:17:41 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 |
Failure Reason:
"2019-12-14T12:32:25.827609+0000 mon.a (mon.0) 497 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603113 |
|
2019-12-14 10:37:19 | 2019-12-14 11:59:54 | 2019-12-14 12:35:52 | 0:35:58 | 0:25:05 | 0:10:53 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} | 2 | ||
Failure Reason:
"2019-12-14T12:20:00.118218+0000 mon.a (mon.0) 261 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603114 |
|
2019-12-14 10:37:20 | 2019-12-14 12:01:19 | 2019-12-14 12:43:18 | 0:41:59 | 0:31:57 | 0:10:02 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 |
Failure Reason:
"2019-12-14T12:25:42.070111+0000 mon.b (mon.0) 246 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603115 |
|
2019-12-14 10:37:20 | 2019-12-14 12:01:33 | 2019-12-14 12:21:32 | 0:19:59 | 0:11:14 | 0:08:45 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/module_selftest.yaml} | 2 |
Failure Reason:
"2019-12-14T12:12:39.209647+0000 mon.a (mon.0) 76 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603116 |
|
2019-12-14 10:37:21 | 2019-12-14 12:01:54 | 2019-12-14 12:39:53 | 0:37:59 | 0:26:25 | 0:11:34 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T12:23:02.224805+0000 mon.b (mon.0) 547 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603117 |
|
2019-12-14 10:37:22 | 2019-12-14 12:03:02 | 2019-12-14 12:39:01 | 0:35:59 | 0:24:47 | 0:11:12 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} | 2 |
Failure Reason:
"2019-12-14T12:22:11.931169+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603118 |
|
2019-12-14 10:37:23 | 2019-12-14 12:03:24 | 2019-12-14 12:43:23 | 0:39:59 | 0:31:10 | 0:08:49 | smithi | master | rhel | 7.7 | rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 2 |
Failure Reason:
Scrubbing terminated -- not all pgs were active and clean. |
||||||||||||||
| fail | 4603119 |
|
2019-12-14 10:37:24 | 2019-12-14 12:03:33 | 2019-12-14 12:45:33 | 0:42:00 | 0:31:12 | 0:10:48 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_api_tests.yaml} | 2 |
Failure Reason:
"2019-12-14T12:21:53.305726+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603120 |
|
2019-12-14 10:37:24 | 2019-12-14 12:03:56 | 2019-12-14 12:39:56 | 0:36:00 | 0:25:14 | 0:10:46 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-eio.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 |
Failure Reason:
"2019-12-14T12:23:36.114319+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603121 |
|
2019-12-14 10:37:25 | 2019-12-14 12:03:58 | 2019-12-14 12:23:57 | 0:19:59 | 0:11:12 | 0:08:47 | smithi | master | ubuntu | 18.04 | rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} | 2 |
Failure Reason:
"2019-12-14T12:16:07.087146+0000 mon.a (mon.0) 127 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 4603122 |
|
2019-12-14 10:37:26 | 2019-12-14 12:04:44 | 2019-12-14 12:18:43 | 0:13:59 | 0:06:05 | 0:07:54 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
| pass | 4603123 |
|
2019-12-14 10:37:27 | 2019-12-14 12:05:24 | 2019-12-14 12:25:23 | 0:19:59 | 0:12:31 | 0:07:28 | smithi | master | rhel | 7.7 | rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_clock_with_skews.yaml} | 2 |
| fail | 4603124 |
|
2019-12-14 10:37:27 | 2019-12-14 12:06:02 | 2019-12-14 12:32:01 | 0:25:59 | 0:16:42 | 0:09:17 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_rand_read.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603125 |
|
2019-12-14 10:37:28 | 2019-12-14 12:06:02 | 2019-12-14 12:46:01 | 0:39:59 | 0:32:14 | 0:07:45 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 |
Failure Reason:
"2019-12-14T12:30:25.497576+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603126 |
|
2019-12-14 10:37:29 | 2019-12-14 12:08:00 | 2019-12-14 12:37:59 | 0:29:59 | 0:17:08 | 0:12:51 | smithi | master | rhel | 7.7 | rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} tasks/orchestrator_cli.yaml} | 2 |
Failure Reason:
"2019-12-14T12:29:14.437816+0000 mon.b (mon.0) 112 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603127 |
|
2019-12-14 10:37:30 | 2019-12-14 12:08:15 | 2019-12-14 12:42:14 | 0:33:59 | 0:24:55 | 0:09:04 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 |
Failure Reason:
"2019-12-14T12:18:32.582678+0000 mon.a (mon.0) 194 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603128 |
|
2019-12-14 10:37:30 | 2019-12-14 12:08:40 | 2019-12-14 12:52:39 | 0:43:59 | 0:30:58 | 0:13:01 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 2 |
Failure Reason:
"2019-12-14T12:37:17.209291+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603129 |
|
2019-12-14 10:37:31 | 2019-12-14 12:09:22 | 2019-12-14 12:55:22 | 0:46:00 | 0:25:07 | 0:20:53 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} | 2 |
Failure Reason:
"2019-12-14T12:31:15.988767+0000 mon.a (mon.0) 184 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603130 |
|
2019-12-14 10:37:32 | 2019-12-14 12:11:42 | 2019-12-14 12:37:41 | 0:25:59 | 0:17:04 | 0:08:55 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_seq_read.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603131 |
|
2019-12-14 10:37:33 | 2019-12-14 12:13:27 | 2019-12-14 12:53:26 | 0:39:59 | 0:30:22 | 0:09:37 | smithi | master | rhel | 7.7 | rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:38:04.896660+0000 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603132 |
|
2019-12-14 10:37:33 | 2019-12-14 12:14:52 | 2019-12-14 13:24:52 | 1:10:00 | 0:57:52 | 0:12:08 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} | 2 | |
Failure Reason:
"2019-12-14T12:42:02.906043+0000 mon.b (mon.0) 219 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603133 |
|
2019-12-14 10:37:34 | 2019-12-14 12:14:52 | 2019-12-14 12:32:51 | 0:17:59 | 0:11:14 | 0:06:45 | smithi | master | rhel | 7.7 | rados/ssh/{fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_python.yaml} | 2 |
Failure Reason:
__init__() got an unexpected keyword argument 'use_ceph_daemon' |
||||||||||||||
| dead | 4603134 |
|
2019-12-14 10:37:35 | 2019-12-14 12:15:25 | 2019-12-15 00:17:49 | 12:02:24 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} | 2 | ||
| fail | 4603135 |
|
2019-12-14 10:37:36 | 2019-12-14 12:16:36 | 2019-12-14 12:56:35 | 0:39:59 | 0:26:30 | 0:13:29 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T12:41:02.844395+0000 mon.c (mon.0) 474 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603136 |
|
2019-12-14 10:37:36 | 2019-12-14 12:16:42 | 2019-12-14 12:54:42 | 0:38:00 | 0:30:29 | 0:07:31 | smithi | master | rhel | 7.7 | rados/singleton/{all/admin-socket.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:33:03.467886+0000 mon.a (mon.0) 60 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603137 |
|
2019-12-14 10:37:37 | 2019-12-14 12:16:44 | 2019-12-14 12:54:43 | 0:37:59 | 0:30:15 | 0:07:44 | smithi | master | rhel | 7.7 | rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:32:30.015736+0000 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603138 |
|
2019-12-14 10:37:38 | 2019-12-14 12:17:12 | 2019-12-14 12:49:12 | 0:32:00 | 0:24:19 | 0:07:41 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/osd_stale_reads.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:35:47.825163+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603139 |
|
2019-12-14 10:37:39 | 2019-12-14 12:17:34 | 2019-12-14 12:43:33 | 0:25:59 | 0:16:28 | 0:09:31 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_write.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603140 |
|
2019-12-14 10:37:39 | 2019-12-14 12:17:53 | 2019-12-14 13:01:53 | 0:44:00 | 0:31:36 | 0:12:24 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/one.yaml workloads/rados_mon_osdmap_prune.yaml} | 2 |
Failure Reason:
"2019-12-14T12:39:25.874336+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 4603141 |
|
2019-12-14 10:37:40 | 2019-12-14 12:18:45 | 2019-12-14 12:58:45 | 0:40:00 | 0:30:54 | 0:09:06 | smithi | master | rhel | 7.7 | rados/singleton/{all/deduptool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:35:17.590915+0000 mon.a (mon.0) 87 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| pass | 4603142 |
|
2019-12-14 10:37:41 | 2019-12-14 12:21:22 | 2019-12-14 12:43:21 | 0:21:59 | 0:11:57 | 0:10:02 | smithi | master | ubuntu | 18.04 | rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} | 3 |
| fail | 4603143 |
|
2019-12-14 10:37:42 | 2019-12-14 12:21:22 | 2019-12-14 12:55:21 | 0:33:59 | 0:24:29 | 0:09:30 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
"2019-12-14T12:39:42.867595+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603144 |
|
2019-12-14 10:37:42 | 2019-12-14 12:21:34 | 2019-12-14 12:47:33 | 0:25:59 | 0:17:53 | 0:08:06 | smithi | master | rhel | 7.7 | rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} tasks/dashboard.yaml} | 2 |
Failure Reason:
"2019-12-14T12:40:21.108001+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 4603145 |
|
2019-12-14 10:37:43 | 2019-12-14 12:22:57 | 2019-12-14 13:04:56 | 0:41:59 | 0:31:53 | 0:10:06 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 |
Failure Reason:
"2019-12-14T12:48:05.466031+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| dead | 4603146 |
|
2019-12-14 10:37:44 | 2019-12-14 12:23:07 | 2019-12-15 00:25:30 | 12:02:23 | smithi | master | rhel | 7.7 | rados/standalone/{supported-random-distro$/{rhel_7.yaml} workloads/scrub.yaml} | 1 | ||
| fail | 4603147 |
|
2019-12-14 10:37:45 | 2019-12-14 12:23:17 | 2019-12-14 12:59:16 | 0:35:59 | 0:25:05 | 0:10:54 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-12-14T12:44:36.045603+0000 mon.a (mon.0) 226 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603148 |
|
2019-12-14 10:37:46 | 2019-12-14 12:24:16 | 2019-12-14 13:14:16 | 0:50:00 | 0:41:08 | 0:08:52 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
Failure Reason:
Scrubbing terminated -- not all pgs were active and clean. |
||||||||||||||
| fail | 4603149 |
|
2019-12-14 10:37:46 | 2019-12-14 12:24:16 | 2019-12-14 13:08:16 | 0:44:00 | 0:32:30 | 0:11:30 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 |
Failure Reason:
"2019-12-14T12:52:52.658155+0000 mon.a (mon.0) 283 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603150 |
|
2019-12-14 10:37:47 | 2019-12-14 12:24:36 | 2019-12-14 13:18:36 | 0:54:00 | 0:33:09 | 0:20:51 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 |
Failure Reason:
"2019-12-14T13:03:04.433150+0000 mon.b (mon.0) 503 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603151 |
|
2019-12-14 10:37:48 | 2019-12-14 12:24:37 | 2019-12-14 13:12:37 | 0:48:00 | 0:25:11 | 0:22:49 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} | 2 | ||
Failure Reason:
"2019-12-14T12:58:46.440631+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603152 |
|
2019-12-14 10:37:49 | 2019-12-14 12:25:44 | 2019-12-14 13:01:43 | 0:35:59 | 0:24:54 | 0:11:05 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_stress_watch.yaml} | 2 |
Failure Reason:
"2019-12-14T12:37:31.221327+0000 mon.b (mon.0) 237 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| pass | 4603153 |
|
2019-12-14 10:37:49 | 2019-12-14 12:26:00 | 2019-12-14 16:44:05 | 4:18:05 | 4:06:50 | 0:11:15 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
| fail | 4603154 |
|
2019-12-14 10:37:50 | 2019-12-14 12:27:46 | 2019-12-14 13:09:45 | 0:41:59 | 0:32:10 | 0:09:49 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} | 2 |
Failure Reason:
"2019-12-14T12:52:58.607302+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603155 |
|
2019-12-14 10:37:51 | 2019-12-14 12:28:26 | 2019-12-14 13:14:26 | 0:46:00 | 0:34:05 | 0:11:55 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 |
Failure Reason:
"2019-12-14T12:57:57.681090+0000 mon.b (mon.0) 757 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603156 |
|
2019-12-14 10:37:52 | 2019-12-14 12:29:15 | 2019-12-14 12:47:14 | 0:17:59 | 0:10:34 | 0:07:25 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/sample_fio.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 4603157 |
|
2019-12-14 10:37:52 | 2019-12-14 12:29:15 | 2019-12-14 13:05:15 | 0:36:00 | 0:25:12 | 0:10:48 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 |
Failure Reason:
"2019-12-14T12:49:24.297760+0000 mon.b (mon.0) 237 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4603158 |
|
2019-12-14 10:37:53 | 2019-12-14 12:29:59 | 2019-12-14 13:21:59 | 0:52:00 | 0:31:42 | 0:20:18 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} | 2 |
Failure Reason:
"2019-12-14T12:59:19.168178+0000 mon.b (mon.0) 156 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| pass | 4603159 |
|
2019-12-14 10:37:54 | 2019-12-14 12:31:43 | 2019-12-14 12:43:42 | 0:11:59 | 0:06:06 | 0:05:53 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 |
| fail | 4603160 |
|
2019-12-14 10:37:55 | 2019-12-14 12:31:43 | 2019-12-14 12:59:43 | 0:28:00 | 0:18:00 | 0:10:00 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/sample_radosbench.yaml} | 1 |
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| pass | 4603161 |
|
2019-12-14 10:37:55 | 2019-12-14 12:32:03 | 2019-12-14 13:00:02 | 0:27:59 | 0:14:29 | 0:13:30 | smithi | master | rhel | 7.7 | rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_clock_no_skews.yaml} | 3 |
Pulpito