| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| kchai | 2018-04-24 14:54:28 | 2018-04-24 14:56:12 | 2018-04-25 08:53:30 | 17:57:18 | rados | wip-kefu-testing-2018-04-24-1145 | mira | 01c4f53 | 3 | 111 | 5 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 2434432 |
|
2018-04-24 14:55:51 | 2018-04-24 14:56:06 | 2018-04-24 15:10:05 | 0:13:59 | 0:02:47 | 0:11:12 | mira | master | rhel | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml supported/rhel_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 |
Failure Reason:
{'mira058.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-04-24 15:09:30.590649', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-04-24 15:09:05.570699', 'delta': '0:00:25.019950', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira101.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}} |
||||||||||||||
| dead | 2434433 |
|
2018-04-24 14:55:52 | 2018-04-24 14:56:11 | 2018-04-25 02:58:41 | 12:02:30 | mira | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore.yaml rados.yaml supported/ubuntu_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | ||
| fail | 2434434 |
|
2018-04-24 14:55:53 | 2018-04-24 14:56:11 | 2018-04-24 15:10:10 | 0:13:59 | 0:02:46 | 0:11:13 | mira | master | rhel | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported/rhel_latest.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 |
Failure Reason:
{'mira038.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-04-24 15:09:25.278621', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-04-24 15:09:00.262026', 'delta': '0:00:25.016595', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira084.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}} |
||||||||||||||
| fail | 2434435 |
|
2018-04-24 14:55:53 | 2018-04-24 14:56:10 | 2018-04-24 15:28:10 | 0:32:00 | 0:20:36 | 0:11:24 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:13:21.473466 mgr.y mgr.4103 172.21.6.118:0/12373 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434436 |
|
2018-04-24 14:55:54 | 2018-04-24 14:56:12 | 2018-04-24 16:24:13 | 1:28:01 | 0:24:51 | 1:03:10 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:04:34.688060 mon.b mon.0 172.21.4.108:6789/0 157 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434437 |
|
2018-04-24 14:55:55 | 2018-04-24 14:56:13 | 2018-04-24 16:40:14 | 1:44:01 | 1:06:26 | 0:37:35 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||
Failure Reason:
failed to become clean before timeout expired |
||||||||||||||
| fail | 2434438 |
|
2018-04-24 14:55:56 | 2018-04-24 14:56:12 | 2018-04-24 15:58:12 | 1:02:00 | 0:22:15 | 0:39:45 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:40:02.790969 mon.b mon.0 172.21.7.120:6789/0 97 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434439 |
|
2018-04-24 14:55:57 | 2018-04-24 14:56:13 | 2018-04-24 15:50:13 | 0:54:00 | 0:17:06 | 0:36:54 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:37:54.936433 mon.b mon.0 172.21.4.108:6789/0 148 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434440 |
|
2018-04-24 14:55:58 | 2018-04-24 14:56:13 | 2018-04-24 15:52:13 | 0:56:00 | 0:17:48 | 0:38:12 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:38:19.491864 mon.b mon.0 172.21.3.118:6789/0 172 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434441 |
|
2018-04-24 14:55:58 | 2018-04-24 14:56:10 | 2018-04-24 15:26:10 | 0:30:00 | 0:19:38 | 0:10:22 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:12:12.262508 mgr.x mgr.4106 172.21.9.120:0/12386 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434442 |
|
2018-04-24 14:55:59 | 2018-04-24 14:56:12 | 2018-04-24 15:38:11 | 0:41:59 | 0:17:06 | 0:24:53 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:25:10.756429 mgr.x mgr.4107 172.21.8.118:0/12313 7 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434443 |
|
2018-04-24 14:56:00 | 2018-04-24 14:56:11 | 2018-04-24 16:04:11 | 1:08:00 | 0:56:51 | 0:11:09 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
failed to recover before timeout expired |
||||||||||||||
| fail | 2434444 |
|
2018-04-24 14:56:01 | 2018-04-24 14:56:11 | 2018-04-24 15:24:10 | 0:27:59 | 0:16:37 | 0:11:22 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:11:09.865008 mgr.x mgr.4107 172.21.9.134:0/12247 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434445 |
|
2018-04-24 14:56:01 | 2018-04-24 14:56:13 | 2018-04-24 16:32:13 | 1:36:00 | 0:13:55 | 1:22:05 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:22:13.219769 mgr.x mgr.4099 172.21.8.118:0/12438 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434446 |
|
2018-04-24 14:56:02 | 2018-04-24 14:56:13 | 2018-04-24 16:12:13 | 1:16:00 | 0:12:24 | 1:03:36 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:03:30.051466 mon.a mon.0 172.21.3.104:6789/0 185 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434447 |
|
2018-04-24 14:56:03 | 2018-04-24 14:56:11 | 2018-04-24 15:40:10 | 0:43:59 | 0:33:31 | 0:10:28 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:12:09.703201 mon.a mon.0 172.21.3.116:6789/0 113 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434448 |
|
2018-04-24 14:56:04 | 2018-04-24 14:56:12 | 2018-04-24 15:26:10 | 0:29:58 | 0:18:35 | 0:11:23 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:11:42.905584 mon.b mon.0 172.21.7.120:6789/0 99 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434449 |
|
2018-04-24 14:56:05 | 2018-04-24 14:56:12 | 2018-04-24 15:48:12 | 0:52:00 | 0:15:32 | 0:36:28 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:38:58.180143 mon.a mon.0 172.21.3.104:6789/0 113 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434450 |
|
2018-04-24 14:56:06 | 2018-04-24 14:56:12 | 2018-04-24 16:08:12 | 1:12:00 | 0:20:08 | 0:51:52 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:52:21.716423 mon.a mon.0 172.21.6.134:6789/0 115 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434451 |
|
2018-04-24 14:56:06 | 2018-04-24 14:56:13 | 2018-04-24 16:00:12 | 1:03:59 | 0:25:55 | 0:38:04 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:38:34.072631 mgr.y mgr.4103 172.21.7.124:0/12406 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434452 |
|
2018-04-24 14:56:07 | 2018-04-24 15:10:18 | 2018-04-24 15:50:18 | 0:40:00 | 0:16:50 | 0:23:10 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:37:35.188603 mon.a mon.0 172.21.5.132:6789/0 179 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434453 |
|
2018-04-24 14:56:08 | 2018-04-24 15:10:18 | 2018-04-24 15:50:18 | 0:40:00 | 0:13:20 | 0:26:40 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:41:15.601757 mgr.x mgr.4107 172.21.9.120:0/12444 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| dead | 2434454 |
|
2018-04-24 14:56:09 | 2018-04-24 15:24:21 | 2018-04-25 03:26:50 | 12:02:29 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | ||||
| fail | 2434455 |
|
2018-04-24 14:56:10 | 2018-04-24 15:26:13 | 2018-04-24 16:34:14 | 1:08:01 | 0:24:56 | 0:43:05 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:14:52.034273 mon.b mon.0 172.21.3.120:6789/0 96 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434456 |
|
2018-04-24 14:56:11 | 2018-04-24 15:26:13 | 2018-04-24 16:10:14 | 0:44:01 | 0:09:46 | 0:34:15 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:06:06.173938 mon.b mon.0 172.21.3.118:6789/0 137 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434457 |
|
2018-04-24 14:56:12 | 2018-04-24 15:28:13 | 2018-04-24 16:30:14 | 1:02:01 | 0:31:19 | 0:30:42 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:04:18.565617 mon.a mon.0 172.21.5.132:6789/0 179 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434458 |
|
2018-04-24 14:56:12 | 2018-04-24 15:38:22 | 2018-04-24 16:18:22 | 0:40:00 | 0:26:49 | 0:13:11 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
"2018-04-24 15:55:30.792614 mon.a mon.0 172.21.3.116:6789/0 187 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434459 |
|
2018-04-24 14:56:13 | 2018-04-24 15:40:16 | 2018-04-24 16:46:17 | 1:06:01 | 0:24:37 | 0:41:24 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:25:33.865804 mgr.x mgr.4104 172.21.3.118:0/12293 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434460 |
|
2018-04-24 14:56:14 | 2018-04-24 15:48:25 | 2018-04-24 16:14:24 | 0:25:59 | 0:15:42 | 0:10:17 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:03:34.217491 mon.a mon.0 172.21.5.110:6789/0 107 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| dead | 2434461 |
|
2018-04-24 14:56:15 | 2018-04-24 15:50:19 | 2018-04-25 03:52:45 | 12:02:26 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||||
| fail | 2434462 |
|
2018-04-24 14:56:16 | 2018-04-24 15:50:19 | 2018-04-24 17:06:20 | 1:16:01 | 0:25:32 | 0:50:29 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:44:57.800629 mon.a mon.0 172.21.5.132:6789/0 179 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434463 |
|
2018-04-24 14:56:16 | 2018-04-24 15:50:19 | 2018-04-24 16:54:20 | 1:04:01 | 0:13:55 | 0:50:06 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:45:02.061544 mon.a mon.0 172.21.5.138:6789/0 164 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434464 |
|
2018-04-24 14:56:17 | 2018-04-24 15:52:15 | 2018-04-24 16:24:15 | 0:32:00 | 0:16:07 | 0:15:53 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:12:15.487120 mon.b mon.0 172.21.7.120:6789/0 122 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434465 |
|
2018-04-24 14:56:18 | 2018-04-24 15:58:23 | 2018-04-24 18:32:26 | 2:34:03 | 1:01:10 | 1:32:53 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
failed to become clean before timeout expired |
||||||||||||||
| fail | 2434466 |
|
2018-04-24 14:56:19 | 2018-04-24 16:00:22 | 2018-04-24 16:38:21 | 0:37:59 | 0:23:06 | 0:14:53 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:19:23.281033 mon.b mon.0 172.21.3.138:6789/0 164 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434467 |
|
2018-04-24 14:56:20 | 2018-04-24 16:04:21 | 2018-04-24 16:44:21 | 0:40:00 | 0:19:21 | 0:20:39 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:28:29.039557 mon.a mon.0 172.21.5.110:6789/0 153 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434468 |
|
2018-04-24 14:56:21 | 2018-04-24 16:08:24 | 2018-04-24 17:24:25 | 1:16:01 | 0:52:17 | 0:23:44 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:37:37.234843 mon.b mon.0 172.21.7.120:6789/0 96 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434469 |
|
2018-04-24 14:56:21 | 2018-04-24 16:10:18 | 2018-04-24 16:44:18 | 0:34:00 | 0:16:15 | 0:17:45 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:32:11.346033 mon.a mon.0 172.21.3.116:6789/0 134 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434470 |
|
2018-04-24 14:56:22 | 2018-04-24 16:12:23 | 2018-04-24 17:14:23 | 1:02:00 | 0:29:01 | 0:32:59 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:49:58.678267 mgr.x mgr.4101 172.21.3.120:0/12078 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434471 |
|
2018-04-24 14:56:23 | 2018-04-24 16:14:26 | 2018-04-24 17:52:28 | 1:38:02 | 0:36:25 | 1:01:37 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:20:22.354551 mon.a mon.0 172.21.5.132:6789/0 117 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434472 |
|
2018-04-24 14:56:24 | 2018-04-24 16:18:32 | 2018-04-24 17:02:33 | 0:44:01 | 0:28:22 | 0:15:39 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:39:10.179728 mon.b mon.0 172.21.4.108:6789/0 141 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434473 |
|
2018-04-24 14:56:25 | 2018-04-24 16:24:15 | 2018-04-24 17:04:15 | 0:40:00 | 0:17:35 | 0:22:25 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:51:43.904686 mgr.y mgr.4101 172.21.6.134:0/12128 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434474 |
|
2018-04-24 14:56:25 | 2018-04-24 16:24:16 | 2018-04-24 17:08:16 | 0:44:00 | 0:16:09 | 0:27:51 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:57:56.740326 mon.b mon.0 172.21.3.140:6789/0 168 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434475 |
|
2018-04-24 14:56:26 | 2018-04-24 16:30:26 | 2018-04-24 17:14:26 | 0:44:00 | 0:26:36 | 0:17:24 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:51:59.208982 mgr.x mgr.4101 172.21.3.138:0/12256 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434476 |
|
2018-04-24 14:56:27 | 2018-04-24 16:32:16 | 2018-04-24 17:32:17 | 1:00:01 | 0:16:36 | 0:43:25 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:19:33.349384 mon.a mon.0 172.21.5.110:6789/0 154 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434477 |
|
2018-04-24 14:56:28 | 2018-04-24 16:34:18 | 2018-04-24 17:40:19 | 1:06:01 | 0:16:39 | 0:49:22 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:28:15.402805 mgr.y mgr.4108 172.21.7.124:0/12130 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434478 |
|
2018-04-24 14:56:29 | 2018-04-24 16:38:23 | 2018-04-24 17:06:23 | 0:28:00 | 0:11:54 | 0:16:06 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 16:57:45.027333 mgr.y mgr.4103 172.21.5.110:0/12350 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434479 |
|
2018-04-24 14:56:30 | 2018-04-24 16:40:25 | 2018-04-24 17:22:25 | 0:42:00 | 0:17:19 | 0:24:41 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:08:40.041999 mon.a mon.0 172.21.3.116:6789/0 102 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434480 |
|
2018-04-24 14:56:30 | 2018-04-24 16:44:28 | 2018-04-24 17:34:28 | 0:50:00 | 0:38:56 | 0:11:04 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
timed out waiting for admin_socket to appear after osd.3 restart |
||||||||||||||
| fail | 2434481 |
|
2018-04-24 14:56:31 | 2018-04-24 16:44:28 | 2018-04-24 17:34:28 | 0:50:00 | 0:21:19 | 0:28:41 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:16:44.891709 mon.b mon.0 172.21.4.108:6789/0 175 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434482 |
|
2018-04-24 14:56:32 | 2018-04-24 16:46:28 | 2018-04-24 17:24:28 | 0:38:00 | 0:10:37 | 0:27:23 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:19:07.905006 mon.a mon.0 172.21.6.134:6789/0 148 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434483 |
|
2018-04-24 14:56:33 | 2018-04-24 16:54:22 | 2018-04-24 18:04:23 | 1:10:01 | 0:20:08 | 0:49:53 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:47:58.787349 mon.b mon.0 172.21.4.108:6789/0 99 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434484 |
|
2018-04-24 14:56:34 | 2018-04-24 17:02:43 | 2018-04-24 17:58:44 | 0:56:01 | 0:24:35 | 0:31:26 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:38:53.612919 mgr.y mgr.4104 172.21.6.134:0/12368 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434485 |
|
2018-04-24 14:56:35 | 2018-04-24 17:04:26 | 2018-04-24 18:32:27 | 1:28:01 | 0:13:04 | 1:14:57 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:22:49.591066 mon.a mon.0 172.21.5.132:6789/0 182 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434486 |
|
2018-04-24 14:56:36 | 2018-04-24 17:06:22 | 2018-04-24 17:40:22 | 0:34:00 | 0:21:16 | 0:12:44 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:23:23.080518 mon.b mon.0 172.21.3.140:6789/0 171 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434487 |
|
2018-04-24 14:56:36 | 2018-04-24 17:06:24 | 2018-04-24 18:08:25 | 1:02:01 | 0:17:56 | 0:44:05 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:54:42.174776 mon.b mon.0 172.21.3.140:6789/0 148 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| dead | 2434488 |
|
2018-04-24 14:56:37 | 2018-04-24 17:08:18 | 2018-04-25 05:10:44 | 12:02:26 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||||
| fail | 2434489 |
|
2018-04-24 14:56:38 | 2018-04-24 17:14:25 | 2018-04-24 17:54:25 | 0:40:00 | 0:10:31 | 0:29:29 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:49:10.547081 mon.b mon.0 172.21.3.118:6789/0 143 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434490 |
|
2018-04-24 14:56:39 | 2018-04-24 17:14:27 | 2018-04-24 18:48:29 | 1:34:02 | 0:35:03 | 0:58:59 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:18:34.728923 mon.b mon.0 172.21.4.108:6789/0 96 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434491 |
|
2018-04-24 14:56:39 | 2018-04-24 17:22:35 | 2018-04-24 18:12:35 | 0:50:00 | 0:37:47 | 0:12:13 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:39:24.964610 mon.b mon.0 172.21.7.120:6789/0 103 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434492 |
|
2018-04-24 14:56:40 | 2018-04-24 17:24:27 | 2018-04-24 18:08:27 | 0:44:00 | 0:19:23 | 0:24:37 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:54:39.577932 mon.a mon.0 172.21.5.138:6789/0 172 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434493 |
|
2018-04-24 14:56:41 | 2018-04-24 17:24:29 | 2018-04-24 17:52:29 | 0:28:00 | 0:11:43 | 0:16:17 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 17:44:49.122745 mon.a mon.0 172.21.5.110:6789/0 145 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434494 |
|
2018-04-24 14:56:42 | 2018-04-24 17:32:19 | 2018-04-24 18:28:19 | 0:56:00 | 0:26:27 | 0:29:33 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:06:50.972178 mon.b mon.0 172.21.3.120:6789/0 165 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434495 |
|
2018-04-24 14:56:43 | 2018-04-24 17:34:39 | 2018-04-24 18:22:39 | 0:48:00 | 0:20:59 | 0:27:01 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:06:58.208301 mon.a mon.0 172.21.5.110:6789/0 107 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434496 |
|
2018-04-24 14:56:44 | 2018-04-24 17:34:39 | 2018-04-24 18:20:39 | 0:46:00 | 0:16:55 | 0:29:05 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:08:01.980680 mgr.x mgr.4109 172.21.3.118:0/12077 7 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434497 |
|
2018-04-24 14:56:44 | 2018-04-24 17:40:31 | 2018-04-24 18:52:32 | 1:12:01 | 0:20:11 | 0:51:50 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:36:57.997409 mon.a mon.0 172.21.5.110:6789/0 108 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434498 |
|
2018-04-24 14:56:45 | 2018-04-24 17:40:31 | 2018-04-24 19:26:33 | 1:46:02 | 0:22:34 | 1:23:28 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:09:00.665225 mon.a mon.0 172.21.6.134:6789/0 107 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434499 |
|
2018-04-24 14:56:46 | 2018-04-24 17:52:38 | 2018-04-24 18:46:39 | 0:54:01 | 0:28:20 | 0:25:41 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:21:46.578429 mon.b mon.0 172.21.3.140:6789/0 99 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434500 |
|
2018-04-24 14:56:47 | 2018-04-24 17:52:38 | 2018-04-24 18:46:39 | 0:54:01 | 0:16:19 | 0:37:42 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:34:59.137983 mon.b mon.0 172.21.3.118:6789/0 99 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434501 |
|
2018-04-24 14:56:48 | 2018-04-24 17:54:27 | 2018-04-24 18:54:27 | 1:00:00 | 0:45:20 | 0:14:40 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:13:48.100614 mon.a mon.0 172.21.6.134:6789/0 152 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434502 |
|
2018-04-24 14:56:48 | 2018-04-24 17:58:54 | 2018-04-24 18:54:55 | 0:56:01 | 0:13:33 | 0:42:28 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:45:56.078909 mgr.y mgr.4107 172.21.5.132:0/12386 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434503 |
|
2018-04-24 14:56:49 | 2018-04-24 18:04:25 | 2018-04-24 19:16:29 | 1:12:04 | 0:33:50 | 0:38:14 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:47:26.392306 mon.a mon.0 172.21.3.116:6789/0 112 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434504 |
|
2018-04-24 14:56:50 | 2018-04-24 18:08:34 | 2018-04-24 19:20:35 | 1:12:01 | 0:20:53 | 0:51:08 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:03:34.102752 mon.b mon.0 172.21.4.108:6789/0 176 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434505 |
|
2018-04-24 14:56:51 | 2018-04-24 18:08:35 | 2018-04-24 18:46:35 | 0:38:00 | 0:22:35 | 0:15:25 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:27:47.446665 mon.b mon.0 172.21.7.120:6789/0 101 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434506 |
|
2018-04-24 14:56:52 | 2018-04-24 18:12:47 | 2018-04-24 18:58:47 | 0:46:00 | 0:20:11 | 0:25:49 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 18:43:08.460449 mon.b mon.0 172.21.3.120:6789/0 144 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| pass | 2434507 |
|
2018-04-24 14:56:53 | 2018-04-24 18:20:50 | 2018-04-24 19:56:54 | 1:36:04 | 0:22:37 | 1:13:27 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
| fail | 2434508 |
|
2018-04-24 14:56:53 | 2018-04-24 18:22:41 | 2018-04-24 20:02:43 | 1:40:02 | 0:18:52 | 1:21:10 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:49:09.239089 mon.a mon.0 172.21.5.110:6789/0 174 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434509 |
|
2018-04-24 14:56:54 | 2018-04-24 18:28:21 | 2018-04-24 19:12:21 | 0:44:00 | 0:15:25 | 0:28:35 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:00:45.226941 mon.b mon.0 172.21.3.118:6789/0 149 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| pass | 2434510 |
|
2018-04-24 14:56:55 | 2018-04-24 18:32:27 | 2018-04-24 19:08:27 | 0:36:00 | 0:12:56 | 0:23:04 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
| fail | 2434511 |
|
2018-04-24 14:56:56 | 2018-04-24 18:32:28 | 2018-04-24 19:14:28 | 0:42:00 | 0:17:57 | 0:24:03 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
timed out waiting for admin_socket to appear after osd.6 restart |
||||||||||||||
| fail | 2434512 |
|
2018-04-24 14:56:57 | 2018-04-24 18:46:45 | 2018-04-24 19:24:45 | 0:38:00 | 0:20:01 | 0:17:59 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:08:36.199944 mon.a mon.0 172.21.5.132:6789/0 114 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434513 |
|
2018-04-24 14:56:58 | 2018-04-24 18:46:45 | 2018-04-24 21:24:48 | 2:38:03 | 0:53:13 | 1:44:50 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
timeout expired in wait_for_all_osds_up |
||||||||||||||
| fail | 2434514 |
|
2018-04-24 14:56:58 | 2018-04-24 18:46:45 | 2018-04-24 20:22:47 | 1:36:02 | 0:16:55 | 1:19:07 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:10:33.127436 mon.a mon.0 172.21.5.132:6789/0 113 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434515 |
|
2018-04-24 14:56:59 | 2018-04-24 18:48:30 | 2018-04-24 19:10:30 | 0:22:00 | 0:08:49 | 0:13:11 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:06:27.619955 mgr.x mgr.4110 172.21.9.120:0/12068 7 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434516 |
|
2018-04-24 14:57:00 | 2018-04-24 18:52:34 | 2018-04-24 19:40:34 | 0:48:00 | 0:15:15 | 0:32:45 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:30:29.540699 mon.a mon.0 172.21.3.116:6789/0 147 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434517 |
|
2018-04-24 14:57:01 | 2018-04-24 18:54:39 | 2018-04-24 19:30:39 | 0:36:00 | 0:22:36 | 0:13:24 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:13:12.451901 mgr.y mgr.4104 172.21.7.124:0/12402 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434518 |
|
2018-04-24 14:57:02 | 2018-04-24 18:54:56 | 2018-04-24 19:50:56 | 0:56:00 | 0:31:59 | 0:24:01 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
timed out waiting for admin_socket to appear after osd.7 restart |
||||||||||||||
| fail | 2434519 |
|
2018-04-24 14:57:02 | 2018-04-24 18:58:59 | 2018-04-24 19:38:59 | 0:40:00 | 0:18:06 | 0:21:54 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:25:34.498789 mon.b mon.0 172.21.3.118:6789/0 178 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434520 |
|
2018-04-24 14:57:03 | 2018-04-24 19:08:40 | 2018-04-24 19:34:39 | 0:25:59 | 0:13:28 | 0:12:31 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:25:06.462791 mon.a mon.0 172.21.5.110:6789/0 107 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434521 |
|
2018-04-24 14:57:04 | 2018-04-24 19:10:42 | 2018-04-24 19:42:41 | 0:31:59 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||||
Failure Reason:
[Errno 113] No route to host |
||||||||||||||
| fail | 2434522 |
|
2018-04-24 14:57:05 | 2018-04-24 19:12:23 | 2018-04-24 19:52:23 | 0:40:00 | 0:28:04 | 0:11:56 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:29:11.521914 mgr.y mgr.4100 172.21.7.132:0/12367 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434523 |
|
2018-04-24 14:57:06 | 2018-04-24 19:14:30 | 2018-04-24 20:46:31 | 1:32:01 | 0:16:57 | 1:15:04 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:34:00.542122 mon.b mon.0 172.21.3.140:6789/0 147 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434524 |
|
2018-04-24 14:57:06 | 2018-04-24 19:16:40 | 2018-04-24 20:04:40 | 0:48:00 | 0:16:02 | 0:31:58 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:52:41.704688 mon.b mon.0 172.21.3.118:6789/0 124 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434525 |
|
2018-04-24 14:57:07 | 2018-04-24 19:20:48 | 2018-04-24 20:14:48 | 0:54:00 | 0:23:31 | 0:30:29 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:56:16.966521 mon.a mon.0 172.21.3.116:6789/0 105 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434526 |
|
2018-04-24 14:57:08 | 2018-04-24 19:24:55 | 2018-04-24 19:48:55 | 0:24:00 | 0:11:24 | 0:12:36 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:41:34.298444 mon.a mon.0 172.21.6.134:6789/0 186 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434527 |
|
2018-04-24 14:57:09 | 2018-04-24 19:26:37 | 2018-04-24 20:32:37 | 1:06:00 | 0:51:28 | 0:14:32 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:45:47.392056 mgr.y mgr.4100 172.21.7.124:0/12401 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434528 |
|
2018-04-24 14:57:10 | 2018-04-24 19:30:50 | 2018-04-24 20:18:50 | 0:48:00 | 0:18:52 | 0:29:08 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:04:44.250410 mon.b mon.0 172.21.3.140:6789/0 122 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434529 |
|
2018-04-24 14:57:10 | 2018-04-24 19:34:41 | 2018-04-24 20:48:42 | 1:14:01 | 0:24:17 | 0:49:44 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:29:46.016461 mgr.x mgr.4111 172.21.8.118:0/12252 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434530 |
|
2018-04-24 14:57:11 | 2018-04-24 19:39:01 | 2018-04-24 20:15:01 | 0:36:00 | 0:16:46 | 0:19:14 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:03:40.184525 mgr.x mgr.4105 172.21.8.118:0/12252 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434531 |
|
2018-04-24 14:57:12 | 2018-04-24 19:40:36 | 2018-04-24 20:20:36 | 0:40:00 | 0:26:47 | 0:13:13 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | ||
Failure Reason:
"2018-04-24 19:57:43.727764 mon.b mon.0 172.21.4.108:6789/0 174 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434532 |
|
2018-04-24 14:57:13 | 2018-04-24 19:42:54 | 2018-04-24 21:10:56 | 1:28:02 | 0:14:58 | 1:13:04 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 21:01:25.965672 mgr.x mgr.4101 172.21.3.140:0/12382 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434533 |
|
2018-04-24 14:57:14 | 2018-04-24 19:48:59 | 2018-04-24 20:14:59 | 0:26:00 | 0:14:12 | 0:11:48 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:05:37.376050 mgr.y mgr.4100 172.21.7.132:0/12351 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'upmap_max_deviation' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434534 |
|
2018-04-24 14:57:14 | 2018-04-24 19:51:10 | 2018-04-24 20:31:10 | 0:40:00 | 0:17:08 | 0:22:52 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:18:38.138776 mon.b mon.0 172.21.3.118:6789/0 137 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434535 |
|
2018-04-24 14:57:15 | 2018-04-24 19:52:34 | 2018-04-24 21:20:35 | 1:28:01 | 0:36:55 | 0:51:06 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | ||
Failure Reason:
timed out waiting for admin_socket to appear after osd.3 restart |
||||||||||||||
| fail | 2434536 |
|
2018-04-24 14:57:16 | 2018-04-24 19:57:08 | 2018-04-24 20:29:08 | 0:32:00 | 0:17:03 | 0:14:57 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:16:51.672339 mon.a mon.0 172.21.5.110:6789/0 104 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434537 |
|
2018-04-24 14:57:17 | 2018-04-24 20:02:53 | 2018-04-24 20:44:53 | 0:42:00 | 0:20:15 | 0:21:45 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:29:58.928179 mon.b mon.0 172.21.7.120:6789/0 97 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434538 |
|
2018-04-24 14:57:18 | 2018-04-24 20:04:51 | 2018-04-24 20:38:51 | 0:34:00 | 0:15:00 | 0:19:00 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:28:32.826920 mgr.x mgr.4107 172.21.9.130:0/12070 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434539 |
|
2018-04-24 14:57:18 | 2018-04-24 20:15:00 | 2018-04-24 22:01:01 | 1:46:01 | 0:25:18 | 1:20:43 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 21:39:34.617606 mon.a mon.0 172.21.5.132:6789/0 146 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434540 |
|
2018-04-24 14:57:19 | 2018-04-24 20:15:00 | 2018-04-24 20:51:00 | 0:36:00 | 0:21:41 | 0:14:19 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:33:43.562016 mgr.x mgr.4104 172.21.4.108:0/12249 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434541 |
|
2018-04-24 14:57:20 | 2018-04-24 20:15:02 | 2018-04-24 21:15:03 | 1:00:01 | 0:34:31 | 0:25:30 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:44:58.329222 mon.b mon.0 172.21.3.118:6789/0 117 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434542 |
|
2018-04-24 14:57:21 | 2018-04-24 20:19:02 | 2018-04-25 00:27:07 | 4:08:05 | 3:47:42 | 0:20:23 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | ||
Failure Reason:
Command failed (workunit test rados/test.sh) on mira051 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-mgr-balancer-options TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 2434543 |
|
2018-04-24 14:57:22 | 2018-04-24 20:32:40 | 2018-04-24 21:06:40 | 0:34:00 | 0:16:48 | 0:17:12 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | ||
Failure Reason:
"2018-04-24 20:53:54.612134 mon.a mon.0 172.21.3.116:6789/0 111 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434544 |
|
2018-04-24 14:57:23 | 2018-04-24 20:39:07 | 2018-04-24 21:15:07 | 0:36:00 | 0:13:39 | 0:22:21 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | ||
Failure Reason:
"2018-04-24 21:05:22.917162 mon.b mon.0 172.21.4.108:6789/0 138 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434545 |
|
2018-04-24 14:57:23 | 2018-04-24 20:45:12 | 2018-04-24 21:45:13 | 1:00:01 | 0:23:45 | 0:36:16 | mira | master | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | ||
Failure Reason:
"2018-04-24 21:26:39.231128 mon.b mon.0 172.21.3.140:6789/0 125 : cluster [ERR] Health check failed: Module 'balancer' has failed: Config option 'upmap_max_deviation' is not in Module.OPTIONS (MGR_MODULE_ERROR)" in cluster log |
||||||||||||||
| fail | 2434546 |
|
2018-04-24 14:57:24 | 2018-04-24 20:46:39 | 2018-04-24 21:34:40 | 0:48:01 | 0:19:57 | 0:28:04 | mira | master | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | ||
Failure Reason:
"2018-04-24 21:18:26.983499 mgr.y mgr.4098 172.21.7.132:0/12241 6 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.y: Config option 'crush_compat_max_iterations' is not in Module.OPTIONS" in cluster log |
||||||||||||||
| fail | 2434547 |
|
2018-04-24 14:57:25 | 2018-04-24 20:48:44 | 2018-04-24 21:24:44 | 0:36:00 | 0:08:06 | 0:27:54 | mira | master | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/module_selftest.yaml} | 2 | ||
Failure Reason:
Test failure: test_influx (tasks.mgr.test_module_selftest.TestModuleSelftest) |
||||||||||||||
| dead | 2434548 |
|
2018-04-24 14:57:26 | 2018-04-24 20:51:04 | 2018-04-25 08:53:30 | 12:02:26 | mira | master | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/few.yaml objectstore/bluestore.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | ||||
| fail | 2434549 |
|
2018-04-24 14:57:26 | 2018-04-24 21:05:13 | 2018-04-25 02:31:20 | 5:26:07 | 0:10:10 | 5:15:57 | mira | master | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | ||
Failure Reason:
Socket is closed |
||||||||||||||
| pass | 2434550 |
|
2018-04-24 14:57:27 | 2018-04-24 21:06:41 | 2018-04-24 21:32:41 | 0:26:00 | 0:09:14 | 0:16:46 | mira | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} | 2 | ||
Pulpito