kchai-2018-08-27_08:20:01-rados-wip-kefu-testing-2018-08-27-1202-distro-basic-mira

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f7a183eba50>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f6b55ae9ad0>: Failed to establish a new connection: [Errno 113] No route to host',))

Scrubbing terminated -- not all pgs were active and clean.

Scrubbing terminated -- not all pgs were active and clean.

Command failed on mira034 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

{'mira053.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 14:32:00.895174', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 14:31:35.870999', 'delta': '0:00:25.024175', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Test failure: test_module_commands (tasks.mgr.test_module_selftest.TestModuleSelftest)

Command failed on mira118 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph rmpool unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it'

Scrubbing terminated -- not all pgs were active and clean.

Command failed on mira012 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty'

{'mira067.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 15:03:40.671543', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 15:03:15.654648', 'delta': '0:00:25.016895', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

"2018-08-27 15:28:01.124901 mon.a (mon.0) 157 : cluster [WRN] Health check failed: Reduced data availability: 16 pgs inactive (PG_AVAILABILITY)" in cluster log

{'mira017.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 15:28:33.026265', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 15:28:08.014509', 'delta': '0:00:25.011756', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/task/cancel (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fd41d21cc10>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/task/cancel (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fa85dd67310>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fb79deac890>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f0d69deaa90>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f49b16f5d10>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f071873af10>: Failed to establish a new connection: [Errno 113] No route to host',))

HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fd599c34c50>: Failed to establish a new connection: [Errno 113] No route to host',))

{'mira088.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 20:43:56.852728', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 20:43:31.833672', 'delta': '0:00:25.019056', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira017.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 20:43:57.684605', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 20:43:32.670086', 'delta': '0:00:25.014519', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Scrubbing terminated -- not all pgs were active and clean.

{'mira071.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 20:42:45.790279', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 20:42:20.774168', 'delta': '0:00:25.016111', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Scrubbing terminated -- not all pgs were active and clean.

Command failed (workunit test rados/test_python.sh) on mira118 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-08-27-1202 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

{'mira038.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 20:42:47.101611', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 20:42:22.090668', 'delta': '0:00:25.010943', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira067.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 20:42:47.723200', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 20:42:22.700894', 'delta': '0:00:25.022306', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Scrubbing terminated -- not all pgs were active and clean.

failed to become clean before timeout expired

Scrubbing terminated -- not all pgs were active and clean.

Scrubbing terminated -- not all pgs were active and clean.

Scrubbing terminated -- not all pgs were active and clean.

Command failed on mira112 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

{'mira069.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 21:50:22.489018', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 21:49:57.475680', 'delta': '0:00:25.013338', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira067.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 21:50:20.718157', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 21:49:55.699493', 'delta': '0:00:25.018664', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Scrubbing terminated -- not all pgs were active and clean.

{'mira053.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 21:03:43.648340', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 21:03:18.639097', 'delta': '0:00:25.009243', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

"2018-08-27 21:04:29.253237 mon.a (mon.0) 125 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

"2018-08-27 21:05:32.618127 mon.b (mon.0) 84 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

Command failed (workunit test mon/test_mon_osdmap_prune.sh) on mira092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-08-27-1202 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh'

failed to recover before timeout expired

Command failed on mira081 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status'

SSH connection to mira038 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op rmattr 25 --op delete 50 --pool unique_pool_0'

HTTPConnectionPool(host='mira001.front.sepia.ceph.com', port=7280): Max retries exceeded with url: / (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7fd3a601f190>: Failed to establish a new connection: [Errno 111] Connection refused',))

SSH connection to mira101 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

Scrubbing terminated -- not all pgs were active and clean.

{'mira065.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 21:38:55.017773', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 21:38:30.000840', 'delta': '0:00:25.016933', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

{'mira088.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 21:52:14.595592', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 21:51:49.583786', 'delta': '0:00:25.011806', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Command failed on mira117 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

Scrubbing terminated -- not all pgs were active and clean.

Scrubbing terminated -- not all pgs were active and clean.

"2018-08-27 22:13:50.645965 mon.a (mon.0) 161 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive (PG_AVAILABILITY)" in cluster log

failed to recover before timeout expired

{'mira077.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 22:29:37.352915', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 22:29:12.338183', 'delta': '0:00:25.014732', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira048.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 22:29:38.713243', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 22:29:13.702116', 'delta': '0:00:25.011127', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

Command failed on mira088 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

SSH connection to mira069 was lost: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

Scrubbing terminated -- not all pgs were active and clean.

SSH connection to mira077 was lost: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

SSH connection to mira067 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_redirect --low_tier_pool low_tier --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 50 --op write 50 --op write_excl 50 --op delete 10 --pool unique_pool_0'

"2018-08-27 23:32:48.074313 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

{'mira051.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-08-27 23:23:50.496395', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-08-27 23:23:25.481326', 'delta': '0:00:25.015069', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

SSH connection to mira065 was lost: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

SSH connection to mira012 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"

{'mira048.front.sepia.ceph.com': {'msg': 'SSH Error: data could not be sent to remote host "mira048.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, 'changed': False}, 'mira075.front.sepia.ceph.com': {'msg': 'SSH Error: data could not be sent to remote host "mira075.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, 'changed': False}}

SSH connection to mira118 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400000 --objects 20 --max-in-flight 8 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op append_excl 5 --op read 0 --op write 0 --op write_excl 0 --op append 5 --op delete 20 --pool unique_pool_0'