Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 5402583 2020-09-03 12:28:26 2020-09-03 12:40:55 2020-09-03 12:56:55 0:16:00 0:00:10 0:15:50 smithi rpm-test centos 8.1 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 2
Failure Reason:

{'Failure object was': {'smithi196.front.sepia.ceph.com': {'msg': 'Could not find imported module support code for copy. Looked for either to_native.py or _text.py', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': "('cannot represent an object', 'Could not find imported module support code for copy. Looked for either to_native.py or _text.py')"}

fail 5402584 2020-09-03 12:28:27 2020-09-03 12:40:55 2020-09-03 13:00:55 0:20:00 0:03:32 0:16:28 smithi rpm-test rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
Failure Reason:

{'Failure object was': {'smithi043.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402585 2020-09-03 12:28:28 2020-09-03 12:40:56 2020-09-03 13:00:55 0:19:59 0:03:39 0:16:20 smithi rpm-test rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
Failure Reason:

{'Failure object was': {'smithi047.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402586 2020-09-03 12:28:29 2020-09-03 12:41:04 2020-09-03 12:49:04 0:08:00 0:01:01 0:06:59 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} 2
Failure Reason:

{'Failure object was': {'smithi132.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

pass 5402587 2020-09-03 12:28:30 2020-09-03 12:41:24 2020-09-03 13:19:25 0:38:01 0:27:48 0:10:13 smithi rpm-test ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} 2
fail 5402588 2020-09-03 12:28:31 2020-09-03 12:41:44 2020-09-03 13:01:44 0:20:00 0:10:22 0:09:38 smithi rpm-test rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
Failure Reason:

Command failed on smithi031 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:c6c6fb5d4a04f22c5b84f90bb18516de0ac08e8f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6bebd9c-ede4-11ea-a080-001a4aab830c -- ceph orch daemon add osd smithi031:vg_nvme/lv_4'

fail 5402589 2020-09-03 12:28:32 2020-09-03 12:43:31 2020-09-03 12:57:30 0:13:59 0:04:58 0:09:01 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

{'smithi139.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi117.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402590 2020-09-03 12:28:33 2020-09-03 12:43:31 2020-09-03 13:21:31 0:38:00 0:29:29 0:08:31 smithi rpm-test ubuntu 18.04 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=28247)

fail 5402591 2020-09-03 12:28:34 2020-09-03 12:46:03 2020-09-03 12:54:02 0:07:59 0:00:57 0:07:02 smithi rpm-test rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/prometheus} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi101.front.sepia.ceph.com,smithi070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402592 2020-09-03 12:28:35 2020-09-03 12:46:03 2020-09-03 12:54:02 0:07:59 0:00:16 0:07:43 smithi rpm-test ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402593 2020-09-03 12:28:36 2020-09-03 12:46:04 2020-09-03 12:56:03 0:09:59 0:01:32 0:08:27 smithi rpm-test ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

{'smithi104.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n result = command_action.run(task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi154.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402594 2020-09-03 12:28:37 2020-09-03 12:46:04 2020-09-03 12:54:02 0:07:58 0:00:29 0:07:29 smithi rpm-test centos 8.1 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
Failure Reason:

{'smithi041.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/items.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402595 2020-09-03 12:28:38 2020-09-03 12:48:36 2020-09-03 12:56:35 0:07:59 0:00:11 0:07:48 smithi rpm-test centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} 2
Failure Reason:

{'Failure object was': {'smithi133.front.sepia.ceph.com': {'msg': 'Could not find imported module support code for stat. Looked for either to_bytes.py or _text.py', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': "('cannot represent an object', 'Could not find imported module support code for stat. Looked for either to_bytes.py or _text.py')"}

dead 5402596 2020-09-03 12:28:39 2020-09-03 12:48:47 2020-09-03 12:56:46 0:07:59 0:01:08 0:06:51 smithi rpm-test ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
Failure Reason:

{'Failure object was': {'smithi065.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402597 2020-09-03 12:28:39 2020-09-03 12:49:05 2020-09-03 13:01:04 0:11:59 0:03:36 0:08:23 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

pass 5402598 2020-09-03 12:28:40 2020-09-03 12:49:19 2020-09-03 13:01:18 0:11:59 0:04:26 0:07:33 smithi rpm-test ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_latest}} 1
pass 5402599 2020-09-03 12:28:41 2020-09-03 12:51:01 2020-09-03 13:03:00 0:11:59 0:04:55 0:07:04 smithi rpm-test ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
fail 5402600 2020-09-03 12:28:42 2020-09-03 12:51:01 2020-09-03 13:01:01 0:10:00 0:00:55 0:09:05 smithi rpm-test centos 8.1 rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
Failure Reason:

{'Failure object was': {'smithi186.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402601 2020-09-03 12:28:43 2020-09-03 12:51:01 2020-09-03 13:01:01 0:10:00 0:00:59 0:09:01 smithi rpm-test centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
Failure Reason:

{'Failure object was': {'smithi101.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402602 2020-09-03 12:28:44 2020-09-03 12:51:14 2020-09-03 13:15:14 0:24:00 0:08:58 0:15:02 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

fail 5402603 2020-09-03 12:28:45 2020-09-03 12:51:15 2020-09-03 13:03:14 0:11:59 0:02:08 0:09:51 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

dead 5402604 2020-09-03 12:28:46 2020-09-03 12:51:19 2020-09-03 13:01:18 0:09:59 0:01:20 0:08:39 smithi rpm-test rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402605 2020-09-03 12:28:47 2020-09-03 12:51:19 2020-09-03 13:03:18 0:11:59 0:00:39 0:11:20 smithi rpm-test centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'smithi033.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n dest_status = self._execute_remote_stat(dest_file, all_vars=task_vars, follow=follow, checksum=force)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n wrap_async=False)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n dest_status = self._execute_remote_stat(dest_file, all_vars=task_vars, follow=follow, checksum=force)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n wrap_async=False)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi057.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/lineinfile.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

fail 5402606 2020-09-03 12:28:48 2020-09-03 12:54:28 2020-09-03 13:02:27 0:07:59 0:02:19 0:05:40 smithi rpm-test centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

fail 5402607 2020-09-03 12:28:49 2020-09-03 12:54:28 2020-09-03 13:02:27 0:07:59 0:00:40 0:07:19 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'smithi045.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/system/user.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi133.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/system/user.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402608 2020-09-03 12:28:50 2020-09-03 12:54:28 2020-09-03 13:06:27 0:11:59 0:00:27 0:11:32 smithi rpm-test rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402609 2020-09-03 12:28:51 2020-09-03 12:54:28 2020-09-03 13:02:27 0:07:59 0:00:37 0:07:22 smithi rpm-test centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
Failure Reason:

{'smithi117.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n dest_status = self._execute_remote_stat(dest_file, all_vars=task_vars, follow=follow, checksum=force)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n wrap_async=False)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'Failure object was': {'smithi190.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402610 2020-09-03 12:28:52 2020-09-03 12:54:28 2020-09-03 13:02:27 0:07:59 0:00:31 0:07:28 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com,smithi093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402611 2020-09-03 12:28:53 2020-09-03 12:56:37 2020-09-03 13:06:36 0:09:59 0:00:55 0:09:04 smithi rpm-test centos 8.1 rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
Failure Reason:

{'Failure object was': {'smithi070.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402612 2020-09-03 12:28:53 2020-09-03 12:56:37 2020-09-03 13:06:37 0:10:00 0:01:17 0:08:43 smithi rpm-test centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
Failure Reason:

{'Failure object was': {'smithi047.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402613 2020-09-03 12:28:54 2020-09-03 12:56:37 2020-09-03 13:18:37 0:22:00 0:05:01 0:16:59 smithi rpm-test centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

fail 5402614 2020-09-03 12:28:55 2020-09-03 12:56:37 2020-09-03 13:08:36 0:11:59 0:01:49 0:10:10 smithi rpm-test ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

{'smithi144.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n dest_status = self._execute_remote_stat(dest_file, all_vars=task_vars, follow=follow, checksum=force)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n wrap_async=False)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'Failure object was': {'smithi151.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402615 2020-09-03 12:28:56 2020-09-03 12:56:37 2020-09-03 13:08:36 0:11:59 0:01:49 0:10:10 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} 2
Failure Reason:

{'smithi062.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/replace.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi169.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/replace.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402616 2020-09-03 12:28:57 2020-09-03 12:56:47 2020-09-03 13:04:46 0:07:59 0:01:24 0:06:35 smithi rpm-test ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
Failure Reason:

{'smithi079.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n result = command_action.run(task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

fail 5402617 2020-09-03 12:28:58 2020-09-03 12:56:56 2020-09-03 13:04:55 0:07:59 0:01:23 0:06:36 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
Failure Reason:

{'smithi194.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402618 2020-09-03 12:28:59 2020-09-03 12:57:26 2020-09-03 13:07:26 0:10:00 0:00:31 0:09:29 smithi rpm-test centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi186.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402619 2020-09-03 12:29:00 2020-09-03 12:57:27 2020-09-03 13:07:26 0:09:59 0:00:54 0:09:05 smithi rpm-test centos 8.1 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} 1
Failure Reason:

{'Failure object was': {'smithi152.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402620 2020-09-03 12:29:01 2020-09-03 12:57:31 2020-09-03 13:07:30 0:09:59 0:00:19 0:09:40 smithi rpm-test ubuntu 18.04 rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi076.front.sepia.ceph.com': {'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}}

fail 5402621 2020-09-03 12:29:02 2020-09-03 13:00:29 2020-09-03 13:10:28 0:09:59 0:02:29 0:07:30 smithi rpm-test ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

dead 5402622 2020-09-03 12:29:03 2020-09-03 13:00:56 2020-09-03 13:08:56 0:08:00 0:01:45 0:06:15 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi016.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402623 2020-09-03 12:29:04 2020-09-03 13:00:56 2020-09-03 13:08:56 0:08:00 0:00:45 0:07:15 smithi rpm-test ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
Failure Reason:

{'Failure object was': {'smithi190.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402624 2020-09-03 12:29:05 2020-09-03 13:01:02 2020-09-03 13:09:01 0:07:59 0:01:15 0:06:44 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
Failure Reason:

{'Failure object was': {'smithi045.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402625 2020-09-03 12:29:06 2020-09-03 13:01:02 2020-09-03 13:09:01 0:07:59 0:01:15 0:06:44 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402626 2020-09-03 12:29:07 2020-09-03 13:01:06 2020-09-03 13:09:05 0:07:59 0:02:03 0:05:56 smithi rpm-test ubuntu 18.04 rados/singleton/{all/divergent_priors msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Could not find a suitable TLS CA certificate bundle, invalid path: /home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/certifi/cacert.pem

fail 5402627 2020-09-03 12:29:07 2020-09-03 13:01:17 2020-09-03 13:15:17 0:14:00 0:06:05 0:07:55 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
Failure Reason:

Command failed on smithi155 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:c6c6fb5d4a04f22c5b84f90bb18516de0ac08e8f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cff7d614-ede6-11ea-a080-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_4'

dead 5402628 2020-09-03 12:29:08 2020-09-03 13:01:19 2020-09-03 13:09:18 0:07:59 0:00:16 0:07:43 smithi rpm-test ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'smithi098.front.sepia.ceph.com': {'msg': 'Could not find imported module support code for file. Looked for either to_bytes.py or _text.py', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': "('cannot represent an object', 'Could not find imported module support code for file. Looked for either to_bytes.py or _text.py')", 'smithi139.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 378, in _copy_file\n module_return = self._execute_module(module_name=\'file\', module_args=new_module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/file.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402629 2020-09-03 12:29:09 2020-09-03 13:01:20 2020-09-03 13:09:19 0:07:59 0:01:34 0:06:25 smithi rpm-test rhel 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi061.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402630 2020-09-03 12:29:10 2020-09-03 13:01:26 2020-09-03 13:09:25 0:07:59 0:01:34 0:06:25 smithi rpm-test centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402631 2020-09-03 12:29:11 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:01:13 0:08:46 smithi rpm-test ubuntu 18.04 rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
Failure Reason:

{'Failure object was': {'smithi138.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402632 2020-09-03 12:29:12 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:00:58 0:09:01 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi194.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi176.front.sepia.ceph.com,smithi044.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402633 2020-09-03 12:29:13 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:01:43 0:08:16 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
Failure Reason:

{'Failure object was': {'smithi129.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402634 2020-09-03 12:29:14 2020-09-03 13:02:36 2020-09-03 13:08:35 0:05:59 0:00:04 0:05:55 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

Command failed with status 1: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi198.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402635 2020-09-03 12:29:15 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:01:54 0:08:05 smithi rpm-test centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
Failure Reason:

{'smithi134.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/shell.py", line 27, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

fail 5402636 2020-09-03 12:29:16 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:00:53 0:09:06 smithi rpm-test ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

{'smithi099.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/packaging/os/apt.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'Failure object was': {'smithi181.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402637 2020-09-03 12:29:16 2020-09-03 13:02:36 2020-09-03 13:12:35 0:09:59 0:01:44 0:08:15 smithi rpm-test centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

{'Failure object was': {'smithi145.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402638 2020-09-03 12:29:17 2020-09-03 13:03:05 2020-09-03 13:11:05 0:08:00 0:01:41 0:06:19 smithi rpm-test ubuntu 18.04 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi080.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/file.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402639 2020-09-03 12:29:18 2020-09-03 13:03:15 2020-09-03 13:09:14 0:05:59 smithi rpm-test centos 8.1 rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
dead 5402640 2020-09-03 12:29:19 2020-09-03 13:03:20 2020-09-03 13:11:19 0:07:59 0:01:19 0:06:40 smithi rpm-test rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi188.front.sepia.ceph.com,smithi025.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402641 2020-09-03 12:29:20 2020-09-03 13:04:46 2020-09-03 13:10:45 0:05:59 0:00:45 0:05:14 smithi rpm-test rhel 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402642 2020-09-03 12:29:21 2020-09-03 13:04:46 2020-09-03 13:14:45 0:09:59 0:01:43 0:08:16 smithi rpm-test centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'smithi185.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/items.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi168.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/items.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402643 2020-09-03 12:29:22 2020-09-03 13:04:46 2020-09-03 13:18:45 0:13:59 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
dead 5402644 2020-09-03 12:29:23 2020-09-03 13:04:46 2020-09-03 13:14:45 0:09:59 0:01:26 0:08:33 smithi rpm-test centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_python} 2
Failure Reason:

{'smithi123.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n dest_status = self._execute_remote_stat(dest_file, all_vars=task_vars, follow=follow, checksum=force)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n wrap_async=False)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi112.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 378, in _copy_file\n module_return = self._execute_module(module_name=\'file\', module_args=new_module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/file.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

dead 5402645 2020-09-03 12:29:24 2020-09-03 13:04:47 2020-09-03 13:14:46 0:09:59 0:01:39 0:08:20 smithi rpm-test rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402646 2020-09-03 12:29:25 2020-09-03 13:04:51 2020-09-03 13:16:51 0:12:00 0:04:22 0:07:38 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
Failure Reason:

No module named 'toml'

dead 5402647 2020-09-03 12:29:25 2020-09-03 13:04:56 2020-09-03 13:18:56 0:14:00 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
fail 5402648 2020-09-03 12:29:26 2020-09-03 13:05:19 2020-09-03 13:13:18 0:07:59 0:01:40 0:06:19 smithi rpm-test ubuntu 18.04 rados/singleton/{all/dump-stuck msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'Failure object was': {'smithi125.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402649 2020-09-03 12:29:27 2020-09-03 13:05:26 2020-09-03 13:13:25 0:07:59 0:01:02 0:06:57 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402650 2020-09-03 12:29:28 2020-09-03 13:05:33 2020-09-03 13:13:32 0:07:59 0:00:47 0:07:12 smithi rpm-test ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

{'smithi142.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/dict.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi047.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/items.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'Failure object was': {'smithi032.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402651 2020-09-03 12:29:29 2020-09-03 13:06:47 2020-09-03 13:14:46 0:07:59 0:00:08 0:07:51 smithi rpm-test centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} 2
Failure Reason:

{'Failure object was': {'smithi103.front.sepia.ceph.com': {'msg': 'Could not find imported module support code for group. Looked for either load_platform_subclass.py or basic.py', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': "('cannot represent an object', 'Could not find imported module support code for group. Looked for either load_platform_subclass.py or basic.py')"}

fail 5402652 2020-09-03 12:29:30 2020-09-03 13:06:47 2020-09-03 13:14:46 0:07:59 0:00:58 0:07:01 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
Failure Reason:

{'Failure object was': {'smithi006.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402653 2020-09-03 12:29:31 2020-09-03 13:06:47 2020-09-03 13:14:46 0:07:59 0:00:15 0:07:44 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi143.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402654 2020-09-03 12:29:32 2020-09-03 13:06:48 2020-09-03 13:14:46 0:07:58 0:00:30 0:07:28 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402655 2020-09-03 12:29:33 2020-09-03 13:07:12 2020-09-03 13:15:11 0:07:59 0:01:21 0:06:38 smithi rpm-test ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/crash} 2
Failure Reason:

{'Failure object was': {'smithi146.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")', 'smithi095.front.sepia.ceph.com': {'_ansible_no_log': None, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 103, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 237, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nFileNotFoundError: [Errno 2] No such file or directory: b\'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/lookup/items.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

pass 5402656 2020-09-03 12:29:34 2020-09-03 13:07:15 2020-09-03 13:17:14 0:09:59 0:03:40 0:06:19 smithi rpm-test ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
fail 5402657 2020-09-03 12:29:34 2020-09-03 13:07:20 2020-09-03 13:15:19 0:07:59 0:00:57 0:07:02 smithi rpm-test ubuntu 18.04 rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'Failure object was': {'smithi151.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402658 2020-09-03 12:29:35 2020-09-03 13:07:27 2020-09-03 13:19:26 0:11:59 0:05:48 0:06:11 smithi rpm-test rhel 8.1 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=24189)

fail 5402659 2020-09-03 12:29:36 2020-09-03 13:07:28 2020-09-03 13:15:28 0:08:00 0:01:10 0:06:50 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

{'Failure object was': {'smithi057.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

fail 5402660 2020-09-03 12:29:37 2020-09-03 13:07:28 2020-09-03 13:15:28 0:08:00 0:01:15 0:06:45 smithi rpm-test rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402661 2020-09-03 12:29:38 2020-09-03 13:07:32 2020-09-03 13:15:31 0:07:59 0:01:29 0:06:30 smithi rpm-test ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402662 2020-09-03 12:29:39 2020-09-03 13:09:09 2020-09-03 13:15:07 0:05:58 0:00:13 0:05:45 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'smithi045.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/commands/command.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'Failure object was': {'smithi169.front.sepia.ceph.com': {'msg': "the connection plugin 'ssh' was not found", '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined', 'yaml.representer.RepresenterError': '(\'cannot represent an object\', "the connection plugin \'ssh\' was not found")'}

dead 5402663 2020-09-03 12:29:40 2020-09-03 13:09:10 2020-09-03 13:19:09 0:09:59 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
dead 5402664 2020-09-03 12:29:41 2020-09-03 13:09:09 2020-09-03 13:15:08 0:05:59 0:00:22 0:05:37 smithi rpm-test centos 8.1 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
Failure Reason:

{'smithi061.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/lineinfile.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi190.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 145, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/lineinfile.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}, 'smithi016.front.sepia.ceph.com': {'_ansible_no_log': False, 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 111, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 371, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/task_executor.py", line 664, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/template.py", line 189, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 517, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/copy.py", line 261, in _copy_file\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 580, in _execute_remote_stat\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nFileNotFoundError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_rpm-test/virtualenv/lib/python3.6/site-packages/ansible/modules/files/stat.py\'\n', 'msg': 'Unexpected failure during module execution.', 'stdout': ''}}

fail 5402665 2020-09-03 12:29:42 2020-09-03 13:09:09 2020-09-03 13:19:08 0:09:59 0:02:49 0:07:10 smithi rpm-test rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=6501)

dead 5402666 2020-09-03 12:29:43 2020-09-03 13:09:09 2020-09-03 13:15:07 0:05:58 0:00:13 0:05:45 smithi rpm-test ubuntu 18.04 rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402667 2020-09-03 12:29:44 2020-09-03 13:09:09 2020-09-03 13:15:08 0:05:59 0:00:12 0:05:47 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
Failure Reason:

Command failed with status 250: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi198.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

fail 5402668 2020-09-03 12:29:45 2020-09-03 13:09:09 2020-09-03 13:19:08 0:09:59 0:03:31 0:06:28 smithi rpm-test rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=28466)

fail 5402669 2020-09-03 12:29:45 2020-09-03 13:09:10 2020-09-03 13:15:08 0:05:58 0:00:50 0:05:08 smithi rpm-test rhel 8.1 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml'

dead 5402670 2020-09-03 12:29:46 2020-09-03 13:09:10 2020-09-03 13:15:08 0:05:58 0:00:17 0:05:41 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
Failure Reason:

{'smithi098.front.sepia.ceph.com': {'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}}

dead 5402671 2020-09-03 12:29:47 2020-09-03 13:09:16 2020-09-03 13:19:15 0:09:59 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
dead 5402672 2020-09-03 12:29:48 2020-09-03 13:09:20 2020-09-03 13:19:19 0:09:59 smithi rpm-test centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} 2
fail 5402673 2020-09-03 12:29:49 2020-09-03 13:09:20 2020-09-03 13:19:19 0:09:59 0:02:07 0:07:52 smithi rpm-test centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=6495)

fail 5402674 2020-09-03 12:29:50 2020-09-03 13:09:26 2020-09-03 13:19:25 0:09:59 0:02:33 0:07:26 smithi rpm-test centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=6817)

dead 5402675 2020-09-03 12:29:51 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
dead 5402676 2020-09-03 12:29:52 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
dead 5402677 2020-09-03 12:29:53 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test centos 8.1 rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
dead 5402678 2020-09-03 12:29:54 2020-09-03 13:11:34 2020-09-03 13:19:33 0:07:59 smithi rpm-test centos 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} 1
dead 5402679 2020-09-03 12:29:55 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
dead 5402680 2020-09-03 12:29:56 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
dead 5402681 2020-09-03 12:29:57 2020-09-03 13:11:33 2020-09-03 13:19:32 0:07:59 smithi rpm-test rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} 2
dead 5402682 2020-09-03 12:29:58 2020-09-03 13:12:02 2020-09-03 13:20:01 0:07:59 smithi rpm-test centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
dead 5402683 2020-09-03 12:29:58 2020-09-03 13:12:02 2020-09-03 13:20:01 0:07:59 smithi rpm-test rhel 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} 2
dead 5402684 2020-09-03 12:29:59 2020-09-03 13:13:40 2020-09-03 13:19:39 0:05:59 smithi rpm-test centos 8.1 rados/singleton/{all/lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
dead 5402685 2020-09-03 12:30:00 2020-09-03 13:13:40 2020-09-03 13:19:39 0:05:59 smithi rpm-test ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps}
dead 5402686 2020-09-03 12:30:01 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
dead 5402687 2020-09-03 12:30:02 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover}
dead 5402688 2020-09-03 12:30:03 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}}
dead 5402689 2020-09-03 12:30:04 2020-09-03 13:13:41 2020-09-03 13:19:39 0:05:58 smithi rpm-test ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps}
dead 5402690 2020-09-03 12:30:05 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
dead 5402691 2020-09-03 12:30:06 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start}
dead 5402692 2020-09-03 12:30:07 2020-09-03 13:13:41 2020-09-03 13:19:40 0:05:59 smithi rpm-test ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
fail 5402693 2020-09-03 12:30:08 2020-09-03 13:15:45 2020-09-03 13:25:44 0:09:59 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
Failure Reason:

machine smithi057.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402694 2020-09-03 12:30:09 2020-09-03 13:15:48 2020-09-03 13:27:47 0:11:59 smithi rpm-test ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
Failure Reason:

machine smithi051.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402695 2020-09-03 12:30:10 2020-09-03 13:15:49 2020-09-03 13:31:47 0:15:58 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache}
Failure Reason:

machine smithi085.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402696 2020-09-03 12:30:11 2020-09-03 13:15:48 2020-09-03 13:23:47 0:07:59 smithi rpm-test centos 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{centos_8}}
Failure Reason:

machine smithi016.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402697 2020-09-03 12:30:12 2020-09-03 13:15:48 2020-09-03 13:31:47 0:15:59 smithi rpm-test ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
Failure Reason:

machine smithi061.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402698 2020-09-03 12:30:13 2020-09-03 13:15:47 2020-09-03 13:27:46 0:11:59 smithi rpm-test centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start}
Failure Reason:

machine smithi169.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402699 2020-09-03 12:30:14 2020-09-03 13:15:47 2020-09-03 13:33:46 0:17:59 smithi rpm-test rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects}
Failure Reason:

machine smithi133.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402700 2020-09-03 12:30:14 2020-09-03 13:15:48 2020-09-03 13:27:47 0:11:59 smithi rpm-test rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
Failure Reason:

machine smithi124.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402701 2020-09-03 12:30:15 2020-09-03 13:15:45 2020-09-03 13:33:45 0:18:00 smithi rpm-test centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind}
Failure Reason:

machine smithi082.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402702 2020-09-03 12:30:16 2020-09-03 13:15:48 2020-09-03 13:27:46 0:11:58 smithi rpm-test ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
Failure Reason:

machine smithi148.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402703 2020-09-03 12:30:17 2020-09-03 13:15:48 2020-09-03 13:25:47 0:09:59 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write}
Failure Reason:

machine smithi064.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402704 2020-09-03 12:30:18 2020-09-03 13:15:47 2020-09-03 13:33:46 0:17:59 smithi rpm-test ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04_podman} fixed-2}
Failure Reason:

machine smithi117.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402705 2020-09-03 12:30:19 2020-09-03 13:15:48 2020-09-03 13:27:46 0:11:58 smithi rpm-test ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
Failure Reason:

machine smithi198.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402706 2020-09-03 12:30:20 2020-09-03 13:15:47 2020-09-03 13:27:46 0:11:59 smithi rpm-test ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard}
Failure Reason:

machine smithi162.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402707 2020-09-03 12:30:21 2020-09-03 13:15:49 2020-09-03 13:25:47 0:09:58 smithi rpm-test centos 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}}
Failure Reason:

machine smithi022.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402708 2020-09-03 12:30:22 2020-09-03 13:15:46 2020-09-03 13:25:46 0:10:00 smithi rpm-test centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
Failure Reason:

machine smithi151.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402709 2020-09-03 12:30:23 2020-09-03 13:15:48 2020-09-03 13:27:47 0:11:59 smithi rpm-test centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests}
Failure Reason:

machine smithi059.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

fail 5402759 2020-09-03 12:31:09 2020-09-03 13:15:47 2020-09-03 13:33:46 0:17:59 smithi rpm-test centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized}
Failure Reason:

machine smithi067.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology

dead 5402781 2020-09-03 12:31:29 2020-09-03 13:15:48 2020-09-03 13:27:46 0:11:58 smithi rpm-test centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/progress}
Failure Reason:

'ssh_keyscan smithi110.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

fail 5402844 2020-09-03 12:32:27 2020-09-03 13:15:45 2020-09-03 13:25:45 0:10:00 smithi rpm-test ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
Failure Reason:

machine smithi062.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_kchai@teuthology