Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5700853 2020-12-11 09:34:23 2020-12-11 10:04:15 2020-12-11 10:14:13 0:09:58 0:02:34 0:07:24 smithi py2 ubuntu rados/basic/{ceph clusters/{fixed-2 openstack} d-require-luminous/at-end mon_kv_backend/leveldb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests} 2
Failure Reason:

{'smithi119.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 110, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 370, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/shell.py", line 27, in run\n result = command_action.run(task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/commands/command.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'smithi089.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 110, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 370, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/shell.py", line 27, in run\n result = command_action.run(task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/commands/command.py\'\n', '_ansible_no_log': False, 'stdout': ''}}

fail 5700854 2020-12-11 09:34:24 2020-12-11 10:04:15 2020-12-11 10:14:13 0:09:58 0:02:08 0:07:50 smithi py2 ubuntu rados/basic-luminous/{ceph clusters/{fixed-2 openstack} objectstore/bluestore-bitmap rados scrub_test} 2
Failure Reason:

{'Failure object was': {'smithi023.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700855 2020-12-11 09:34:25 2020-12-11 10:04:16 2020-12-11 10:14:14 0:09:58 0:02:09 0:07:49 smithi py2 ubuntu rados/mgr/{clusters/2-node-mgr debug/mgr objectstore/bluestore-bitmap tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'smithi007.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700856 2020-12-11 09:34:25 2020-12-11 10:04:20 2020-12-11 10:14:18 0:09:58 0:02:22 0:07:36 smithi py2 ubuntu rados/monthrash/{ceph clusters/3-mons d-require-luminous/at-end mon_kv_backend/leveldb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados thrashers/force-sync-many workloads/pool-create-delete} 2
Failure Reason:

{'smithi175.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 144, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/files/file.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'Failure object was': {'smithi038.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700857 2020-12-11 09:34:26 2020-12-11 10:04:27 2020-12-11 10:14:26 0:09:59 0:01:42 0:08:17 smithi py2 ubuntu rados/multimon/{clusters/21 mon_kv_backend/leveldb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_clock_no_skews} 3
Failure Reason:

{'smithi129.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 102, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 236, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/lookup/dict.py\'\n', '_ansible_no_log': None, 'stdout': ''}, 'smithi079.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 144, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/template.py", line 189, in run\n result.update(copy_action.run(task_vars=task_vars))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/copy.py", line 517, in run\n module_return = self._copy_file(source_full, source_rel, content, content_tempfile, dest, task_vars, follow)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/copy.py", line 378, in _copy_file\n module_return = self._execute_module(module_name=\'file\', module_args=new_module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/files/file.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'smithi055.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 102, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 236, in _get_loop_items\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/loader.py", line 558, in get\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/loader.py", line 534, in _load_module_source\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/lookup/dict.py\'\n', '_ansible_no_log': None, 'stdout': ''}}

fail 5700858 2020-12-11 09:34:27 2020-12-11 10:07:00 2020-12-11 10:12:59 0:05:59 0 smithi py2 ubuntu rados/objectstore/alloc-hint 1
Failure Reason:

No module named pcp

fail 5700859 2020-12-11 09:34:28 2020-12-11 10:07:00 2020-12-11 10:14:59 0:07:59 0:01:31 0:06:28 smithi py2 ubuntu rados/rest/mgr-restful 1
Failure Reason:

{'smithi074.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 144, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/commands/command.py\'\n', '_ansible_no_log': False, 'stdout': ''}}

fail 5700860 2020-12-11 09:34:28 2020-12-11 10:07:00 2020-12-11 10:16:59 0:09:59 0:00:46 0:09:13 smithi py2 ubuntu rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-bitmap rados} 1
Failure Reason:

nter.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/update_keys.yml': line 24, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Update authorized_keys using the keys repo\n ^ here\n")

fail 5700861 2020-12-11 09:34:29 2020-12-11 10:07:00 2020-12-11 10:18:59 0:11:59 0:00:14 0:11:45 smithi py2 ubuntu rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-bitmap rados} 1
Failure Reason:

ter.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/create_users.yml': line 10, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Create all admin users with sudo access.\n ^ here\n")

fail 5700862 2020-12-11 09:34:30 2020-12-11 10:09:29 2020-12-11 10:17:27 0:07:58 0:00:11 0:07:47 smithi py2 ubuntu rados/singleton-nomsgr/{all/admin_socket_output rados} 1
Failure Reason:

{'Failure object was': {'smithi107.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700863 2020-12-11 09:34:31 2020-12-11 10:13:28 2020-12-11 10:19:27 0:05:59 0 smithi py2 ubuntu rados/standalone/crush 1
Failure Reason:

No module named pcp

fail 5700864 2020-12-11 09:34:32 2020-12-11 10:13:28 2020-12-11 10:21:27 0:07:59 0:01:14 0:06:45 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados rocksdb thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

{'smithi181.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 144, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/commands/command.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'Failure object was': {'smithi023.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700865 2020-12-11 09:34:32 2020-12-11 10:13:28 2020-12-11 10:21:27 0:07:59 0:01:48 0:06:11 smithi py2 ubuntu rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} d-require-luminous/at-end fast/fast leveldb msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
Failure Reason:

{'Failure object was': {'smithi087.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700866 2020-12-11 09:34:33 2020-12-11 10:13:28 2020-12-11 10:21:27 0:07:59 0:01:43 0:06:16 smithi py2 ubuntu rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} d-require-luminous/at-end leveldb msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

{'smithi109.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 110, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 370, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/normal.py", line 46, in run\n result = merge_hash(result, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/packaging/os/apt_key.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined', 'smithi089.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 144, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/command.py", line 24, in run\n results = merge_hash(results, self._execute_module(task_vars=task_vars, wrap_async=wrap_async))\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n (module_style, shebang, module_data, module_path) = self._configure_module(module_name=module_name, module_args=module_args, task_vars=task_vars)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n environment=final_environment)\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/commands/command.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'Failure object was': {'smithi047.front.sepia.ceph.com': {'msg': 'u"the connection plugin \'ssh\' was not found"', '_ansible_no_log': False}}, 'RepresenterError': '(\'cannot represent an object\', u"the connection plugin \'ssh\' was not found")'}

fail 5700867 2020-12-11 09:34:34 2020-12-11 10:14:15 2020-12-11 10:36:14 0:21:59 0:10:11 0:11:48 smithi py2 centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} d-require-luminous/at-end leveldb msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported/centos_latest thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Command crashed: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring'

fail 5700868 2020-12-11 09:34:35 2020-12-11 10:14:15 2020-12-11 10:22:14 0:07:59 0:01:01 0:06:58 smithi py2 ubuntu rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} d-require-luminous/at-end fast/fast leveldb msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/update_keys.yml': line 31, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Update authorized_keys for each user with literal keys\n ^ here\n")Failure object was: {'smithi078.front.sepia.ceph.com': {'msg': u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/revoke_users.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Filter the revoked_users list\n ^ here\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/revoke_users.yml': line 2, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n---\n- name: Filter the revoked_users list\n ^ here\n")

fail 5700869 2020-12-11 09:34:36 2020-12-11 10:14:16 2020-12-11 10:22:15 0:07:59 0:00:49 0:07:10 smithi py2 ubuntu rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} d-require-luminous/at-end leveldb msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

n safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/update_keys.yml': line 24, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Update authorized_keys using the keys repo\n ^ here\n")

fail 5700870 2020-12-11 09:34:36 2020-12-11 10:14:19 2020-12-11 10:22:18 0:07:59 0:00:51 0:07:08 smithi py2 ubuntu rados/thrash-luminous/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/normal_pg_log backoff/normal ceph clusters/{fixed-2 openstack} msgr/async objectstore/bluestore-bitmap rados rocksdb thrashers/default thrashosds-health workloads/redirect} 2
Failure Reason:

epo\n ^ here\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/update_keys.yml': line 24, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Update authorized_keys using the keys repo\n ^ here\n")

fail 5700871 2020-12-11 09:34:37 2020-12-11 10:14:22 2020-12-11 10:42:21 0:27:59 0:14:51 0:13:08 smithi py2 centos 7.4 rados/upgrade/jewel-x-singleton/{0-cluster/{openstack start} 1-jewel-install/jewel 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-luminous 8-workload/{rbd-python rgw-swift snaps-many-objects} distros/centos_latest thrashosds-health} 3
Failure Reason:

Command failed on smithi129 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0'

fail 5700872 2020-12-11 09:34:38 2020-12-11 10:14:23 2020-12-11 10:22:22 0:07:59 0:00:46 0:07:13 smithi py2 ubuntu rados/verify/{ceph clusters/{fixed-2 openstack} d-require-luminous/at-end d-thrash/default/{default thrashosds-health} mon_kv_backend/leveldb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

{'smithi083.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 110, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 370, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/normal.py", line 46, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/system/authorized_key.py\'\n', '_ansible_no_log': False, 'stdout': ''}, 'smithi099.front.sepia.ceph.com': {'msg': 'Unexpected failure during module execution.', 'exception': 'Traceback (most recent call last):\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 110, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 370, in _run_loop\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/task_executor.py", line 648, in _execute\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/normal.py", line 46, in run\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 809, in _execute_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/plugins/action/__init__.py", line 203, in _configure_module\n File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/executor/module_common.py", line 1015, in modify_module\nIOError: [Errno 2] No such file or directory: \'/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/ansible/modules/system/authorized_key.py\'\n', '_ansible_no_log': False, 'stdout': ''}}

fail 5700873 2020-12-11 09:34:39 2020-12-11 10:14:27 2020-12-11 10:22:26 0:07:59 0:00:50 0:07:09 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-crush-compat msgr-failures/few msgr/random objectstore/bluestore-comp rados rocksdb thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

epo\n ^ here\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefinedRepresenterError: ('cannot represent an object', u"The conditional check 'perform_users_role|bool' failed. The error was: unable to evaluate conditional: perform_users_role|bool\n\nThe error appears to be in '/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/users/tasks/update_keys.yml': line 24, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Update authorized_keys using the keys repo\n ^ here\n")

fail 5700874 2020-12-11 09:34:40 2020-12-11 10:14:27 2020-12-11 10:32:27 0:18:00 0:09:05 0:08:55 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-stupid rados rocksdb thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base'

fail 5700875 2020-12-11 09:34:40 2020-12-11 10:15:23 2020-12-11 10:31:22 0:15:59 0:07:53 0:08:06 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados rocksdb thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700876 2020-12-11 09:34:41 2020-12-11 10:15:23 2020-12-11 10:33:22 0:17:59 0:10:01 0:07:58 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/few msgr/random objectstore/bluestore-bitmap rados rocksdb thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700877 2020-12-11 09:34:42 2020-12-11 10:15:23 2020-12-11 10:33:22 0:17:59 0:08:47 0:09:12 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp rados rocksdb thrashers/default thrashosds-health workloads/cache-snaps} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

dead 5700878 2020-12-11 09:34:43 2020-12-11 10:17:37 2020-12-11 10:19:36 0:01:59 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-upmap msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados rocksdb thrashers/mapgap thrashosds-health workloads/cache}
Failure Reason:

[Errno 2] No such file or directory

fail 5700879 2020-12-11 09:34:44 2020-12-11 10:17:37 2020-12-11 10:31:36 0:13:59 0:07:41 0:06:18 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs msgr-failures/few msgr/random objectstore/filestore-xfs rados rocksdb thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

dead 5700880 2020-12-11 09:34:44 2020-12-11 10:17:37 2020-12-11 22:20:06 12:02:29 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/osd-delay msgr/simple objectstore/bluestore-bitmap rados rocksdb thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 5700881 2020-12-11 09:34:45 2020-12-11 10:17:37 2020-12-11 11:49:38 1:32:01 1:24:57 0:07:04 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-crush-compat msgr-failures/fastclose msgr/async objectstore/bluestore-comp rados rocksdb thrashers/pggrow thrashosds-health workloads/radosbench} 2
fail 5700882 2020-12-11 09:34:46 2020-12-11 10:19:22 2020-12-11 10:35:21 0:15:59 0:08:23 0:07:36 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-upmap msgr-failures/few msgr/random objectstore/bluestore-stupid rados rocksdb thrashers/default thrashosds-health workloads/small-objects} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op setattr 25 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op rmattr 25 --op delete 50 --pool unique_pool_0'

fail 5700883 2020-12-11 09:34:47 2020-12-11 10:19:22 2020-12-11 10:35:21 0:15:59 0:07:51 0:08:08 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs msgr-failures/osd-delay msgr/simple objectstore/filestore-xfs rados rocksdb thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

fail 5700884 2020-12-11 09:34:48 2020-12-11 10:19:22 2020-12-11 10:39:21 0:19:59 0:10:38 0:09:21 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados rocksdb thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --write-fadvise-dontneed --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op write_excl 50 --op delete 10 --pool unique_pool_0'

pass 5700885 2020-12-11 09:34:49 2020-12-11 10:19:22 2020-12-11 10:47:22 0:28:00 0:19:59 0:08:01 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-crush-compat msgr-failures/few msgr/random objectstore/bluestore-comp rados rocksdb thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
fail 5700886 2020-12-11 09:34:49 2020-12-11 10:19:23 2020-12-11 10:39:22 0:19:59 0:12:24 0:07:35 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-stupid rados rocksdb thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 10000 --objects 6600 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 1200 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base'

fail 5700887 2020-12-11 09:34:50 2020-12-11 10:19:28 2020-12-11 10:37:28 0:18:00 0:08:26 0:09:34 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados rocksdb thrashers/default thrashosds-health workloads/cache-agent-small} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base'

fail 5700888 2020-12-11 09:34:51 2020-12-11 10:19:38 2020-12-11 10:37:36 0:17:58 0:09:49 0:08:09 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/few msgr/random objectstore/bluestore-bitmap rados rocksdb thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700889 2020-12-11 09:34:52 2020-12-11 10:21:32 2020-12-11 10:37:31 0:15:59 0:08:47 0:07:12 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp rados rocksdb thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700890 2020-12-11 09:34:53 2020-12-11 10:21:32 2020-12-11 10:37:31 0:15:59 0:08:01 0:07:58 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-1-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs-balancer-upmap msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados rocksdb thrashers/none thrashosds-health workloads/cache-snaps} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700891 2020-12-11 09:34:53 2020-12-11 10:21:32 2020-12-11 10:37:31 0:15:59 0:08:12 0:07:47 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-require-luminous/at-mkfs msgr-failures/few msgr/random objectstore/filestore-xfs rados rocksdb thrashers/pggrow thrashosds-health workloads/cache} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

fail 5700892 2020-12-11 09:34:54 2020-12-11 10:21:32 2020-12-11 10:37:31 0:15:59 0:09:09 0:06:50 smithi py2 ubuntu rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-require-luminous/at-end msgr-failures/osd-delay msgr/simple objectstore/bluestore-bitmap rados rocksdb thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'