Description: multimds/basic/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml}

Log: http://qa-proxy.ceph.com/teuthology/sidharthanup-2020-04-29_15:59:48-multimds-master-distro-default-smithi/4997939/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=9d46461af6f84f4db8d212d62fd00bb6

Failure Reason:

File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main\n return managercli.ManagerCLI().main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main\n ret = CLI.main(self)\n File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main\n return cmd.main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main\n return_code = self._do_command()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command\n release=self.options.release\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer\n ret = self.conn.request_put(method, params)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put\n return self._request("PUT", method, params, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request\n info=info, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request\n self.validateResponse(result, request_type, handler)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse\n raise RestlibException(response[\'status\'], error_msg, response.get(\'headers\'))\nrhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/9039a5be-acb9-4563-9f6b-82b0ac52e7c4', 'rc': 1, 'start': '2020-04-29 16:13:05.081724', 'end': '2020-04-29 16:13:06.162333', 'delta': '0:00:01.080609', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'subscription-manager release --set=8.1', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': ['Traceback (most recent call last):', ' File "/sbin/subscription-manager", line 11, in <module>', " load_entry_point('subscription-manager==1.25.17', 'console_scripts', 'subscription-manager')()", ' File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main', ' return managercli.ManagerCLI().main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main', ' ret = CLI.main(self)', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main', ' return cmd.main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main', ' return_code = self._do_command()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command', ' release=self.options.release', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer', ' ret = self.conn.request_put(method, params)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put', ' return self._request("PUT", method, params, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request', ' info=info, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request', ' self.validateResponse(result, request_type, handler)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse', " raise RestlibException(response['status'], error_msg, response.get('headers'))", 'rhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.', 'Please inspect their state, fix their errors and resume them.', '', 'Required lock: update', 'Conflicts with tasks:', '- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/9039a5be-acb9-4563-9f6b-82b0ac52e7c4'], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence('tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'subscription-manager')Failure object was: {'smithi065.front.sepia.ceph.com': {'msg': 'non-zero return code', 'cmd': ['subscription-manager', 'release', '--set=8.1'], 'stdout': '', 'stderr': 'Traceback (most recent call last):\n File "/sbin/subscription-manager", line 11, in <module>\n load_entry_point(\'subscription-manager==1.25.17\', \'console_scripts\', \'subscription-manager\')()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main\n return managercli.ManagerCLI().main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main\n ret = CLI.main(self)\n File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main\n return cmd.main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main\n return_code = self._do_command()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command\n release=self.options.release\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer\n ret = self.conn.request_put(method, params)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put\n return self._request("PUT", method, params, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request\n info=info, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request\n self.validateResponse(result, request_type, handler)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse\n raise RestlibException(response[\'status\'], error_msg, response.get(\'headers\'))\nrhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/88c40284-e563-44e4-9068-da7608f95477', 'rc': 1, 'start': '2020-04-29 16:13:06.047455', 'end': '2020-04-29 16:13:07.137908', 'delta': '0:00:01.090453', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'subscription-manager release --set=8.1', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': ['Traceback (most recent call last):', ' File "/sbin/subscription-manager", line 11, in <module>', " load_entry_point('subscription-manager==1.25.17', 'console_scripts', 'subscription-manager')()", ' File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main', ' return managercli.ManagerCLI().main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main', ' ret = CLI.main(self)', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main', ' return cmd.main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main', ' return_code = self._do_command()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command', ' release=self.options.release', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer', ' ret = self.conn.request_put(method, params)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put', ' return self._request("PUT", method, params, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request', ' info=info, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request', ' self.validateResponse(result, request_type, handler)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse', " raise RestlibException(response['status'], error_msg, response.get('headers'))", 'rhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.', 'Please inspect their state, fix their errors and resume them.', '', 'Required lock: update', 'Conflicts with tasks:', '- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/88c40284-e563-44e4-9068-da7608f95477'], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence('tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'subscription-manager')

  • log_href: http://qa-proxy.ceph.com/teuthology/sidharthanup-2020-04-29_15:59:48-multimds-master-distro-default-smithi/4997939/teuthology.log
  • archive_path: /home/teuthworker/archive/sidharthanup-2020-04-29_15:59:48-multimds-master-distro-default-smithi/4997939
  • description: multimds/basic/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml}
  • duration: 0:01:45
  • email: sanupkri@redhat.com
  • failure_reason: File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main\n return managercli.ManagerCLI().main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main\n ret = CLI.main(self)\n File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main\n return cmd.main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main\n return_code = self._do_command()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command\n release=self.options.release\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer\n ret = self.conn.request_put(method, params)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put\n return self._request("PUT", method, params, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request\n info=info, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request\n self.validateResponse(result, request_type, handler)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse\n raise RestlibException(response[\'status\'], error_msg, response.get(\'headers\'))\nrhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/9039a5be-acb9-4563-9f6b-82b0ac52e7c4', 'rc': 1, 'start': '2020-04-29 16:13:05.081724', 'end': '2020-04-29 16:13:06.162333', 'delta': '0:00:01.080609', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'subscription-manager release --set=8.1', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': ['Traceback (most recent call last):', ' File "/sbin/subscription-manager", line 11, in ', " load_entry_point('subscription-manager==1.25.17', 'console_scripts', 'subscription-manager')()", ' File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main', ' return managercli.ManagerCLI().main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main', ' ret = CLI.main(self)', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main', ' return cmd.main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main', ' return_code = self._do_command()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command', ' release=self.options.release', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer', ' ret = self.conn.request_put(method, params)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put', ' return self._request("PUT", method, params, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request', ' info=info, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request', ' self.validateResponse(result, request_type, handler)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse', " raise RestlibException(response['status'], error_msg, response.get('headers'))", 'rhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.', 'Please inspect their state, fix their errors and resume them.', '', 'Required lock: update', 'Conflicts with tasks:', '- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/9039a5be-acb9-4563-9f6b-82b0ac52e7c4'], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence('tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'subscription-manager')Failure object was: {'smithi065.front.sepia.ceph.com': {'msg': 'non-zero return code', 'cmd': ['subscription-manager', 'release', '--set=8.1'], 'stdout': '', 'stderr': 'Traceback (most recent call last):\n File "/sbin/subscription-manager", line 11, in \n load_entry_point(\'subscription-manager==1.25.17\', \'console_scripts\', \'subscription-manager\')()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main\n return managercli.ManagerCLI().main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main\n ret = CLI.main(self)\n File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main\n return cmd.main()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main\n return_code = self._do_command()\n File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command\n release=self.options.release\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer\n ret = self.conn.request_put(method, params)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put\n return self._request("PUT", method, params, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request\n info=info, headers=headers)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request\n self.validateResponse(result, request_type, handler)\n File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse\n raise RestlibException(response[\'status\'], error_msg, response.get(\'headers\'))\nrhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/88c40284-e563-44e4-9068-da7608f95477', 'rc': 1, 'start': '2020-04-29 16:13:06.047455', 'end': '2020-04-29 16:13:07.137908', 'delta': '0:00:01.090453', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'subscription-manager release --set=8.1', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': ['Traceback (most recent call last):', ' File "/sbin/subscription-manager", line 11, in ', " load_entry_point('subscription-manager==1.25.17', 'console_scripts', 'subscription-manager')()", ' File "/usr/lib64/python3.6/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main', ' return managercli.ManagerCLI().main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 2982, in main', ' ret = CLI.main(self)', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/cli.py", line 183, in main', ' return cmd.main()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 536, in main', ' return_code = self._do_command()', ' File "/usr/lib64/python3.6/site-packages/subscription_manager/managercli.py", line 1680, in _do_command', ' release=self.options.release', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 1121, in updateConsumer', ' ret = self.conn.request_put(method, params)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 735, in request_put', ' return self._request("PUT", method, params, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 752, in _request', ' info=info, headers=headers)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 627, in _request', ' self.validateResponse(result, request_type, handler)', ' File "/usr/lib64/python3.6/site-packages/rhsm/connection.py", line 689, in validateResponse', " raise RestlibException(response['status'], error_msg, response.get('headers'))", 'rhsm.connection.RestlibException: HTTP error (500 - Internal Server Error): Required lock is already taken by other running tasks.', 'Please inspect their state, fix their errors and resume them.', '', 'Required lock: update', 'Conflicts with tasks:', '- https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/88c40284-e563-44e4-9068-da7608f95477'], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence('tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'subscription-manager')
  • flavor:
  • job_id: 4997939
  • kernel:
    • client:
      • sha1: distro
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: sidharthanup-2020-04-29_15:59:48-multimds-master-distro-default-smithi
  • nuke_on_error: True
  • os_type: rhel
  • os_version: 8.1
  • overrides:
    • ceph-deploy:
      • fs: xfs
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
        • osd:
          • mon osd full ratio: 0.9
          • mon osd backfillfull_ratio: 0.85
          • bluestore fsck on mount: True
          • mon osd nearfull ratio: 0.8
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • bluestore block size: 96636764160
          • debug rocksdb: 10
          • osd failsafe full ratio: 0.95
      • bluestore: True
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • sha1: 5d4f7f2fb5a442c8a51f6aa7e0314f7e832bc263
      • branch: qa-test-exports-fix
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
      • fs: xfs
      • cephfs_ec_profile:
        • m=2
        • k=2
        • crush-failure-domain=osd
      • sha1: c033094bfb23c79c15233f25aea5f3481129216c
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • fuse default permissions: False
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • mon osd full ratio: 0.9
          • debug ms: 20
          • debug journal: 20
          • debug osd: 25
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • mon osd backfillfull_ratio: 0.85
          • osd op complaint time: 180
          • bluestore block size: 96636764160
          • debug filestore: 20
          • debug rocksdb: 10
          • mon osd nearfull ratio: 0.8
          • osd failsafe full ratio: 0.95
          • bluestore fsck on mount: True
      • max_mds: 9
    • install:
      • ceph:
        • sha1: c033094bfb23c79c15233f25aea5f3481129216c
    • admin_socket:
      • branch: master
    • thrashosds:
      • bdev_inject_crash_probability: 0.5
      • bdev_inject_crash: 2
  • owner: scheduled_sidharthanup@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mon.c', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mgr.x', 'mds.e', 'mds.f', 'mds.g', 'mds.h', 'mds.i', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0', 'client.1']
  • sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=9d46461af6f84f4db8d212d62fd00bb6
  • status: dead
  • success: False
  • branch: master
  • seed:
  • sha1: c033094bfb23c79c15233f25aea5f3481129216c
  • subset:
  • suite:
  • suite_branch: qa-test-exports-fix
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 5d4f7f2fb5a442c8a51f6aa7e0314f7e832bc263
  • targets:
    • smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1pTP9GY9AK5VhWllroHxHVCEE7J2KRE2UnBZUBq4Arfsgg7choj6N9MGnmm036VcaxFCkOoVRloWvgtZE8ofmJl+z5N1AidF1FuD1e+xZT7CEm7MYXR47bm+a1Jq/gnGRXTllxlEuG+CAx3/s4xnRpNpwoHW2+9Yeje8WUUl6XMOE/oHvAkRCbvU0kjyLkhs+xYo80oa0PeHzJCjeVZ/jLZJ2D1wyc9Kb4bmgiG6Emg83OnWDRlkCwf1C17eYt9tnEszQ9jbfeRa0lsuMrzngxE8LULzgvDOKbFDoGZnd6+S82m9J+FewwVfDorFtFE1dcioqkP2IB0TuesT+qW8cqtSZllnhbdapeVkPTa5nGCd+Eg577X0IMDhs7rSAulujDLkw7uGoj4ZFRLGkQxPPoao+/y6sAu0UaARtpHQJyeuoN46SSo/Pa3DkGUHjVw8pQ1NtpzaaDdxbOlQsoGxKjhGsz8PcLoqNcl6o8pbJCq46dftSQHQpqo9wqZ5F/nE=
    • smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClWXwU0aByx7tPP2TDlsBEu6ERp7aczkGywX0FxeoQBMKOgT2XSp8YAx2g5dqJq8FX8z4ezpk2KdU3cl16v5J5RuAnO+VaDgeW7GXa22hQWjHu0y/D6QWzRPLeSSuYOBdwbPJd/oZChnV5t7AsWYBOJk4y2iTWS3wxLHQGcNdU4ufn7TmJgk64j64BbVGYandHqZjqol+WkW42myXbr77Cas2rFiD9Zu9WMp8NHlX5TlgHgY/jU3vgcuS5kG1PkB8y80JF3p7kqD3EXbjQdc5trsORzF7+G3Yp+Fi/YGhDttVzR1jxzElj8C/HpDNi4hucCOHJt1RuLqYudne3pjQTnMHwGDbShUg8gwIk5iQPpQqfJosFrtWT85SyGUIs2BFpQ6NC81nRpVEMWwAgcDXjby8PGvKaOdSkKw5bnTouhkNpPPONEsf30FzY7k16CTXA3z9zOIEJDp8gaxoErlGALYlySva7L80uKt7xn9rHQkWrt+3/ciKW4JDEq4DyU70=
    • smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOpFKvPGAZn53szYiIzYWNC9mUaGCsJCe/p99x2rHkccUu23yfEs+AHWJPLRNlOCu1OpziuIgQ5zZBJKTzMCD8tts9a77yZt3xDspE5lUXgISZ9zMzzSzivfvmJ1W0tSQu6esfG1bud7uQl91pBPdp5Um+EeK/RXcaRHOFc05nVXeCKqZ7EgAp2HxXEvCwLVR14OIuHzo1ygUqDK9uY+doYQ5Q+vmq9GpXAmDlzMlTa9barKNV1NIKY1YJ72f76N59p+NlMFghy7k/u5Y50WYNp/HRZYR+7bs5ObPqxLxEeN2k6yQEwiKx9jScJgGiCNWlT93vI4L1EOFjK94SGPOQenoF7n3MmMAj0v/m/PVRIL5Z+hHUKTBvIYxmIlV7l0yxO2WXqn+SM8IgNWZGD2ltbv53V2PBKF4umOsr4V5as/BKqau9eD/fVd02H4GTBZnESbVcOGvGCP6bv4WYXLLJ42Cm6fI6T13OoQMoXGgHYCIMWfdC+xHekY8rIo4EW8c=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 3
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • sha1: distro
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • network-manager
          • iproute2
          • util-linux
          • dump
          • indent
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • NetworkManager
          • iproute
          • util-linux
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
    • ceph:
    • exec:
      • client.0:
        • sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it
    • kclient:
    • check-counter:
      • counters:
        • mds:
          • mds.exported
          • mds.imported
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_exports
      • fail_on_skip: False
  • teuthology_branch: master
  • verbose: False
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-04-29 16:01:26
  • started: 2020-04-29 16:01:44
  • updated: 2020-04-29 16:13:44
  • status_class: danger
  • runtime: 0:12:00
  • wait_time: 0:10:15