dis-2020-07-10_00:06:37-krbd:fsx-wip-krbd-58-options-testing-basic-mira

{'Failure object was': {'mira071.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-10 00:23:42.908558', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.060693', 'stderr': ' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.\\n WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.\\n WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.\\n WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.\\n WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.\\n WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:42.847865', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.', ' WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.', ' WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.', ' WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.', ' WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.', ' WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:43.179682', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.065351', 'stderr': ' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.\\n WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.\\n WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.\\n WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.\\n WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.\\n WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:43.114331', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.', ' WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.', ' WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.', ' WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.', ' WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.', ' WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:43.442602', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.061860', 'stderr': ' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.\\n WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.\\n WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.\\n WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.\\n WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.\\n WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:43.380742', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.', ' WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.', ' WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.', ' WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.', ' WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.', ' WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:43.699226', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.064275', 'stderr': ' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.\\n WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.\\n WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.\\n WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.\\n WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.\\n WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:43.634951', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.', ' WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.', ' WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.', ' WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.', ' WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.', ' WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:43.973709', 'stdout': ' Labels on physical volume "/dev/sdf" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdf', 'rc': 0, 'start': '2020-07-10 00:23:43.912059', 'stderr': ' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.\\n WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.\\n WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.\\n WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.\\n WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.\\n WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.\\n WARNING: PV /dev/sdf is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdf of volume group "vg_hdd".', 'delta': '0:00:00.061650', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdf', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdf" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV Lx1Yhd-O35i-msQt-lOr7-ae7n-fYLG-ExqxTU not found or rejected by a filter.', ' WARNING: Device for PV IQ4b5Y-N4iH-xCif-2Uur-cqgc-3TpE-RAdesk not found or rejected by a filter.', ' WARNING: Device for PV 53pxrF-CaeZ-J1Nr-ik4U-Yrl2-qpP7-eLGNKv not found or rejected by a filter.', ' WARNING: Device for PV uoGyCe-Rz1i-HVdA-sidT-njd2-kUO9-dH5p8V not found or rejected by a filter.', ' WARNING: Device for PV QONSv2-gc19-W46i-Ofp2-5ZEf-bfs8-Vq16on not found or rejected by a filter.', ' WARNING: Device for PV 3G3pdD-2qVq-7XTV-M8Yn-jwMU-x6cp-0qGRAo not found or rejected by a filter.', ' WARNING: PV /dev/sdf is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdf of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdf', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdf'}, {'changed': True, 'end': '2020-07-10 00:23:44.237821', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.056504', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:44.181317', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:44.504220', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.055818', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:44.448402', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

{'Failure object was': {'mira053.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-10 00:22:59.934235', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.061629', 'stderr': ' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.\\n WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.\\n WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.\\n WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.\\n WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.\\n WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:59.872606', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.', ' WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.', ' WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.', ' WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.', ' WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.', ' WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:00.201664', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.064843', 'stderr': ' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.\\n WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.\\n WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.\\n WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.\\n WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.\\n WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:00.136821', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.', ' WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.', ' WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.', ' WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.', ' WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.', ' WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:00.465737', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.062194', 'stderr': ' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.\\n WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.\\n WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.\\n WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.\\n WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.\\n WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:00.403543', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.', ' WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.', ' WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.', ' WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.', ' WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.', ' WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:00.747347', 'stdout': ' Labels on physical volume "/dev/sde" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sde', 'rc': 0, 'start': '2020-07-10 00:23:00.680548', 'stderr': ' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.\\n WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.\\n WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.\\n WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.\\n WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.\\n WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.\\n WARNING: PV /dev/sde is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sde of volume group "vg_hdd".', 'delta': '0:00:00.066799', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sde', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sde" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV ZLV7C7-wfCp-4H9V-APA5-8eEF-iFyR-SdN164 not found or rejected by a filter.', ' WARNING: Device for PV RnrUMK-kcPf-irIA-fxoi-5pPh-Ov3g-Wh05CH not found or rejected by a filter.', ' WARNING: Device for PV e8qPGl-TbeC-JaP0-QVeo-t2kE-1c59-yJ7cJ0 not found or rejected by a filter.', ' WARNING: Device for PV 2kOeTJ-47ts-yMw8-EZiz-G0jQ-kWKR-KL3NYb not found or rejected by a filter.', ' WARNING: Device for PV qdCO4w-uhui-bKsL-gdGL-cQHw-hgjw-R3KfZU not found or rejected by a filter.', ' WARNING: Device for PV ynIzwg-8XOh-d5w3-09qH-vcSu-rqE7-5K0D3W not found or rejected by a filter.', ' WARNING: PV /dev/sde is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sde of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sde', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sde'}, {'changed': True, 'end': '2020-07-10 00:23:01.011318', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.061651', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:00.949667', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:01.309627', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.062967', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:01.246660', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:01.574563', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.060252', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:01.514311', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

{'Failure object was': {'mira057.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-10 00:22:14.065495', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.069287', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:13.996208', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:14.341326', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.061908', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:14.279418', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:14.604568', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.062854', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:14.541714', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:14.887425', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.060761', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:14.826664', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:15.181612', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.063999', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:15.117613', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:15.460348', 'stdout': ' Labels on physical volume "/dev/sdg" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdg', 'rc': 0, 'start': '2020-07-10 00:22:15.395603', 'stderr': ' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.\\n WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.\\n WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.\\n WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.\\n WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.\\n WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.\\n WARNING: PV /dev/sdg is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdg of volume group "vg_hdd".', 'delta': '0:00:00.064745', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdg', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdg" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV UvYAwt-m5Hd-nEBk-6f03-V5bC-rEsf-pYM8pk not found or rejected by a filter.', ' WARNING: Device for PV 6Sl7cM-4ddl-wnWm-CR3e-z342-nzdq-ROPsCE not found or rejected by a filter.', ' WARNING: Device for PV 0OI5Zh-Rf94-YRYL-7YJW-KMte-TeIK-h66XXF not found or rejected by a filter.', ' WARNING: Device for PV MYLPTk-FiH7-KMA5-qbk2-9fFN-T6Yx-WCGwdh not found or rejected by a filter.', ' WARNING: Device for PV ezvZ88-aPEm-Fpyi-bMes-LBde-EXUC-77Hkxv not found or rejected by a filter.', ' WARNING: Device for PV amSnkm-jaVK-LjGx-A5xZ-Zkcq-Urzq-RK9JbY not found or rejected by a filter.', ' WARNING: PV /dev/sdg is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdg of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdg', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdg'}, {'changed': True, 'end': '2020-07-10 00:22:15.722891', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.059932', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:15.662959', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

"2020-07-10T00:27:20.261458+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Degraded data redundancy: 8/196 objects degraded (4.082%), 7 pgs degraded (PG_DEGRADED)" in cluster log

{'Failure object was': {'mira077.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-10 00:23:23.504204', 'stdout': ' Labels on physical volume "/dev/sdb" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdb', 'rc': 0, 'start': '2020-07-10 00:23:23.437497', 'stderr': ' WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.\\n WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.\\n WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.\\n WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.\\n WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.\\n WARNING: PV /dev/sdb is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".', 'delta': '0:00:00.066707', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdb', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdb" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.', ' WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.', ' WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.', ' WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.', ' WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.', ' WARNING: PV /dev/sdb is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdb', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdb'}, {'changed': True, 'end': '2020-07-10 00:23:23.784503', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.061873', 'stderr': ' WARNING: Device for PV uepOqc-vyXv-4d3s-yWr3-XAQh-CkMC-kJCBsE not found or rejected by a filter.\\n WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.\\n WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.\\n WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.\\n WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.\\n WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:23.722630', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV uepOqc-vyXv-4d3s-yWr3-XAQh-CkMC-kJCBsE not found or rejected by a filter.', ' WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.', ' WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.', ' WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.', ' WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.', ' WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:24.048372', 'stdout': ' Labels on physical volume "/dev/sdd" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdd', 'rc': 0, 'start': '2020-07-10 00:23:23.975803', 'stderr': ' WARNING: Device for PV uepOqc-vyXv-4d3s-yWr3-XAQh-CkMC-kJCBsE not found or rejected by a filter.\\n WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.\\n WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.\\n WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.\\n WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.\\n WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.\\n WARNING: PV /dev/sdd is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdd of volume group "vg_hdd".', 'delta': '0:00:00.072569', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdd', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdd" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV uepOqc-vyXv-4d3s-yWr3-XAQh-CkMC-kJCBsE not found or rejected by a filter.', ' WARNING: Device for PV nwSbAd-xSUN-M6u4-xNR7-u8Nq-uYX5-eXxLXp not found or rejected by a filter.', ' WARNING: Device for PV 6n1zi3-YWCp-wLlI-WLEf-I0Y9-utzv-FOE38f not found or rejected by a filter.', ' WARNING: Device for PV Ajh3w1-RW8e-zNdH-2Sn6-XdQn-M4gb-XQhxfY not found or rejected by a filter.', ' WARNING: Device for PV Jy8Ngq-nx2q-1iDS-sdyb-RIdv-9J49-xW7zHW not found or rejected by a filter.', ' WARNING: Device for PV KaauKf-x2xC-8lPU-EVPm-KOaj-bjCM-FmqeYW not found or rejected by a filter.', ' WARNING: PV /dev/sdd is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdd of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdd', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdd'}, {'changed': True, 'end': '2020-07-10 00:23:24.308031', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.059997', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:24.248034', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:24.579598', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.057134', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:24.522464', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:24.835017', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.055769', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:24.779248', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:23:25.088943', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.054616', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:23:25.034327', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/dev/sdb')"}

"2020-07-10T00:28:29.351316+0000 mon.b (mon.0) 142 : cluster [WRN] Health check failed: Degraded data redundancy: 5/110 objects degraded (4.545%), 2 pgs degraded (PG_DEGRADED)" in cluster log

{'Failure object was': {'mira041.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-10 00:22:08.821929', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.063970', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:08.757959', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:09.092479', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.066620', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:09.025859', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:09.374313', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.065615', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:09.308698', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:09.655757', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.062233', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:09.593524', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:09.952398', 'stdout': ' Labels on physical volume "/dev/sdf" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdf', 'rc': 0, 'start': '2020-07-10 00:22:09.884286', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n WARNING: PV /dev/sdf is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdf of volume group "vg_hdd".', 'delta': '0:00:00.068112', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdf', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdf" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' WARNING: PV /dev/sdf is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdf of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdf', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdf'}, {'changed': True, 'end': '2020-07-10 00:22:10.222437', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.068400', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV xFaB8V-Kqk1-RtOp-ROBs-eIpw-wC5u-0wStw0 not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-10 00:22:10.154037', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV xFaB8V-Kqk1-RtOp-ROBs-eIpw-wC5u-0wStw0 not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-10 00:22:10.496591', 'stdout': ' Labels on physical volume "/dev/sdh" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdh', 'rc': 0, 'start': '2020-07-10 00:22:10.425690', 'stderr': ' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.\\n WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.\\n WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.\\n WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.\\n WARNING: Device for PV xFaB8V-Kqk1-RtOp-ROBs-eIpw-wC5u-0wStw0 not found or rejected by a filter.\\n WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.\\n WARNING: PV /dev/sdh is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdh of volume group "vg_hdd".', 'delta': '0:00:00.070901', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdh', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdh" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV 2cazj1-C05J-spMp-jlra-Z18t-gJhu-yErI3s not found or rejected by a filter.', ' WARNING: Device for PV 2doVbI-avfO-L0YW-jSoa-V3ZH-c6la-xF7PYG not found or rejected by a filter.', ' WARNING: Device for PV 3fwsWV-0mZF-aUfZ-vnuC-3OFZ-Cvus-zbJvsP not found or rejected by a filter.', ' WARNING: Device for PV JUhZzk-SNsd-X06T-XLR0-ADR2-DaLu-19TCib not found or rejected by a filter.', ' WARNING: Device for PV xFaB8V-Kqk1-RtOp-ROBs-eIpw-wC5u-0wStw0 not found or rejected by a filter.', ' WARNING: Device for PV EuJUlz-9HC6-soT4-CKXy-ygtq-XdCe-TxnfD8 not found or rejected by a filter.', ' WARNING: PV /dev/sdh is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdh of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdh', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdh'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

"2020-07-10T01:34:31.344872+0000 mon.b (mon.0) 126 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log