Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
mira066.front.sepia.ceph.com mira True False centos 7 x86_64 None
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5220640 2020-07-13 05:55:57 2020-07-13 08:16:29 2020-07-13 08:42:28 0:25:59 0:08:06 0:17:53 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/centos_latest python_versions/python_2 tasks/ceph-admin-commands} 4
Failure Reason:

Command failed on mira083 with status 2: 'sudo tar cz -f - -C /var/lib/ceph/mon -- . > /tmp/tmp.64UulEYG8x'

pass 5220630 2020-07-13 05:55:48 2020-07-13 07:28:30 2020-07-13 08:18:31 0:50:01 0:24:11 0:25:50 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_bluestore_dmcrypt distros/centos_latest python_versions/python_3 tasks/ceph-admin-commands} 4
pass 5220623 2020-07-13 05:55:41 2020-07-13 06:36:11 2020-07-13 07:30:11 0:54:00 0:25:16 0:28:44 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_dmcrypt_off distros/centos_latest python_versions/python_3 tasks/rbd_import_export} 4
dead 5220620 2020-07-13 05:55:39 2020-07-13 06:22:08 2020-07-13 06:40:07 0:17:59 0:03:45 0:14:14 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/ubuntu_latest python_versions/python_2 tasks/rbd_import_export} 4
Failure Reason:

{'Failure object was': {'mira066.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-13 06:38:12.314909', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.029394', 'stderr': ' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.\\n WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.\\n WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.\\n WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.\\n WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-13 06:38:12.285515', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.', ' WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.', ' WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.', ' WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.', ' WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-13 06:38:12.586912', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.029315', 'stderr': ' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.\\n WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.\\n WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.\\n WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.\\n WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-13 06:38:12.557597', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.', ' WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.', ' WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.', ' WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.', ' WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-13 06:38:12.840146', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.031097', 'stderr': ' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.\\n WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.\\n WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.\\n WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.\\n WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-13 06:38:12.809049', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.', ' WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.', ' WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.', ' WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.', ' WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-13 06:38:13.084132', 'stdout': ' Labels on physical volume "/dev/sde" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sde', 'rc': 0, 'start': '2020-07-13 06:38:13.052914', 'stderr': ' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.\\n WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.\\n WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.\\n WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.\\n WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.\\n WARNING: PV /dev/sde is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sde of volume group "vg_hdd".', 'delta': '0:00:00.031218', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sde', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sde" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV fYpRzm-1Z8T-SFw0-2pPX-qOAt-4lbg-HgCH08 not found or rejected by a filter.', ' WARNING: Device for PV SOk6NC-WN40-iFfI-F9V7-zctT-dsID-03HynD not found or rejected by a filter.', ' WARNING: Device for PV rsi3q9-M7N9-JreN-7oA4-yUHA-eHUQ-D0RaIb not found or rejected by a filter.', ' WARNING: Device for PV EhSzp3-9Lwg-Eumm-zs7i-srsj-eaOd-DLvzBt not found or rejected by a filter.', ' WARNING: Device for PV hGKMpO-e5CE-WUoB-3xx3-zmji-WFAF-yVDjvq not found or rejected by a filter.', ' WARNING: PV /dev/sde is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sde of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sde', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sde'}, {'changed': True, 'end': '2020-07-13 06:38:13.339913', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.025850', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-13 06:38:13.314063', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-13 06:38:13.624784', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.027628', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-13 06:38:13.597156', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

pass 5220612 2020-07-13 05:55:32 2020-07-13 05:55:49 2020-07-13 06:25:49 0:30:00 0:17:08 0:12:52 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/ubuntu_latest python_versions/python_3 tasks/rbd_import_export} 4
pass 5212077 2020-07-10 00:10:56 2020-07-10 03:44:16 2020-07-10 04:44:17 1:00:01 0:42:26 0:17:35 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 5212067 2020-07-10 00:10:48 2020-07-10 02:37:47 2020-07-10 03:51:48 1:14:01 0:40:16 0:33:45 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 5212060 2020-07-10 00:10:42 2020-07-10 02:03:46 2020-07-10 02:59:48 0:56:02 0:31:22 0:24:40 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 5212026 2020-07-10 00:07:02 2020-07-10 01:21:28 2020-07-10 02:17:28 0:56:00 0:32:44 0:23:16 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 5212020 2020-07-10 00:06:56 2020-07-10 00:53:26 2020-07-10 01:35:25 0:41:59 0:27:52 0:14:07 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
fail 5212008 2020-07-10 00:06:44 2020-07-10 00:07:07 2020-07-10 00:57:07 0:50:00 0:36:48 0:13:12 mira master ubuntu 18.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2020-07-10T00:27:20.261458+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Degraded data redundancy: 8/196 objects degraded (4.082%), 7 pgs degraded (PG_DEGRADED)" in cluster log

pass 5202322 2020-07-06 05:55:55 2020-07-06 07:53:50 2020-07-06 08:53:50 1:00:00 0:16:38 0:43:22 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_dmcrypt_off distros/ubuntu_latest python_versions/python_3 tasks/rbd_import_export} 4
pass 5202315 2020-07-06 05:55:49 2020-07-06 07:19:39 2020-07-06 08:25:40 1:06:01 0:37:12 0:28:49 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/centos_latest python_versions/python_3 tasks/ceph-admin-commands} 4
fail 5202307 2020-07-06 05:55:42 2020-07-06 06:35:38 2020-07-06 06:55:37 0:19:59 0:04:17 0:15:42 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/ubuntu_latest python_versions/python_2 tasks/ceph-admin-commands} 4
Failure Reason:

Command failed on mira066 with status 2: 'sudo tar cz -f - -C /var/lib/ceph/mon -- . > /tmp/tmp.p3EwXQtpF0'

dead 5202301 2020-07-06 05:55:37 2020-07-06 05:55:38 2020-07-06 06:39:38 0:44:00 0:03:19 0:40:41 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_bluestore_dmcrypt distros/ubuntu_latest python_versions/python_2 tasks/rbd_import_export} 4
Failure Reason:

{'Failure object was': {'mira016.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-07-06 06:38:27.507546', 'stdout': ' Labels on physical volume "/dev/sdb" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdb', 'rc': 0, 'start': '2020-07-06 06:38:27.476931', 'stderr': ' WARNING: Device for PV 9cyMAK-g1E2-0XKk-20Ze-Y2jD-TIzD-wQA2Jf not found or rejected by a filter.\\n WARNING: Device for PV ZB6zga-9Vgp-jfNm-9cXQ-0B6b-3cvV-6WcQYZ not found or rejected by a filter.\\n WARNING: Device for PV jYQJsF-4vf1-Onjn-YwGs-aJVs-uhwa-6HaaHn not found or rejected by a filter.\\n WARNING: Device for PV 5VmXqr-c3R6-WXNC-vCkv-Ysvq-2zLe-Y24xB2 not found or rejected by a filter.\\n WARNING: Device for PV tcwZfs-7x0a-VGSe-JYyU-M78d-fHZ1-cCub5p not found or rejected by a filter.\\n WARNING: PV /dev/sdb is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".', 'delta': '0:00:00.030615', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdb', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdb" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV 9cyMAK-g1E2-0XKk-20Ze-Y2jD-TIzD-wQA2Jf not found or rejected by a filter.', ' WARNING: Device for PV ZB6zga-9Vgp-jfNm-9cXQ-0B6b-3cvV-6WcQYZ not found or rejected by a filter.', ' WARNING: Device for PV jYQJsF-4vf1-Onjn-YwGs-aJVs-uhwa-6HaaHn not found or rejected by a filter.', ' WARNING: Device for PV 5VmXqr-c3R6-WXNC-vCkv-Ysvq-2zLe-Y24xB2 not found or rejected by a filter.', ' WARNING: Device for PV tcwZfs-7x0a-VGSe-JYyU-M78d-fHZ1-cCub5p not found or rejected by a filter.', ' WARNING: PV /dev/sdb is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdb', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdb'}, {'changed': True, 'end': '2020-07-06 06:38:27.728377', 'stdout': ' Labels on physical volume "/dev/sdc" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdc', 'rc': 0, 'start': '2020-07-06 06:38:27.698871', 'stderr': ' WARNING: Device for PV MgPFl2-Vqki-ghs5-96xe-lgFt-wVkK-eGo1ZT not found or rejected by a filter.\\n WARNING: Device for PV 9cyMAK-g1E2-0XKk-20Ze-Y2jD-TIzD-wQA2Jf not found or rejected by a filter.\\n WARNING: Device for PV ZB6zga-9Vgp-jfNm-9cXQ-0B6b-3cvV-6WcQYZ not found or rejected by a filter.\\n WARNING: Device for PV jYQJsF-4vf1-Onjn-YwGs-aJVs-uhwa-6HaaHn not found or rejected by a filter.\\n WARNING: Device for PV 5VmXqr-c3R6-WXNC-vCkv-Ysvq-2zLe-Y24xB2 not found or rejected by a filter.\\n WARNING: Device for PV tcwZfs-7x0a-VGSe-JYyU-M78d-fHZ1-cCub5p not found or rejected by a filter.\\n WARNING: PV /dev/sdc is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdc of volume group "vg_hdd".', 'delta': '0:00:00.029506', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdc', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdc" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV MgPFl2-Vqki-ghs5-96xe-lgFt-wVkK-eGo1ZT not found or rejected by a filter.', ' WARNING: Device for PV 9cyMAK-g1E2-0XKk-20Ze-Y2jD-TIzD-wQA2Jf not found or rejected by a filter.', ' WARNING: Device for PV ZB6zga-9Vgp-jfNm-9cXQ-0B6b-3cvV-6WcQYZ not found or rejected by a filter.', ' WARNING: Device for PV jYQJsF-4vf1-Onjn-YwGs-aJVs-uhwa-6HaaHn not found or rejected by a filter.', ' WARNING: Device for PV 5VmXqr-c3R6-WXNC-vCkv-Ysvq-2zLe-Y24xB2 not found or rejected by a filter.', ' WARNING: Device for PV tcwZfs-7x0a-VGSe-JYyU-M78d-fHZ1-cCub5p not found or rejected by a filter.', ' WARNING: PV /dev/sdc is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdc of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdc', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdc'}, {'changed': True, 'end': '2020-07-06 06:38:27.920431', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028876', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-06 06:38:27.891555', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-06 06:38:28.168324', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028132', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-06 06:38:28.140192', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-06 06:38:28.357852', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.027411', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-06 06:38:28.330441', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-06 06:38:28.545150', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.026576', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-06 06:38:28.518574', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-07-06 06:38:28.735078', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.026096', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-07-06 06:38:28.708982', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/dev/sdb')"}

pass 5202299 2020-07-06 05:55:35 2020-07-06 05:55:37 2020-07-06 07:23:39 1:28:02 0:16:39 1:11:23 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/ubuntu_latest python_versions/python_3 tasks/ceph-admin-commands} 4
pass 5202295 2020-07-06 05:55:31 2020-07-06 05:55:35 2020-07-06 06:25:34 0:29:59 0:17:15 0:12:44 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/ubuntu_latest python_versions/python_3 tasks/rbd_import_export} 4
fail 5189059 2020-06-29 05:55:45 2020-06-29 07:32:05 2020-06-29 08:24:05 0:52:00 0:07:30 0:44:30 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_filestore distros/centos_latest python_versions/python_2 tasks/rbd_import_export} 4
Failure Reason:

Command failed on mira066 with status 2: 'sudo tar cz -f - -C /var/lib/ceph/mon -- . > /tmp/tmp.fuss9J2vev'

pass 5189049 2020-06-29 05:55:36 2020-06-29 06:43:58 2020-06-29 07:59:59 1:16:01 0:36:01 0:40:00 mira master centos 7.8 ceph-deploy/{cluster/4node config/ceph_volume_bluestore_dmcrypt distros/centos_latest python_versions/python_3 tasks/rbd_import_export} 4
fail 5189045 2020-06-29 05:55:33 2020-06-29 06:26:00 2020-06-29 07:00:00 0:34:00 0:04:07 0:29:53 mira master ubuntu 18.04 ceph-deploy/{cluster/4node config/ceph_volume_bluestore_dmcrypt distros/ubuntu_latest python_versions/python_2 tasks/ceph-admin-commands} 4
Failure Reason:

Command failed on mira066 with status 2: 'sudo tar cz -f - -C /var/lib/ceph/mon -- . > /tmp/tmp.0GRkYEEZcA'