Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 5701391 2020-12-11 12:48:38 2020-12-11 12:49:12 2020-12-11 13:43:11 0:53:59 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701392 2020-12-11 12:48:39 2020-12-11 12:49:13 2020-12-11 13:17:11 0:27:58 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701393 2020-12-11 12:48:40 2020-12-11 12:49:11 2020-12-11 13:07:10 0:17:59 mira master ubuntu 18.04 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard}
Failure Reason:

reached maximum tries (100) after waiting for 600 seconds

dead 5701394 2020-12-11 12:48:41 2020-12-11 12:49:12 2020-12-11 13:05:11 0:15:59 mira master centos 8.2 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

fail 5701395 2020-12-11 12:48:41 2020-12-11 12:49:13 2020-12-11 16:11:16 3:22:03 0:28:50 2:53:13 mira master ubuntu 18.04 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

Test failure: test_host_smart (tasks.mgr.dashboard.test_host.HostControllerTest)

fail 5701396 2020-12-11 12:48:42 2020-12-11 12:49:11 2020-12-11 13:27:11 0:38:00 0:28:31 0:09:29 mira master ubuntu 18.04 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

Test failure: test_host_smart (tasks.mgr.dashboard.test_host.HostControllerTest)

dead 5701397 2020-12-11 12:48:43 2020-12-11 12:49:12 2020-12-11 13:05:11 0:15:59 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701398 2020-12-11 12:48:44 2020-12-11 12:49:13 2020-12-11 15:49:15 3:00:02 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701399 2020-12-11 12:48:45 2020-12-11 12:49:12 2020-12-11 13:03:11 0:13:59 0:03:37 0:10:22 mira master ubuntu 18.04 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'mira075.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-12-11 13:01:07.924703', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028288', 'stderr': ' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.\\n WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.\\n WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.\\n WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.\\n WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.\\n Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 13:01:07.896415', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.', ' WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.', ' WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.', ' WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.', ' WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.', ' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 13:01:08.100545', 'stdout': ' Labels on physical volume "/dev/sdc" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdc', 'rc': 0, 'start': '2020-12-11 13:01:08.068929', 'stderr': ' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.\\n WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.\\n WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.\\n WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.\\n WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.\\n WARNING: PV /dev/sdc is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdc of volume group "vg_hdd".', 'delta': '0:00:00.031616', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdc', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdc" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.', ' WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.', ' WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.', ' WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.', ' WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.', ' WARNING: PV /dev/sdc is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdc of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdc', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdc'}, {'changed': True, 'end': '2020-12-11 13:01:08.269573', 'stdout': ' Labels on physical volume "/dev/sdd" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdd', 'rc': 0, 'start': '2020-12-11 13:01:08.240464', 'stderr': ' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.\\n WARNING: Device for PV 6jHfRL-RdEG-NaCZ-kesn-0mMN-x3UI-j5Jz5Y not found or rejected by a filter.\\n WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.\\n WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.\\n WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.\\n WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.\\n WARNING: PV /dev/sdd is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdd of volume group "vg_hdd".', 'delta': '0:00:00.029109', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdd', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdd" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV iDSaqP-OcZc-SW8F-G29m-VVAu-5Nkj-FDTzjb not found or rejected by a filter.', ' WARNING: Device for PV 6jHfRL-RdEG-NaCZ-kesn-0mMN-x3UI-j5Jz5Y not found or rejected by a filter.', ' WARNING: Device for PV eE99w4-VxNS-EObj-NWxr-luKm-nfre-IZsSnk not found or rejected by a filter.', ' WARNING: Device for PV zjYzGX-qTD6-sZro-dvdB-qKq4-yGH1-OVjZ67 not found or rejected by a filter.', ' WARNING: Device for PV kDYMrc-uWmU-0MgW-yPXY-hRTF-ouUd-PuobPN not found or rejected by a filter.', ' WARNING: Device for PV JaEIKD-cXUt-OSsf-Prto-X1eK-OoKh-UooHEw not found or rejected by a filter.', ' WARNING: PV /dev/sdd is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdd of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdd', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdd'}, {'changed': True, 'end': '2020-12-11 13:01:08.434878', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.026371', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 13:01:08.408507', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 13:01:08.602139', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.029728', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 13:01:08.572411', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 13:01:08.770799', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.029157', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 13:01:08.741642', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 13:01:08.937391', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028070', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 13:01:08.909321', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '[unknown]')"}

dead 5701400 2020-12-11 12:48:46 2020-12-11 12:49:13 2020-12-11 15:49:15 3:00:02 mira master centos 8.2 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701401 2020-12-11 12:48:47 2020-12-11 12:49:12 2020-12-11 13:05:10 0:15:58 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701402 2020-12-11 12:48:47 2020-12-11 12:49:12 2020-12-11 13:05:11 0:15:59 mira master centos 8.2 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701403 2020-12-11 12:48:48 2020-12-11 12:49:13 2020-12-11 15:49:15 3:00:02 mira master centos 8.2 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701404 2020-12-11 12:48:49 2020-12-11 12:49:13 2020-12-11 15:49:15 3:00:02 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701405 2020-12-11 12:48:50 2020-12-11 12:49:12 2020-12-11 13:05:10 0:15:58 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701406 2020-12-11 12:48:51 2020-12-11 12:49:13 2020-12-11 15:47:15 2:58:02 0:03:41 2:54:21 mira master ubuntu 18.04 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

{'Failure object was': {'mira057.front.sepia.ceph.com': {'results': [{'changed': True, 'end': '2020-12-11 15:45:19.080919', 'stdout': ' Labels on physical volume "/dev/sdb" successfully wiped.', 'cmd': 'pvremove --force --force --yes /dev/sdb', 'rc': 0, 'start': '2020-12-11 15:45:19.046579', 'stderr': ' WARNING: Device for PV bsfF2E-7IG5-vMtu-9LtL-vKAr-52Ua-uvdwUC not found or rejected by a filter.\\n WARNING: Device for PV 7G0iO2-8olu-vLkE-7j6T-8eaY-F3MY-1u5wPv not found or rejected by a filter.\\n WARNING: Device for PV B5KVpD-hk6N-rjkc-52Cf-gpae-53Oc-HVYzDQ not found or rejected by a filter.\\n WARNING: Device for PV NkdY91-ehYU-ZGhu-ttr2-0Fbh-tE96-ti1w4R not found or rejected by a filter.\\n WARNING: Device for PV 8mJIwe-tdXp-2rVq-eNgF-6Foe-J3dE-78lIi0 not found or rejected by a filter.\\n WARNING: Device for PV X4SRsg-psez-Hwy1-f0Of-HTRf-oe2z-gjk2Vp not found or rejected by a filter.\\n WARNING: PV /dev/sdb is used by VG vg_hdd.\\n WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".', 'delta': '0:00:00.034340', 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes /dev/sdb', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'stdout_lines': [' Labels on physical volume "/dev/sdb" successfully wiped.'], 'stderr_lines': [' WARNING: Device for PV bsfF2E-7IG5-vMtu-9LtL-vKAr-52Ua-uvdwUC not found or rejected by a filter.', ' WARNING: Device for PV 7G0iO2-8olu-vLkE-7j6T-8eaY-F3MY-1u5wPv not found or rejected by a filter.', ' WARNING: Device for PV B5KVpD-hk6N-rjkc-52Cf-gpae-53Oc-HVYzDQ not found or rejected by a filter.', ' WARNING: Device for PV NkdY91-ehYU-ZGhu-ttr2-0Fbh-tE96-ti1w4R not found or rejected by a filter.', ' WARNING: Device for PV 8mJIwe-tdXp-2rVq-eNgF-6Foe-J3dE-78lIi0 not found or rejected by a filter.', ' WARNING: Device for PV X4SRsg-psez-Hwy1-f0Of-HTRf-oe2z-gjk2Vp not found or rejected by a filter.', ' WARNING: PV /dev/sdb is used by VG vg_hdd.', ' WARNING: Wiping physical volume label from /dev/sdb of volume group "vg_hdd".'], '_ansible_no_log': False, 'failed': False, 'item': '/dev/sdb', 'ansible_loop_var': 'item', '_ansible_item_label': '/dev/sdb'}, {'changed': True, 'end': '2020-12-11 15:45:19.249979', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.026991', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:19.222988', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 15:45:19.419790', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028702', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:19.391088', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 15:45:19.590164', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028265', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:19.561899', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 15:45:19.754892', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.024682', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:19.730210', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 15:45:19.918582', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.027307', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:19.891275', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}, {'changed': True, 'end': '2020-12-11 15:45:20.088737', 'stdout': '', 'cmd': 'pvremove --force --force --yes [unknown]', 'failed': True, 'delta': '0:00:00.028464', 'stderr': ' Device [unknown] not found.', 'rc': 5, 'invocation': {'module_args': {'creates': 'None', 'executable': 'None', '_uses_shell': True, 'strip_empty_ends': True, '_raw_params': 'pvremove --force --force --yes [unknown]', 'removes': 'None', 'argv': 'None', 'warn': True, 'chdir': 'None', 'stdin_add_newline': True, 'stdin': 'None'}}, 'start': '2020-12-11 15:45:20.060273', 'msg': 'non-zero return code', 'stdout_lines': [], 'stderr_lines': [' Device [unknown] not found.'], '_ansible_no_log': False, 'item': '[unknown]', 'ansible_loop_var': 'item', '_ansible_item_label': '[unknown]'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/dev/sdb')"}

dead 5701407 2020-12-11 12:48:52 2020-12-11 12:49:11 2020-12-11 13:05:10 0:15:59 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

dead 5701408 2020-12-11 12:48:53 2020-12-11 12:49:12 2020-12-11 13:05:11 0:15:59 mira master rhel 8.3 rados:dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds