Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 3839558 2019-04-13 01:25:26 2019-04-13 14:31:54 2019-04-13 15:49:54 1:18:00 0:35:10 0:42:50 smithi master centos 7.5 upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade.yaml supported-all-distro/centos_latest.yaml} 3
Failure Reason:

Command failed on smithi062 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 3839559 2019-04-13 01:25:27 2019-04-13 14:31:54 2019-04-13 16:19:55 1:48:01 0:26:28 1:21:33 smithi master centos 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi136 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 3839560 2019-04-13 01:25:28 2019-04-13 14:32:01 2019-04-13 15:20:01 0:48:00 0:28:41 0:19:19 smithi master rhel 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-comp.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 3839561 2019-04-13 01:25:29 2019-04-13 14:34:03 2019-04-13 14:56:02 0:21:59 0:04:43 0:17:16 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-stupid.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

1'], u'uuids': []}, u'sectors': u'781422768', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}, u'model': u'INTEL SSDPEDMD400G4', u'serial': u'PHFT6204010G400BGN', u'size': u'372.61 GB'}, 'key': u'nvme0n1'}, u'delta': u'0:00:01.111482', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'Creating new GPT entries.', u'GPT data structures destroyed! You may now partition the disk using fdisk or', u'other utilities.'], u'start': u'2019-04-13 14:53:53.731173', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4', u'end': u'2019-04-13 14:53:56.086170', '_ansible_no_log': False, u'stdout': u'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', '_ansible_item_result': True, u'changed': True, 'item': {'value': {u'scheduler_mode': u'', u'rotational': u'0', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-KSoSt597e2LD41ofHTAlF6W3xGtLzRP0KOUx0RByPSF5vMJbZkF1UjfycstXgGB4'], u'uuids': [u'bf079c1a-daee-46d0-ad18-8157f6884689']}, u'sectors': u'187539456', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [], u'partitions': {}, u'model': None, u'serial': u'PHFT6204010G400BGN', u'size': u'89.43 GB'}, 'key': u'dm-4'}, u'delta': u'0:00:01.056556', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'Creating new GPT entries.', u'Warning: The kernel is still using the old partition table.', u'The new table will be used at the next reboot.', u'GPT data structures destroyed! You may now partition the disk using fdisk or', u'other utilities.'], u'start': u'2019-04-13 14:53:55.029614', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2', u'end': u'2019-04-13 14:53:57.345776', '_ansible_no_log': False, u'stdout': u'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', '_ansible_item_result': True, u'changed': True, 'item': {'value': {u'scheduler_mode': u'', u'rotational': u'0', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-KSoSt597e2LD41ofHTAlF6W3xGtLzRP0ALrUSqsBlQonccMDxme0dLDHdgACRncw'], u'uuids': [u'1d51f2b4-c224-4d77-87c8-199a71dfcc81']}, u'sectors': u'187539456', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [], u'partitions': {}, u'model': None, u'serial': u'PHFT6204010G400BGN', u'size': u'89.43 GB'}, 'key': u'dm-2'}, u'delta': u'0:00:01.046930', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'Creating new GPT entries.', u'Warning: The kernel is still using the old partition table.', u'The new table will be used at the next reboot.', u'GPT data structures destroyed! You may now partition the disk using fdisk or', u'other utilities.'], u'start': u'2019-04-13 14:53:56.298846', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3', u'end': u'2019-04-13 14:53:58.638294', '_ansible_no_log': False, u'stdout': u'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', '_ansible_item_result': True, u'changed': True, 'item': {'value': {u'scheduler_mode': u'', u'rotational': u'0', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-KSoSt597e2LD41ofHTAlF6W3xGtLzRP0FtYSA3fmOSjFgONq5QT6Bw5F8DC4dCuL'], u'uuids': [u'24246178-422f-4dd7-937b-7c9da9ab000a']}, u'sectors': u'187539456', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [], u'partitions': {}, u'model': None, u'serial': u'PHFT6204010G400BGN', u'size': u'89.43 GB'}, 'key': u'dm-3'}, u'delta': u'0:00:01.041784', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'Creating new GPT entries.', u'Warning: The kernel is still using the old partition table.', u'The new table will be used at the next reboot.', u'GPT data structures destroyed! You may now partition the disk using fdisk or', u'other utilities.'], u'start': u'2019-04-13 14:53:57.596510', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [u'Warning! MBR not overwritten! Error is 5!'], u'cmd': u'sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0', u'end': u'2019-04-13 14:54:00.032521', '_ansible_no_log': False, u'stdout': u'Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.', '_ansible_item_result': True, u'changed': True, 'item': {'value': {u'scheduler_mode': u'', u'rotational': u'0', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-KSoSt597e2LD41ofHTAlF6W3xGtLzRP0eBxEcMKFGJWyzyYr3RGiDaiVGtkQ68ht'], u'uuids': [u'88347c6e-86d6-437b-95eb-594a9bafbf64']}, u'sectors': u'31252480', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [], u'partitions': {}, u'model': None, u'serial': u'PHFT6204010G400BGN', u'size': u'14.90 GB'}, 'key': u'dm-0'}, u'delta': u'0:00:01.201575', u'stderr': u'Warning! MBR not overwritten! Error is 5!', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'Creating new GPT entries.', u'Warning: The kernel is still using the old partition table.', u'The new table will be used at the next reboot.', u'GPT data structures destroyed! You may now partition the disk using fdisk or', u'other utilities.'], u'start': u'2019-04-13 14:53:58.830946', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [u'Problem opening /dev/dm-1 for reading! Error is 2.', u'The specified file does not exist!', u"Problem opening '' for writing! Program will now terminate.", u'Warning! MBR not overwritten! Error is 2!', u'Problem opening /dev/dm-1 for reading! Error is 2.', u'The specified file does not exist!', u"Problem opening '' for writing! Program will now terminate.", u'Warning! MBR not overwritten! Error is 2!'], u'cmd': u'sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1', u'end': u'2019-04-13 14:54:00.217922', '_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': True, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u'sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'item': {'value': {u'scheduler_mode': u'', u'rotational': u'0', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-KSoSt597e2LD41ofHTAlF6W3xGtLzRP0C7dHfBA1zjU12KB8Ln7b2t9pSzAzHfg6'], u'uuids': [u'5af63665-403a-4b06-8244-a2a0bb8a47b3']}, u'sectors': u'187539456', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'512', u'holders': [], u'partitions': {}, u'model': None, u'serial': u'PHFT6204010G400BGN', u'size': u'89.43 GB'}, 'key': u'dm-1'}, u'delta': u'0:00:00.006817', u'stderr': u"Problem opening /dev/dm-1 for reading! Error is 2.\nThe specified file does not exist!\nProblem opening '' for writing! Program will now terminate.\nWarning! MBR not overwritten! Error is 2!\nProblem opening /dev/dm-1 for reading! Error is 2.\nThe specified file does not exist!\nProblem opening '' for writing! Program will now terminate.\nWarning! MBR not overwritten! Error is 2!", u'rc': 2, u'msg': u'non-zero return code', 'stdout_lines': [], u'start': u'2019-04-13 14:54:00.211105', u'failed': True}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 218, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 190, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 217, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 101, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 249, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)smithi112.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_result: true _ansible_no_log: false _ansible_parsed: true changed: false err: " /dev/vg_nvme/lv_5: not found: device not cleared\n Aborting. Failed to\ \ wipe start of new LV.\n" failed: true invocation: module_args: {active: true, force: false, lv: lv_5, opts: null, pvs: null, shrink: true, size: 4%VG, snapshot: null, state: present, vg: vg_nvme} item: key: lv_5 value: {size: 4%VG, vg: vg_nvme} msg: Creating logical volume 'lv_5' failed rc: 5 - _ansible_item_result: true _ansible_no_log: false _ansible_parsed: true changed: false err: " /dev/vg_nvme/lv_4: not found: device not cleared\n Aborting. Failed to\ \ wipe start of new LV.\n" failed: true invocation: module_args: {active: true, force: false, lv: lv_4, opts: null, pvs: null, shrink: true, size: 24%VG, snapshot: null, state: present, vg: vg_nvme} item: key: lv_4 value: {scratch_dev: true, size: 24%VG, vg: vg_nvme} msg: Creating logical volume 'lv_4' failed rc: 5 - _ansible_item_result: true _ansible_no_log: false _ansible_parsed: true changed: false err: " /dev/vg_nvme/lv_3: not found: device not cleared\n Aborting. Failed to\ \ wipe start of new LV.\n" failed: true invocation: module_args: {active: true, force: false, lv: lv_3, opts: null, pvs: null, shrink: true, size: 24%VG, snapshot: null, state: present, vg: vg_nvme} item: key: lv_3 value: {scratch_dev: true, size: 24%VG, vg: vg_nvme} msg: Creating logical volume 'lv_3' failed rc: 5 - _ansible_item_result: true _ansible_no_log: false _ansible_parsed: true changed: false err: " /dev/vg_nvme/lv_2: not found: device not cleared\n Aborting. Failed to\ \ wipe start of new LV.\n" failed: true invocation: module_args: {active: true, force: false, lv: lv_2, opts: null, pvs: null, shrink: true, size: 24%VG, snapshot: null, state: present, vg: vg_nvme} item: key: lv_2 value: {scratch_dev: true, size: 24%VG, vg: vg_nvme} msg: Creating logical volume 'lv_2' failed rc: 5 - _ansible_item_result: true _ansible_no_log: false _ansible_parsed: true changed: false err: " /dev/vg_nvme/lv_1: not found: device not cleared\n Aborting. Failed to\ \ wipe start of new LV.\n" failed: true invocation: module_args: {active: true, force: false, lv: lv_1, opts: null, pvs: null, shrink: true, size: 24%VG, snapshot: null, state: present, vg: vg_nvme} item: key: lv_1 value: {scratch_dev: true, size: 24%VG, vg: vg_nvme} msg: Creating logical volume 'lv_1' failed rc: 5

fail 3839562 2019-04-13 01:25:30 2019-04-13 14:35:29 2019-04-13 15:13:29 0:38:00 0:22:10 0:15:50 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi060 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 3839563 2019-04-13 01:25:30 2019-04-13 14:35:29 2019-04-13 15:25:29 0:50:00 0:39:04 0:10:56 smithi master rhel 7.5 upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade.yaml supported-all-distro/rhel_7.5.yaml} 3
Failure Reason:

Command failed on smithi153 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

dead 3839564 2019-04-13 01:25:31 2019-04-13 14:36:03 2019-04-13 15:02:02 0:25:59 0:09:31 0:16:28 smithi master centos 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 2
Failure Reason:

nt', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, '_ansible_ignore_errors': None, u'msg': u''}, {'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, 'failed': False, '_ansible_item_result': True, u'results': [u'libuuid-2.23.2-59.el7.x86_64 providing libuuid is already installed'], 'item': u'libuuid', u'rc': 0, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'libuuid'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, '_ansible_ignore_errors': None, u'msg': u''}, {'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, 'failed': False, '_ansible_item_result': True, u'results': [u'btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed'], 'item': u'btrfs-progs', u'rc': 0, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'btrfs-progs'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, '_ansible_ignore_errors': None, u'msg': u''}, {'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, 'failed': False, '_ansible_item_result': True, u'results': [u'attr-2.4.46-13.el7.x86_64 providing attr is already installed'], 'item': u'attr', u'rc': 0, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'attr'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, '_ansible_ignore_errors': None, u'msg': u''}, {'msg': u'SSH Error: data could not be sent to remote host "smithi157.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, '_ansible_item_result': True, '_ansible_ignore_errors': None, 'item': u'valgrind'}, {'msg': u'SSH Error: data could not be sent to remote host "smithi157.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, '_ansible_item_result': True, '_ansible_ignore_errors': None, 'item': u'python-nose'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'mpich', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'mpich'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'ant', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'ant'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'lsof', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'lsof'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'iozone', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'iozone'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'libtool', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'libtool'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'automake', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'automake'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'gettext', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'gettext'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'libuuid-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'libuuid-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'libacl-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'libacl-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'bc', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'bc'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'xfsdump', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'xfsdump'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'blktrace', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'blktrace'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'numpy', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'numpy'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'python-matplotlib', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'python-matplotlib'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'qemu-kvm', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'qemu-kvm'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'usbredir', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'usbredir'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'genisoimage', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'genisoimage'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'httpd', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'httpd'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'httpd-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'httpd-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'httpd-tools', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'httpd-tools'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'mod_ssl', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'mod_ssl'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'mod_fastcgi-2.4.7-1.ceph.el7', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'mod_fastcgi-2.4.7-1.ceph.el7'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'libev-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'libev-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'perl-XML-Twig', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'perl-XML-Twig'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'java-1.6.0-openjdk-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'java-1.6.0-openjdk-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'junit4', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'junit4'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'nfs-utils', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'nfs-utils'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'ncurses-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'ncurses-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'python-devel', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'python-devel'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'python-virtualenv', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'python-virtualenv'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'perl-CPAN', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'perl-CPAN'], u'list': None, u'disable_gpg_check': False, u'conf_file': None, u'install_repoquery': True, u'state': u'present', u'disablerepo': None, u'update_cache': False, u'enablerepo': None, u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 218, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 190, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 217, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 101, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 249, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: @core

dead 3839565 2019-04-13 01:25:32 2019-04-13 14:37:52 2019-04-13 14:59:51 0:21:59 smithi master rhel 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 2
Failure Reason:

SSH connection to smithi073 was lost: 'sudo package-cleanup -y --oldkernels'

fail 3839566 2019-04-13 01:25:33 2019-04-13 14:37:52 2019-04-13 15:47:52 1:10:00 0:22:12 0:47:48 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-comp.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi060 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

dead 3839567 2019-04-13 01:25:34 2019-04-13 14:37:52 2019-04-13 15:05:52 0:28:00 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-stupid.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 1
Failure Reason:

SSH connection to smithi073 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'

fail 3839568 2019-04-13 01:25:35 2019-04-13 14:39:13 2019-04-13 16:21:13 1:42:00 0:32:13 1:09:47 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade.yaml supported-all-distro/ubuntu_16.04.yaml} 3
Failure Reason:

Command failed on smithi049 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 3839569 2019-04-13 01:25:35 2019-04-13 14:39:38 2019-04-13 15:23:38 0:44:00 0:25:45 0:18:15 smithi master centos 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-stupid.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi012 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

dead 3839570 2019-04-13 01:25:36 2019-04-13 14:39:47 2019-04-13 14:57:46 0:17:59 0:09:07 0:08:52 smithi master rhel 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
Failure Reason:

{'smithi095.front.sepia.ceph.com': {'msg': 'SSH Error: data could not be sent to remote host "smithi095.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, 'changed': False}, 'smithi112.front.sepia.ceph.com': {'msg': 'All items completed', 'changed': False, 'results': [{'_ansible_parsed': True, '_ansible_item_result': True, '_ansible_no_log': False, 'err': ' /dev/vg_nvme/lv_5: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n', 'failed': True, 'changed': False, 'item': {'key': 'lv_5', 'value': {'size': '4%VG', 'vg': 'vg_nvme'}}, 'rc': 5, 'invocation': {'module_args': {'pvs': None, 'force': False, 'vg': 'vg_nvme', 'lv': 'lv_5', 'state': 'present', 'snapshot': None, 'active': True, 'shrink': True, 'opts': None, 'size': '4%VG'}}, 'msg': "Creating logical volume 'lv_5' failed"}, {'_ansible_parsed': True, '_ansible_item_result': True, '_ansible_no_log': False, 'err': ' /dev/vg_nvme/lv_4: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n', 'failed': True, 'changed': False, 'item': {'key': 'lv_4', 'value': {'scratch_dev': True, 'size': '24%VG', 'vg': 'vg_nvme'}}, 'rc': 5, 'invocation': {'module_args': {'pvs': None, 'force': False, 'vg': 'vg_nvme', 'lv': 'lv_4', 'state': 'present', 'snapshot': None, 'active': True, 'shrink': True, 'opts': None, 'size': '24%VG'}}, 'msg': "Creating logical volume 'lv_4' failed"}, {'_ansible_parsed': True, '_ansible_item_result': True, '_ansible_no_log': False, 'err': ' /dev/vg_nvme/lv_3: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n', 'failed': True, 'changed': False, 'item': {'key': 'lv_3', 'value': {'scratch_dev': True, 'size': '24%VG', 'vg': 'vg_nvme'}}, 'rc': 5, 'invocation': {'module_args': {'pvs': None, 'force': False, 'vg': 'vg_nvme', 'lv': 'lv_3', 'state': 'present', 'snapshot': None, 'active': True, 'shrink': True, 'opts': None, 'size': '24%VG'}}, 'msg': "Creating logical volume 'lv_3' failed"}, {'_ansible_parsed': True, '_ansible_item_result': True, '_ansible_no_log': False, 'err': ' /dev/vg_nvme/lv_2: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n', 'failed': True, 'changed': False, 'item': {'key': 'lv_2', 'value': {'scratch_dev': True, 'size': '24%VG', 'vg': 'vg_nvme'}}, 'rc': 5, 'invocation': {'module_args': {'pvs': None, 'force': False, 'vg': 'vg_nvme', 'lv': 'lv_2', 'state': 'present', 'snapshot': None, 'active': True, 'shrink': True, 'opts': None, 'size': '24%VG'}}, 'msg': "Creating logical volume 'lv_2' failed"}, {'_ansible_parsed': True, '_ansible_item_result': True, '_ansible_no_log': False, 'err': ' /dev/vg_nvme/lv_1: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n', 'failed': True, 'changed': False, 'item': {'key': 'lv_1', 'value': {'scratch_dev': True, 'size': '24%VG', 'vg': 'vg_nvme'}}, 'rc': 5, 'invocation': {'module_args': {'pvs': None, 'force': False, 'vg': 'vg_nvme', 'lv': 'lv_1', 'state': 'present', 'snapshot': None, 'active': True, 'shrink': True, 'opts': None, 'size': '24%VG'}}, 'msg': "Creating logical volume 'lv_1' failed"}]}}

fail 3839571 2019-04-13 01:25:37 2019-04-13 14:40:03 2019-04-13 16:28:04 1:48:01 0:21:45 1:26:16 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi098 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

fail 3839572 2019-04-13 01:25:38 2019-04-13 14:40:04 2019-04-13 15:22:04 0:42:00 0:22:21 0:19:39 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-comp.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi137 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 3839573 2019-04-13 01:25:39 2019-04-13 14:40:05 2019-04-13 16:16:05 1:36:00 0:30:41 1:05:19 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade.yaml supported-all-distro/ubuntu_latest.yaml} 3
Failure Reason:

Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0'

fail 3839574 2019-04-13 01:25:40 2019-04-13 14:42:36 2019-04-13 14:58:36 0:16:00 smithi master centos 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-comp.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi073 with status 1: 'sudo package-cleanup -y --oldkernels'

fail 3839575 2019-04-13 01:25:40 2019-04-13 14:43:09 2019-04-13 15:21:08 0:37:59 0:29:22 0:08:37 smithi master rhel 7.5 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-stupid.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
Failure Reason:

Command failed on smithi071 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

dead 3839576 2019-04-13 01:25:41 2019-04-13 14:43:57 2019-04-13 14:51:56 0:07:59 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml}
Failure Reason:

'ssh_keyscan smithi154.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

fail 3839577 2019-04-13 01:25:42 2019-04-13 14:43:57 2019-04-13 15:01:57 0:18:00 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1.short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 1
Failure Reason:

Command failed on smithi095 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'