Pulpito :: Results Dashboard

Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Nodes	Status
2020-01-21 15:50:30	2020-01-22 12:00:39	2020-01-22 12:12:33	0:11:54	0:05:39	0:06:15	smithi	master	rhel	7.5	2	fail

Nodes: smithi198 smithi194

Description: rbd/openstack/{base/install.yaml clusters/{fixed-2.yaml openstack.yaml} features/minimum.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_latest.yaml} workloads/devstack-tempest-gate.yaml}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-01-21_15:49:17-rbd-wip-yuri2-testing-2020-01-20-2122-nautilus-distro-basic-smithi/4690997/teuthology.log

Failure Reason:

"/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'dnf -y groupinstall base --nobest && dnf -y group upgrade base')Failure object was: {'smithi198.front.sepia.ceph.com': {'stderr_lines': [u'/bin/sh: dnf: command not found'], u'changed': True, u'stderr': u'/bin/sh: dnf: command not found', u'stdout': u'', u'msg': u'non-zero return code', u'delta': u'0:00:00.002611', 'stdout_lines': [], u'end': u'2020-01-22 12:11:31.341125', '_ansible_no_log': False, u'cmd': u'dnf -y groupinstall base --nobest && dnf -y group upgrade base', u'start': u'2020-01-22 12:11:31.338514', u'warnings': [u"Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], u'rc': 127, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'strip_empty_ends': True, u'_raw_params': u'dnf -y groupinstall base --nobest && dnf -y group upgrade base', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

All Details...

log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2020-01-21_15:49:17-rbd-wip-yuri2-testing-2020-01-20-2122-nautilus-distro-basic-smithi/4690997/teuthology.log
archive_path: /home/teuthworker/archive/yuriw-2020-01-21_15:49:17-rbd-wip-yuri2-testing-2020-01-20-2122-nautilus-distro-basic-smithi/4690997
description: rbd/openstack/{base/install.yaml clusters/{fixed-2.yaml openstack.yaml} features/minimum.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_latest.yaml} workloads/devstack-tempest-gate.yaml}
duration: 0:05:39
email: ceph-qa@ceph.io
failure_reason: "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'dnf -y groupinstall base --nobest && dnf -y group upgrade base')Failure object was: {'smithi198.front.sepia.ceph.com': {'stderr_lines': [u'/bin/sh: dnf: command not found'], u'changed': True, u'stderr': u'/bin/sh: dnf: command not found', u'stdout': u'', u'msg': u'non-zero return code', u'delta': u'0:00:00.002611', 'stdout_lines': [], u'end': u'2020-01-22 12:11:31.341125', '_ansible_no_log': False, u'cmd': u'dnf -y groupinstall base --nobest && dnf -y group upgrade base', u'start': u'2020-01-22 12:11:31.338514', u'warnings': [u"Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], u'rc': 127, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'strip_empty_ends': True, u'_raw_params': u'dnf -y groupinstall base --nobest && dnf -y group upgrade base', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'dnf -y groupinstall base --nobest && dnf -y group upgrade base')
flavor:
job_id: 4690997
kernel:
- sha1: distro
- kdb: True
last_in_suite: False
machine_type: smithi
name: yuriw-2020-01-21_15:49:17-rbd-wip-yuri2-testing-2020-01-20-2122-nautilus-distro-basic-smithi
nuke_on_error: True
os_type: rhel
os_version: 7.5
overrides:
- ceph-deploy:
  - fs: xfs
  - conf:
    - client:
      - log file: /var/log/ceph/ceph-$name.$pid.log
    - global:
      - osd pool default size: 2
      - osd crush chooseleaf type: 0
    - osd:
      - mon osd full ratio: 0.9
      - mon osd backfillfull_ratio: 0.85
      - bluestore fsck on mount: True
      - mon osd nearfull ratio: 0.8
      - debug bluestore: 20
      - debug bluefs: 20
      - osd objectstore: bluestore
      - bluestore block size: 96636764160
      - debug rocksdb: 10
      - bdev enable discard: True
      - osd failsafe full ratio: 0.95
      - bdev async discard: True
    - mon:
      - osd default pool size: 2
  - bluestore: True
- workunit:
  - sha1: 4a0517eeddb57d2c7622b7b9a478f3e5f39cab23
  - branch: wip-yuri2-testing-2020-01-20-2122-nautilus
- ceph:
  - log-whitelist:
    - $MDS_ALL_DOWN$
    - $MDS_UP_LESS_THAN_MAX$
    - $POOL_APP_NOT_ENABLED$
  - fs: xfs
  - conf:
    - client:
      - rbd default features: 1
    - mon:
      - debug mon: 20
      - debug paxos: 20
      - debug ms: 1
    - osd:
      - mon osd full ratio: 0.9
      - debug ms: 1
      - debug filestore: 20
      - bluestore fsck on mount: True
      - bdev enable discard: True
      - debug osd: 25
      - bluestore block size: 96636764160
      - debug bluestore: 20
      - debug bluefs: 20
      - osd objectstore: bluestore
      - mon osd backfillfull_ratio: 0.85
      - bluestore allocator: stupid
      - bdev async discard: True
      - debug rocksdb: 10
      - mon osd nearfull ratio: 0.8
      - osd failsafe full ratio: 0.95
      - debug journal: 20
  - sha1: 4a0517eeddb57d2c7622b7b9a478f3e5f39cab23
- install:
  - ceph:
    - sha1: 4a0517eeddb57d2c7622b7b9a478f3e5f39cab23
- admin_socket:
  - branch: wip-yuri2-testing-2020-01-20-2122-nautilus
- thrashosds:
  - bdev_inject_crash_probability: 0.5
  - bdev_inject_crash: 2
owner: scheduled_yuriw@teuthology
pid:
roles:
- ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2']
- ['client.0']
sentry_event:
status: fail
success: False
branch: wip-yuri2-testing-2020-01-20-2122-nautilus
seed:
sha1: 4a0517eeddb57d2c7622b7b9a478f3e5f39cab23
subset:
suite:
suite_branch: wip-yuri2-testing-2020-01-20-2122-nautilus
suite_path:
suite_relpath:
suite_repo:
suite_sha1: 4a0517eeddb57d2c7622b7b9a478f3e5f39cab23
targets:
- smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDE3f7lGwLE8MCtSgoRwh6tR+7K25XD+xfVJpFVxqAHK2rlyrbMI7hJLrFs1jAVbyb/fdUexov1etRwY02D3/8NNjH0sj0CV3ISdqwRNr4Tj5UkvCARnSt5n2m4mdtEdeEIz50byf4pEDQAlAYEEt6mmzTXXZN9nGqlqqS12RuIDueIC/1QL26QGAO+Vxqq7JCMriKHXpNxOHmN3wnA/ce955aPXbKL8tBe2TnB0uZjYhU8owG5ey50SfRn8ypZBdg/ydSgrZs6vNmjIIBWIakR+kj2QLiKPM0bae+T5QwfU7+j1AQmvszZe3v4VKf0jxmQ41f0Uf6dcfkrJsjRgmu3
- smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFgw2KXXpVZE1iMZH9CSdB57RNcrhT/8TZmZC0SbOmIXKmAT0dMgYQowKmZsfH2K5fzWhzS17oTy/nRzroSebYfAdSZCcG6NbIGOzbk3k8DICfK9xw4X5+FGD2jQ7fXQRlL7Kj3y5Gz1UaCejpPu+8ojf5Vja49Pik/E7aOg9mmEmGZn8wcvhCyfHfEB9sDDi6gysbB7bbLkAHlaht9JlJCiEvM1bN7Oo/kZYs+3cbxoL2BtgeNDKcY8+o4A31TdLh5YjFKinyhY9jO2RHJxs/ag6/ElXJ7N+LrqgP38bqwjmwubWerin8zQsiTdwyMCy0bsEYOHAaBArm3zhTDrbr
tasks:
- internal.check_packages:
- internal.buildpackages_prep:
- internal.lock_machines:
  - 2
  - smithi
- internal.save_config:
- internal.check_lock:
- internal.add_remotes:
- console_log:
- internal.connect:
- internal.push_inventory:
- internal.serialize_remote_roles:
- internal.check_conflict:
- internal.check_ceph_data:
- internal.vm_setup:
- kernel:
  - sha1: distro
  - kdb: True
- internal.base:
- internal.archive_upload:
- internal.archive:
- internal.coredump:
- internal.sudo:
- internal.syslog:
- internal.timer:
- pcp:
- selinux:
- ansible.cephlab:
- clock:
- install:
- ceph:
- qemu:
  - all:
    - memory: 12288
    - disks:
      - image_size: 30720
      - image_size: 30720
    - cpus: 4
    - image_url: https://cloud-images.ubuntu.com/releases/16.04/release/ubuntu-16.04-server-cloudimg-amd64-disk1.img
    - cloud_config_archive:
      - content: users: - name: stack lock_passwd: False shell: /bin/bash sudo: ["ALL=(root) NOPASSWD:ALL\nDefaults:stack,tempest !requiretty"] - name: tempest lock_passwd: False shell: /bin/bash sudo: - "ALL=(root) NOPASSWD:/sbin/ip" - "ALL=(root) NOPASSWD:/sbin/iptables" - "ALL=(root) NOPASSWD:/usr/bin/ovsdb-client"
      - type: text/cloud-config
      - #!/bin/bash -ex wget -q -O- "http://git.ceph.com/?p=ceph.git;a=blob_plain;f=keys/autobuild.asc" | apt-key add - wget -q -O /etc/apt/sources.list.d/ceph.list "https://shaman.ceph.com/api/repos/ceph/{ceph_branch}/{ceph_sha1}/ubuntu/xenial/repo" apt-get update mount --bind /mnt/test_b /opt mkdir /opt/stack chown -R stack:stack /home/stack chown -R stack:stack /opt/stack mkdir /mnt/log/stack chmod a+rwx /mnt/log/stack chown -R stack:stack /mnt/log/stack apt-get install -y ceph-common librbd1 mkdir /mnt/log/stack/ceph chown -R stack:stack /mnt/log/stack/ceph chmod a+rwx /mnt/log/stack/ceph # sanity check that the cluster is reachable from the VM echo '[client]' >> /etc/ceph/ceph.conf echo 'log file = /mnt/log/stack/ceph/$name.$pid.log' >> /etc/ceph/ceph.conf rbd --debug-ms=10 --debug-rbd=20 info client.0.1
    - test: qa/workunits/rbd/run_devstack_tempest.sh
    - type: filesystem
teuthology_branch: master
verbose: True
pcp_grafana_url:
priority:
user:
queue:
posted: 2020-01-21 15:50:30
started: 2020-01-22 12:00:39
updated: 2020-01-22 12:12:33
status_class: danger
runtime: 0:11:54
wait_time: 0:06:15