Pulpito :: Results Dashboard

Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Nodes	Status
2016-07-29 22:40:43	2016-07-30 12:37:46	2016-07-30 13:23:31	0:45:45	0:41:30	0:04:15	smithi	wip-16826-2.2			3	fail

Nodes: smithi047 smithi013 smithi061

Description: rbd/qemu/{cache/writethrough.yaml cachepool/ec-cache.yaml clusters/{fixed-3.yaml openstack.yaml} features/defaults.yaml fs/xfs.yaml msgr-failures/few.yaml workloads/qemu_bonnie.yaml}

Log: http://qa-proxy.ceph.com/teuthology/zack-2016-07-29_15:33:20-rbd-jewel---basic-smithi/341366/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=07b5202197d3493aae7a76ccdfe9efcc

Performance graphs: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-07-30T13%3A09%3A11&time_from=2016-07-30T12%3A38%3A00&hosts=smithi047%2Csmithi061%2Csmithi013

Failure Reason:

data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 122, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 247, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: destFailure object was: {'smithi061.front.sepia.ceph.com': {'invocation': {'module_name': u'template', 'module_args': {u'dest': u'/etc/apt/sources.list', u'src': u'apt/sources.list.trusty', u'group': u'root', u'mode': 420, u'owner': u'root'}}, 'msg': u"[Errno 2] No such file or directory: '/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/modules/core/files/stat.py'", 'changed': False, '_ansible_no_log': False, 'failed': True}}Traceback (most recent call last): File "/home/teuthworker/src/ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 218, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 190, in dump_all dumper.represent(data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 122, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 247, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: destsmithi013.front.sepia.ceph.com: {exception: "Traceback (most recent call last):\n\ \ File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py\"\ , line 89, in run\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py\"\ , line 193, in _get_loop_items\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/__init__.py\"\ , line 333, in get\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/__init__.py\"\ , line 318, in _load_module_source\nIOError: [Errno 2] No such file or directory:\ \ '/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/lookup/items.py'\n", failed: true, msg: Unexpected failure during module execution., stdout: ''}

All Details...

log_href: http://qa-proxy.ceph.com/teuthology/zack-2016-07-29_15:33:20-rbd-jewel---basic-smithi/341366/teuthology.log
archive_path: /var/lib/teuthworker/archive/zack-2016-07-29_15:33:20-rbd-jewel---basic-smithi/341366
description: rbd/qemu/{cache/writethrough.yaml cachepool/ec-cache.yaml clusters/{fixed-3.yaml openstack.yaml} features/defaults.yaml fs/xfs.yaml msgr-failures/few.yaml workloads/qemu_bonnie.yaml}
duration: 0:41:30
email: zack@redhat.com
failure_reason: data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 122, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 247, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: destFailure object was: {'smithi061.front.sepia.ceph.com': {'invocation': {'module_name': u'template', 'module_args': {u'dest': u'/etc/apt/sources.list', u'src': u'apt/sources.list.trusty', u'group': u'root', u'mode': 420, u'owner': u'root'}}, 'msg': u"[Errno 2] No such file or directory: '/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/modules/core/files/stat.py'", 'changed': False, '_ansible_no_log': False, 'failed': True}}Traceback (most recent call last): File "/home/teuthworker/src/ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 218, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 190, in dump_all dumper.represent(data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 223, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 122, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 247, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: destsmithi013.front.sepia.ceph.com: {exception: "Traceback (most recent call last):\n\ \ File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py\"\ , line 89, in run\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/executor/task_executor.py\"\ , line 193, in _get_loop_items\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/__init__.py\"\ , line 333, in get\n File \"/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/__init__.py\"\ , line 318, in _load_module_source\nIOError: [Errno 2] No such file or directory:\ \ '/home/teuthworker/src/teuthology_wip-16826-2.2/virtualenv/local/lib/python2.7/site-packages/ansible/plugins/lookup/items.py'\n", failed: true, msg: Unexpected failure during module execution., stdout: ''}
flavor:
job_id: 341366
kernel:
last_in_suite: False
machine_type: smithi
name: zack-2016-07-29_15:33:20-rbd-jewel---basic-smithi
nuke_on_error: True
os_type:
os_version:
overrides:
- ceph:
  - log-whitelist:
    - slow request
    - wrongly marked me down
  - fs: xfs
  - conf:
    - client:
      - rbd default format: 2
      - rbd default features: 61
    - global:
      - ms inject socket failures: 5000
    - osd:
      - debug osd: 25
      - debug filestore: 20
      - debug journal: 20
      - debug ms: 1
      - osd sloppy crc: True
    - mon:
      - debug mon: 20
      - debug paxos: 20
      - debug ms: 1
  - sha1: 894a5f8d878d4b267f80b90a4bffce157f2b4ba7
- ceph-deploy:
  - conf:
    - client:
      - log file: /var/log/ceph/ceph-$name.$pid.log
    - mon:
      - osd default pool size: 2
      - debug mon: 1
      - debug paxos: 20
      - debug ms: 20
- workunit:
  - sha1: 894a5f8d878d4b267f80b90a4bffce157f2b4ba7
- install:
  - ceph:
    - sha1: 894a5f8d878d4b267f80b90a4bffce157f2b4ba7
- admin_socket:
  - branch: jewel
owner: scheduled_zack@teuthology
pid:
roles:
- ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2']
- ['mon.b', 'osd.3', 'osd.4', 'osd.5']
- ['client.0']
sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=07b5202197d3493aae7a76ccdfe9efcc
status: fail
success: False
branch: jewel
seed:
sha1: 894a5f8d878d4b267f80b90a4bffce157f2b4ba7
subset:
suite:
suite_branch: jewel
suite_path:
suite_relpath:
suite_repo:
suite_sha1:
targets:
- ubuntu@smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkU/6uiQlln70mPROubMCY/lf2P9nOjvJ6k0edqEE00AQUtI+NH1CAolGYA4r5EAwh7mzqjSG0op29glNJ3Z1vkP9xalVdY45Q448hAmJyp2aR813M+GcyMENnS6yYtOhlUUN/XOVPp6Z4RD6MJFZQjN4oyXw4b1fwY1+H37O4Ze9Ztrp+lG7hIwcTsNgJrqa58OpPdwS8GH5QDHDhujNH/2C0ZNy65qWls+vzr/EObY/7sL7j5VofqEickjWoJrmBI4ecYTcqhYk6DSZTLkRI4U+DgJUeOsZf5V8onFQ8KBdOJlYvYOVtSz1EUo5ytYdbD3f2K7pN6sm1J3//yLsf
- ubuntu@smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoSH0HcJFeNYslWfI4hUCvigyrLj5wEB+L4f6tl7YpJ5gNJfOOEpwVk4XHbKrrmFssGyR/PybtLUsZwk9wDnymjvbYuMf9EuazKYH54MLVqCdRFr+2C5vaNt3nOWzRAZCybO0OLGebDiv50gfs4b1A8NkwTiwip7kAfaBoc5LU+dpIXqQI5YI3UixeIj2uKUAg9EBIw9D2UQw66WvUk1hJwHNDbZI7ivE3WF+wDLBV43RD7NDnxGY/XHPVswJESrcIX2NsmvUWuxJ6L0zmgCzXZQQsBr7e4i+xzdRE1VJkh4N3F8ML3rK8s79FwMW24WLqJYT0TuaYos2OMFLU9BeT
- ubuntu@smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+Cj+p74DdjTtp72wmVcuAM/h8CSCE0qcp7CEA9xhPZ9fB+YgrZ59jYL5gD3+cgh5dGXkF1psVyABiVZsF021VcPYqPbFAzG4MbTUaHddnP/Hbb1aVEadfD4uaK/SqOPmwSNNxzTyQndZiQe0oF1Zrj4x8JWR3JXZa0ddVLWVkZOqnV49FOdq9wEUBDasFcdSY+/Kd+bAgwEr5U5fW+es0y+bFvNC2LJW1rBZbpjbJjEzSTrYUHSf08RFvTiFMsymBGKEbVZCNqhce6wXXk04p01uuamewBCmXiwk52LIycdaa4oG4Udsb/CAEb/zKxWPPiHnLVL+fivDuQoGNG5bz
tasks:
- internal.check_packages:
- internal.buildpackages_prep:
- internal.lock_machines:
  - 3
  - smithi
- internal.save_config:
- internal.check_lock:
- internal.add_remotes:
- internal.connect:
- internal.push_inventory:
- internal.serialize_remote_roles:
- internal.check_conflict:
- internal.check_ceph_data:
- internal.vm_setup:
- internal.base:
- internal.archive_upload:
- internal.archive:
- internal.coredump:
- internal.sudo:
- internal.syslog:
- internal.timer:
- pcp:
- selinux:
- ansible.cephlab:
- clock.check:
- install:
- ceph:
  - conf:
    - client:
      - rbd cache max dirty: 0
      - rbd cache: True
- exec:
  - client.0:
    - sudo ceph osd erasure-code-profile set teuthologyprofile ruleset-failure-domain=osd m=1 k=2
    - sudo ceph osd pool delete rbd rbd --yes-i-really-really-mean-it
    - sudo ceph osd pool create rbd 4 4 erasure teuthologyprofile
    - sudo ceph osd pool create cache 4
    - sudo ceph osd tier add rbd cache
    - sudo ceph osd tier cache-mode cache writeback
    - sudo ceph osd tier set-overlay rbd cache
    - sudo ceph osd pool set cache hit_set_type bloom
    - sudo ceph osd pool set cache hit_set_count 8
    - sudo ceph osd pool set cache hit_set_period 60
    - sudo ceph osd pool set cache target_max_objects 250
- qemu:
  - all:
    - test: http://git.ceph.com/?p=ceph.git;a=blob_plain;f=qa/workunits/suites/bonnie.sh
    - clone: True
teuthology_branch: wip-16826-2.2
verbose: True
pcp_grafana_url: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-07-30T13%3A09%3A11&time_from=2016-07-30T12%3A38%3A00&hosts=smithi047%2Csmithi061%2Csmithi013
priority:
user:
queue:
posted: 2016-07-29 22:40:43
started: 2016-07-30 12:37:46
updated: 2016-07-30 13:23:31
status_class: danger
runtime: 0:45:45
wait_time: 0:04:15