Pulpito :: Results Dashboard

Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Nodes	Status
2018-04-13 07:23:28	2018-04-13 10:57:35	2018-04-13 12:03:35	1:06:00	0:21:31	0:44:29	mira	master			2	fail

Nodes: mira051 mira082

Description: rados/multimon/{clusters/6.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados/{op_queue/pool.yaml rados.yaml} tasks/mon_clock_with_skews.yaml}

Log: http://qa-proxy.ceph.com/teuthology/pbs1108-2018-04-13_07:22:23-rados-wip-pool-unit-dmclock-distro-basic-mira/2393897/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=8aec3d465e004783b104ea7f9dbe036f

Failure Reason:

File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 249, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: /home/teuthworker/.cache/src/keys

All Details...

log_href: http://qa-proxy.ceph.com/teuthology/pbs1108-2018-04-13_07:22:23-rados-wip-pool-unit-dmclock-distro-basic-mira/2393897/teuthology.log
archive_path: /home/teuthworker/archive/pbs1108-2018-04-13_07:22:23-rados-wip-pool-unit-dmclock-distro-basic-mira/2393897
description: rados/multimon/{clusters/6.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados/{op_queue/pool.yaml rados.yaml} tasks/mon_clock_with_skews.yaml}
duration: 0:21:31
email: pbs1108@gmail.com
failure_reason: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 249, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: /home/teuthworker/.cache/src/keys
flavor:
job_id: 2393897
kernel:
- sha1: distro
- kdb: True
last_in_suite: False
machine_type: mira
name: pbs1108-2018-04-13_07:22:23-rados-wip-pool-unit-dmclock-distro-basic-mira
nuke_on_error: True
os_type:
os_version:
overrides:
- ceph:
  - log-whitelist:
    - slow request
    - $SLOW_OPS$
  - fs: xfs
  - conf:
    - client:
      - objecter mclock service tracker: True
    - global:
      - mon mgr beacon grace: 90
      - enable experimental unrecoverable data corrupting features: *
      - ms type: random
      - ms inject socket failures: 1000
    - osd:
      - osd op queue cut off: debug_random
      - debug ms: 1
      - debug journal: 20
      - debug osd: 25
      - osd objectstore: filestore
      - osd debug verify cached snaps: True
      - osd debug verify missing on start: True
      - osd op queue: mclock_pool
      - osd sloppy crc: True
      - debug filestore: 20
    - mon:
      - debug ms: 1
      - debug mon: 20
      - debug paxos: 20
      - mon keyvaluedb: rocksdb
  - sha1: 5e3d60b516cbef3ee511a3aab822bb52a0f532d4
- ceph-deploy:
  - fs: xfs
  - filestore: True
  - conf:
    - client:
      - log file: /var/log/ceph/ceph-$name.$pid.log
    - mon:
      - osd default pool size: 2
    - osd:
      - osd sloppy crc: True
      - osd objectstore: filestore
- workunit:
  - sha1: a57e01de6b8676756847661aba7aedc89149818c
  - branch: wip-pool-unit-dmclock-qa
- install:
  - ceph:
    - sha1: 5e3d60b516cbef3ee511a3aab822bb52a0f532d4
- admin_socket:
  - branch: wip-pool-unit-dmclock
owner: scheduled_pbs1108@teuthology
pid:
roles:
- ['mon.a', 'mon.c', 'mon.e', 'mgr.x', 'osd.0']
- ['mon.b', 'mon.d', 'mon.f', 'mgr.y', 'osd.1']
sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=8aec3d465e004783b104ea7f9dbe036f
status: fail
success: False
branch: wip-pool-unit-dmclock
seed:
sha1: 5e3d60b516cbef3ee511a3aab822bb52a0f532d4
subset:
suite:
suite_branch: wip-pool-unit-dmclock-qa
suite_path:
suite_relpath:
suite_repo:
suite_sha1: a57e01de6b8676756847661aba7aedc89149818c
targets:
- mira051.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjPhDX3DNEcOyFEPJscOgQUaYh46U+VArNzK/VyzLQi2CgXDquG0LJ6/9gAQFnDS94Hi/xLd6G91MNgfCcuCULgC4SaS7c1sCOCpLRY6wxyevErtbEjG5k7hY6TjVlAt0wyCFF5owy4Zb1f+UnIcmI+mYxYTDdDJqVu3wS8n4M82drHPCX+2Wn9gLEV+M/lJcxcErqsgv6dWGaOTIShif76lNkM/V55DysACN6KwMLVwii75oCMTQ2+7RfrZ8EX9E6VHVbQhHxsEDpYUUXJIs58A73mUK83Y8sQGUrvqRdsZDCprYHtvum8oBvm4CufEU0ELHldIOmwCVXtJwm0g0f
- mira082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNfJP9A47riGUkrTnKQNXCceWtbhExrMg5Uz0atTymT9DVprP53+4+A9qXB0gFrqIReBFgKaK6AorWZC0D9vW1anc2EhlmZqbXo9tr2vXkxGITzz6qd0x1kg1I6KCUSNFxYkfKA5uqYWOnfJjL6LcvZ0Mbrbk1sg2t5b0XxsAdLpSNCTfF/hWaOD5aZgGfqqeGaYqkm+A+idtvT9QEmIuMGCWuJ0UkZd92wITpMoVx+13kJsMut6b7Iol82VD+78BdthjLCRzRt0afWZmvzeGvFW4Nt2F6SwMWGd3/QQK91SvMKqvRSDkRcyj8lhwa7qthwcttyCxfrmCaInfo62DB
tasks:
- internal.check_packages:
- internal.buildpackages_prep:
- internal.lock_machines:
  - 2
  - mira
- internal.save_config:
- internal.check_lock:
- internal.add_remotes:
- console_log:
- internal.connect:
- internal.push_inventory:
- internal.serialize_remote_roles:
- internal.check_conflict:
- internal.check_ceph_data:
- internal.vm_setup:
- kernel:
  - sha1: distro
  - kdb: True
- internal.base:
- internal.archive_upload:
- internal.archive:
- internal.coredump:
- internal.sudo:
- internal.syslog:
- internal.timer:
- pcp:
- selinux:
- ansible.cephlab:
- clock:
- install:
- exec:
  - mon.b:
    - date -u -s @$(expr $(date -u +%s) + 10)
- ceph:
  - wait-for-healthy: False
  - log-whitelist:
    - .*clock.*skew.*
    - clocks not synchronized
    - overall HEALTH_
    - $MON_CLOCK_SKEW$
    - $MGR_DOWN$
    - $PG_
    - \(SLOW_OPS$
    - No standby daemons available
- mon_clock_skew_check:
  - expect-skew: True
teuthology_branch: master
verbose: False
pcp_grafana_url:
priority:
user:
queue:
posted: 2018-04-13 07:23:28
started: 2018-04-13 10:57:35
updated: 2018-04-13 12:03:35
status_class: danger
runtime: 1:06:00
wait_time: 0:44:29