Pulpito :: Results Dashboard

Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Nodes	Status
2016-06-11 10:02:34	2016-06-11 12:17:40	2016-06-11 15:29:47	3:12:07	0:23:07	2:49:00	vps	master	ubuntu		2	fail

Nodes: vpm065 vpm195

Description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml}

Log: http://qa-proxy.ceph.com/teuthology/teuthology-2016-06-11_03:00:02-rados-hammer-distro-basic-vps/251336/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=128d1ff7eeec47929f71f8d9a62f917f

Performance graphs: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-06-11T15%3A27%3A04&time_from=2016-06-11T15%3A05%3A00&hosts=vpm065%2Cvpm195

Failure Reason:

{'vpm065.front.sepia.ceph.com': {'invocation': {'module_name': 'apt', 'module_args': ''}, 'failed': True, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" install \'ntp\'\' failed: E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stderr': "E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following extra packages will be installed:\n libopts25\nSuggested packages:\n ntp-doc\nThe following NEW packages will be installed:\n libopts25 ntp\n0 upgraded, 2 newly installed, 0 to remove and 212 not upgraded.\nNeed to get 474 kB of archives.\nAfter this operation, 1677 kB of additional disk space will be used.\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty/main libopts25 amd64 1:5.18-2ubuntu2\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty-updates/main ntp amd64 1:4.2.6.p5+dfsg-3ubuntu2.14.04.8\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\n"}, 'vpm195.front.sepia.ceph.com': {'invocation': {'module_name': 'apt', 'module_args': ''}, 'failed': True, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" install \'ntp\'\' failed: E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stderr': "E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following extra packages will be installed:\n libopts25\nSuggested packages:\n ntp-doc\nThe following NEW packages will be installed:\n libopts25 ntp\n0 upgraded, 2 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 474 kB of archives.\nAfter this operation, 1677 kB of additional disk space will be used.\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty/main libopts25 amd64 1:5.18-2ubuntu2\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty-updates/main ntp amd64 1:4.2.6.p5+dfsg-3ubuntu2.14.04.8\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\n"}}

All Details...

log_href: http://qa-proxy.ceph.com/teuthology/teuthology-2016-06-11_03:00:02-rados-hammer-distro-basic-vps/251336/teuthology.log
archive_path: /var/lib/teuthworker/archive/teuthology-2016-06-11_03:00:02-rados-hammer-distro-basic-vps/251336
description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml}
duration: 0:23:07
email: ceph-qa@ceph.com
failure_reason: {'vpm065.front.sepia.ceph.com': {'invocation': {'module_name': 'apt', 'module_args': ''}, 'failed': True, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" install \'ntp\'\' failed: E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stderr': "E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following extra packages will be installed:\n libopts25\nSuggested packages:\n ntp-doc\nThe following NEW packages will be installed:\n libopts25 ntp\n0 upgraded, 2 newly installed, 0 to remove and 212 not upgraded.\nNeed to get 474 kB of archives.\nAfter this operation, 1677 kB of additional disk space will be used.\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty/main libopts25 amd64 1:5.18-2ubuntu2\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty-updates/main ntp amd64 1:4.2.6.p5+dfsg-3ubuntu2.14.04.8\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\n"}, 'vpm195.front.sepia.ceph.com': {'invocation': {'module_name': 'apt', 'module_args': ''}, 'failed': True, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" install \'ntp\'\' failed: E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve \'apt-mirror.front.sepia.ceph.com\'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stderr': "E: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/a/autogen/libopts25_5.18-2ubuntu2_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/pool/main/n/ntp/ntp_4.2.6.p5+dfsg-3ubuntu2.14.04.8_amd64.deb Could not resolve 'apt-mirror.front.sepia.ceph.com'\n\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n", 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following extra packages will be installed:\n libopts25\nSuggested packages:\n ntp-doc\nThe following NEW packages will be installed:\n libopts25 ntp\n0 upgraded, 2 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 474 kB of archives.\nAfter this operation, 1677 kB of additional disk space will be used.\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty/main libopts25 amd64 1:5.18-2ubuntu2\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\nErr http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/ trusty-updates/main ntp amd64 1:4.2.6.p5+dfsg-3ubuntu2.14.04.8\n Could not resolve 'apt-mirror.front.sepia.ceph.com'\n"}}
flavor:
job_id: 251336
kernel:
- sha1: distro
- kdb: True
last_in_suite: False
machine_type: vps
name: teuthology-2016-06-11_03:00:02-rados-hammer-distro-basic-vps
nuke_on_error: True
os_type: ubuntu
os_version:
overrides:
- ceph:
  - log-whitelist:
    - slow request
  - fs: ext4
  - conf:
    - global:
      - ms tcp read timeout: 5
      - osd_pool_default_size: 2
      - osd_pool_default_min_size: 2
      - osd_max_pg_log_entries: 200
      - osd_min_pg_log_entries: 100
      - ms inject socket failures: 2500
    - mon:
      - debug mon: 20
      - debug paxos: 20
      - debug ms: 1
    - osd:
      - debug osd: 25
      - debug filestore: 20
      - debug journal: 20
      - debug ms: 1
  - sha1: 054a90edb2812f78426b8cb1dac2e768b2e7fc51
- ceph-deploy:
  - conf:
    - client:
      - log file: /var/log/ceph/ceph-$name.$pid.log
    - mon:
      - osd default pool size: 2
      - debug mon: 1
      - debug paxos: 20
      - debug ms: 20
  - branch:
    - dev-commit: 054a90edb2812f78426b8cb1dac2e768b2e7fc51
- workunit:
  - sha1: 054a90edb2812f78426b8cb1dac2e768b2e7fc51
- install:
  - ceph:
    - sha1: 054a90edb2812f78426b8cb1dac2e768b2e7fc51
- admin_socket:
  - branch: hammer
owner: scheduled_teuthology@teuthology
pid:
roles:
- ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2', 'client.0']
- ['mon.b', 'osd.3', 'osd.4', 'osd.5', 'client.1']
sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=128d1ff7eeec47929f71f8d9a62f917f
status: fail
success: False
branch: hammer
seed:
sha1: 054a90edb2812f78426b8cb1dac2e768b2e7fc51
subset:
suite:
suite_branch: hammer
suite_path:
suite_relpath:
suite_repo:
suite_sha1: b0e4fb806447e68ba56337d7e812f632954c24f7
targets:
- ubuntu@vpm065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeYHAaB650Z5O8nKfH76wl7bh97G0aZ1w5Ev54pV29wbthErqbrgj9vuf052U9KSEBlMLPt+VKRX7tIiOhd9VozzlTaLlkjuMZeQRFKPGDT/J2/jko2tjfxIMhexALw4sOsr+BntAWQOIultFqJJxbumKtFG7+fs8r7w5y8PSMp87fB+TyBbZXcl+K3msubFuRKYfluQ75hhUO2VzV4LWB793LAFcr7v23b4b+STft832Z5ajaNteWq0/rvBi5RP8ov/yTSCh7wVYN5tJeqYOMcRzX7JXVOkK+4BvcSeNrzm3F0tqklsZUaZYv/tH7LLlMRV3WskrZxnGez4/DnM8V
- ubuntu@vpm195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDU2kx82l2+TTdswNSjZH03jEWFexxFNg/WSwSPMnSSPZc64ltTsim0oI1RLPzgtMOB1TiSDYXTNueJxgw78EwlLqxqo6AGpWV9UrdUKYT/GAhND2rpRemsDN31ES58E97bBLzCQzkMiA+bP7rB8hM3XQdnsLDrOSbMSQDuWAXn3zhPxSQGtA/dfkKP9V9105SpE2yD2VC1sOY0PvYkuzTxmdB203Awp/S0gbE1EL1/X8AeeSgvUKxDpmiObNcAI3PjkV9NEPnxt8/5m3uRiV2Q+ZA3qpz7gezF+T7qrOrDUpSokOKnNDMyxQMkxjPdOE/WL9TK0FWYokcT5J3C84kx
tasks:
- internal.check_packages:
- internal.buildpackages_prep:
- internal.lock_machines:
  - 2
  - vps
- internal.save_config:
- internal.check_lock:
- internal.add_remotes:
- internal.connect:
- internal.push_inventory:
- internal.serialize_remote_roles:
- internal.check_conflict:
- internal.check_ceph_data:
- internal.vm_setup:
- kernel:
  - sha1: distro
  - kdb: True
- internal.base:
- internal.archive_upload:
- internal.archive:
- internal.coredump:
- internal.sudo:
- internal.syslog:
- internal.timer:
- pcp:
- selinux:
- ansible.cephlab:
- clock.check:
- install:
- ceph:
  - log-whitelist:
    - wrongly marked me down
    - objects unfound and apparently lost
  - conf:
    - osd:
      - osd max backfills: 1
      - osd scrub min interval: 60
      - osd scrub max interval: 120
- thrashosds:
  - chance_pgnum_grow: 3
  - chance_pgpnum_fix: 1
  - timeout: 1200
- rados:
  - op_weights:
    - snap_remove: 50
    - snap_create: 50
    - rollback: 50
    - read: 100
    - copy_from: 50
    - write: 100
    - delete: 50
  - pool_snaps: True
  - clients:
    - client.0
  - objects: 50
  - ops: 4000
teuthology_branch: master
verbose: True
pcp_grafana_url: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-06-11T15%3A27%3A04&time_from=2016-06-11T15%3A05%3A00&hosts=vpm065%2Cvpm195
priority:
user:
queue:
posted: 2016-06-11 10:02:34
started: 2016-06-11 12:17:40
updated: 2016-06-11 15:29:47
status_class: danger
runtime: 3:12:07
wait_time: 2:49:00