Pulpito

teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps/1019189

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2015-08-17 21:24:06 2015-08-17 21:25:13 2015-08-17 22:01:15 0:36:02 0:28:23 0:07:39 vps master centos 6.5 3 fail

Description: upgrade:firefly-x/stress-split/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_6.5.yaml}

Log: http://qa-proxy.ceph.com/teuthology/teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps/1019189/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/search?q=ed86153adecd43949faf559c339e5ec1

Failure Reason:

{'vpm063.front.sepia.ceph.com': {'item': 'gperftools-devel,cryptopp-devel,cryptopp,dbench,fuse-sshfs,bonnie++,perl-JSON,python-virtualenv,smbios-utils', 'rc': 1, 'invocation': {'module_name': 'yum', 'module_args': ''}, 'changed': True, 'results': ['Loaded plugins: fastestmirror, priorities, security\nSetting up Install Process\nLoading mirror speeds from cached hostfile\n * base: repos.lax.quadranet.com\n * extras: mirror.supremebytes.com\n * updates: mirror.pac-12.org\n43 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package bonnie++.x86_64 0:1.96-2.el6 will be installed\n---> Package cryptopp.x86_64 0:5.6.2-9.el6 will be installed\n---> Package cryptopp-devel.x86_64 0:5.6.2-9.el6 will be installed\n---> Package dbench.x86_64 0:4.0-4.el6 will be installed\n---> Package fuse-sshfs.x86_64 0:2.5-1.el6.rf will be installed\n---> Package gperftools-devel.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: gperftools-libs(x86-64) = 2.0-11.el6.3 for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_and_profiler.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libprofiler.so.0()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n---> Package perl-JSON.noarch 0:2.15-5.el6 will be installed\n---> Package python-virtualenv.noarch 0:1.10.1-1.el6 will be installed\n---> Package smbios-utils.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: smbios-utils-python for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Processing Dependency: smbios-utils-bin for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package gperftools-libs.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: libunwind.so.8()(64bit) for package: gperftools-libs-2.0-11.el6.3.x86_64\n---> Package smbios-utils-bin.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: libsmbios = 2.2.26-3.el6 for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios_c.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n---> Package smbios-utils-python.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: python-smbios = 2.2.26-3.el6 for package: smbios-utils-python-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package libsmbios.x86_64 0:2.2.26-3.el6 will be installed\n---> Package libunwind.x86_64 0:1.1-3.el6 will be installed\n---> Package python-smbios.x86_64 0:2.2.26-3.el6 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n bonnie++ x86_64 1.96-2.el6 epel 67 k\n cryptopp x86_64 5.6.2-9.el6 epel 1.0 M\n cryptopp-devel x86_64 5.6.2-9.el6 epel 148 k\n dbench x86_64 4.0-4.el6 epel 1.2 M\n fuse-sshfs x86_64 2.5-1.el6.rf rpmforge 50 k\n gperftools-devel x86_64 2.0-11.el6.3 epel 290 k\n perl-JSON noarch 2.15-5.el6 base 97 k\n python-virtualenv noarch 1.10.1-1.el6 epel 1.3 M\n smbios-utils x86_64 2.2.26-3.el6 epel 14 k\nInstalling for dependencies:\n gperftools-libs x86_64 2.0-11.el6.3 epel 246 k\n libsmbios x86_64 2.2.26-3.el6 epel 226 k\n libunwind x86_64 1.1-3.el6 epel 55 k\n python-smbios x86_64 2.2.26-3.el6 epel 64 k\n smbios-utils-bin x86_64 2.2.26-3.el6 epel 91 k\n smbios-utils-python x86_64 2.2.26-3.el6 epel 60 k\n\nTransaction Summary\n================================================================================\nInstall 15 Package(s)\n\nTotal download size: 4.8 M\nInstalled size: 37 M\nDownloading Packages:\n'], 'msg': "http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: (28, 'connect() timed out!')\nTrying other mirror.\n\n\nError Downloading Packages:\n bonnie++-1.96-2.el6.x86_64: failure: bonnie++-1.96-2.el6.x86_64.rpm from epel: [Errno 256] No more mirrors to try.\n\n"}}

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps/1019189/teuthology.log
  • archive_path: /var/lib/teuthworker/archive/teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps/1019189
  • description: upgrade:firefly-x/stress-split/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_6.5.yaml}
  • duration: 0:28:23
  • email: ceph-qa@ceph.com
  • failure_reason: {'vpm063.front.sepia.ceph.com': {'item': 'gperftools-devel,cryptopp-devel,cryptopp,dbench,fuse-sshfs,bonnie++,perl-JSON,python-virtualenv,smbios-utils', 'rc': 1, 'invocation': {'module_name': 'yum', 'module_args': ''}, 'changed': True, 'results': ['Loaded plugins: fastestmirror, priorities, security\nSetting up Install Process\nLoading mirror speeds from cached hostfile\n * base: repos.lax.quadranet.com\n * extras: mirror.supremebytes.com\n * updates: mirror.pac-12.org\n43 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package bonnie++.x86_64 0:1.96-2.el6 will be installed\n---> Package cryptopp.x86_64 0:5.6.2-9.el6 will be installed\n---> Package cryptopp-devel.x86_64 0:5.6.2-9.el6 will be installed\n---> Package dbench.x86_64 0:4.0-4.el6 will be installed\n---> Package fuse-sshfs.x86_64 0:2.5-1.el6.rf will be installed\n---> Package gperftools-devel.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: gperftools-libs(x86-64) = 2.0-11.el6.3 for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_and_profiler.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libprofiler.so.0()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n---> Package perl-JSON.noarch 0:2.15-5.el6 will be installed\n---> Package python-virtualenv.noarch 0:1.10.1-1.el6 will be installed\n---> Package smbios-utils.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: smbios-utils-python for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Processing Dependency: smbios-utils-bin for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package gperftools-libs.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: libunwind.so.8()(64bit) for package: gperftools-libs-2.0-11.el6.3.x86_64\n---> Package smbios-utils-bin.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: libsmbios = 2.2.26-3.el6 for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios_c.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n---> Package smbios-utils-python.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: python-smbios = 2.2.26-3.el6 for package: smbios-utils-python-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package libsmbios.x86_64 0:2.2.26-3.el6 will be installed\n---> Package libunwind.x86_64 0:1.1-3.el6 will be installed\n---> Package python-smbios.x86_64 0:2.2.26-3.el6 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n bonnie++ x86_64 1.96-2.el6 epel 67 k\n cryptopp x86_64 5.6.2-9.el6 epel 1.0 M\n cryptopp-devel x86_64 5.6.2-9.el6 epel 148 k\n dbench x86_64 4.0-4.el6 epel 1.2 M\n fuse-sshfs x86_64 2.5-1.el6.rf rpmforge 50 k\n gperftools-devel x86_64 2.0-11.el6.3 epel 290 k\n perl-JSON noarch 2.15-5.el6 base 97 k\n python-virtualenv noarch 1.10.1-1.el6 epel 1.3 M\n smbios-utils x86_64 2.2.26-3.el6 epel 14 k\nInstalling for dependencies:\n gperftools-libs x86_64 2.0-11.el6.3 epel 246 k\n libsmbios x86_64 2.2.26-3.el6 epel 226 k\n libunwind x86_64 1.1-3.el6 epel 55 k\n python-smbios x86_64 2.2.26-3.el6 epel 64 k\n smbios-utils-bin x86_64 2.2.26-3.el6 epel 91 k\n smbios-utils-python x86_64 2.2.26-3.el6 epel 60 k\n\nTransaction Summary\n================================================================================\nInstall 15 Package(s)\n\nTotal download size: 4.8 M\nInstalled size: 37 M\nDownloading Packages:\n'], 'msg': "http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: (28, 'connect() timed out!')\nTrying other mirror.\n\n\nError Downloading Packages:\n bonnie++-1.96-2.el6.x86_64: failure: bonnie++-1.96-2.el6.x86_64.rpm from epel: [Errno 256] No more mirrors to try.\n\n"}}
  • flavor:
  • job_id: 1019189
  • kernel:
    • sha1: distro
    • kdb: True
  • last_in_suite: False
  • machine_type: vps
  • name: teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps
  • nuke_on_error: True
  • os_type: centos
  • os_version: 6.5
  • overrides:
    • s3tests:
      • idle_timeout: 1200
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
          • debug mon: 1
          • debug paxos: 20
          • debug ms: 20
      • branch:
        • dev: hammer
    • rgw:
      • default_idle_timeout: 1200
    • ceph-fuse:
      • client.0:
        • mount_wait: 60
        • mount_timeout: 120
    • workunit:
      • sha1: 88e7ee716fdd7bcf81845087021a677de5a50da8
    • ceph:
      • log-whitelist:
        • slow request
        • Missing health data for MDS
        • failed to encode map
        • wrongly marked me down
        • objects unfound and apparently lost
        • log bound mismatch
      • conf:
        • global:
          • osd heartbeat grace: 100
          • mon lease ack timeout: 25
          • mon lease: 15
        • mon:
          • mon warn on legacy crush tunables: False
          • debug mon: 20
          • debug paxos: 20
          • debug ms: 1
        • osd:
          • debug osd: 20
          • debug filestore: 20
          • debug journal: 20
          • debug ms: 1
      • sha1: 88e7ee716fdd7bcf81845087021a677de5a50da8
    • install:
      • ceph:
        • sha1: 88e7ee716fdd7bcf81845087021a677de5a50da8
    • admin_socket:
      • branch: hammer
  • owner: scheduled_teuthology@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mon.b', 'mon.c', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6']
    • ['osd.7', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'osd.12', 'osd.13']
    • ['client.0']
  • sentry_event: http://sentry.ceph.com/sepia/teuthology/search?q=ed86153adecd43949faf559c339e5ec1
  • status: fail
  • success: False
  • branch:
  • seed:
  • sha1:
  • subset:
  • suite:
  • suite_branch: hammer
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1:
  • targets:
    • ubuntu@vpm064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuK4OKTvFTSXnIfVwJh2VyZ07NVvevBkKMrhK+qwxKeMW4o9qX8qjLYri9QzZxOHHk4gcPFS+DFmGutSx5XB+o8lpuEd1NjFCvsGw/iqbVA80q+oF4uM08cDf/9LA59QJuTSa7aFYjUElN3JxstAExf+jeTrDiYPWR5bEtVuNjkYzpbX7OnEtzkfVN51G+kExSSak0EAuY7T20WrNShhnQLjuLj4VdbXM7x93SP7pMND7rtVwbucwi5ltkPizUMgFn78eSSCpIt15Vz3y2qNnnRawyax9RF7sOFffKKpjassh6hfXxZsONnm5ezHX9g5ncWf6mMkKgRBZ+E5y5OJzNQ==
    • ubuntu@vpm063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAxXQIKuLwlBZPYcgCzVhs3oS2OJsoHovaI8BeVjw0rIRc4sf0gAWctfH4uoalwrmyf6DELDl6J0Cm88t7JjoHvVMk9cH5MwEDLwsCuaxL4zTuHZ+gLkOfwUn7QLikC73xzIR7rLyVOl7LbIBMFFN0rprEgKFSqXW0ZbpbufwmhbxXkUbp2DjNicYIoGUK/QD6hye5sjIorAIiI3enVxbgJKn6cLgjFJ7o2Hauw4smG4ljaTze67iXEUBmzdEOptl1AFJFHDbb0cmU/AHPJ2Ljv4IA5S2ZfG+ySmTlAVoPOWPEn1l3WhpMUW75faSBaIKbzUpjXMCK/A6YpI72Tvc4fw==
    • ubuntu@vpm127.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA+/bKXIfHARnA70I2FsVfUtifEGZDfNSrBKCkRQzDaFvsYhM9jmPWoD9m6z/LWJxvBvyAmDgTlZiQyp0otYcJqsvOfOZamdTt7GOOOA6gimdK9huzbJldewItNOkOaQuHFDDPoewRHXlQAxyiUd3/iTm3779j5DBNBowr5yrNVlM5qi/ypQhfT7jkY5ng5gIdYPnPH8TFT/4X7l4IjG+TOlzAC/sQ8XINSsCwzOzCXyZNtVG68qsgoAeRcrn03UTinLSA8tIFvU298aQ8xXoA8xOwaThlRV8ReWcVJWjOHrRCMUlXn/M0Y8hlHYsZ5VHm+Y7239/OwzENkSZA/Snl0w==
  • tasks:
    • internal.check_packages:
    • internal.lock_machines:
      • 3
      • vps
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • sha1: distro
      • kdb: True
    • internal.base:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • selinux:
    • ansible.cephlab:
    • clock.check:
    • install:
      • branch: firefly
    • ceph:
      • fs: xfs
    • install.upgrade:
      • osd.0:
    • ceph.restart:
      • daemons:
        • osd.0
        • osd.1
        • osd.2
        • osd.3
        • osd.4
        • osd.5
        • osd.6
    • thrashosds:
      • chance_pgnum_grow: 1
      • chance_pgpnum_fix: 1
      • timeout: 1200
    • ceph.restart:
      • daemons:
        • mon.a
      • wait-for-healthy: False
      • wait-for-osds-up: True
    • workunit:
      • clients:
        • client.0:
          • cls/test_cls_rbd.sh
      • branch: firefly
    • workunit:
      • clients:
        • client.0:
          • rbd/import_export.sh
      • env:
        • RBD_CREATE_ARGS: --new-format
      • branch: firefly
    • rados:
      • op_weights:
        • read: 45
        • write: 45
        • delete: 10
      • clients:
        • client.0
      • objects: 500
      • ops: 4000
    • rados:
      • op_weights:
        • snap_remove: 50
        • snap_create: 50
        • rollback: 50
        • read: 100
        • write: 100
        • delete: 50
      • clients:
        • client.0
      • objects: 50
      • ops: 4000
    • ceph.restart:
      • daemons:
        • mon.b
      • wait-for-healthy: False
      • wait-for-osds-up: True
    • radosbench:
      • clients:
        • client.0
      • time: 1800
    • workunit:
      • clients:
        • client.0:
          • rbd/test_librbd.sh
      • branch: firefly
    • ceph.restart:
      • daemons:
        • mon.c
      • wait-for-healthy: False
      • wait-for-osds-up: True
    • ceph.wait_for_mon_quorum:
      • a
      • b
      • c
    • workunit:
      • clients:
        • client.0:
          • rbd/test_librbd_python.sh
      • branch: firefly
    • rgw:
      • client.0:
      • default_idle_timeout: 300
    • swift:
      • client.0:
        • rgw_server: client.0
    • rados:
      • op_weights:
        • snap_remove: 50
        • snap_create: 50
        • rollback: 50
        • read: 100
        • write: 100
        • delete: 50
      • clients:
        • client.0
      • objects: 500
      • ops: 4000
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2015-08-17 21:24:06
  • started: 2015-08-17 21:25:13
  • updated: 2015-08-17 22:01:15
  • status_class: danger
  • runtime: 0:36:02
  • wait_time: 0:07:39