Pulpito

teuthology-2015-08-17_14:24:00-upgrade:firefly-x-hammer-distro-basic-vps

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail
teuthology 2015-08-17 21:24:00 2015-08-17 21:24:47 2015-08-18 00:59:04 3:34:17 upgrade:firefly-x hammer vps — 6 9

Average wait time: 0:14:52

See other runs of suite 'upgrade:firefly-x' on branch 'hammer'?

See other runs on branch 'hammer'?

See other runs scheduled on 2015-08-17?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
fail 1019188 2015-08-17 21:24:06 2015-08-17 21:24:12 2015-08-17 23:16:20 1:52:08 1:45:57 0:06:11 vps master centos 6.5 upgrade:firefly-x/singleton/versions-steps-x/{versions-steps-x.yaml distros/centos_6.5.yaml} 3
Failure Reason:

Command failed on vpm156 with status 1: 'sudo yum -y install libcephfs_jni1 rbd-fuse ceph-radosgw librbd1 ceph-debuginfo ceph-fuse python-ceph ceph ceph-devel ceph-test librados2 cephfs-java libcephfs1'

fail 1019189 2015-08-17 21:24:06 2015-08-17 21:25:13 2015-08-17 22:01:15 0:36:02 0:28:23 0:07:39 vps master centos 6.5 upgrade:firefly-x/stress-split/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_6.5.yaml} 3
Failure Reason:

{'vpm063.front.sepia.ceph.com': {'item': 'gperftools-devel,cryptopp-devel,cryptopp,dbench,fuse-sshfs,bonnie++,perl-JSON,python-virtualenv,smbios-utils', 'rc': 1, 'invocation': {'module_name': 'yum', 'module_args': ''}, 'changed': True, 'results': ['Loaded plugins: fastestmirror, priorities, security\nSetting up Install Process\nLoading mirror speeds from cached hostfile\n * base: repos.lax.quadranet.com\n * extras: mirror.supremebytes.com\n * updates: mirror.pac-12.org\n43 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package bonnie++.x86_64 0:1.96-2.el6 will be installed\n---> Package cryptopp.x86_64 0:5.6.2-9.el6 will be installed\n---> Package cryptopp-devel.x86_64 0:5.6.2-9.el6 will be installed\n---> Package dbench.x86_64 0:4.0-4.el6 will be installed\n---> Package fuse-sshfs.x86_64 0:2.5-1.el6.rf will be installed\n---> Package gperftools-devel.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: gperftools-libs(x86-64) = 2.0-11.el6.3 for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_minimal.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_debug.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc_and_profiler.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libtcmalloc.so.4()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n--> Processing Dependency: libprofiler.so.0()(64bit) for package: gperftools-devel-2.0-11.el6.3.x86_64\n---> Package perl-JSON.noarch 0:2.15-5.el6 will be installed\n---> Package python-virtualenv.noarch 0:1.10.1-1.el6 will be installed\n---> Package smbios-utils.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: smbios-utils-python for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Processing Dependency: smbios-utils-bin for package: smbios-utils-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package gperftools-libs.x86_64 0:2.0-11.el6.3 will be installed\n--> Processing Dependency: libunwind.so.8()(64bit) for package: gperftools-libs-2.0-11.el6.3.x86_64\n---> Package smbios-utils-bin.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: libsmbios = 2.2.26-3.el6 for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios_c.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n--> Processing Dependency: libsmbios.so.2()(64bit) for package: smbios-utils-bin-2.2.26-3.el6.x86_64\n---> Package smbios-utils-python.x86_64 0:2.2.26-3.el6 will be installed\n--> Processing Dependency: python-smbios = 2.2.26-3.el6 for package: smbios-utils-python-2.2.26-3.el6.x86_64\n--> Running transaction check\n---> Package libsmbios.x86_64 0:2.2.26-3.el6 will be installed\n---> Package libunwind.x86_64 0:1.1-3.el6 will be installed\n---> Package python-smbios.x86_64 0:2.2.26-3.el6 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n bonnie++ x86_64 1.96-2.el6 epel 67 k\n cryptopp x86_64 5.6.2-9.el6 epel 1.0 M\n cryptopp-devel x86_64 5.6.2-9.el6 epel 148 k\n dbench x86_64 4.0-4.el6 epel 1.2 M\n fuse-sshfs x86_64 2.5-1.el6.rf rpmforge 50 k\n gperftools-devel x86_64 2.0-11.el6.3 epel 290 k\n perl-JSON noarch 2.15-5.el6 base 97 k\n python-virtualenv noarch 1.10.1-1.el6 epel 1.3 M\n smbios-utils x86_64 2.2.26-3.el6 epel 14 k\nInstalling for dependencies:\n gperftools-libs x86_64 2.0-11.el6.3 epel 246 k\n libsmbios x86_64 2.2.26-3.el6 epel 226 k\n libunwind x86_64 1.1-3.el6 epel 55 k\n python-smbios x86_64 2.2.26-3.el6 epel 64 k\n smbios-utils-bin x86_64 2.2.26-3.el6 epel 91 k\n smbios-utils-python x86_64 2.2.26-3.el6 epel 60 k\n\nTransaction Summary\n================================================================================\nInstall 15 Package(s)\n\nTotal download size: 4.8 M\nInstalled size: 37 M\nDownloading Packages:\n'], 'msg': "http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/bonnie%2B%2B-1.96-2.el6.x86_64.rpm: (28, 'connect() timed out!')\nTrying other mirror.\n\n\nError Downloading Packages:\n bonnie++-1.96-2.el6.x86_64: failure: bonnie++-1.96-2.el6.x86_64.rpm from epel: [Errno 256] No more mirrors to try.\n\n"}}

pass 1019190 2015-08-17 21:24:07 2015-08-17 21:24:27 2015-08-18 00:36:43 3:12:16 2:47:06 0:25:10 vps master centos 6.5 upgrade:firefly-x/parallel/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/{ec-rados-parallel.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_6.5.yaml} 3
fail 1019191 2015-08-17 21:24:07 2015-08-17 21:24:17 2015-08-17 22:00:19 0:36:02 0:29:12 0:06:50 vps master centos 6.5 upgrade:firefly-x/stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/centos_6.5.yaml} 3
Failure Reason:

{'vpm062.front.sepia.ceph.com': {'invocation': {'module_name': 'yum', 'module_args': ''}, 'msg': "http://dl.fedoraproject.org/pub/epel/6/x86_64/python-pip-7.1.0-1.el6.noarch.rpm: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/python-pip-7.1.0-1.el6.noarch.rpm: (28, 'connect() timed out!')\nTrying other mirror.\n\n\nError Downloading Packages:\n python-pip-7.1.0-1.el6.noarch: failure: python-pip-7.1.0-1.el6.noarch.rpm from epel: [Errno 256] No more mirrors to try.\n\n", 'changed': True, 'results': ['Loaded plugins: fastestmirror, priorities, security\nSetting up Install Process\nLoading mirror speeds from cached hostfile\n * base: repos.lax.quadranet.com\n * extras: mirror.supremebytes.com\n * updates: centos.mirror.ndchost.com\n43 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package python-pip.noarch 0:7.1.0-1.el6 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n python-pip noarch 7.1.0-1.el6 epel 1.5 M\n\nTransaction Summary\n================================================================================\nInstall 1 Package(s)\n\nTotal download size: 1.5 M\nInstalled size: 6.6 M\nDownloading Packages:\n'], 'rc': 1}}

fail 1019192 2015-08-17 21:24:07 2015-08-17 21:24:57 2015-08-17 23:55:09 2:30:12 2:25:24 0:04:48 vps master debian 7.0 upgrade:firefly-x/parallel/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/{ec-rados-parallel.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/debian_7.0.yaml} 3
Failure Reason:

Command failed on vpm154 with status 1: 'cd /home/ubuntu/cephtest/swift && ./bootstrap'

pass 1019193 2015-08-17 21:24:08 2015-08-17 21:25:03 2015-08-17 23:09:10 1:44:07 1:40:39 0:03:28 vps master debian 7.0 upgrade:firefly-x/stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/debian_7.0.yaml} 3
fail 1019194 2015-08-17 21:24:08 2015-08-17 21:24:37 2015-08-18 00:24:51 3:00:14 2:48:09 0:12:05 vps master debian 7.0 upgrade:firefly-x/singleton/versions-steps-x/{versions-steps-x.yaml distros/debian_7.0.yaml} 3
Failure Reason:

"2015-08-18 00:10:24.978590 mds.0 10.214.130.6:6800/26545 1 : [ERR] bad backtrace on dir ino 600" in cluster log

pass 1019195 2015-08-17 21:24:09 2015-08-17 21:25:33 2015-08-18 00:23:48 2:58:15 2:53:29 0:04:46 vps master debian 7.0 upgrade:firefly-x/stress-split/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/debian_7.0.yaml} 3
fail 1019196 2015-08-17 21:24:09 2015-08-17 21:24:22 2015-08-18 00:40:38 3:16:16 3:09:33 0:06:43 vps master ubuntu 12.04 upgrade:firefly-x/singleton/versions-steps-x/{versions-steps-x.yaml distros/ubuntu_12.04.yaml} 3
Failure Reason:

"2015-08-18 00:24:59.007590 mds.0 10.214.130.78:6800/22740 1 : [ERR] bad backtrace on dir ino 600" in cluster log

fail 1019197 2015-08-17 21:24:10 2015-08-17 21:25:08 2015-08-17 21:43:08 0:18:00 0:12:45 0:05:15 vps master centos 6.5 upgrade:firefly-x/parallel/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/{ec-rados-parallel.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_6.5.yaml} 3
Failure Reason:

{'vpm104.front.sepia.ceph.com': {'cmd': ['yum-complete-transaction', '--cleanup-only'], 'end': '2015-08-17 21:32:41.936952', 'stdout': "Loaded plugins: fastestmirror\nDetermining fastest mirrors\n * base: repos.lax.quadranet.com\n * extras: mirror.pac-12.org\n * updates: mirror.pac-12.org\nhttp://dl.fedoraproject.org/pub/epel/6/x86_64/repodata/repomd.xml: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/repodata/repomd.xml: (28, 'connect() timed out!')\nTrying other mirror.\nCannot retrieve repository metadata (repomd.xml) for repository: epel. Please verify its path and try again", 'changed': False, 'rc': 1, 'start': '2015-08-17 21:32:00.661360', 'stderr': '', 'delta': '0:00:41.275592', 'invocation': {'module_name': 'command', 'module_args': 'yum-complete-transaction --cleanup-only'}, 'stdout_lines': ['Loaded plugins: fastestmirror', 'Determining fastest mirrors', ' * base: repos.lax.quadranet.com', ' * extras: mirror.pac-12.org', ' * updates: mirror.pac-12.org', "http://dl.fedoraproject.org/pub/epel/6/x86_64/repodata/repomd.xml: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/repodata/repomd.xml: (28, 'connect() timed out!')", 'Trying other mirror.', 'Cannot retrieve repository metadata (repomd.xml) for repository: epel. Please verify its path and try again'], 'warnings': []}, 'vpm195.front.sepia.ceph.com': {'invocation': {'module_name': 'authorized_key', 'module_args': 'user="ubuntu" key=https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'failed': True, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

fail 1019198 2015-08-17 21:24:10 2015-08-17 21:24:32 2015-08-17 22:00:34 0:36:02 0:29:03 0:06:59 vps master centos 6.5 upgrade:firefly-x/stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/centos_6.5.yaml} 3
Failure Reason:

{'vpm005.front.sepia.ceph.com': {'invocation': {'module_name': 'yum', 'module_args': ''}, 'msg': "http://dl.fedoraproject.org/pub/epel/6/x86_64/python-pip-7.1.0-1.el6.noarch.rpm: [Errno 12] Timeout on http://dl.fedoraproject.org/pub/epel/6/x86_64/python-pip-7.1.0-1.el6.noarch.rpm: (28, 'connect() timed out!')\nTrying other mirror.\n\n\nError Downloading Packages:\n python-pip-7.1.0-1.el6.noarch: failure: python-pip-7.1.0-1.el6.noarch.rpm from epel: [Errno 256] No more mirrors to try.\n\n", 'changed': True, 'results': ['Loaded plugins: fastestmirror, priorities, security\nSetting up Install Process\nLoading mirror speeds from cached hostfile\n * base: repos.lax.quadranet.com\n * extras: mirror.supremebytes.com\n * updates: centos.mirror.ndchost.com\n43 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package python-pip.noarch 0:7.1.0-1.el6 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n python-pip noarch 7.1.0-1.el6 epel 1.5 M\n\nTransaction Summary\n================================================================================\nInstall 1 Package(s)\n\nTotal download size: 1.5 M\nInstalled size: 6.6 M\nDownloading Packages:\n'], 'rc': 1}}

pass 1019199 2015-08-17 21:24:11 2015-08-17 21:24:52 2015-08-17 23:45:03 2:20:11 2:17:11 0:03:00 vps master debian 7.0 upgrade:firefly-x/parallel/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/{ec-rados-parallel.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/debian_7.0.yaml} 3
pass 1019200 2015-08-17 21:24:11 2015-08-17 21:25:38 2015-08-17 23:33:48 2:08:10 0:21:01 1:47:09 vps master debian 7.0 upgrade:firefly-x/stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/debian_7.0.yaml} 3
fail 1019201 2015-08-17 21:24:12 2015-08-17 21:24:47 2015-08-18 00:59:04 3:34:17 3:26:34 0:07:43 vps master ubuntu 14.04 upgrade:firefly-x/singleton/versions-steps-x/{versions-steps-x.yaml distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2015-08-18 00:41:25.312259 mds.0 10.214.130.11:6800/27367 1 : [ERR] bad backtrace on dir ino 600" in cluster log

pass 1019202 2015-08-17 21:24:12 2015-08-17 21:25:18 2015-08-17 23:49:29 2:24:11 2:08:49 0:15:22 vps master ubuntu 12.04 upgrade:firefly-x/parallel/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/{ec-rados-parallel.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_12.04.yaml} 3