Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi096.front.sepia.ceph.com smithi True True 2019-08-20 15:52:36.776349 scheduled_yuriw@teuthology centos 7 x86_64 /home/teuthworker/archive/yuriw-2019-08-20_15:10:14-rbd-wip-yuri3-testing-2019-08-19-1619-nautilus-distro-basic-smithi/4234360
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
running 4234360 2019-08-20 15:11:39 2019-08-20 15:51:16 2019-08-20 16:11:15 0:21:05 smithi master centos 7.5
fail 4233898 2019-08-20 13:15:51 2019-08-20 14:18:37 2019-08-20 15:54:38 1:36:01 0:19:30 1:16:31 smithi master
Failure Reason:

Command failed on smithi023 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release nautilus'"

pass 4233545 2019-08-20 11:56:17 2019-08-20 12:14:26 2019-08-20 12:36:26 0:22:00 0:14:34 0:07:26 smithi master centos 7.6
running 4233529 2019-08-20 11:56:02 2019-08-20 12:08:41 2019-08-20 16:10:49 4:03:40 smithi master ubuntu 18.04
pass 4233313 2019-08-20 08:28:45 2019-08-20 08:43:41 2019-08-20 09:37:40 0:53:59 0:14:20 0:39:39 smithi master centos 7.6
pass 4233283 2019-08-20 08:28:23 2019-08-20 08:42:08 2019-08-20 09:16:06 0:33:58 0:25:13 0:08:45 smithi master ubuntu 18.04
pass 4233225 2019-08-20 07:00:26 2019-08-20 09:58:17 2019-08-20 11:16:18 1:18:01 0:12:14 1:05:47 smithi master
pass 4233086 2019-08-20 05:06:59 2019-08-20 07:05:49 2019-08-20 08:09:49 1:04:00 0:42:32 0:21:28 smithi master ubuntu 18.04
pass 4233052 2019-08-20 05:02:09 2019-08-20 09:44:07 2019-08-20 10:54:06 1:09:59 0:48:16 0:21:43 smithi master centos 7.6
dead 4232702 2019-08-20 02:30:32 2019-08-20 07:12:52 2019-08-20 08:44:53 1:32:01 0:19:41 1:12:20 smithi master ubuntu 16.04
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=32137)

fail 4231627 2019-08-19 21:52:24 2019-08-20 09:32:43 2019-08-20 09:52:42 0:19:59 0:10:03 0:09:56 smithi master ubuntu 18.04
Failure Reason:

Command failed on smithi096 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 4231494 2019-08-19 21:50:58 2019-08-20 11:40:19 2019-08-20 12:16:18 0:35:59 0:28:53 0:07:06 smithi master ubuntu 16.04
fail 4231432 2019-08-19 21:50:30 2019-08-20 08:09:50 2019-08-20 08:19:49 0:09:59 0:03:21 0:06:38 smithi master centos 7.6
Failure Reason:

5af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:06.186929', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: www.gtlib.gatech.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: www.gtlib.gatech.edu', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/02ad53e4a8943c664c67aa7ea262847b706b870148fd16535451a2e543fa17af-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/53fc8cfd63713020d57c1607cf3cb099c7708a2809bcd3f242f90305af8cb924-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-08-20 08:18:04.538945', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')

pass 4231391 2019-08-19 21:50:00 2019-08-20 11:09:54 2019-08-20 11:41:54 0:32:00 0:14:07 0:17:53 smithi master centos 7.5
dead 4230856 2019-08-19 18:22:57 2019-08-19 19:19:02 2019-08-20 07:21:28 12:02:26 smithi master rhel 7.6
fail 4230713 2019-08-19 16:43:51 2019-08-19 17:16:53 2019-08-19 19:22:54 2:06:01 1:10:29 0:55:32 smithi master centos
Failure Reason:

Command failed (s3 tests against rgw) on smithi017 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616'"

fail 4230660 2019-08-19 16:42:56 2019-08-19 16:46:53 2019-08-19 18:06:53 1:20:00 1:13:29 0:06:31 smithi master centos
Failure Reason:

Command failed (s3 tests against rgw) on smithi017 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616'"

fail 4230567 2019-08-19 15:13:55 2019-08-19 15:30:23 2019-08-19 16:48:24 1:18:01 0:50:52 0:27:09 smithi master rhel 7.6
Failure Reason:

Found coredumps on ubuntu@smithi096.front.sepia.ceph.com

pass 4230320 2019-08-19 13:37:09 2019-08-19 15:10:35 2019-08-19 15:50:35 0:40:00 0:30:04 0:09:56 smithi master rhel 7.6
fail 4230244 2019-08-19 13:35:46 2019-08-19 13:54:35 2019-08-19 15:14:35 1:20:00 1:09:50 0:10:10 smithi master centos 7.6
Failure Reason:

timed out waiting for admin_socket to appear after osd.6 restart