| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2020-07-01 14:23:03 | 2020-07-01 14:26:43 | 2020-07-01 19:04:52 | 4:38:09 | upgrade:nautilus-x | master | smithi | 5ccfc2d | 15 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 5194559 |
|
2020-07-01 14:25:40 | 2020-07-01 14:26:30 | 2020-07-01 15:10:30 | 0:44:00 | 0:23:01 | 0:20:59 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi101 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194560 |
|
2020-07-01 14:25:41 | 2020-07-01 14:26:30 | 2020-07-01 18:20:35 | 3:54:05 | 2:57:56 | 0:56:09 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) |
||||||||||||||
| fail | 5194561 |
|
2020-07-01 14:25:41 | 2020-07-01 14:26:31 | 2020-07-01 17:14:34 | 2:48:03 | 0:04:33 | 2:43:30 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/nautilus/8bfdf6e5d126191e84168650f254f47633a572c4/ubuntu/bionic/flavors/default/repo (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),)) |
||||||||||||||
| fail | 5194562 |
|
2020-07-01 14:25:42 | 2020-07-01 14:26:36 | 2020-07-01 15:26:37 | 1:00:01 | 0:20:38 | 0:39:23 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi139 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194563 |
|
2020-07-01 14:25:43 | 2020-07-01 14:26:43 | 2020-07-01 15:04:43 | 0:38:00 | 0:24:08 | 0:13:52 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi120 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194564 |
|
2020-07-01 14:25:44 | 2020-07-01 14:28:31 | 2020-07-01 17:34:35 | 3:06:04 | 2:34:13 | 0:31:51 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
Command failed on smithi187 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194565 |
|
2020-07-01 14:25:45 | 2020-07-01 14:28:31 | 2020-07-01 18:46:36 | 4:18:05 | 0:36:27 | 3:41:38 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
Command failed on smithi104 with status 128: 'rm -rf /home/ubuntu/cephtest/qemu_clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/qemu_clone.client.0 && cd /home/ubuntu/cephtest/qemu_clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194566 |
|
2020-07-01 14:25:46 | 2020-07-01 14:30:34 | 2020-07-01 15:06:34 | 0:36:00 | 0:21:04 | 0:14:56 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi124 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194567 |
|
2020-07-01 14:25:47 | 2020-07-01 14:30:34 | 2020-07-01 15:10:34 | 0:40:00 | 0:22:44 | 0:17:16 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi092 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194568 |
|
2020-07-01 14:25:48 | 2020-07-01 14:34:46 | 2020-07-01 19:04:52 | 4:30:06 | 3:25:55 | 1:04:11 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
Command failed on smithi016 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194569 |
|
2020-07-01 14:25:48 | 2020-07-01 14:36:14 | 2020-07-01 16:38:16 | 2:02:02 | 0:37:19 | 1:24:43 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
Command failed on smithi129 with status 128: 'rm -rf /home/ubuntu/cephtest/qemu_clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/qemu_clone.client.0 && cd /home/ubuntu/cephtest/qemu_clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194570 |
|
2020-07-01 14:25:49 | 2020-07-01 14:36:23 | 2020-07-01 15:36:24 | 1:00:01 | 0:20:39 | 0:39:22 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi151 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194571 |
|
2020-07-01 14:25:50 | 2020-07-01 14:36:26 | 2020-07-01 15:10:26 | 0:34:00 | 0:14:37 | 0:19:23 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} | 4 |
Failure Reason:
HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f6c4834cf98>: Failed to establish a new connection: [Errno 110] Connection timed out',)) |
||||||||||||||
| dead | 5194572 |
|
2020-07-01 14:25:51 | 2020-07-01 14:36:27 | 2020-07-01 17:34:30 | 2:58:03 | 0:02:40 | 2:55:23 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
{'Failure object was': {'smithi096.front.sepia.ceph.com': {'results': [{'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: <urlopen error timed out>', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"} |
||||||||||||||
| fail | 5194573 |
|
2020-07-01 14:25:52 | 2020-07-01 14:36:30 | 2020-07-01 16:22:31 | 1:46:01 | 0:36:02 | 1:09:59 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} | 5 |
Failure Reason:
Command failed on smithi117 with status 128: 'rm -rf /home/ubuntu/cephtest/qemu_clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/qemu_clone.client.0 && cd /home/ubuntu/cephtest/qemu_clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
| fail | 5194574 |
|
2020-07-01 14:25:53 | 2020-07-01 14:36:33 | 2020-07-01 15:12:33 | 0:36:00 | 0:22:19 | 0:13:41 | smithi | master | ubuntu | 18.04 | upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} | 4 |
Failure Reason:
Command failed on smithi074 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' |
||||||||||||||
Pulpito