| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| dparmar | 2022-10-10 20:40:10 | 2022-10-10 20:41:17 | 2022-10-10 21:13:45 | 0:32:28 | fs:upgrade | main | smithi | 9cfd351 | 3 | 5 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| dead | 7062024 |
|
2022-10-10 20:40:15 | 2022-10-10 20:41:17 | 2022-10-10 20:54:46 | 0:13:29 | 0:04:26 | 0:09:03 | smithi | main | rhel | 8.6 | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/fsstress}} | 4 |
Failure Reason:
{'smithi171.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi049.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi087.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi052.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}} |
||||||||||||||
| fail | 7062025 |
|
2022-10-10 20:40:16 | 2022-10-10 20:42:48 | 2022-10-10 20:59:33 | 0:16:45 | 0:05:55 | 0:10:50 | smithi | main | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_cfuse_workunits_dbench_iozone}} | 4 | ||
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=pacific |
||||||||||||||
| dead | 7062026 |
|
2022-10-10 20:40:17 | 2022-10-10 20:43:48 | 2022-10-10 20:55:13 | 0:11:25 | 0:04:24 | 0:07:01 | smithi | main | rhel | 8.6 | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_cfuse_workunits_untarbuild_blogbench}} | 4 |
Failure Reason:
{'smithi093.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi196.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi053.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi055.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}} |
||||||||||||||
| fail | 7062027 |
|
2022-10-10 20:40:18 | 2022-10-10 20:44:19 | 2022-10-10 21:02:48 | 0:18:29 | 0:05:56 | 0:12:33 | smithi | main | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_untar_build}} | 4 | ||
Failure Reason:
SSH connection to smithi012 was lost: 'sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true' |
||||||||||||||
| dead | 7062028 |
|
2022-10-10 20:40:18 | 2022-10-10 20:46:30 | 2022-10-10 21:13:45 | 0:27:15 | 0:13:51 | 0:13:24 | smithi | main | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/fsstress}} | 4 | ||
Failure Reason:
{'smithi111.front.sepia.ceph.com': {'changed': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi111.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, 'smithi106.front.sepia.ceph.com': {'changed': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi106.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, 'smithi133.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi133.front.sepia.ceph.com,172.21.15.133' (ECDSA) to the list of known hosts.\r\nubuntu@smithi133.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}, 'smithi142.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'cmd': 'cat /etc/timezone', 'delta': '0:00:00.011168', 'end': '2022-10-10 21:13:18.452045', 'invocation': {'module_args': {'_raw_params': 'cat /etc/timezone', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-10-10 21:13:18.440877', 'stderr': 'cat: /etc/timezone: No such file or directory', 'stderr_lines': ['cat: /etc/timezone: No such file or directory'], 'stdout': '', 'stdout_lines': []}} |
||||||||||||||
| dead | 7062029 |
|
2022-10-10 20:40:19 | 2022-10-10 20:49:30 | 2022-10-10 21:01:37 | 0:12:07 | 0:04:27 | 0:07:40 | smithi | main | rhel | 8.6 | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_cfuse_workunits_dbench_iozone}} | 4 |
Failure Reason:
{'smithi109.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi120.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi071.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}, 'smithi097.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}} |
||||||||||||||
| dead | 7062030 |
|
2022-10-10 20:40:20 | 2022-10-10 20:50:31 | 2022-10-10 21:02:52 | 0:12:21 | smithi | main | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_cfuse_workunits_untarbuild_blogbench}} | 4 | ||||
Failure Reason:
SSH connection to smithi203 was lost: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main' |
||||||||||||||
| fail | 7062031 |
|
2022-10-10 20:40:21 | 2022-10-10 20:53:52 | 2022-10-10 21:08:44 | 0:14:52 | 0:07:27 | 0:07:25 | smithi | main | rhel | 8.6 | fs:upgrade/upgraded_client/from_pacific/{bluestore-bitmap clusters/{1-mds-2-client} conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-client-upgrade 2-workload/kernel_untar_build}} | 4 |
Failure Reason:
{'smithi052.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi052.front.sepia.ceph.com,172.21.15.52' (ECDSA) to the list of known hosts.\r\nubuntu@smithi052.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}, 'smithi087.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi087.front.sepia.ceph.com,172.21.15.87' (ECDSA) to the list of known hosts.\r\nubuntu@smithi087.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}, 'smithi171.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi171.front.sepia.ceph.com,172.21.15.171' (ECDSA) to the list of known hosts.\r\nubuntu@smithi171.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}, 'smithi049.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "failed to transfer file to /home/teuthworker/.ansible/tmp/ansible-local-211498y518ssy/tmpvzkdqu36 /home/ubuntu/.ansible/tmp/ansible-tmp-1665435729.2772644-23154-137776594949535/AnsiballZ_user.py:\n\ndd: failed to open '/home/ubuntu/.ansible/tmp/ansible-tmp-1665435729.2772644-23154-137776594949535/AnsiballZ_user.py': No such file or directory\n"}} |
||||||||||||||
Pulpito