Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 5873867 2021-02-10 22:05:46 2021-02-10 22:08:20 2021-02-10 22:15:21 0:07:01 smithi master centos 8.2 rados:cephadm/dashboard/{distro/centos_latest task/test_e2e} 2
dead 5873868 2021-02-10 22:05:46 2021-02-10 22:08:20 2021-02-10 22:15:18 0:06:58 smithi master centos 8.2 rados:cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} 2
fail 5873869 2021-02-10 22:05:47 2021-02-10 22:08:20 2021-02-10 22:22:55 0:14:35 smithi master centos 8.0 rados:cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start}
Failure Reason:

Command failed on smithi098 with status 1: 'sudo yum install -y kernel'

dead 5873870 2021-02-10 22:05:48 2021-02-10 22:08:21 2021-02-10 22:15:17 0:06:56 smithi master centos 8.0 rados:cephadm/smoke-roleless/{distro/centos_8.0 start} 2
fail 5873871 2021-02-10 22:05:49 2021-02-10 22:08:21 2021-02-10 22:25:28 0:17:07 0:11:09 0:05:58 smithi master ubuntu 20.04 rados:cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_20.04} fixed-2 mon_election/classic}
Failure Reason:

Failure object was: {'smithi038.front.sepia.ceph.com': {'msg': "Failed to get information on remote file (/etc/sudoers.d/cephlab_sudo): Warning: Permanently added 'smithi038.front.sepia.ceph.com,172.21.15.38' (ECDSA) to the list of known hosts.\r\nControlSocket /home/teuthworker/.ansible/cp/4ac85fd62e already exists, disabling multiplexing\r\n/bin/sh: /usr/bin/python: No such file or directory\n", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', "Failed to get information on remote file (/etc/sudoers.d/cephlab_sudo): Warning: Permanently added 'smithi038.front.sepia.ceph.com,172.21.15.38' (ECDSA) to the list of known hosts.\r\nControlSocket /home/teuthworker/.ansible/cp/4ac85fd62e already exists, disabling multiplexing\r\n/bin/sh: /usr/bin/python: No such file or directory\n")

dead 5873872 2021-02-10 22:05:50 2021-02-10 22:08:21 2021-02-10 22:20:59 0:12:38 smithi master centos 8.2 rados:cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: 'ssh_keyscan smithi047.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

dead 5873873 2021-02-10 22:05:51 2021-02-10 22:08:21 2021-02-10 22:17:25 0:09:04 smithi master centos 8.2 rados:cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption}
Failure Reason:

SSH connection to smithi082 was lost: 'sudo yum install -y kernel'

fail 5873874 2021-02-10 22:05:51 2021-02-10 22:08:22 2021-02-10 22:22:34 0:14:12 smithi master centos 8.2 rados:cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start}
Failure Reason:

Command failed on smithi087 with status 1: 'sudo yum install -y kernel'

pass 5873875 2021-02-10 22:05:52 2021-02-10 22:08:22 2021-02-10 22:39:15 0:30:53 0:13:06 0:17:47 smithi master centos 8.2 rados:cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} 1
fail 5873876 2021-02-10 22:05:53 2021-02-10 22:08:22 2021-02-10 22:23:16 0:14:54 smithi master rhel 8.3 rados:cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
Failure Reason:

Stale jobs detected, aborting.

fail 5873877 2021-02-10 22:05:54 2021-02-10 22:08:22 2021-02-10 22:22:16 0:13:54 smithi master rhel 8.3 rados:cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start}
Failure Reason:

Command failed on smithi101 with status 1: 'sudo yum install -y kernel'

fail 5873878 2021-02-10 22:05:55 2021-02-10 22:08:23 2021-02-10 22:29:41 0:21:18 0:05:13 0:16:05 smithi master centos 8.2 rados:cephadm/smoke-roleless/{distro/centos_latest start}
Failure Reason:

Command failed on smithi136 with status 1: 'curl --silent https://raw.githubusercontent.com/ceph/ceph/b4d9cc45d6ff1ea5382954dece424128b478d6f7/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm'

fail 5873879 2021-02-10 22:05:55 2021-02-10 22:08:23 2021-02-10 22:29:43 0:21:20 0:05:38 0:15:42 smithi master ubuntu 18.04 rados:cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity}
Failure Reason:

{'Failure object was': {'smithi036.front.sepia.ceph.com': {'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable', 'invocation': {'module_args': {'name': 'nagios_run_sudo', 'state': True, 'persistent': True, 'ignore_selinux_state': False}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'nagios_run_sudo')"}

fail 5873880 2021-02-10 22:05:56 2021-02-10 22:08:23 2021-02-10 22:23:17 0:14:54 smithi master centos 8.2 rados:cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos}
Failure Reason:

Command failed on smithi159 with status 100: 'sudo apt-get clean'

fail 5873881 2021-02-10 22:05:57 2021-02-10 22:08:23 2021-02-10 22:23:03 0:14:40 smithi master ubuntu 18.04 rados:cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
Failure Reason:

Stale jobs detected, aborting.

dead 5873882 2021-02-10 22:05:58 2021-02-10 22:08:24 2021-02-10 22:21:01 0:12:37 smithi master ubuntu 18.04 rados:cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: 'ssh_keyscan smithi040.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

dead 5873883 2021-02-10 22:05:59 2021-02-10 22:08:24 2021-02-10 22:15:05 0:06:41 smithi master centos 8.2 rados:cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} 1
fail 5873884 2021-02-10 22:06:00 2021-02-10 22:08:24 2021-02-10 22:23:24 0:15:00 smithi master ubuntu 20.04 rados:cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start}
Failure Reason:

Command failed on smithi144 with status 1: 'sudo yum install -y kernel'

dead 5873885 2021-02-10 22:06:00 2021-02-10 22:08:24 2021-02-10 22:14:06 0:05:42 smithi master rhel 8.3 rados:cephadm/smoke-roleless/{distro/rhel_latest start} 2
Failure Reason:

Error reimaging machines: SSH connection to smithi162 was lost: 'sudo hostname smithi162'

fail 5873886 2021-02-10 22:06:01 2021-02-10 22:08:25 2021-02-10 22:22:42 0:14:17 smithi master centos 8.0 rados:cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start}
Failure Reason:

Command failed on smithi057 with status 1: 'sudo yum install -y kernel'

dead 5873887 2021-02-10 22:06:02 2021-02-10 22:08:25 2021-02-10 22:30:26 0:22:01 0:05:40 0:16:21 smithi master ubuntu 20.04 rados:cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_20.04} fixed-2 mon_election/classic}
Failure Reason:

{'Failure object was': {'smithi131.front.sepia.ceph.com': {'msg': 'non-zero return code', 'cmd': ['rpm', '--rebuilddb'], 'stdout': '', 'stderr': "error: can't create transaction lock on /var/lib/rpm/.rpm.lock (Resource temporarily unavailable)", 'rc': 255, 'start': '2021-02-10 22:25:52.091884', 'end': '2021-02-10 22:25:52.099768', 'delta': '0:00:00.007884', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'rpm --rebuilddb', 'warn': True, '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': 'None', 'chdir': 'None', 'executable': 'None', 'creates': 'None', 'removes': 'None', 'stdin': 'None'}}, 'warnings': ["Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': [], 'stderr_lines': ["error: can't create transaction lock on /var/lib/rpm/.rpm.lock (Resource temporarily unavailable)"], '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'rpm')"}

dead 5873888 2021-02-10 22:06:03 2021-02-10 22:08:25 2021-02-10 22:24:35 0:16:10 smithi master ubuntu 20.04 rados:cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
Failure Reason:

SSH connection to smithi095 was lost: 'rpm -q kernel --last | head -n 1'

dead 5873889 2021-02-10 22:06:04 2021-02-10 22:08:25 2021-02-10 22:15:20 0:06:55 smithi master centos 8.2 rados:cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} 1
dead 5873890 2021-02-10 22:06:05 2021-02-10 22:08:26 2021-02-10 22:17:22 0:08:56 smithi master centos 8.2 rados:cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start}
Failure Reason:

SSH connection to smithi045 was lost: 'sudo yum install -y kernel'

dead 5873891 2021-02-10 22:06:05 2021-02-10 22:08:26 2021-02-10 22:15:52 0:07:26 smithi master ubuntu 18.04 rados:cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2