Pulpito

adking-2023-06-14_21:15:41-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304577

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2023-06-14 21:17:34 2023-06-14 21:24:03 2023-06-14 21:45:58 0:21:55 0:08:24 0:13:31 smithi main centos 8.stream 2 dead

Description: orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}

Log: http://qa-proxy.ceph.com/teuthology/adking-2023-06-14_21:15:41-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304577/teuthology.log

Sentry event: https://sentry.ceph.com/organizations/ceph/?query=816a7f30c23d43d19586a22a9a4f5e59

Failure Reason:

{'smithi131.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:13.392491', 'end': '2023-06-14 21:42:45.700621', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-14 21:42:32.308130', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/adking-2023-06-14_21:15:41-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304577/teuthology.log
  • archive_path: /home/teuthworker/archive/adking-2023-06-14_21:15:41-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304577
  • description: orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
  • duration: 0:08:24
  • email: adking@redhat.com
  • failure_reason: {'smithi131.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:13.392491', 'end': '2023-06-14 21:42:45.700621', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-06-14 21:42:32.308130', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}
  • flavor:
  • job_id: 7304577
  • kernel:
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: adking-2023-06-14_21:15:41-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi
  • nuke_on_error: True
  • os_type: centos
  • os_version: 8.stream
  • overrides:
    • admin_socket:
      • branch: wip-guits-testing-4-2023-06-14-1428
    • ceph:
      • conf:
        • global:
          • mon election default strategy: 1
          • ms bind msgr1: False
          • ms bind msgr2: True
          • ms type: async
        • mgr:
          • debug mgr: 20
          • debug ms: 1
        • mon:
          • debug mon: 20
          • debug ms: 1
          • debug paxos: 20
        • osd:
          • debug ms: 1
          • debug osd: 20
          • osd shutdown pgref assert: True
      • flavor: default
      • log-ignorelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
      • sha1: 2a9f88d69c93a40d0581c0676c06a9c9f9708b5c
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
    • cephadm:
      • cephadm_mode: cephadm-package
    • install:
      • ceph:
        • flavor: default
        • sha1: 2a9f88d69c93a40d0581c0676c06a9c9f9708b5c
      • extra_packages:
        • cephadm
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • branch: wip-guits-testing-4-2023-06-14-1428
      • sha1: 2a9f88d69c93a40d0581c0676c06a9c9f9708b5c
  • owner: scheduled_adking@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
    • ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
  • sentry_event: https://sentry.ceph.com/organizations/ceph/?query=816a7f30c23d43d19586a22a9a4f5e59
  • status: dead
  • success: False
  • branch: wip-guits-testing-4-2023-06-14-1428
  • seed:
  • sha1: 2a9f88d69c93a40d0581c0676c06a9c9f9708b5c
  • subset:
  • suite:
  • suite_branch: wip-guits-testing-4-2023-06-14-1428
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 2a9f88d69c93a40d0581c0676c06a9c9f9708b5c
  • targets:
    • smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9DyMw1lLJvr0QLzIGHTHf3n0fon7IIY8pQ4+wyz/mDj7MrRm+/bVaXTg7jZV58VO7ctiv0AhKy8yquOuqU9KMC06Od5K/i6vh1edH3idwDnbMRvm3tJUtIt61Zkmu65Nlmw1NqaxwHtBpSYyGuI8BZ17Cdm0V1He1uzEUaWyBnzjov3l69+CpzeM2gC5A+0E37ciutfwsLt0kPIBIj2OL3VTt7/w7jHXisVNf6Qt9vzBXYctnzmgGIQDCeG21DYheIYxBDEMK7mZqneBWxwFFbTYjLm4gOpUuwX6tAvoOW3EVh3A2A2Vb+8CasvbjSg90POwyEYxP8dd71g/qZziiMDIIDOy49wUpJwkbdfbpJyuvzZwOUp5teh3eiSR7C6Eu66BdZo7Vgj9AmkeqBbqX3CfBcYPFhs4vp1AtgJj4+8inHNIDE2Q7jUoGsJFzZDAnrI6ze1OE+7Pne6uTvYFvK4FKcLbHt2ReR9tvLRnjidyNjLIFwMWGnd8ypBT820s=
    • smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yClxyArN2q/MrxtiRrD+CjeIWiwUsSioqHDyIA+FTH10xCLfI+UI5oNCsbh8emd4AilG8jw959Wi5NqFbiTViRCEStgt/DRZr4BBrFdBGi5QU3bKMPXuBaDlx7tjtPdaT/Vs0g+jEsZtK3aHsAqhBBnwOQDxzBW7t92VSrGrOWjPMCn4S9I7z6UUn8JUzfsxb9eZGnDsxpzaAlJK7ln6un9moI5sC4nF/yLP7NBfChD0oUzA0AEfD6QxUJFzl+9J2qiMWypEcI7ayll6T2AeMXacWmKWRUXP+i03/hkUWDxGYrYYPCQKcM89sRUTiUz5zsNecLqmdWKab/tB1ypVI2HIMrUcT4rhXk1wBm8SD6j5+ZmrVdNVO2FnncNSJg3S1KvHShywxWbNh3SkUMXMpQfTGjRRLw779Qqd58srTot25cDblpBtiNJWAeaoqcWeTZRSC4C9uiDgxQhcpOQKYMYYP9N8awg4XQHGe0Z5V/osOtJXyYGDCQ7iML/z6rc=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • pexec:
      • all:
        • sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup
        • sudo dnf -y module reset container-tools
        • sudo dnf -y module install container-tools --allowerasing --nobest
        • sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf
    • install:
    • cephadm:
      • conf:
        • mgr:
          • debug mgr: 20
          • debug ms: 1
    • cephadm.shell:
      • mon.a:
        • set -ex for f in osd.0 osd.1 osd.2 osd.3 osd.4 osd.5 osd.6 osd.7 mgr.y mgr.x do echo "rotating key for $f" K=$(ceph auth get-key $f) NK="$K" ceph orch daemon rotate-key $f while [ "$K" == "$NK" ]; do sleep 5 NK=$(ceph auth get-key $f) done done
  • teuthology_branch: main
  • verbose: False
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2023-06-14 21:17:34
  • started: 2023-06-14 21:24:03
  • updated: 2023-06-14 21:45:58
  • status_class: danger
  • runtime: 0:21:55
  • wait_time: 0:13:31