Description: rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093871/teuthology.log

Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cde6d0ac6d3c4de7bfac49adfa9e27a8

Failure Reason:

{'smithi169.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:02:09.040203', 'end': '2022-11-28 17:25:44.818841', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:23:35.778638', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi189.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:02:12.116309', 'end': '2022-11-28 17:25:47.868894', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:23:35.752585', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}

  • log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093871/teuthology.log
  • archive_path: /home/teuthworker/archive/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093871
  • description: rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests}
  • duration: 0:08:49
  • email:
  • failure_reason: {'smithi169.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:02:09.040203', 'end': '2022-11-28 17:25:44.818841', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:23:35.778638', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi189.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:02:12.116309', 'end': '2022-11-28 17:25:47.868894', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:23:35.752585', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Connection timed out'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}
  • flavor:
  • job_id: 7093871
  • kernel:
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi
  • nuke_on_error: True
  • os_type: centos
  • os_version: 8.stream
  • overrides:
    • admin_socket:
      • branch: wip-yuri2-testing-2022-10-19-1252-pacific
    • ceph:
      • conf:
        • client:
          • rbd_persistent_cache_mode: rwl
          • rbd_persistent_cache_path: /home/ubuntu/cephtest/rbd-pwl-cache
          • rbd_persistent_cache_size: 5368709120
          • rbd_plugins: pwl_cache
        • mgr:
          • debug mgr: 20
          • debug ms: 1
        • mon:
          • debug mon: 20
          • debug ms: 1
          • debug paxos: 20
        • osd:
          • debug ms: 1
          • debug osd: 20
      • flavor: default
      • log-ignorelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
      • sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
    • install:
      • ceph:
        • flavor: default
        • sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • branch: wip-yuri2-testing-2022-10-19-1252-pacific
      • sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
  • owner: scheduled_yuriw@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.x', 'osd.0', 'osd.1']
    • ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0']
  • sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cde6d0ac6d3c4de7bfac49adfa9e27a8
  • status: dead
  • success: False
  • branch: wip-yuri2-testing-2022-10-19-1252-pacific
  • seed:
  • sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
  • subset:
  • suite:
  • suite_branch: wip-yuri2-testing-2022-10-19-1252-pacific
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
  • targets:
    • smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKGBKKzluIfN/iFIi+kmoAS91jsBJuAIfmjxD2Z7f4TDC6eyQgpP9pqCN8VRaIjTbEkM4Clgra2EHieBViiOOkgXwC+XbqWxooew+19yqUqyaYGsC/78VQouS+lNCgdJWE6h3E9X2yUeamjE3G3u+UnShMdRnOfqUFI+6/YURCuHqLmKwRFxfFAJpeoNvHoiJScjy5PDzVqqaoJuf3/zWePPmYP/65nw5iRrXq3VaZ/2AdxsXXnHd+IUU03mkWA7wUbM8KW7NQUaJwMhTX9JY+snfl7BAg6hIdcizgLd1SBNaTrorl1C2SEMKPGUlOWxVUPz2BK9aU/v9/0jiCNb9R2Cm0mHQRfBketwwzriyNw5K8s3pNXa/k8weE3Bh8A14p5jpH4Tav+cIJWRXyx0IUYNTJxrorKPp6z9yqExI4bd0NBgAW9Z7aKha9vRj9pOz2NgOPLcaqX/9eoJ1eIre6+39H465rKTOGNk9zLoTWVAjAaZHDlEtG5nc26EZpi8M=
    • smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkjBGFHO+GpAxyzLLfpMBMJhUQdGKsnIWmRXnfPATNKrN/Smx0qGShllprb6+tx4C5J4jXCZUbJvVTbDKn0414v/X9yICpgp6nijymWvwtHtBub/AaTNv/swLPj5qSe5YJ6Haav1S6Hi+6LZTgwmsxnKfsI/rIce2KcW0PS6uzFRi6eYX1NSSD6EEm6TfmrjAMmWUuKB8pRhGSolYaQSXqzWWL3onOofo/LWMRJhnol9oV62JC5nKb7dQQ6U2ABJqoz/aur46ViDeCa73aojP9Gx9OdYgYznz4uB9AX9NfV9hfBcYmpIUt8ZBFVLaRbsF2EgcDOCihnF1PGdips4Mq5eCF3HqkdpCX6FRnq/+o74pMk0rfYqeDX9BBssIXDpysEog2y53QjeUvZmC2xyhVjjgN8o+evACCu2cz9mOZfrpqM2rW1vY3a/OHnUJrP69AMQTf4goFkpG9OutG7aLY0lte5sHvW+0TdzeGxWo2jrrHT+aqOgHk6lTvZjs+8TU=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
    • ceph:
    • exec:
      • client.0:
        • mkdir /home/ubuntu/cephtest/tmpfs
        • mkdir /home/ubuntu/cephtest/rbd-pwl-cache
        • sudo mount -t tmpfs -o size=20G tmpfs /home/ubuntu/cephtest/tmpfs
        • truncate -s 20G /home/ubuntu/cephtest/tmpfs/loopfile
        • mkfs.ext4 /home/ubuntu/cephtest/tmpfs/loopfile
        • sudo mount -o loop /home/ubuntu/cephtest/tmpfs/loopfile /home/ubuntu/cephtest/rbd-pwl-cache
        • sudo chmod 777 /home/ubuntu/cephtest/rbd-pwl-cache
    • exec_on_cleanup:
      • client.0:
        • sudo umount /home/ubuntu/cephtest/rbd-pwl-cache
        • sudo umount /home/ubuntu/cephtest/tmpfs
        • rm -rf /home/ubuntu/cephtest/rbd-pwl-cache
        • rm -rf /home/ubuntu/cephtest/tmpfs
    • qemu:
      • client.0:
        • cpus: 4
        • disks: 3
        • memory: 4096
        • test: qa/run_xfstests_qemu.sh
        • type: block
  • teuthology_branch: main
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2022-11-28 16:18:54
  • started: 2022-11-28 17:09:58
  • updated: 2022-11-28 17:26:25
  • status_class: danger
  • runtime: 0:16:27
  • wait_time: 0:07:38