Pulpito :: Results Dashboard

Posted	Started	Updated	Runtime	Duration	In Waiting	Machine	Teuthology Branch	OS Type	OS Version	Nodes	Status
2022-11-28 16:18:52	2022-11-28 17:09:08	2022-11-28 17:22:49	0:13:41	0:07:18	0:06:23	smithi	main	rhel	8.4	1	dead

Nodes: smithi138

Description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093867/teuthology.log

Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7b9589b86f924a568c11d08d0139eb40

Failure Reason:

{'smithi138.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:00.662911', 'end': '2022-11-28 17:22:20.568438', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:21:19.905527', 'stderr': "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nCurl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Connection timed out]", 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', "Curl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Connection timed out]"], 'stdout': 'Updating Subscription Management repositories.', 'stdout_lines': ['Updating Subscription Management repositories.']}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}

All Details...

log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093867/teuthology.log
archive_path: /home/teuthworker/archive/yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7093867
description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic}
duration: 0:07:18
email:
failure_reason: {'smithi138.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:00.662911', 'end': '2022-11-28 17:22:20.568438', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 17:21:19.905527', 'stderr': "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nCurl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Connection timed out]", 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', "Curl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Connection timed out]"], 'stdout': 'Updating Subscription Management repositories.', 'stdout_lines': ['Updating Subscription Management repositories.']}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}
flavor:
job_id: 7093867
kernel:
- kdb: True
- sha1: distro
last_in_suite: False
machine_type: smithi
name: yuriw-2022-11-28_16:17:49-rbd-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi
nuke_on_error: True
os_type: rhel
os_version: 8.4
overrides:
- admin_socket:
  - branch: wip-yuri2-testing-2022-10-19-1252-pacific
- ceph:
  - conf:
    - client:
      - rbd default format: 1
    - global:
      - mon client directed command retry: 5
      - ms inject socket failures: 5000
    - mgr:
      - debug mgr: 20
      - debug ms: 1
    - mon:
      - debug mon: 20
      - debug ms: 1
      - debug paxos: 20
    - osd:
      - bdev async discard: True
      - bdev enable discard: True
      - bluestore allocator: stupid
      - bluestore block size: 96636764160
      - bluestore fsck on mount: True
      - debug bluefs: 1/20
      - debug bluestore: 1/20
      - debug ms: 1
      - debug osd: 20
      - debug rocksdb: 4/10
      - mon osd backfillfull_ratio: 0.85
      - mon osd full ratio: 0.9
      - mon osd nearfull ratio: 0.8
      - osd failsafe full ratio: 0.95
      - osd objectstore: bluestore
      - osd shutdown pgref assert: True
  - flavor: default
  - fs: xfs
  - log-ignorelist:
    - $MDS_ALL_DOWN$
    - $MDS_UP_LESS_THAN_MAX$
    - $OSD_SLOW_PING_TIME
    - overall HEALTH_
    - \(CACHE_POOL_NEAR_FULL$
    - $CACHE_POOL_NO_HIT_SET$
  - sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
- ceph-deploy:
  - bluestore: True
  - conf:
    - client:
      - log file: /var/log/ceph/ceph-$name.$pid.log
    - global:
      - osd crush chooseleaf type: 0
      - osd pool default pg num: 128
      - osd pool default pgp num: 128
      - osd pool default size: 2
    - mon:
      - osd default pool size: 2
    - osd:
      - bdev async discard: True
      - bdev enable discard: True
      - bluestore block size: 96636764160
      - bluestore fsck on mount: True
      - debug bluefs: 1/20
      - debug bluestore: 1/20
      - debug rocksdb: 4/10
      - mon osd backfillfull_ratio: 0.85
      - mon osd full ratio: 0.9
      - mon osd nearfull ratio: 0.8
      - osd failsafe full ratio: 0.95
      - osd objectstore: bluestore
  - fs: xfs
- install:
  - ceph:
    - flavor: default
    - sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
- selinux:
  - whitelist:
    - scontext=system_u:system_r:logrotate_t:s0
- thrashosds:
  - bdev_inject_crash: 2
  - bdev_inject_crash_probability: 0.5
- workunit:
  - branch: wip-yuri2-testing-2022-10-19-1252-pacific
  - sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
owner: scheduled_yuriw@teuthology
pid:
roles:
- ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']
sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7b9589b86f924a568c11d08d0139eb40
status: dead
success: False
branch: wip-yuri2-testing-2022-10-19-1252-pacific
seed:
sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
subset:
suite:
suite_branch: wip-yuri2-testing-2022-10-19-1252-pacific
suite_path:
suite_relpath:
suite_repo:
suite_sha1: 8971b5542afa0f81acdcd730197df1f921e9bf83
targets:
- smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2Oy3v+RIT/SaYxxXy+i5H82Xv5IXEI9xmt0tZgjpc6F8mwy0FjSSTZyVcRK54zpHCeu5sb9RhSaSkzD+Tfx5FLxhw1cxF1lwtt9xolQhjXFwIs+Mhw+ij3TWQhQ+mZwR167vR86fPCpVFDe2drCdj3dmjlQQAi1l85A9bGHmRpMCzJBDnoXll2Bwnh1Yj/IHvdhwvmH1ogsJMUOsz4sbbdhI3goUEFrRYDKyLXrvH/+l/Ov7I5RC2YrQ2ssE1ZjLCEeKfyaSJLL/WzQUJrP8r5P6pb1pQRs5MaZvnJJHk9VBEdzStWrQbLfIxy86DtNcWdfaPXNKuSHNXAmsD8DNHK0E9HxN850hN3h8BzeRwqMkA+A4fzv+H6nmimEeMd7uYzYDq5mUB9yFubfKNSN+WOu1zynISjRUUxA0gFHH8Ds9gQ6CyBCIzFfgRghgjroTZ9QqXi80Z+drDU9kXvlwt5HKBJhtJNVKo6vmMC7u5KpY1auQQJAWy8nC2YLVYxds=
tasks:
- internal.check_packages:
- internal.buildpackages_prep:
- internal.save_config:
- internal.check_lock:
- internal.add_remotes:
- console_log:
- internal.connect:
- internal.push_inventory:
- internal.serialize_remote_roles:
- internal.check_conflict:
- internal.check_ceph_data:
- internal.vm_setup:
- kernel:
  - kdb: True
  - sha1: distro
- internal.base:
- internal.archive_upload:
- internal.archive:
- internal.coredump:
- internal.sudo:
- internal.syslog:
- internal.timer:
- pcp:
- selinux:
- ansible.cephlab:
- clock:
- install:
- ceph:
- exec:
  - client.0:
    - sudo ceph osd pool create cache 4
    - sudo ceph osd tier add rbd cache
    - sudo ceph osd tier cache-mode cache writeback
    - sudo ceph osd tier set-overlay rbd cache
    - sudo ceph osd pool set cache hit_set_type bloom
    - sudo ceph osd pool set cache hit_set_count 8
    - sudo ceph osd pool set cache hit_set_period 60
    - sudo ceph osd pool set cache target_max_objects 250
- workunit:
  - clients:
    - client.0:
      - rbd/cli_generic.sh
teuthology_branch: main
verbose: True
pcp_grafana_url:
priority:
user:
queue:
posted: 2022-11-28 16:18:52
started: 2022-11-28 17:09:08
updated: 2022-11-28 17:22:49
status_class: danger
runtime: 0:13:41
wait_time: 0:06:23