Pulpito

benhanokh-2023-03-16_05:22:01-rados-WIP_GBH_snap_mapper_4-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
benhanokh 2023-03-16 05:22:01 2023-03-24 20:25:45 2023-03-25 09:13:55 12:48:10 rados WIP_GBH_snap_mapper_4 smithi 5a9a5f0 38 7 54

Average wait time: 0:12:13

See other runs of suite 'rados' on branch 'WIP_GBH_snap_mapper_4'?

See other runs on branch 'WIP_GBH_snap_mapper_4'?

See other runs scheduled on 2023-03-16?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7209863 2023-03-16 05:23:05 2023-03-24 20:25:45 2023-03-24 20:45:51 0:20:06 0:09:49 0:10:17 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
dead 7209864 2023-03-16 05:23:06 2023-03-24 20:27:00 2023-03-25 08:36:48 12:09:48 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

hit max job timeout

pass 7209865 2023-03-16 05:23:07 2023-03-24 20:27:00 2023-03-24 20:49:03 0:22:03 0:11:30 0:10:33 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} 2
fail 7209866 2023-03-16 05:23:09 2023-03-24 20:27:01 2023-03-24 20:44:54 0:17:53 0:06:37 0:11:16 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi005 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

dead 7209867 2023-03-16 05:23:10 2023-03-24 20:27:01 2023-03-24 20:44:53 0:17:52 0:05:09 0:12:43 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'smithi084.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi089.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi037.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi093.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

pass 7209868 2023-03-16 05:23:11 2023-03-24 20:27:22 2023-03-24 20:49:47 0:22:25 0:11:26 0:10:59 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
dead 7209869 2023-03-16 05:23:12 2023-03-24 20:27:22 2023-03-24 20:45:18 0:17:56 0:04:54 0:13:02 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
Failure Reason:

{'smithi171.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi057.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209870 2023-03-16 05:23:13 2023-03-24 20:27:22 2023-03-24 20:49:31 0:22:09 0:04:50 0:17:19 smithi main ubuntu 20.04 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi193.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209871 2023-03-16 05:23:14 2023-03-24 20:33:49 2023-03-24 20:50:06 0:16:17 0:04:51 0:11:26 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
Failure Reason:

{'smithi063.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209872 2023-03-16 05:23:15 2023-03-24 20:33:50 2023-03-24 20:51:16 0:17:26 0:04:53 0:12:33 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
Failure Reason:

{'smithi153.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi142.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209873 2023-03-16 05:23:16 2023-03-24 20:33:51 2023-03-24 20:49:50 0:15:59 0:04:53 0:11:06 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} 2
Failure Reason:

{'smithi046.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi121.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209874 2023-03-16 05:23:17 2023-03-24 20:33:51 2023-03-24 20:50:50 0:16:59 0:04:50 0:12:09 smithi main ubuntu 20.04 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi186.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209875 2023-03-16 05:23:18 2023-03-24 20:34:42 2023-03-24 20:51:10 0:16:28 0:04:52 0:11:36 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
Failure Reason:

{'smithi157.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209876 2023-03-16 05:23:19 2023-03-24 20:34:42 2023-03-24 20:50:47 0:16:05 0:04:54 0:11:11 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

{'smithi115.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi165.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209877 2023-03-16 05:23:20 2023-03-24 20:34:43 2023-03-24 20:53:24 0:18:41 0:05:02 0:13:39 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

{'smithi032.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi038.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209878 2023-03-16 05:23:21 2023-03-24 20:38:00 2023-03-24 20:54:36 0:16:36 0:05:01 0:11:35 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

{'smithi035.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi043.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi083.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi173.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi138.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209879 2023-03-16 05:23:22 2023-03-24 20:38:31 2023-03-24 20:54:49 0:16:18 0:04:55 0:11:23 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'smithi044.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi002.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209880 2023-03-16 05:23:23 2023-03-24 20:39:17 2023-03-24 20:56:06 0:16:49 0:04:55 0:11:54 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
Failure Reason:

{'smithi145.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi047.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209881 2023-03-16 05:23:25 2023-03-24 20:39:18 2023-03-24 20:56:14 0:16:56 0:04:55 0:12:01 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

{'smithi070.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi139.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209882 2023-03-16 05:23:26 2023-03-24 20:39:18 2023-03-24 20:55:29 0:16:11 0:04:53 0:11:18 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
Failure Reason:

{'smithi203.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209883 2023-03-16 05:23:27 2023-03-24 20:39:19 2023-03-24 20:58:24 0:19:05 0:04:57 0:14:08 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
Failure Reason:

{'smithi169.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi029.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209884 2023-03-16 05:23:28 2023-03-24 20:39:29 2023-03-24 20:56:38 0:17:09 0:04:55 0:12:14 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
Failure Reason:

{'smithi099.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi175.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209885 2023-03-16 05:23:29 2023-03-24 20:39:30 2023-03-24 20:57:20 0:17:50 0:04:55 0:12:55 smithi main ubuntu 20.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

{'smithi012.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi102.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209886 2023-03-16 05:23:30 2023-03-24 20:41:05 2023-03-24 20:57:29 0:16:24 0:04:53 0:11:31 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi122.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209887 2023-03-16 05:23:31 2023-03-24 20:41:05 2023-03-24 20:57:47 0:16:42 0:04:55 0:11:47 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
Failure Reason:

{'smithi061.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209888 2023-03-16 05:23:32 2023-03-24 20:41:05 2023-03-24 20:58:19 0:17:14 0:04:57 0:12:17 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/insights} 2
Failure Reason:

{'smithi194.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi017.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209889 2023-03-16 05:23:33 2023-03-24 20:41:36 2023-03-24 20:58:45 0:17:09 0:04:57 0:12:12 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} 2
Failure Reason:

{'smithi016.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi176.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209890 2023-03-16 05:23:35 2023-03-24 20:41:36 2023-03-24 20:59:45 0:18:09 0:05:00 0:13:09 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

{'smithi085.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi118.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209891 2023-03-16 05:23:36 2023-03-24 20:41:47 2023-03-24 20:59:21 0:17:34 0:04:57 0:12:37 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/flannel rook/1.7.2} 1
Failure Reason:

{'smithi130.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209892 2023-03-16 05:23:37 2023-03-24 20:41:47 2023-03-24 20:58:46 0:16:59 0:04:53 0:12:06 smithi main ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi082.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209893 2023-03-16 05:23:38 2023-03-24 20:41:48 2023-03-24 21:00:08 0:18:20 0:04:59 0:13:21 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

{'smithi196.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi003.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209894 2023-03-16 05:23:39 2023-03-24 20:42:52 2023-03-24 21:00:46 0:17:54 0:05:01 0:12:53 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
Failure Reason:

{'smithi098.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi184.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209895 2023-03-16 05:23:40 2023-03-24 20:42:52 2023-03-24 21:00:38 0:17:46 0:04:59 0:12:47 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
Failure Reason:

{'smithi103.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209896 2023-03-16 05:23:41 2023-03-24 20:42:53 2023-03-24 21:00:46 0:17:53 0:05:01 0:12:52 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
Failure Reason:

{'smithi131.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi064.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209897 2023-03-16 05:23:42 2023-03-24 20:42:53 2023-03-24 21:01:05 0:18:12 0:04:59 0:13:13 smithi main ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi195.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209898 2023-03-16 05:23:43 2023-03-24 20:42:53 2023-03-24 21:02:07 0:19:14 0:05:04 0:14:10 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} 2
Failure Reason:

{'smithi077.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi090.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209899 2023-03-16 05:23:45 2023-03-24 20:43:34 2023-03-24 21:02:00 0:18:26 0:05:05 0:13:21 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

{'smithi052.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi008.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209900 2023-03-16 05:23:46 2023-03-24 20:43:45 2023-03-24 21:02:29 0:18:44 0:05:04 0:13:40 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

{'smithi086.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi178.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209901 2023-03-16 05:23:47 2023-03-24 20:43:45 2023-03-24 21:02:51 0:19:06 0:05:04 0:14:02 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

{'smithi089.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi093.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209902 2023-03-16 05:23:48 2023-03-24 20:45:11 2023-03-24 21:03:05 0:17:54 0:05:00 0:12:54 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
Failure Reason:

{'smithi037.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209903 2023-03-16 05:23:49 2023-03-24 20:45:11 2023-03-24 21:02:39 0:17:28 0:05:01 0:12:27 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} 1
Failure Reason:

{'smithi084.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209904 2023-03-16 05:23:50 2023-03-24 20:45:12 2023-03-24 21:03:43 0:18:31 0:05:00 0:13:31 smithi main ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi078.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209905 2023-03-16 05:23:51 2023-03-24 20:45:12 2023-03-24 21:03:44 0:18:32 0:05:00 0:13:32 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_nfs} 1
Failure Reason:

{'smithi019.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209906 2023-03-16 05:23:52 2023-03-24 20:45:13 2023-03-24 21:03:49 0:18:36 0:04:59 0:13:37 smithi main ubuntu 20.04 rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi005.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209907 2023-03-16 05:23:53 2023-03-24 20:45:13 2023-03-24 21:04:18 0:19:05 0:05:00 0:14:05 smithi main ubuntu 20.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

{'smithi057.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209908 2023-03-16 05:23:54 2023-03-24 20:45:23 2023-03-24 21:04:29 0:19:06 0:05:01 0:14:05 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
Failure Reason:

{'smithi100.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi171.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209909 2023-03-16 05:23:55 2023-03-24 20:45:54 2023-03-24 21:04:29 0:18:35 0:05:00 0:13:35 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
Failure Reason:

{'smithi018.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209910 2023-03-16 05:23:57 2023-03-24 20:47:29 2023-03-24 21:07:45 0:20:16 0:07:56 0:12:20 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

{'smithi132.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

dead 7209911 2023-03-16 05:23:58 2023-03-24 20:49:25 2023-03-25 08:59:20 12:09:55 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 2
Failure Reason:

hit max job timeout

fail 7209912 2023-03-16 05:23:59 2023-03-24 20:49:35 2023-03-24 21:12:26 0:22:51 0:10:24 0:12:27 smithi main ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

+ '[' -z '' ']' + return + case $- in + return ++ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --pgid 2.0s1 --op list ++ grep '"oid":"test"' *** Caught signal (Segmentation fault) ** in thread 7f5f30888500 thread_name:ceph-objectstor ceph version 18.0.0-2995-g5a9a5f09 (5a9a5f09a2ae63c3d69b158c225f9f6299648198) reef (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f5f31e18420] 2: pthread_mutex_lock() 3: (BlueFS::dir_exists(std::basic_string_view<char, std::char_traits<char> >)+0x46) [0x55f047126ac6] 4: (BlueStore::restore_snap_mapper(GlobalSnapMapper&)+0x4a) [0x55f0470869ba] 5: main() 6: __libc_start_main() 7: _start() + object=

fail 7209913 2023-03-16 05:24:00 2023-03-24 20:49:56 2023-03-24 21:28:03 0:38:07 0:27:52 0:10:15 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-code.sh) on smithi117 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5a9a5f09a2ae63c3d69b158c225f9f6299648198 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh'

dead 7209914 2023-03-16 05:24:01 2023-03-24 20:49:56 2023-03-25 08:59:52 12:09:56 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

pass 7209915 2023-03-16 05:24:02 2023-03-24 20:51:13 2023-03-24 21:11:50 0:20:37 0:10:28 0:10:09 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
fail 7209916 2023-03-16 05:24:03 2023-03-24 20:51:13 2023-03-24 21:09:58 0:18:45 0:06:38 0:12:07 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi097 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7209917 2023-03-16 05:24:04 2023-03-24 20:51:14 2023-03-24 21:11:40 0:20:26 0:09:38 0:10:48 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
dead 7209918 2023-03-16 05:24:05 2023-03-24 20:51:14 2023-03-25 09:02:22 12:11:08 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

hit max job timeout

pass 7209919 2023-03-16 05:24:07 2023-03-24 20:51:24 2023-03-24 21:18:45 0:27:21 0:16:21 0:11:00 smithi main ubuntu 20.04 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} 1
dead 7209920 2023-03-16 05:24:08 2023-03-24 20:51:35 2023-03-25 09:03:11 12:11:36 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

dead 7209921 2023-03-16 05:24:09 2023-03-24 20:51:35 2023-03-25 09:02:23 12:10:48 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

hit max job timeout

pass 7209922 2023-03-16 05:24:10 2023-03-24 20:53:31 2023-03-24 21:17:50 0:24:19 0:13:36 0:10:43 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209923 2023-03-16 05:24:11 2023-03-24 20:53:31 2023-03-24 21:13:59 0:20:28 0:09:25 0:11:03 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
dead 7209924 2023-03-16 05:24:12 2023-03-24 20:53:32 2023-03-25 09:04:18 12:10:46 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

hit max job timeout

pass 7209925 2023-03-16 05:24:14 2023-03-24 20:54:59 2023-03-24 21:24:44 0:29:45 0:19:35 0:10:10 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209926 2023-03-16 05:24:15 2023-03-24 20:54:59 2023-03-24 21:18:51 0:23:52 0:12:44 0:11:08 smithi main ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209927 2023-03-16 05:24:16 2023-03-24 20:55:00 2023-03-24 21:15:32 0:20:32 0:09:05 0:11:27 smithi main ubuntu 20.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 7209928 2023-03-16 05:24:17 2023-03-24 20:55:00 2023-03-24 21:26:11 0:31:11 0:20:10 0:11:01 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7209929 2023-03-16 05:24:18 2023-03-24 20:56:30 2023-03-24 21:33:08 0:36:38 0:25:01 0:11:37 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 2
pass 7209930 2023-03-16 05:24:19 2023-03-24 20:57:24 2023-03-24 21:17:20 0:19:56 0:09:25 0:10:31 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 7209931 2023-03-16 05:24:20 2023-03-24 20:57:25 2023-03-24 21:18:51 0:21:26 0:10:11 0:11:15 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
dead 7209932 2023-03-16 05:24:21 2023-03-24 20:57:55 2023-03-25 09:08:19 12:10:24 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

hit max job timeout

pass 7209933 2023-03-16 05:24:23 2023-03-23 22:24:01 2023-03-23 22:50:49 0:26:48 0:15:26 0:11:22 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 7209934 2023-03-16 05:24:24 2023-03-24 20:57:56 2023-03-24 21:26:21 0:28:25 0:17:38 0:10:47 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7209935 2023-03-16 05:24:25 2023-03-24 20:57:56 2023-03-24 21:15:52 0:17:56 0:07:03 0:10:53 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7209936 2023-03-16 05:24:26 2023-03-24 20:57:57 2023-03-24 21:19:19 0:21:22 0:09:31 0:11:51 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 7209937 2023-03-16 05:24:27 2023-03-24 20:58:27 2023-03-24 21:35:07 0:36:40 0:23:57 0:12:43 smithi main ubuntu 20.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 7209938 2023-03-16 05:24:28 2023-03-24 20:58:28 2023-03-24 21:34:52 0:36:24 0:24:19 0:12:05 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7209939 2023-03-16 05:24:29 2023-03-24 20:58:48 2023-03-24 21:23:30 0:24:42 0:12:53 0:11:49 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209940 2023-03-16 05:24:30 2023-03-24 20:58:49 2023-03-24 22:10:00 1:11:11 0:59:56 0:11:15 smithi main ubuntu 20.04 rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
fail 7209941 2023-03-16 05:24:31 2023-03-24 20:59:46 2023-03-24 21:19:11 0:19:25 0:07:07 0:12:18 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi003 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7209942 2023-03-16 05:24:33 2023-03-24 21:00:16 2023-03-24 21:30:15 0:29:59 0:18:58 0:11:01 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
dead 7209943 2023-03-16 05:24:34 2023-03-24 21:00:17 2023-03-25 09:11:20 12:11:03 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

hit max job timeout

pass 7209944 2023-03-16 05:24:35 2023-03-24 21:00:37 2023-03-24 21:21:04 0:20:27 0:09:29 0:10:58 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 7209945 2023-03-16 05:24:36 2023-03-24 21:00:38 2023-03-24 21:31:41 0:31:03 0:19:38 0:11:25 smithi main ubuntu 20.04 rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209946 2023-03-16 05:24:37 2023-03-24 21:00:38 2023-03-24 21:26:01 0:25:23 0:14:24 0:10:59 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
dead 7209947 2023-03-16 05:24:38 2023-03-22 02:05:01 2023-03-22 14:14:16 12:09:15 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
Failure Reason:

hit max job timeout

pass 7209948 2023-03-16 05:24:39 2023-03-24 21:01:04 2023-03-24 21:25:20 0:24:16 0:11:52 0:12:24 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209949 2023-03-16 05:24:40 2023-03-24 21:01:05 2023-03-24 21:23:02 0:21:57 0:09:07 0:12:50 smithi main ubuntu 20.04 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
fail 7209950 2023-03-16 05:24:41 2023-03-24 21:01:05 2023-03-24 21:23:13 0:22:08 0:09:28 0:12:40 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test_kvstore_tool.sh) on smithi195 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5a9a5f09a2ae63c3d69b158c225f9f6299648198 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh'

pass 7209951 2023-03-16 05:24:42 2023-03-24 21:01:15 2023-03-24 21:39:19 0:38:04 0:25:31 0:12:33 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 7209952 2023-03-16 05:24:43 2023-03-24 21:02:22 2023-03-24 21:28:33 0:26:11 0:13:48 0:12:23 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 7209953 2023-03-16 05:24:44 2023-03-24 21:02:22 2023-03-24 21:31:26 0:29:04 0:15:13 0:13:51 smithi main ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
dead 7209954 2023-03-16 05:24:46 2023-03-24 21:02:22 2023-03-25 09:13:55 12:11:33 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

pass 7209955 2023-03-16 05:24:47 2023-03-21 07:04:16 2023-03-21 10:37:37 3:33:21 3:19:38 0:13:43 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 7209956 2023-03-16 05:24:48 2023-03-24 21:02:23 2023-03-24 21:24:00 0:21:37 0:09:42 0:11:55 smithi main ubuntu 20.04 rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7209957 2023-03-16 05:24:49 2023-03-24 21:02:23 2023-03-24 21:26:39 0:24:16 0:11:13 0:13:03 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7209958 2023-03-16 05:24:50 2023-03-24 21:02:24 2023-03-24 21:27:10 0:24:46 0:11:59 0:12:47 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 7209959 2023-03-16 05:24:51 2023-03-24 21:02:34 2023-03-24 21:39:16 0:36:42 0:24:45 0:11:57 smithi main ubuntu 20.04 rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
fail 7209960 2023-03-16 05:24:52 2023-03-24 21:02:44 2023-03-24 21:39:51 0:37:07 0:24:38 0:12:29 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} 1
Failure Reason:

Command failed (workunit test osd-backfill/osd-backfill-recovery-log.sh) on smithi191 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5a9a5f09a2ae63c3d69b158c225f9f6299648198 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh'

pass 7209961 2023-03-16 05:24:53 2023-03-24 21:02:55 2023-03-24 21:26:10 0:23:15 0:08:47 0:14:28 smithi main ubuntu 20.04 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2