Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7339107 2023-07-14 23:48:18 2023-07-15 16:06:42 2023-07-15 16:32:48 0:26:06 0:15:16 0:10:50 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7339110 2023-07-14 23:48:19 2023-07-15 16:11:34 2023-07-15 16:38:56 0:27:22 0:18:21 0:09:01 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} 1
fail 7339113 2023-07-14 23:48:20 2023-07-15 16:12:25 2023-07-15 16:50:46 0:38:21 0:27:52 0:10:29 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi084 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 050bbd88-232d-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339116 2023-07-14 23:48:21 2023-07-15 16:14:06 2023-07-15 16:45:10 0:31:04 0:14:59 0:16:05 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7339119 2023-07-14 23:48:22 2023-07-15 16:16:18 2023-07-15 16:47:45 0:31:27 0:20:09 0:11:18 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7339121 2023-07-14 23:48:22 2023-07-15 16:45:02 915 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7339125 2023-07-14 23:48:23 2023-07-15 16:22:22 2023-07-15 17:11:54 0:49:32 0:39:27 0:10:05 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7339128 2023-07-14 23:48:24 2023-07-15 17:21:17 2889 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7339130 2023-07-14 23:48:25 2023-07-15 16:23:15 2023-07-15 17:06:26 0:43:11 0:32:02 0:11:09 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7339133 2023-07-14 23:48:26 2023-07-15 16:27:17 2023-07-15 16:57:12 0:29:55 0:21:32 0:08:23 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7339137 2023-07-14 23:48:27 2023-07-15 17:18:02 2130 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7339140 2023-07-14 23:48:28 2023-07-15 16:33:01 2023-07-15 16:52:02 0:19:01 0:11:52 0:07:09 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7339142 2023-07-14 23:48:28 2023-07-15 16:33:31 2023-07-15 16:59:02 0:25:31 0:18:37 0:06:54 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7339145 2023-07-14 23:48:29 2023-07-15 16:35:53 2023-07-15 17:00:42 0:24:49 0:12:45 0:12:04 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7339148 2023-07-14 23:48:30 2023-07-15 16:37:15 2023-07-15 17:14:56 0:37:41 0:23:01 0:14:40 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7339151 2023-07-14 23:48:31 2023-07-15 16:41:57 2023-07-15 17:14:24 0:32:27 0:18:39 0:13:48 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7339154 2023-07-14 23:48:32 2023-07-15 16:45:08 2023-07-15 17:10:27 0:25:19 0:19:06 0:06:13 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7339157 2023-07-14 23:48:33 2023-07-15 16:47:50 2023-07-15 17:16:01 0:28:11 0:18:28 0:09:43 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7339160 2023-07-14 23:48:33 2023-07-15 16:50:52 2023-07-15 18:00:38 1:09:46 1:00:13 0:09:33 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7339163 2023-07-14 23:48:34 2023-07-15 16:52:13 2023-07-15 17:33:39 0:41:26 0:32:31 0:08:55 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7339166 2023-07-14 23:48:35 2023-07-15 16:53:45 2023-07-15 17:19:12 0:25:27 0:16:08 0:09:19 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7339169 2023-07-14 23:48:36 2023-07-15 16:57:16 2023-07-15 17:30:32 0:33:16 0:22:14 0:11:02 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7339172 2023-07-14 23:48:37 2023-07-15 16:59:08 2023-07-15 17:26:38 0:27:30 0:15:21 0:12:09 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7339175 2023-07-14 23:48:38 2023-07-15 16:59:49 2023-07-15 18:06:53 1:07:04 0:55:09 0:11:55 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi082 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 377927fa-2333-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339178 2023-07-14 23:48:39 2023-07-15 17:00:01 2023-07-15 17:26:02 0:26:01 0:18:00 0:08:01 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7339181 2023-07-14 23:48:40 2023-07-15 17:01:12 2023-07-15 17:20:51 0:19:39 0:06:23 0:13:16 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi040 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7339184 2023-07-14 23:48:41 2023-07-15 17:02:24 2023-07-15 17:29:47 0:27:23 0:14:59 0:12:24 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7339187 2023-07-14 23:48:41 2023-07-15 17:06:46 2023-07-15 17:53:48 0:47:02 0:37:18 0:09:44 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7339190 2023-07-14 23:48:42 2023-07-15 17:09:48 2023-07-15 17:37:01 0:27:13 0:16:42 0:10:31 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} 1
pass 7339193 2023-07-14 23:48:43 2023-07-15 17:10:29 2023-07-15 18:03:51 0:53:22 0:41:43 0:11:39 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7339196 2023-07-14 23:48:44 2023-07-15 17:13:11 2023-07-15 17:41:17 0:28:06 0:17:54 0:10:12 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} 2
pass 7339199 2023-07-14 23:48:45 2023-07-15 17:15:02 2023-07-15 18:16:46 1:01:44 0:49:50 0:11:54 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7339202 2023-07-14 23:48:46 2023-07-15 17:17:54 2023-07-15 17:39:12 0:21:18 0:14:39 0:06:39 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 7339205 2023-07-14 23:48:47 2023-07-15 17:19:16 2023-07-15 17:43:34 0:24:18 0:13:00 0:11:18 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7339208 2023-07-14 23:48:47 2023-07-15 17:20:57 2023-07-15 18:10:30 0:49:33 0:39:56 0:09:37 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7339211 2023-07-14 23:48:48 2023-07-15 17:21:29 2023-07-15 18:17:06 0:55:37 0:43:23 0:12:14 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7339214 2023-07-14 23:48:49 2023-07-15 17:24:30 2023-07-15 17:52:09 0:27:39 0:20:00 0:07:39 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7339217 2023-07-14 23:48:50 2023-07-15 17:26:22 2023-07-15 18:13:00 0:46:38 0:34:11 0:12:27 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7339220 2023-07-14 23:48:51 2023-07-15 17:26:53 2023-07-15 18:01:16 0:34:23 0:21:40 0:12:43 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7339223 2023-07-14 23:48:52 2023-07-15 17:29:55 2023-07-15 18:08:27 0:38:32 0:24:15 0:14:17 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7339226 2023-07-14 23:48:53 2023-07-15 17:32:47 2023-07-15 18:10:43 0:37:56 0:24:50 0:13:06 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7339229 2023-07-14 23:48:54 2023-07-15 17:36:39 2023-07-15 17:59:46 0:23:07 0:14:07 0:09:00 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7339232 2023-07-14 23:48:55 2023-07-15 17:37:50 2023-07-15 18:00:28 0:22:38 0:11:37 0:11:01 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7340b320cd33b16a99e21356b6b1d11b75f050a0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cc53adbe-2338-11ee-9b33-001a4aab830c -- ceph osd stat -f json'

pass 7339235 2023-07-14 23:48:55 2023-07-15 17:40:02 2023-07-15 18:32:22 0:52:20 0:43:40 0:08:40 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7339238 2023-07-14 23:48:56 2023-07-15 17:41:43 2023-07-15 18:25:57 0:44:14 0:37:18 0:06:56 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7339241 2023-07-14 23:48:57 2023-07-15 17:43:35 2023-07-15 18:13:42 0:30:07 0:23:14 0:06:53 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7339244 2023-07-14 23:48:58 2023-07-15 17:47:47 2023-07-15 18:14:34 0:26:47 0:16:27 0:10:20 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7339247 2023-07-14 23:48:59 2023-07-15 17:51:09 2023-07-15 18:17:52 0:26:43 0:15:40 0:11:03 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7339250 2023-07-14 23:49:00 2023-07-15 17:53:50 2023-07-15 18:17:51 0:24:01 0:13:53 0:10:08 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7339253 2023-07-14 23:49:01 2023-07-15 17:55:12 2023-07-15 18:52:02 0:56:50 0:45:38 0:11:12 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi134 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 415661fe-233b-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339256 2023-07-14 23:49:01 2023-07-15 17:55:43 2023-07-15 18:26:55 0:31:12 0:23:22 0:07:50 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7339259 2023-07-14 23:49:02 2023-07-15 17:57:55 2023-07-15 18:28:28 0:30:33 0:20:54 0:09:39 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7339262 2023-07-14 23:49:03 2023-07-15 18:00:36 2023-07-15 18:38:11 0:37:35 0:26:33 0:11:02 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7339265 2023-07-14 23:49:04 2023-07-15 18:04:38 2023-07-15 18:31:05 0:26:27 0:18:04 0:08:23 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7339268 2023-07-14 23:49:05 2023-07-15 18:06:23 2023-07-15 18:59:19 0:52:56 0:39:21 0:13:35 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7339271 2023-07-14 23:49:06 2023-07-15 18:08:05 2023-07-15 18:59:26 0:51:21 0:41:07 0:10:14 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7339273 2023-07-14 23:49:07 2023-07-15 18:09:06 2023-07-15 18:49:00 0:39:54 0:30:25 0:09:29 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7339275 2023-07-14 23:49:08 2023-07-15 18:09:37 2023-07-15 18:44:22 0:34:45 0:20:46 0:13:59 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7339277 2023-07-14 23:49:09 2023-07-15 18:11:20 2023-07-15 18:35:19 0:23:59 0:11:16 0:12:43 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} 1
pass 7339279 2023-07-14 23:49:09 2023-07-15 18:11:22 2023-07-15 18:40:16 0:28:54 0:16:14 0:12:40 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7339281 2023-07-14 23:49:10 2023-07-15 18:12:42 2023-07-15 18:43:50 0:31:08 0:15:12 0:15:56 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7339283 2023-07-14 23:49:11 2023-07-15 18:13:08 2023-07-15 18:33:45 0:20:37 0:06:58 0:13:39 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi100 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7339285 2023-07-14 23:49:12 2023-07-15 18:14:12 2023-07-15 18:58:17 0:44:05 0:32:05 0:12:00 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7339287 2023-07-14 23:49:13 2023-07-15 18:15:04 2023-07-15 18:46:48 0:31:44 0:21:21 0:10:23 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7339289 2023-07-14 23:49:14 2023-07-15 18:16:58 2023-07-15 18:47:55 0:30:57 0:18:05 0:12:52 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7339291 2023-07-14 23:49:15 2023-07-15 18:17:51 2023-07-15 18:47:07 0:29:16 0:18:32 0:10:44 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} 1
pass 7339293 2023-07-14 23:49:15 2023-07-15 18:18:12 2023-07-15 18:45:14 0:27:02 0:14:08 0:12:54 smithi main ubuntu 20.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7339295 2023-07-14 23:49:16 2023-07-15 18:18:13 2023-07-15 18:45:27 0:27:14 0:14:03 0:13:11 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
pass 7339297 2023-07-14 23:49:17 2023-07-15 18:18:13 2023-07-15 18:48:53 0:30:40 0:14:00 0:16:40 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
dead 7339300 2023-07-14 23:49:18 2023-07-15 18:20:41 2023-07-15 18:24:17 0:03:36 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi007

pass 7339303 2023-07-14 23:49:19 2023-07-15 18:23:58 2023-07-15 19:24:11 1:00:13 0:44:00 0:16:13 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7339306 2023-07-14 23:49:20 2023-07-15 18:38:52 2023-07-15 19:07:29 0:28:37 0:19:58 0:08:39 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7339309 2023-07-14 23:49:20 2023-07-15 18:41:10 2023-07-15 19:13:12 0:32:02 0:20:31 0:11:31 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7339312 2023-07-14 23:49:21 2023-07-15 18:43:50 2023-07-15 19:34:08 0:50:18 0:36:07 0:14:11 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi130 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a4c4c64-2342-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339315 2023-07-14 23:49:22 2023-07-15 18:44:22 2023-07-15 19:06:09 0:21:47 0:09:35 0:12:12 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7339318 2023-07-14 23:49:23 2023-07-15 18:46:30 2023-07-15 19:14:09 0:27:39 0:17:04 0:10:35 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7339321 2023-07-14 23:49:24 2023-07-15 18:48:22 2023-07-15 19:13:50 0:25:28 0:17:12 0:08:16 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7339324 2023-07-14 23:49:25 2023-07-15 18:53:23 2023-07-15 19:26:17 0:32:54 0:19:24 0:13:30 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7339327 2023-07-14 23:49:25 2023-07-15 18:56:58 2023-07-15 19:50:26 0:53:28 0:38:46 0:14:42 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7339330 2023-07-14 23:49:26 2023-07-15 19:43:09 1873 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7339332 2023-07-14 23:49:27 2023-07-15 19:00:36 2023-07-15 19:40:50 0:40:14 0:28:11 0:12:03 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
dead 7339335 2023-07-14 23:49:28 2023-07-15 19:03:07 2023-07-15 19:29:58 0:26:51 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7339338 2023-07-14 23:49:29 2023-07-15 19:06:40 2023-07-15 19:36:11 0:29:31 0:17:55 0:11:36 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7339341 2023-07-14 23:49:29 2023-07-15 19:12:24 2023-07-15 19:39:04 0:26:40 0:14:43 0:11:57 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
dead 7339344 2023-07-14 23:49:30 2023-07-15 19:14:39 2023-07-15 19:30:20 0:15:41 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi090

dead 7339347 2023-07-14 23:49:31 2023-07-15 19:16:40 2023-07-15 19:21:04 0:04:24 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Error reimaging machines: Expected smithi092's OS to be ubuntu 20.04 but found ubuntu 22.04

fail 7339350 2023-07-14 23:49:32 2023-07-15 19:18:20 2023-07-15 20:05:41 0:47:21 0:29:06 0:18:15 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7339352 2023-07-14 23:49:33 2023-07-15 19:19:24 2023-07-15 19:59:32 0:40:08 0:32:43 0:07:25 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} 1
pass 7339354 2023-07-14 23:49:34 2023-07-15 19:19:40 2023-07-15 20:03:48 0:44:08 0:32:07 0:12:01 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7339356 2023-07-14 23:49:34 2023-07-15 19:19:51 2023-07-15 19:50:11 0:30:20 0:20:01 0:10:19 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7339358 2023-07-14 23:49:35 2023-07-15 19:20:30 2023-07-15 20:15:25 0:54:55 0:42:20 0:12:35 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7339360 2023-07-14 23:49:36 2023-07-15 19:20:59 2023-07-15 20:11:37 0:50:38 0:35:55 0:14:43 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7339362 2023-07-14 23:49:37 2023-07-15 19:23:02 2023-07-15 20:03:30 0:40:28 0:24:55 0:15:33 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7339364 2023-07-14 23:49:38 2023-07-15 19:25:43 2023-07-15 20:24:31 0:58:48 0:45:38 0:13:10 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi045 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34cb3aa6-2348-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339366 2023-07-14 23:49:38 2023-07-15 19:26:22 2023-07-15 19:54:11 0:27:49 0:18:27 0:09:22 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7339368 2023-07-14 23:49:39 2023-07-15 19:27:56 2023-07-15 19:59:53 0:31:57 0:20:00 0:11:57 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7339370 2023-07-14 23:49:40 2023-07-15 19:28:07 2023-07-15 19:58:47 0:30:40 0:14:52 0:15:48 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7339372 2023-07-14 23:49:41 2023-07-15 19:30:03 2023-07-15 20:04:35 0:34:32 0:21:23 0:13:09 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7339374 2023-07-14 23:49:42 2023-07-15 19:30:29 2023-07-15 19:51:22 0:20:53 0:06:27 0:14:26 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi148 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7339376 2023-07-14 23:49:43 2023-07-15 19:30:29 2023-07-15 20:12:51 0:42:22 0:26:21 0:16:01 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} 5
dead 7339378 2023-07-14 23:49:43 2023-07-15 19:34:03 2023-07-15 19:37:02 0:02:59 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi151

dead 7339380 2023-07-14 23:49:44 2023-07-15 19:35:04 2023-07-15 19:39:05 0:04:01 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Expected smithi130's OS to be centos 8 but found ubuntu 20.04

pass 7339382 2023-07-14 23:49:45 2023-07-15 19:36:40 2023-07-15 20:10:00 0:33:20 0:18:19 0:15:01 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} 2
pass 7339384 2023-07-14 23:49:46 2023-07-15 19:39:10 2023-07-15 20:29:25 0:50:15 0:37:36 0:12:39 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7339386 2023-07-14 23:49:47 2023-07-15 19:40:04 2023-07-15 20:06:21 0:26:17 0:15:40 0:10:37 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7339388 2023-07-14 23:49:48 2023-07-15 19:40:05 2023-07-15 20:12:04 0:31:59 0:17:21 0:14:38 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7339390 2023-07-14 23:49:49 2023-07-15 19:43:51 2023-07-15 20:09:28 0:25:37 0:14:14 0:11:23 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} 1
pass 7339392 2023-07-14 23:49:49 2023-07-15 19:44:41 2023-07-15 20:15:49 0:31:08 0:13:43 0:17:25 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
dead 7339394 2023-07-14 23:49:50 2023-07-15 19:46:03 2023-07-15 19:50:15 0:04:12 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi003

pass 7339396 2023-07-14 23:49:51 2023-07-15 19:46:59 2023-07-15 20:46:59 1:00:00 0:48:09 0:11:51 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
dead 7339398 2023-07-14 23:49:52 2023-07-15 19:47:00 2023-07-15 19:51:49 0:04:49 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi133

dead 7339400 2023-07-14 23:49:53 2023-07-15 19:47:55 2023-07-15 19:50:43 0:02:48 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi022

dead 7339402 2023-07-14 23:49:54 2023-07-15 19:50:16 2023-07-15 19:52:26 0:02:10 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Error reimaging machines: Expected smithi110's OS to be centos 8 but found rhel 8.6

dead 7339404 2023-07-14 23:49:54 2023-07-15 19:50:24 2023-07-15 20:06:35 0:16:11 0:03:39 0:12:32 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

smithi143.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3smithi018.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3

dead 7339406 2023-07-14 23:49:55 2023-07-15 19:50:24 2023-07-15 20:01:58 0:11:34 0:03:02 0:08:32 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

smithi196.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3smithi016.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3

pass 7339408 2023-07-14 23:49:56 2023-07-15 19:50:55 2023-07-15 20:59:00 1:08:05 0:59:49 0:08:16 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
dead 7339410 2023-07-14 23:49:57 2023-07-15 19:52:00 2023-07-15 20:06:04 0:14:04 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi140

dead 7339412 2023-07-14 23:49:58 2023-07-15 19:52:01 2023-07-15 19:55:57 0:03:56 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi082's OS to be rhel 8.6 but found ubuntu 20.04

dead 7339414 2023-07-14 23:49:59 2023-07-15 19:52:21 2023-07-15 20:02:25 0:10:04 0:02:10 0:07:54 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

smithi150.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3smithi142.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3

pass 7339416 2023-07-14 23:50:00 2023-07-15 19:53:44 2023-07-15 20:34:03 0:40:19 0:30:00 0:10:19 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7339418 2023-07-14 23:50:00 2023-07-15 19:54:17 2023-07-15 20:26:50 0:32:33 0:19:06 0:13:27 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7339420 2023-07-14 23:50:01 2023-07-15 19:54:17 2023-07-15 20:25:04 0:30:47 0:19:50 0:10:57 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7339422 2023-07-14 23:50:02 2023-07-15 19:56:22 2023-07-15 20:23:54 0:27:32 0:13:35 0:13:57 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7339424 2023-07-14 23:50:03 2023-07-15 19:57:32 2023-07-15 20:26:23 0:28:51 0:18:07 0:10:44 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7339426 2023-07-14 23:50:04 2023-07-15 19:57:33 2023-07-15 20:22:04 0:24:31 0:17:01 0:07:30 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} 1
pass 7339428 2023-07-14 23:50:05 2023-07-15 19:57:54 2023-07-15 20:34:33 0:36:39 0:28:06 0:08:33 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
dead 7339430 2023-07-14 23:50:06 2023-07-15 19:58:35 2023-07-15 20:00:32 0:01:57 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi181

pass 7339432 2023-07-14 23:50:06 2023-07-15 20:00:37 2023-07-15 20:57:16 0:56:39 0:43:45 0:12:54 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7339434 2023-07-14 23:50:07 2023-07-15 20:02:03 2023-07-15 21:52:44 1:50:41 0:38:25 1:12:16 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7339436 2023-07-14 23:50:08 2023-07-15 20:34:59 963 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7339437 2023-07-14 23:50:09 2023-07-15 20:02:14 2023-07-15 20:48:11 0:45:57 0:32:58 0:12:59 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7339439 2023-07-14 23:50:10 2023-07-15 20:03:10 2023-07-15 20:07:58 0:04:48 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Error reimaging machines: Expected smithi039's OS to be ubuntu 20.04 but found centos 8

dead 7339441 2023-07-14 23:50:10 2023-07-15 20:03:40 2023-07-15 20:07:29 0:03:49 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Error reimaging machines: Expected smithi142's OS to be rhel 8.6 but found ubuntu 20.04

dead 7339443 2023-07-14 23:50:11 2023-07-15 20:03:41 2023-07-15 20:08:12 0:04:31 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi135's OS to be rhel 8.6 but found centos 8

dead 7339445 2023-07-14 23:50:12 2023-07-15 20:04:55 2023-07-15 20:08:23 0:03:28 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Error reimaging machines: Expected smithi061's OS to be ubuntu 20.04 but found centos 8

pass 7339447 2023-07-14 23:50:13 2023-07-15 20:06:09 2023-07-15 20:39:21 0:33:12 0:25:49 0:07:23 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
dead 7339449 2023-07-14 23:50:14 2023-07-15 20:07:10 2023-07-15 20:10:45 0:03:35 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi143

dead 7339451 2023-07-14 23:50:15 2023-07-15 20:07:11 2023-07-15 20:17:39 0:10:28 0:03:19 0:07:09 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

smithi138.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3

dead 7339453 2023-07-14 23:50:15 2023-07-15 20:07:36 2023-07-15 20:11:06 0:03:30 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
Failure Reason:

Error reimaging machines: Expected smithi087's OS to be rhel 8.6 but found ubuntu 20.04

dead 7339455 2023-07-14 23:50:16 2023-07-15 20:08:35 2023-07-15 20:12:40 0:04:05 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} 1
Failure Reason:

Error reimaging machines: Expected smithi006's OS to be centos 8 but found rhel 8.6

dead 7339458 2023-07-14 23:50:17 2023-07-15 20:12:42 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

Error reimaging machines: Expected smithi050's OS to be centos 8 but found rhel 8.6

dead 7339459 2023-07-14 23:50:18 2023-07-15 20:09:18 2023-07-15 20:20:07 0:10:49 0:03:39 0:07:10 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

smithi192.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3smithi129.front.sepia.ceph.com: changed: false msg: All items completed results: - _ansible_item_label: key: vg_nvme value: pvs: /dev/nvme0n1 _ansible_no_log: false ansible_loop_var: item changed: false err: " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for\ \ more information.\n" failed: true invocation: module_args: force: false pesize: '4' pv_options: '' pvresize: false pvs: - /dev/nvme0n1 state: present vg: vg_nvme vg_options: '' item: key: vg_nvme value: pvs: /dev/nvme0n1 msg: Creating volume group 'vg_nvme' failed rc: 3

fail 7339461 2023-07-14 23:50:19 2023-07-15 20:10:00 2023-07-15 20:51:21 0:41:21 0:27:57 0:13:24 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi070 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76bf78a4-234e-11ee-9b33-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7339464 2023-07-14 23:50:19 2023-07-15 20:10:49 2023-07-15 21:08:11 0:57:22 0:44:37 0:12:45 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
dead 7339468 2023-07-14 23:50:20 2023-07-15 20:11:21 2023-07-15 20:14:29 0:03:08 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi031