Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7755979 2024-06-14 18:30:20 2024-06-14 22:15:49 2024-06-14 23:02:40 0:46:51 0:36:19 0:10:32 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
dead 7755980 2024-06-14 18:30:21 2024-06-14 22:17:00 2024-06-14 22:19:24 0:02:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi162

dead 7755981 2024-06-14 18:30:22 2024-06-14 22:18:20 2024-06-14 22:26:25 0:08:05 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi105

fail 7755982 2024-06-14 18:30:23 2024-06-14 22:25:22 2024-06-14 22:57:53 0:32:31 0:22:37 0:09:54 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7755983 2024-06-14 18:30:24 2024-06-14 22:25:52 2024-06-14 22:52:59 0:27:07 0:16:56 0:10:11 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7755984 2024-06-14 18:30:25 2024-06-14 22:25:52 2024-06-14 23:21:12 0:55:20 0:45:34 0:09:46 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7755985 2024-06-14 18:30:26 2024-06-14 22:26:13 2024-06-14 22:41:14 0:15:01 0:05:32 0:09:29 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7755986 2024-06-14 18:30:27 2024-06-14 22:26:13 2024-06-14 22:55:26 0:29:13 0:17:25 0:11:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7755987 2024-06-14 18:30:29 2024-06-14 22:28:24 2024-06-14 22:43:47 0:15:23 0:04:30 0:10:53 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

fail 7755988 2024-06-14 18:30:30 2024-06-14 22:28:24 2024-06-14 22:44:15 0:15:51 0:05:40 0:10:11 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi195 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7755989 2024-06-14 18:30:31 2024-06-14 22:28:24 2024-06-14 23:17:29 0:49:05 0:34:46 0:14:19 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7755990 2024-06-14 18:30:32 2024-06-14 22:32:25 2024-06-14 22:56:13 0:23:48 0:13:03 0:10:45 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7755991 2024-06-14 18:30:33 2024-06-14 22:33:16 2024-06-14 23:25:44 0:52:28 0:41:32 0:10:56 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7755992 2024-06-14 18:30:34 2024-06-14 22:34:06 2024-06-14 23:25:40 0:51:34 0:41:38 0:09:56 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7755993 2024-06-14 18:30:35 2024-06-14 22:34:07 2024-06-14 22:50:57 0:16:50 0:08:27 0:08:23 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_adoption} 1
pass 7755994 2024-06-14 18:30:36 2024-06-14 22:34:07 2024-06-14 23:00:53 0:26:46 0:14:12 0:12:34 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
fail 7755995 2024-06-14 18:30:37 2024-06-14 22:37:18 2024-06-14 23:06:27 0:29:09 0:17:17 0:11:52 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7755996 2024-06-14 18:30:38 2024-06-14 22:39:38 2024-06-14 22:42:22 0:02:44 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi032

pass 7755997 2024-06-14 18:30:39 2024-06-14 22:41:19 2024-06-14 23:06:14 0:24:55 0:14:16 0:10:39 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7755998 2024-06-14 18:30:40 2024-06-14 22:42:49 2024-06-14 23:11:00 0:28:11 0:17:24 0:10:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7755999 2024-06-14 18:30:41 2024-06-14 22:43:50 2024-06-14 22:44:54 0:01:04 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi162

pass 7756000 2024-06-14 18:30:42 2024-06-14 22:43:50 2024-06-14 23:04:50 0:21:00 0:11:01 0:09:59 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
dead 7756001 2024-06-14 18:30:43 2024-06-14 22:43:51 2024-06-14 22:48:55 0:05:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi177

pass 7756002 2024-06-14 18:30:44 2024-06-14 22:47:51 2024-06-14 23:34:47 0:46:56 0:32:34 0:14:22 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
fail 7756003 2024-06-14 18:30:45 2024-06-14 22:50:52 2024-06-14 23:26:07 0:35:15 0:23:16 0:11:59 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756004 2024-06-14 18:30:46 2024-06-14 22:52:33 2024-06-14 23:29:15 0:36:42 0:23:07 0:13:35 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
fail 7756005 2024-06-14 18:30:47 2024-06-14 22:55:33 2024-06-14 23:25:28 0:29:55 0:19:57 0:09:58 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756006 2024-06-14 18:30:48 2024-06-14 22:56:14 2024-06-14 23:25:34 0:29:20 0:17:31 0:11:49 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756007 2024-06-14 18:30:49 2024-06-14 22:57:57 2024-06-14 23:26:29 0:28:32 0:17:19 0:11:13 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756008 2024-06-14 18:30:50 2024-06-14 22:59:18 2024-06-14 23:21:55 0:22:37 0:13:20 0:09:17 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_cephadm_timeout} 1
fail 7756009 2024-06-14 18:30:51 2024-06-14 22:59:18 2024-06-14 23:28:14 0:28:56 0:17:16 0:11:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756010 2024-06-14 18:30:52 2024-06-14 23:00:59 2024-06-14 23:50:34 0:49:35 0:37:35 0:12:00 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7756011 2024-06-14 18:30:53 2024-06-14 23:02:49 2024-06-14 23:25:33 0:22:44 0:12:32 0:10:12 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7756012 2024-06-14 18:30:54 2024-06-14 23:02:49 2024-06-14 23:34:33 0:31:44 0:22:53 0:08:51 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756013 2024-06-14 18:30:55 2024-06-14 23:02:50 2024-06-14 23:44:41 0:41:51 0:32:02 0:09:49 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7756014 2024-06-14 18:30:56 2024-06-14 23:03:10 2024-06-14 23:49:52 0:46:42 0:35:43 0:10:59 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7756015 2024-06-14 18:30:57 2024-06-14 23:05:01 2024-06-14 23:29:55 0:24:54 0:15:09 0:09:45 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7756016 2024-06-14 18:30:58 2024-06-14 23:05:01 2024-06-14 23:32:17 0:27:16 0:17:24 0:09:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756017 2024-06-14 18:30:59 2024-06-14 23:05:12 2024-06-14 23:27:57 0:22:45 0:11:39 0:11:06 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7756018 2024-06-14 18:31:00 2024-06-14 23:06:32 2024-06-14 23:38:40 0:32:08 0:22:35 0:09:33 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756019 2024-06-14 18:31:01 2024-06-14 23:07:13 2024-06-14 23:48:21 0:41:08 0:30:39 0:10:29 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7756020 2024-06-14 18:31:02 2024-06-14 23:07:13 2024-06-14 23:12:02 0:04:49 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi165

pass 7756021 2024-06-14 18:31:03 2024-06-14 23:10:58 2024-06-14 23:34:25 0:23:27 0:12:46 0:10:41 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7756022 2024-06-14 18:31:04 2024-06-14 23:11:09 2024-06-15 00:03:44 0:52:35 0:41:36 0:10:59 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7756023 2024-06-14 18:31:05 2024-06-14 23:11:49 2024-06-14 23:41:58 0:30:09 0:19:40 0:10:29 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli} 1
fail 7756024 2024-06-14 18:31:06 2024-06-14 23:12:40 2024-06-14 23:44:45 0:32:05 0:22:48 0:09:17 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756025 2024-06-14 18:31:07 2024-06-14 23:12:40 2024-06-14 23:41:36 0:28:56 0:17:12 0:11:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756026 2024-06-14 18:31:08 2024-06-14 23:14:41 2024-06-14 23:46:57 0:32:16 0:21:57 0:10:19 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
fail 7756027 2024-06-14 18:31:09 2024-06-14 23:15:11 2024-06-14 23:44:20 0:29:09 0:17:05 0:12:04 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7756028 2024-06-14 18:31:10 2024-06-14 23:17:02 2024-06-14 23:18:36 0:01:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi152

fail 7756029 2024-06-14 18:31:11 2024-06-14 23:17:32 2024-06-14 23:39:35 0:22:03 0:07:34 0:14:29 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi045 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7756030 2024-06-14 18:31:12 2024-06-14 23:22:03 2024-06-15 00:23:12 1:01:09 0:48:36 0:12:33 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
fail 7756031 2024-06-14 18:31:13 2024-06-14 23:25:34 2024-06-14 23:57:46 0:32:12 0:22:16 0:09:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756032 2024-06-14 18:31:14 2024-06-14 23:25:44 2024-06-14 23:59:27 0:33:43 0:23:11 0:10:32 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7756033 2024-06-14 18:31:15 2024-06-14 23:25:45 2024-06-14 23:59:53 0:34:08 0:22:43 0:11:25 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli_mon} 5
pass 7756034 2024-06-14 18:31:16 2024-06-14 23:26:35 2024-06-14 23:51:27 0:24:52 0:12:03 0:12:49 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7756035 2024-06-14 18:31:17 2024-06-14 23:28:06 2024-06-15 00:03:39 0:35:33 0:25:31 0:10:02 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7756036 2024-06-14 18:31:18 2024-06-14 23:28:06 2024-06-14 23:55:31 0:27:25 0:17:09 0:10:16 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756037 2024-06-14 18:31:19 2024-06-14 23:28:16 2024-06-14 23:53:43 0:25:27 0:15:42 0:09:45 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

dead 7756038 2024-06-14 18:31:21 2024-06-14 23:28:57 2024-06-14 23:30:01 0:01:04 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi012

pass 7756039 2024-06-14 18:31:22 2024-06-14 23:28:57 2024-06-14 23:50:28 0:21:31 0:11:11 0:10:20 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_ca_signed_key} 2
fail 7756040 2024-06-14 18:31:23 2024-06-14 23:29:18 2024-06-14 23:56:51 0:27:33 0:17:12 0:10:21 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7756041 2024-06-14 18:31:24 2024-06-14 23:29:58 2024-06-14 23:31:02 0:01:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi073

fail 7756042 2024-06-14 18:31:25 2024-06-14 23:29:59 2024-06-15 00:01:31 0:31:32 0:22:50 0:08:42 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756043 2024-06-14 18:31:26 2024-06-14 23:29:59 2024-06-14 23:48:56 0:18:57 0:08:15 0:10:42 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3daf20513a97cf7004cd9e7bfdba8f5a015acbc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

dead 7756044 2024-06-14 18:31:27 2024-06-14 23:29:59 2024-06-14 23:33:23 0:03:24 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi037

fail 7756045 2024-06-14 18:31:28 2024-06-14 23:32:20 2024-06-15 00:01:44 0:29:24 0:17:08 0:12:16 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756046 2024-06-14 18:31:29 2024-06-14 23:34:30 2024-06-15 00:31:40 0:57:10 0:48:24 0:08:46 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7756047 2024-06-14 18:31:30 2024-06-14 23:34:41 2024-06-15 00:25:44 0:51:03 0:42:08 0:08:55 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7756048 2024-06-14 18:31:31 2024-06-14 23:34:51 2024-06-14 23:52:37 0:17:46 0:08:32 0:09:14 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_adoption} 1
fail 7756049 2024-06-14 18:31:32 2024-06-14 23:34:52 2024-06-15 00:09:11 0:34:19 0:22:29 0:11:50 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756050 2024-06-14 18:31:33 2024-06-14 23:37:42 2024-06-15 00:05:14 0:27:32 0:17:31 0:10:01 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7756051 2024-06-14 18:31:35 2024-06-14 23:38:23 2024-06-14 23:39:47 0:01:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi188

fail 7756052 2024-06-14 18:31:36 2024-06-14 23:38:43 2024-06-14 23:56:21 0:17:38 0:08:13 0:09:25 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi172 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3daf20513a97cf7004cd9e7bfdba8f5a015acbc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7756053 2024-06-14 18:31:37 2024-06-14 23:38:44 2024-06-14 23:46:33 0:07:49 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Command failed on smithi117 with status 1: 'sudo yum install -y kernel'

pass 7756054 2024-06-14 18:31:38 2024-06-14 23:39:44 2024-06-15 00:02:35 0:22:51 0:14:26 0:08:25 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7756055 2024-06-14 18:31:39 2024-06-14 23:39:44 2024-06-15 00:08:47 0:29:03 0:17:13 0:11:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756056 2024-06-14 18:31:40 2024-06-14 23:41:45 2024-06-15 00:04:36 0:22:51 0:11:22 0:11:29 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7756057 2024-06-14 18:31:41 2024-06-14 23:43:36 2024-06-15 00:13:37 0:30:01 0:20:02 0:09:59 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756058 2024-06-14 18:31:42 2024-06-14 23:44:26 2024-06-15 00:12:22 0:27:56 0:17:42 0:10:14 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756059 2024-06-14 18:31:43 2024-06-14 23:44:47 2024-06-15 00:11:56 0:27:09 0:17:14 0:09:55 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756060 2024-06-14 18:31:44 2024-06-14 23:44:47 2024-06-15 00:51:15 1:06:28 0:55:59 0:10:29 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7756061 2024-06-14 18:31:45 2024-06-14 23:45:27 2024-06-15 00:08:33 0:23:06 0:12:22 0:10:44 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_extra_daemon_features} 2
pass 7756062 2024-06-14 18:31:46 2024-06-14 23:45:28 2024-06-15 00:24:33 0:39:05 0:30:18 0:08:47 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7756063 2024-06-14 18:31:47 2024-06-14 23:45:28 2024-06-15 00:12:59 0:27:31 0:18:46 0:08:45 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_cephadm_timeout} 1
fail 7756064 2024-06-14 18:31:48 2024-06-14 23:45:29 2024-06-15 00:18:11 0:32:42 0:22:07 0:10:35 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756065 2024-06-14 18:31:49 2024-06-14 23:46:39 2024-06-15 00:13:59 0:27:20 0:17:17 0:10:03 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756066 2024-06-14 18:31:50 2024-06-14 23:46:39 2024-06-15 00:14:54 0:28:15 0:17:15 0:11:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756067 2024-06-14 18:31:51 2024-06-14 23:47:00 2024-06-15 00:15:43 0:28:43 0:15:34 0:13:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_host_drain} 3
pass 7756068 2024-06-14 18:31:52 2024-06-14 23:48:30 2024-06-15 00:33:50 0:45:20 0:31:41 0:13:39 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7756069 2024-06-14 18:31:53 2024-06-14 23:50:01 2024-06-15 00:17:07 0:27:06 0:17:19 0:09:47 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756070 2024-06-14 18:31:54 2024-06-14 23:50:01 2024-06-15 00:05:43 0:15:42 0:05:47 0:09:55 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

Command failed on smithi131 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7756071 2024-06-14 18:31:55 2024-06-14 23:50:02 2024-06-15 00:22:22 0:32:20 0:22:16 0:10:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756072 2024-06-14 18:31:56 2024-06-14 23:50:32 2024-06-15 00:21:30 0:30:58 0:21:43 0:09:15 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 7756073 2024-06-14 18:31:57 2024-06-14 23:50:42 2024-06-15 00:42:55 0:52:13 0:42:05 0:10:08 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7756074 2024-06-14 18:31:58 2024-06-14 23:51:33 2024-06-15 00:43:38 0:52:05 0:41:38 0:10:27 smithi main ubuntu 20.04 orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_20.04} tasks/nfs} 1
pass 7756075 2024-06-14 18:31:59 2024-06-14 23:51:33 2024-06-15 00:14:23 0:22:50 0:12:20 0:10:30 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli} 1
pass 7756076 2024-06-14 18:32:00 2024-06-14 23:52:44 2024-06-15 00:15:13 0:22:29 0:11:54 0:10:35 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7756077 2024-06-14 18:32:01 2024-06-14 23:53:34 2024-06-15 00:26:27 0:32:53 0:22:35 0:10:18 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7756078 2024-06-14 18:32:03 2024-06-14 23:55:35 2024-06-15 00:21:32 0:25:57 0:14:38 0:11:19 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7756079 2024-06-14 18:32:04 2024-06-14 23:56:25 2024-06-15 00:23:52 0:27:27 0:17:17 0:10:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756080 2024-06-14 18:32:05 2024-06-14 23:56:56 2024-06-15 00:23:19 0:26:23 0:15:51 0:10:32 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

pass 7756081 2024-06-14 18:32:06 2024-06-14 23:57:46 2024-06-15 00:21:08 0:23:22 0:10:53 0:12:29 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7756082 2024-06-14 18:32:07 2024-06-14 23:59:37 2024-06-15 00:20:52 0:21:15 0:12:30 0:08:45 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7756083 2024-06-14 18:32:08 2024-06-14 23:59:57 2024-06-15 00:59:32 0:59:35 0:49:35 0:10:00 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
fail 7756084 2024-06-14 18:32:09 2024-06-14 23:59:58 2024-06-15 00:27:09 0:27:11 0:17:24 0:09:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756085 2024-06-14 18:32:10 2024-06-14 23:59:58 2024-06-15 00:34:45 0:34:47 0:22:55 0:11:52 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756086 2024-06-14 18:32:11 2024-06-15 00:00:48 2024-06-15 00:33:07 0:32:19 0:22:43 0:09:36 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756087 2024-06-14 18:32:12 2024-06-15 00:02:45 2024-06-15 00:50:40 0:47:55 0:37:24 0:10:31 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7756088 2024-06-14 18:32:13 2024-06-15 00:03:46 2024-06-15 00:31:58 0:28:12 0:17:31 0:10:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756089 2024-06-14 18:32:14 2024-06-15 00:03:46 2024-06-15 00:41:41 0:37:55 0:27:49 0:10:06 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7756090 2024-06-14 18:32:15 2024-06-15 00:04:46 2024-06-15 00:28:18 0:23:32 0:13:07 0:10:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_rgw_multisite} 3
pass 7756091 2024-06-14 18:32:16 2024-06-15 00:05:17 2024-06-15 00:42:06 0:36:49 0:22:50 0:13:59 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli_mon} 5
fail 7756092 2024-06-14 18:32:17 2024-06-15 00:08:58 2024-06-15 00:36:03 0:27:05 0:17:32 0:09:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756093 2024-06-14 18:32:18 2024-06-15 00:09:18 2024-06-15 00:39:03 0:29:45 0:17:13 0:12:32 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756094 2024-06-14 18:32:19 2024-06-15 00:11:59 2024-06-15 00:44:28 0:32:29 0:22:23 0:10:06 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756095 2024-06-14 18:32:20 2024-06-15 00:12:29 2024-06-15 00:58:16 0:45:47 0:36:35 0:09:12 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
dead 7756096 2024-06-14 18:32:21 2024-06-15 00:13:00 2024-06-15 00:14:44 0:01:44 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi136

pass 7756097 2024-06-14 18:32:22 2024-06-15 00:13:40 2024-06-15 00:39:14 0:25:34 0:15:31 0:10:03 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7756098 2024-06-14 18:32:23 2024-06-15 00:14:21 2024-06-15 00:52:52 0:38:31 0:26:39 0:11:52 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7756099 2024-06-14 18:32:24 2024-06-15 00:14:31 2024-06-15 00:42:17 0:27:46 0:17:27 0:10:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756100 2024-06-14 18:32:25 2024-06-15 00:15:02 2024-06-15 00:37:22 0:22:20 0:11:57 0:10:23 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7756101 2024-06-14 18:32:26 2024-06-15 00:15:42 2024-06-15 00:29:03 0:13:21 0:04:29 0:08:52 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0

fail 7756102 2024-06-14 18:32:27 2024-06-15 00:15:52 2024-06-15 00:43:34 0:27:42 0:17:26 0:10:16 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756103 2024-06-14 18:32:28 2024-06-15 00:16:23 2024-06-15 01:09:17 0:52:54 0:42:52 0:10:02 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7756104 2024-06-14 18:32:29 2024-06-15 00:16:23 2024-06-15 00:37:59 0:21:36 0:11:25 0:10:11 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_adoption} 1
fail 7756105 2024-06-14 18:32:30 2024-06-15 00:16:23 2024-06-15 00:45:13 0:28:50 0:17:25 0:11:25 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756106 2024-06-14 18:32:31 2024-06-15 00:18:14 2024-06-15 00:55:33 0:37:19 0:23:23 0:13:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756107 2024-06-14 18:32:32 2024-06-15 00:21:15 2024-06-15 00:46:43 0:25:28 0:16:42 0:08:46 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_ca_signed_key} 2
fail 7756108 2024-06-14 18:32:33 2024-06-15 00:21:15 2024-06-15 00:48:27 0:27:12 0:17:42 0:09:30 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756109 2024-06-14 18:32:34 2024-06-15 00:21:36 2024-06-15 01:21:05 0:59:29 0:50:05 0:09:24 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
fail 7756110 2024-06-14 18:32:35 2024-06-15 00:21:36 2024-06-15 00:48:35 0:26:59 0:17:19 0:09:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7756111 2024-06-14 18:32:36 2024-06-15 00:21:46 2024-06-15 00:23:30 0:01:44 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi167

fail 7756112 2024-06-14 18:32:37 2024-06-15 00:22:27 2024-06-15 00:40:32 0:18:05 0:07:27 0:10:38 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi098 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7756113 2024-06-14 18:32:38 2024-06-15 00:22:47 2024-06-15 01:29:09 1:06:22 0:56:16 0:10:06 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 7756114 2024-06-14 18:32:39 2024-06-15 00:23:18 2024-06-15 00:40:52 0:17:34 0:08:14 0:09:20 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi113 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3daf20513a97cf7004cd9e7bfdba8f5a015acbc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7756115 2024-06-14 18:32:40 2024-06-15 00:23:28 2024-06-15 00:55:49 0:32:21 0:22:23 0:09:58 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756116 2024-06-14 18:32:41 2024-06-15 00:23:58 2024-06-15 00:56:32 0:32:34 0:22:28 0:10:06 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756117 2024-06-14 18:32:42 2024-06-15 00:24:39 2024-06-15 01:08:53 0:44:14 0:34:29 0:09:45 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
dead 7756118 2024-06-14 18:32:43 2024-06-15 00:25:49 2024-06-15 00:27:33 0:01:44 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi016

pass 7756119 2024-06-14 18:32:44 2024-06-15 00:26:30 2024-06-15 00:47:25 0:20:55 0:12:12 0:08:43 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7756120 2024-06-14 18:32:45 2024-06-15 00:26:30 2024-06-15 00:52:25 0:25:55 0:15:09 0:10:46 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
dead 7756121 2024-06-14 18:32:46 2024-06-15 00:27:11 2024-06-15 00:29:25 0:02:14 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi143

dead 7756122 2024-06-14 18:32:47 2024-06-15 00:28:21 2024-06-15 00:29:25 0:01:04 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi084

pass 7756123 2024-06-14 18:32:48 2024-06-15 00:28:21 2024-06-15 00:52:20 0:23:59 0:12:14 0:11:45 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
fail 7756124 2024-06-14 18:32:49 2024-06-15 00:29:12 2024-06-15 00:58:46 0:29:34 0:17:27 0:12:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756125 2024-06-14 18:32:50 2024-06-15 00:31:43 2024-06-15 00:46:33 0:14:50 0:05:39 0:09:11 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm_repos} 1
fail 7756126 2024-06-14 18:32:51 2024-06-15 00:31:43 2024-06-15 01:05:40 0:33:57 0:23:04 0:10:53 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756127 2024-06-14 18:32:52 2024-06-15 00:31:53 2024-06-15 01:00:51 0:28:58 0:19:54 0:09:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756128 2024-06-14 18:32:53 2024-06-15 00:31:54 2024-06-15 00:58:53 0:26:59 0:17:31 0:09:28 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756129 2024-06-14 18:32:54 2024-06-15 00:31:54 2024-06-15 01:28:54 0:57:00 0:44:51 0:12:09 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
fail 7756130 2024-06-14 18:32:55 2024-06-15 00:32:04 2024-06-15 01:00:16 0:28:12 0:17:15 0:10:57 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756131 2024-06-14 18:32:56 2024-06-15 00:33:15 2024-06-15 01:04:34 0:31:19 0:18:26 0:12:53 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_extra_daemon_features} 2
pass 7756132 2024-06-14 18:32:57 2024-06-15 00:33:55 2024-06-15 01:26:12 0:52:17 0:41:08 0:11:09 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7756133 2024-06-14 18:32:58 2024-06-15 00:34:46 2024-06-15 00:56:43 0:21:57 0:12:45 0:09:12 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli} 1
fail 7756134 2024-06-14 18:32:59 2024-06-15 00:36:06 2024-06-15 01:04:11 0:28:05 0:17:32 0:10:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7756135 2024-06-14 18:33:00 2024-06-15 00:36:57 2024-06-15 01:11:52 0:34:55 0:23:06 0:11:49 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756136 2024-06-14 18:33:01 2024-06-15 00:37:27 2024-06-15 01:08:35 0:31:08 0:22:37 0:08:31 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7756137 2024-06-14 18:33:01 2024-06-15 00:37:28 2024-06-15 01:06:11 0:28:43 0:17:20 0:11:23 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756138 2024-06-14 18:33:02 2024-06-15 00:39:08 2024-06-15 01:04:09 0:25:01 0:14:17 0:10:44 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7756139 2024-06-14 18:33:03 2024-06-15 00:39:19 2024-06-15 01:07:05 0:27:46 0:17:28 0:10:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7756140 2024-06-14 18:33:05 2024-06-15 00:39:19 2024-06-15 01:01:45 0:22:26 0:11:17 0:11:09 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7756141 2024-06-14 18:33:06 2024-06-15 00:40:40 2024-06-15 01:37:11 0:56:31 0:46:07 0:10:24 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7756142 2024-06-14 18:33:07 2024-06-15 00:41:50 2024-06-15 01:07:24 0:25:34 0:14:46 0:10:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_host_drain} 3
fail 7756143 2024-06-14 18:33:08 2024-06-15 00:42:11 2024-06-15 01:43:15 1:01:04 0:52:06 0:08:58 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7756144 2024-06-14 18:33:09 2024-06-15 00:42:11 2024-06-15 01:09:35 0:27:24 0:17:36 0:09:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy