Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7725241 2024-05-24 21:08:46 2024-05-25 03:38:01 2024-05-25 04:02:45 0:24:44 0:11:04 0:13:40 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7725242 2024-05-24 21:08:47 2024-05-25 03:41:32 2024-05-25 04:20:09 0:38:37 0:27:08 0:11:29 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-05-25T04:04:36.130372+0000 mon.a (mon.0) 388 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7725243 2024-05-24 21:08:48 2024-05-25 03:41:33 2024-05-25 04:07:02 0:25:29 0:15:22 0:10:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-05-25T04:02:59.494174+0000 mon.smithi008 (mon.0) 784 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7725244 2024-05-24 21:08:50 2024-05-25 03:42:13 2024-05-25 04:16:37 0:34:24 0:24:18 0:10:06 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7725245 2024-05-24 21:08:50 2024-05-25 03:43:23 2024-05-25 04:49:39 1:06:16 0:52:23 0:13:53 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7725246 2024-05-24 21:08:51 2024-05-25 03:45:44 2024-05-25 04:21:00 0:35:16 0:20:30 0:14:46 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7725247 2024-05-24 21:08:52 2024-05-25 03:51:25 2024-05-25 04:38:36 0:47:11 0:38:46 0:08:25 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7725248 2024-05-24 21:08:53 2024-05-25 03:51:26 2024-05-25 04:48:17 0:56:51 0:36:14 0:20:37 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli_mon} 5
pass 7725249 2024-05-24 21:08:54 2024-05-25 04:01:48 2024-05-25 04:29:32 0:27:44 0:18:10 0:09:34 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
dead 7725250 2024-05-24 21:08:55 2024-05-25 04:01:48 2024-05-25 04:03:52 0:02:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi117

fail 7725251 2024-05-24 21:08:56 2024-05-25 04:02:48 2024-05-25 04:38:40 0:35:52 0:21:27 0:14:25 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-25T04:33:23.685673+0000 mon.smithi008 (mon.0) 813 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7725252 2024-05-24 21:08:57 2024-05-25 04:07:09 2024-05-25 04:48:25 0:41:16 0:32:13 0:09:03 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7725253 2024-05-24 21:08:58 2024-05-25 04:07:20 2024-05-25 04:34:06 0:26:46 0:16:08 0:10:38 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7725254 2024-05-24 21:08:59 2024-05-25 04:08:40 2024-05-25 04:46:10 0:37:30 0:18:40 0:18:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
dead 7725255 2024-05-24 21:09:00 2024-05-25 04:16:42 2024-05-25 04:21:16 0:04:34 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi029

fail 7725256 2024-05-24 21:09:01 2024-05-25 04:20:12 2024-05-25 05:07:56 0:47:44 0:38:26 0:09:18 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7725257 2024-05-24 21:09:02 2024-05-25 04:21:03 2024-05-25 04:38:33 0:17:30 0:07:30 0:10:00 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi018 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7725258 2024-05-24 21:09:03 2024-05-25 04:21:03 2024-05-25 05:10:10 0:49:07 0:36:13 0:12:54 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7725259 2024-05-24 21:09:04 2024-05-25 04:22:54 2024-05-25 05:05:40 0:42:46 0:33:42 0:09:04 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-05-25T04:48:26.842671+0000 mon.a (mon.0) 1424 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725260 2024-05-24 21:09:05 2024-05-25 04:22:54 2024-05-25 04:42:00 0:19:06 0:09:48 0:09:18 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7725261 2024-05-24 21:09:06 2024-05-25 04:23:05 2024-05-25 04:43:40 0:20:35 0:12:11 0:08:24 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
pass 7725262 2024-05-24 21:09:07 2024-05-25 04:23:05 2024-05-25 04:47:32 0:24:27 0:12:46 0:11:41 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7725263 2024-05-24 21:09:08 2024-05-25 04:24:05 2024-05-25 04:59:00 0:34:55 0:25:37 0:09:18 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-05-25T04:39:45.573826+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7725264 2024-05-24 21:09:09 2024-05-25 04:24:06 2024-05-25 04:52:49 0:28:43 0:13:02 0:15:41 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
dead 7725265 2024-05-24 21:09:10 2024-05-25 04:29:37 2024-05-25 04:34:51 0:05:14 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi163

pass 7725266 2024-05-24 21:09:11 2024-05-25 04:33:48 2024-05-25 04:56:23 0:22:35 0:14:03 0:08:32 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7725267 2024-05-24 21:09:12 2024-05-25 04:33:48 2024-05-25 05:01:26 0:27:38 0:18:41 0:08:57 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7725268 2024-05-24 21:09:13 2024-05-25 04:34:08 2024-05-25 05:00:12 0:26:04 0:11:42 0:14:22 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7725269 2024-05-24 21:09:14 2024-05-25 04:38:29 2024-05-25 05:30:09 0:51:40 0:42:51 0:08:49 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7725270 2024-05-24 21:09:15 2024-05-25 04:38:30 2024-05-25 05:25:53 0:47:23 0:37:38 0:09:45 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7725271 2024-05-24 21:09:16 2024-05-25 04:38:30 2024-05-25 05:40:00 1:01:30 0:51:36 0:09:54 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-05-25T05:04:31.652941+0000 mon.a (mon.0) 1079 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725272 2024-05-24 21:09:17 2024-05-25 04:38:40 2024-05-25 05:04:17 0:25:37 0:11:29 0:14:08 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_ca_signed_key} 2
pass 7725273 2024-05-24 21:09:18 2024-05-25 04:43:21 2024-05-25 05:08:35 0:25:14 0:13:53 0:11:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7725274 2024-05-24 21:09:19 2024-05-25 04:43:42 2024-05-25 05:15:32 0:31:50 0:20:21 0:11:29 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7725275 2024-05-24 21:09:20 2024-05-25 04:45:55 2024-05-25 05:10:59 0:25:04 0:15:09 0:09:55 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm} 1
fail 7725276 2024-05-24 21:09:21 2024-05-25 04:45:56 2024-05-25 05:11:55 0:25:59 0:14:33 0:11:26 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-25T05:07:48.863253+0000 mon.smithi062 (mon.0) 820 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725277 2024-05-24 21:09:22 2024-05-25 04:46:26 2024-05-25 05:09:38 0:23:12 0:13:54 0:09:18 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7725278 2024-05-24 21:09:23 2024-05-25 04:46:27 2024-05-25 05:31:19 0:44:52 0:32:41 0:12:11 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-05-25T05:20:00.000185+0000 mon.smithi071 (mon.0) 419 : cluster [WRN] osd.3 (root=default,host=smithi111) is down" in cluster log

fail 7725279 2024-05-24 21:09:24 2024-05-25 04:47:54 2024-05-25 05:11:13 0:23:19 0:14:40 0:08:39 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-25T05:10:13.585531+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7725280 2024-05-24 21:09:25 2024-05-25 04:48:24 2024-05-25 05:09:19 0:20:55 0:11:54 0:09:01 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7725281 2024-05-24 21:09:26 2024-05-25 04:48:24 2024-05-25 05:13:59 0:25:35 0:14:58 0:10:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7725282 2024-05-24 21:09:27 2024-05-25 04:48:25 2024-05-25 05:06:05 0:17:40 0:09:02 0:08:38 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi117 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=17c123e524b17eb0cf38bdb0a0ca89d80b36c131 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7725283 2024-05-24 21:09:28 2024-05-25 04:48:35 2024-05-25 05:34:46 0:46:11 0:36:47 0:09:24 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
fail 7725284 2024-05-24 21:09:29 2024-05-25 04:49:46 2024-05-25 05:18:56 0:29:10 0:17:48 0:11:22 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=17c123e524b17eb0cf38bdb0a0ca89d80b36c131 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

pass 7725285 2024-05-24 21:09:30 2024-05-25 04:49:46 2024-05-25 05:21:30 0:31:44 0:21:09 0:10:35 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7725286 2024-05-24 21:09:31 2024-05-25 04:49:46 2024-05-25 05:14:29 0:24:43 0:15:05 0:09:38 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7725287 2024-05-24 21:09:32 2024-05-25 04:49:47 2024-05-25 05:17:35 0:27:48 0:16:11 0:11:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7725288 2024-05-24 21:09:33 2024-05-25 04:49:47 2024-05-25 05:14:21 0:24:34 0:12:13 0:12:21 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-05-25T05:09:10.012506+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7725289 2024-05-24 21:09:34 2024-05-25 04:51:18 2024-05-25 05:15:22 0:24:04 0:13:22 0:10:42 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_extra_daemon_features} 2
Failure Reason:

"2024-05-25T05:10:17.500500+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725290 2024-05-24 21:09:35 2024-05-25 04:52:28 2024-05-25 05:22:48 0:30:20 0:19:06 0:11:14 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7725291 2024-05-24 21:09:36 2024-05-25 04:52:59 2024-05-25 05:46:59 0:54:00 0:43:39 0:10:21 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7725292 2024-05-24 21:09:37 2024-05-25 04:53:29 2024-05-25 05:21:05 0:27:36 0:15:38 0:11:58 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7725293 2024-05-24 21:09:38 2024-05-25 04:56:30 2024-05-25 05:47:42 0:51:12 0:38:24 0:12:48 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7725294 2024-05-24 21:09:39 2024-05-25 04:58:01 2024-05-25 05:27:37 0:29:36 0:19:52 0:09:44 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-05-25T05:26:07.876337+0000 mon.a (mon.0) 533 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7725295 2024-05-24 21:09:40 2024-05-25 04:58:01 2024-05-25 05:28:37 0:30:36 0:19:10 0:11:26 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
fail 7725296 2024-05-24 21:09:41 2024-05-25 04:59:01 2024-05-25 05:32:47 0:33:46 0:23:18 0:10:28 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-25T05:25:07.383092+0000 mon.smithi122 (mon.0) 857 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7725297 2024-05-24 21:09:42 2024-05-25 04:59:02 2024-05-25 05:24:58 0:25:56 0:15:16 0:10:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-05-25T05:22:58.796949+0000 mon.a (mon.0) 736 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

pass 7725298 2024-05-24 21:09:43 2024-05-25 04:59:52 2024-05-25 05:48:06 0:48:14 0:35:58 0:12:16 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7725299 2024-05-24 21:09:43 2024-05-25 05:00:13 2024-05-25 05:27:44 0:27:31 0:17:18 0:10:13 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7725300 2024-05-24 21:09:44 2024-05-25 05:00:13 2024-05-25 05:53:47 0:53:34 0:38:53 0:14:41 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rotate-keys} 2
fail 7725301 2024-05-24 21:09:45 2024-05-25 05:03:44 2024-05-25 05:21:18 0:17:34 0:07:24 0:10:10 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi077 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7725302 2024-05-24 21:09:46 2024-05-25 05:03:44 2024-05-25 05:27:25 0:23:41 0:13:32 0:10:09 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7725303 2024-05-24 21:09:47 2024-05-25 05:04:25 2024-05-25 05:31:00 0:26:35 0:14:53 0:11:42 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-25T05:26:44.571711+0000 mon.smithi106 (mon.0) 843 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7725304 2024-05-24 21:09:48 2024-05-25 05:06:15 2024-05-25 05:30:30 0:24:15 0:13:29 0:10:46 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-05-25T05:25:03.945394+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7725305 2024-05-24 21:09:49 2024-05-25 05:07:36 2024-05-25 05:40:48 0:33:12 0:21:16 0:11:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-05-25T05:36:10.868787+0000 mon.smithi027 (mon.0) 774 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7725306 2024-05-24 21:09:50 2024-05-25 05:07:36 2024-05-25 05:43:33 0:35:57 0:26:00 0:09:57 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-05-25T05:28:43.358989+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

dead 7725307 2024-05-24 21:09:51 2024-05-25 05:07:57 2024-05-25 05:09:40 0:01:43 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi052

pass 7725308 2024-05-24 21:09:52 2024-05-25 05:08:37 2024-05-25 05:44:44 0:36:07 0:25:07 0:11:00 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7725309 2024-05-24 21:09:53 2024-05-25 05:09:27 2024-05-25 05:32:58 0:23:31 0:14:19 0:09:12 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7725310 2024-05-24 21:09:54 2024-05-25 05:09:28 2024-05-25 05:32:04 0:22:36 0:11:32 0:11:04 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7725311 2024-05-24 21:09:55 2024-05-25 05:11:18 2024-05-25 05:37:27 0:26:09 0:14:14 0:11:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7725312 2024-05-24 21:09:56 2024-05-25 05:11:59 2024-05-25 05:46:27 0:34:28 0:22:00 0:12:28 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
fail 7725313 2024-05-24 21:09:57 2024-05-25 05:14:00 2024-05-25 05:35:30 0:21:30 0:12:00 0:09:30 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-05-25T05:31:47.227783+0000 mon.a (mon.0) 467 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725314 2024-05-24 21:09:58 2024-05-25 05:14:30 2024-05-25 05:43:45 0:29:15 0:18:35 0:10:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
fail 7725315 2024-05-24 21:09:59 2024-05-25 05:14:30 2024-05-25 05:40:27 0:25:57 0:14:56 0:11:01 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-25T05:35:49.979143+0000 mon.smithi175 (mon.0) 820 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725316 2024-05-24 21:10:00 2024-05-25 05:15:31 2024-05-25 06:33:25 1:17:54 1:07:04 0:10:50 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
fail 7725317 2024-05-24 21:10:01 2024-05-25 05:15:41 2024-05-25 06:01:35 0:45:54 0:32:47 0:13:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7725318 2024-05-24 21:10:02 2024-05-25 05:17:42 2024-05-25 06:10:44 0:53:02 0:41:06 0:11:56 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-05-25T05:40:08.486836+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725319 2024-05-24 21:10:03 2024-05-25 05:19:02 2024-05-25 05:56:29 0:37:27 0:25:41 0:11:46 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7725320 2024-05-24 21:10:04 2024-05-25 05:21:13 2024-05-25 06:06:17 0:45:04 0:35:43 0:09:21 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-05-25T05:46:20.878889+0000 mon.a (mon.0) 1081 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7725321 2024-05-24 21:10:05 2024-05-25 05:21:23 2024-05-25 05:44:38 0:23:15 0:13:44 0:09:31 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-05-25T05:40:38.214517+0000 mon.a (mon.0) 402 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725322 2024-05-24 21:10:06 2024-05-25 05:21:34 2024-05-25 05:48:04 0:26:30 0:15:28 0:11:02 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7725323 2024-05-24 21:10:07 2024-05-25 05:22:54 2024-05-25 06:28:17 1:05:23 0:52:46 0:12:37 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7725324 2024-05-24 21:10:08 2024-05-25 05:25:05 2024-05-25 05:43:52 0:18:47 0:09:53 0:08:54 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7725325 2024-05-24 21:10:09 2024-05-25 05:25:05 2024-05-25 05:52:27 0:27:22 0:18:38 0:08:44 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7725326 2024-05-24 21:10:10 2024-05-25 05:25:06 2024-05-25 05:47:42 0:22:36 0:13:12 0:09:24 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7725327 2024-05-24 21:10:11 2024-05-25 05:25:06 2024-05-25 05:50:30 0:25:24 0:13:47 0:11:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
dead 7725328 2024-05-24 21:10:12 2024-05-25 05:27:27 2024-05-25 05:28:51 0:01:24 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi072

pass 7725329 2024-05-24 21:10:13 2024-05-25 05:27:47 2024-05-25 05:58:16 0:30:29 0:20:06 0:10:23 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7725330 2024-05-24 21:10:14 2024-05-25 05:28:37 2024-05-25 06:11:13 0:42:36 0:30:30 0:12:06 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7725331 2024-05-24 21:10:15 2024-05-25 05:30:18 2024-05-25 05:56:02 0:25:44 0:14:59 0:10:45 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7725332 2024-05-24 21:10:16 2024-05-25 05:31:08 2024-05-25 05:54:56 0:23:48 0:14:14 0:09:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7725333 2024-05-24 21:10:17 2024-05-25 05:31:29 2024-05-25 05:53:01 0:21:32 0:11:26 0:10:06 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7725334 2024-05-24 21:10:18 2024-05-25 05:32:09 2024-05-25 05:51:49 0:19:40 0:10:58 0:08:42 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi070 with status 5: 'sudo systemctl stop ceph-8edd8418-1a5a-11ef-bc9b-c7b262605968@mon.a'

dead 7725335 2024-05-24 21:10:19 2024-05-25 05:32:20 2024-05-25 05:33:54 0:01:34 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi122

fail 7725336 2024-05-24 21:10:20 2024-05-25 05:32:50 2024-05-25 05:58:01 0:25:11 0:15:16 0:09:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-25T05:54:08.107260+0000 mon.smithi050 (mon.0) 818 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725337 2024-05-24 21:10:21 2024-05-25 05:33:00 2024-05-25 05:57:49 0:24:49 0:13:23 0:11:26 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7725338 2024-05-24 21:10:22 2024-05-25 05:34:51 2024-05-25 06:16:24 0:41:33 0:31:28 0:10:05 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7725339 2024-05-24 21:10:23 2024-05-25 05:35:31 2024-05-25 06:05:11 0:29:40 0:19:28 0:10:12 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-25T06:02:24.289428+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

dead 7725340 2024-05-24 21:10:24 2024-05-25 05:35:32 2024-05-25 05:36:36 0:01:04 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi094

pass 7725341 2024-05-24 21:10:25 2024-05-25 05:35:32 2024-05-25 06:07:38 0:32:06 0:20:05 0:12:01 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
dead 7725342 2024-05-24 21:10:26 2024-05-25 05:37:33 2024-05-25 05:41:07 0:03:34 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi169

fail 7725343 2024-05-24 21:10:27 2024-05-25 05:40:03 2024-05-25 06:37:32 0:57:29 0:47:55 0:09:34 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-05-25T06:17:13.243509+0000 mon.a (mon.0) 1057 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725344 2024-05-24 21:10:28 2024-05-25 05:40:34 2024-05-25 06:05:52 0:25:18 0:15:03 0:10:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7725345 2024-05-24 21:10:29 2024-05-25 05:40:34 2024-05-25 06:29:09 0:48:35 0:36:10 0:12:25 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7725346 2024-05-24 21:10:30 2024-05-25 05:40:34 2024-05-25 05:58:08 0:17:34 0:07:21 0:10:13 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi122 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7725347 2024-05-24 21:10:31 2024-05-25 05:40:35 2024-05-25 06:05:37 0:25:02 0:15:31 0:09:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7725348 2024-05-24 21:10:32 2024-05-25 05:40:35 2024-05-25 05:57:49 0:17:14 0:06:35 0:10:39 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7725349 2024-05-24 21:10:33 2024-05-25 05:40:35 2024-05-25 06:03:38 0:23:03 0:13:36 0:09:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
dead 7725350 2024-05-24 21:10:34 2024-05-25 05:40:36 2024-05-25 05:44:40 0:04:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi144

fail 7725351 2024-05-24 21:10:35 2024-05-25 05:43:37 2024-05-25 06:09:04 0:25:27 0:15:36 0:09:51 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-05-25T06:03:07.624946+0000 mon.a (mon.0) 653 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725352 2024-05-24 21:10:36 2024-05-25 05:43:47 2024-05-25 06:33:39 0:49:52 0:39:25 0:10:27 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
fail 7725353 2024-05-24 21:10:37 2024-05-25 05:43:57 2024-05-25 06:46:00 1:02:03 0:52:09 0:09:54 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7725354 2024-05-24 21:10:38 2024-05-25 05:44:48 2024-05-25 06:27:46 0:42:58 0:34:33 0:08:25 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7725355 2024-05-24 21:10:39 2024-05-25 05:44:48 2024-05-25 06:38:30 0:53:42 0:44:50 0:08:52 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
Failure Reason:

"2024-05-25T06:10:08.971086+0000 mon.a (mon.0) 329 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

fail 7725356 2024-05-24 21:10:40 2024-05-25 05:44:49 2024-05-25 06:10:04 0:25:15 0:14:55 0:10:20 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-05-25T06:07:54.822563+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7725357 2024-05-24 21:10:41 2024-05-25 05:44:49 2024-05-25 06:05:43 0:20:54 0:12:09 0:08:45 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7725358 2024-05-24 21:10:42 2024-05-25 05:44:49 2024-05-25 06:24:40 0:39:51 0:25:56 0:13:55 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7725359 2024-05-24 21:10:43 2024-05-25 05:47:00 2024-05-25 06:11:05 0:24:05 0:13:10 0:10:55 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
fail 7725360 2024-05-24 21:10:44 2024-05-25 05:47:50 2024-05-25 06:14:32 0:26:42 0:17:42 0:09:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-25T06:08:32.406516+0000 mon.smithi018 (mon.0) 835 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7725361 2024-05-24 21:10:45 2024-05-25 05:47:51 2024-05-25 06:09:01 0:21:10 0:11:39 0:09:31 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7725362 2024-05-24 21:10:46 2024-05-25 05:48:11 2024-05-25 06:11:54 0:23:43 0:12:07 0:11:36 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7725363 2024-05-24 21:10:47 2024-05-25 05:48:11 2024-05-25 06:18:15 0:30:04 0:18:50 0:11:14 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_extra_daemon_features} 2
dead 7725364 2024-05-24 21:10:48 2024-05-25 05:50:32 2024-05-25 05:52:56 0:02:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi194

pass 7725365 2024-05-24 21:10:49 2024-05-25 05:51:53 2024-05-25 06:22:01 0:30:08 0:19:49 0:10:19 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7725366 2024-05-24 21:10:50 2024-05-25 05:52:33 2024-05-25 06:56:00 1:03:27 0:53:10 0:10:17 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
fail 7725367 2024-05-24 21:10:51 2024-05-25 05:53:04 2024-05-25 06:26:01 0:32:57 0:20:58 0:11:59 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-25T06:20:16.286298+0000 mon.smithi037 (mon.0) 854 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7725368 2024-05-24 21:10:52 2024-05-25 05:53:54 2024-05-25 06:22:32 0:28:38 0:16:41 0:11:57 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-05-25T06:16:13.544006+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

dead 7725369 2024-05-24 21:10:53 2024-05-25 05:55:05 2024-05-25 18:04:13 12:09:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

hit max job timeout

pass 7725370 2024-05-24 21:10:54 2024-05-25 05:56:05 2024-05-25 07:01:54 1:05:49 0:55:52 0:09:57 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7725371 2024-05-24 21:10:55 2024-05-25 05:56:15 2024-05-25 06:37:02 0:40:47 0:32:32 0:08:15 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7725372 2024-05-24 21:10:56 2024-05-25 05:56:16 2024-05-25 06:33:08 0:36:52 0:24:53 0:11:59 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7725373 2024-05-24 21:10:57 2024-05-25 05:57:56 2024-05-25 06:19:05 0:21:09 0:11:25 0:09:44 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7725374 2024-05-24 21:10:58 2024-05-25 05:58:07 2024-05-25 06:21:25 0:23:18 0:14:06 0:09:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7725375 2024-05-24 21:10:59 2024-05-25 05:58:17 2024-05-25 06:45:34 0:47:17 0:36:26 0:10:51 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-05-25T06:25:28.516217+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725376 2024-05-24 21:11:00 2024-05-25 05:58:18 2024-05-25 06:27:32 0:29:14 0:14:08 0:15:06 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7725377 2024-05-24 21:11:01 2024-05-25 06:01:38 2024-05-25 06:26:45 0:25:07 0:14:39 0:10:28 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-25T06:23:53.781295+0000 mon.smithi005 (mon.0) 834 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725378 2024-05-24 21:11:02 2024-05-25 06:03:39 2024-05-25 06:35:00 0:31:21 0:19:47 0:11:34 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7725379 2024-05-24 21:11:03 2024-05-25 06:05:20 2024-05-25 06:39:21 0:34:01 0:24:27 0:09:34 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7725380 2024-05-24 21:11:04 2024-05-25 06:05:40 2024-05-25 07:25:30 1:19:50 1:09:37 0:10:13 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7725381 2024-05-24 21:11:05 2024-05-25 06:05:50 2024-05-25 06:35:19 0:29:29 0:18:08 0:11:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7725382 2024-05-24 21:11:06 2024-05-25 06:06:01 2024-05-25 06:28:45 0:22:44 0:12:24 0:10:20 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-05-25T06:25:03.373894+0000 mon.a (mon.0) 449 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7725383 2024-05-24 21:11:07 2024-05-25 06:07:41 2024-05-25 06:45:17 0:37:36 0:25:16 0:12:20 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-05-25T06:33:13.403059+0000 mon.a (mon.0) 447 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725384 2024-05-24 21:11:08 2024-05-25 06:09:12 2024-05-25 06:37:19 0:28:07 0:16:29 0:11:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7725385 2024-05-24 21:11:09 2024-05-25 06:10:12 2024-05-25 06:53:52 0:43:40 0:32:53 0:10:47 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7725386 2024-05-24 21:11:10 2024-05-25 06:10:53 2024-05-25 06:33:16 0:22:23 0:12:21 0:10:02 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
dead 7725387 2024-05-24 21:11:11 2024-05-25 06:11:13 2024-05-25 18:19:26 12:08:13 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

hit max job timeout

pass 7725388 2024-05-24 21:11:12 2024-05-25 06:11:24 2024-05-25 06:42:07 0:30:43 0:18:58 0:11:45 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7725389 2024-05-24 21:11:13 2024-05-25 06:11:54 2024-05-25 06:41:36 0:29:42 0:18:58 0:10:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7725390 2024-05-24 21:11:14 2024-05-25 06:11:55 2024-05-25 06:39:16 0:27:21 0:14:30 0:12:51 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7725391 2024-05-24 21:11:15 2024-05-25 06:16:26 2024-05-25 06:34:49 0:18:23 0:07:28 0:10:55 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi018 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7725392 2024-05-24 21:11:16 2024-05-25 06:16:26 2024-05-25 06:43:25 0:26:59 0:14:18 0:12:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
dead 7725393 2024-05-24 21:11:17 2024-05-25 06:18:16 2024-05-25 06:20:10 0:01:54 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi050

pass 7725394 2024-05-24 21:11:18 2024-05-25 06:19:07 2024-05-25 06:46:30 0:27:23 0:14:56 0:12:27 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7725395 2024-05-24 21:11:19 2024-05-25 06:21:28 2024-05-25 07:04:45 0:43:17 0:33:36 0:09:41 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
fail 7725396 2024-05-24 21:11:20 2024-05-25 06:22:08 2024-05-25 07:06:11 0:44:03 0:34:00 0:10:03 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-05-25T06:39:32.713002+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7725397 2024-05-24 21:11:21 2024-05-25 06:22:38 2024-05-25 06:52:27 0:29:49 0:16:57 0:12:52 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-05-25T06:46:11.131346+0000 mon.a (mon.0) 450 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725398 2024-05-24 21:11:22 2024-05-25 06:24:49 2024-05-25 06:50:17 0:25:28 0:15:18 0:10:10 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7725399 2024-05-24 21:11:23 2024-05-25 06:24:50 2024-05-25 06:58:13 0:33:23 0:22:18 0:11:05 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-25T06:53:05.544027+0000 mon.smithi037 (mon.0) 793 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725400 2024-05-24 21:11:24 2024-05-25 06:26:10 2024-05-25 06:56:25 0:30:15 0:19:28 0:10:47 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7725401 2024-05-24 21:11:25 2024-05-25 06:26:50 2024-05-25 07:16:26 0:49:36 0:38:25 0:11:11 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7725402 2024-05-24 21:11:26 2024-05-25 06:27:21 2024-05-25 06:53:07 0:25:46 0:14:18 0:11:28 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-25T06:50:43.954978+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7725403 2024-05-24 21:11:27 2024-05-25 06:27:21 2024-05-25 06:51:35 0:24:14 0:13:49 0:10:25 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7725404 2024-05-24 21:11:28 2024-05-25 06:27:52 2024-05-25 06:49:35 0:21:43 0:11:29 0:10:14 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7725405 2024-05-24 21:11:29 2024-05-25 06:28:22 2024-05-25 06:51:43 0:23:21 0:14:33 0:08:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7725406 2024-05-24 21:11:30 2024-05-25 06:28:52 2024-05-25 06:58:22 0:29:30 0:20:02 0:09:28 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
fail 7725407 2024-05-24 21:11:31 2024-05-25 06:28:53 2024-05-25 06:56:40 0:27:47 0:12:40 0:15:07 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-05-25T06:50:47.659393+0000 mon.a (mon.0) 402 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7725408 2024-05-24 21:11:32 2024-05-25 06:33:14 2024-05-25 06:57:49 0:24:35 0:12:06 0:12:29 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_ca_signed_key} 2
pass 7725409 2024-05-24 21:11:33 2024-05-25 06:33:14 2024-05-25 06:58:28 0:25:14 0:15:56 0:09:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7725410 2024-05-24 21:11:34 2024-05-25 06:33:14 2024-05-25 07:23:41 0:50:27 0:39:32 0:10:55 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
fail 7725411 2024-05-24 21:11:35 2024-05-25 06:33:35 2024-05-25 07:03:12 0:29:37 0:21:05 0:08:32 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-05-25T07:00:39.941000+0000 mon.smithi089 (mon.0) 938 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7725412 2024-05-24 21:11:36 2024-05-25 06:33:45 2024-05-25 06:57:52 0:24:07 0:13:30 0:10:37 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7725413 2024-05-24 21:11:37 2024-05-25 06:34:56 2024-05-25 07:20:04 0:45:08 0:36:19 0:08:49 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7725414 2024-05-24 21:11:38 2024-05-25 06:35:06 2024-05-25 07:05:21 0:30:15 0:19:44 0:10:31 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_cephadm} 1
pass 7725415 2024-05-24 21:11:39 2024-05-25 06:35:26 2024-05-25 07:01:43 0:26:17 0:15:48 0:10:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7725416 2024-05-24 21:11:40 2024-05-25 06:37:07 2024-05-25 07:20:40 0:43:33 0:34:27 0:09:06 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7725417 2024-05-24 21:11:41 2024-05-25 06:37:28 2024-05-25 07:00:36 0:23:08 0:13:22 0:09:46 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-05-25T06:58:57.211557+0000 mon.a (mon.0) 538 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7725418 2024-05-24 21:11:42 2024-05-25 06:37:28 2024-05-25 07:00:42 0:23:14 0:13:22 0:09:52 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
fail 7725419 2024-05-24 21:11:43 2024-05-25 06:37:38 2024-05-25 07:06:13 0:28:35 0:17:26 0:11:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-25T07:00:16.740846+0000 mon.smithi031 (mon.0) 861 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7725420 2024-05-24 21:11:44 2024-05-25 06:39:19 2024-05-25 06:53:58 0:14:39 0:06:28 0:08:11 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_cephadm_repos} 1
fail 7725421 2024-05-24 21:11:45 2024-05-25 06:39:19 2024-05-25 07:06:24 0:27:05 0:16:28 0:10:37 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-05-25T06:56:48.720837+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

dead 7725422 2024-05-24 21:11:46 2024-05-25 06:39:30 2024-05-25 06:47:17 0:07:47 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Error reimaging machines: This operation would block forever Hub: <Hub '' at 0x7f1fa30153f0 epoll default pending=0 ref=0 fileno=4 thread_ident=0x7f1fa57af740> Handles: []

dead 7725423 2024-05-24 21:11:47 2024-05-25 06:41:40 2024-05-25 06:43:14 0:01:34 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi163

pass 7725424 2024-05-24 21:11:48 2024-05-25 06:42:11 2024-05-25 07:05:53 0:23:42 0:14:15 0:09:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7725425 2024-05-24 21:11:49 2024-05-25 06:42:51 2024-05-25 07:10:22 0:27:31 0:14:44 0:12:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-25T07:06:12.482116+0000 mon.smithi032 (mon.0) 837 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log