Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7740456 2024-06-04 07:19:06 2024-06-04 07:20:23 2024-06-04 08:34:44 1:14:21 0:52:08 0:22:13 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7740457 2024-06-04 07:19:08 2024-06-04 07:20:24 2024-06-04 08:36:01 1:15:37 0:47:43 0:27:54 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-06-04T08:29:37.116071+0000 mon.a (mon.0) 458 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

dead 7740458 2024-06-04 07:19:09 2024-06-04 07:20:54 2024-06-04 07:25:29 0:04:35 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi204

dead 7740459 2024-06-04 07:19:11 2024-06-04 07:24:25 2024-06-04 07:25:29 0:01:04 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi161

fail 7740460 2024-06-04 07:19:12 2024-06-04 07:24:26 2024-06-04 08:57:54 1:33:28 1:12:25 0:21:03 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-06-04T08:45:34.408955+0000 mon.a (mon.0) 2113 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740461 2024-06-04 07:19:14 2024-06-04 07:27:36 2024-06-04 08:34:24 1:06:48 0:45:58 0:20:50 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7740462 2024-06-04 07:19:15 2024-06-04 07:27:36 2024-06-04 07:51:11 0:23:35 0:14:13 0:09:22 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7740463 2024-06-04 07:19:16 2024-06-04 07:27:37 2024-06-04 07:57:11 0:29:34 0:18:59 0:10:35 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7740464 2024-06-04 07:19:18 2024-06-04 07:27:37 2024-06-04 09:01:02 1:33:25 1:04:24 0:29:01 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7740465 2024-06-04 07:19:19 2024-06-04 07:47:17 2024-06-04 08:16:43 0:29:26 0:19:57 0:09:29 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} 2
fail 7740466 2024-06-04 07:19:20 2024-06-04 07:47:18 2024-06-04 08:40:11 0:52:53 0:27:23 0:25:30 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-06-04T08:35:12.096954+0000 mon.smithi038 (mon.0) 860 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740467 2024-06-04 07:19:22 2024-06-04 07:47:18 2024-06-04 08:32:20 0:45:02 0:21:46 0:23:16 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7740468 2024-06-04 07:19:23 2024-06-04 07:47:18 2024-06-04 08:41:23 0:54:05 0:18:08 0:35:57 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7740469 2024-06-04 07:19:24 2024-06-04 07:47:29 2024-06-04 09:28:49 1:41:20 1:20:09 0:21:11 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
dead 7740470 2024-06-04 07:19:25 2024-06-04 07:47:29 2024-06-04 07:52:13 0:04:44 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi121

dead 7740471 2024-06-04 07:19:27 2024-06-04 07:51:10 2024-06-04 07:52:14 0:01:04 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi155

pass 7740472 2024-06-04 07:19:28 2024-06-04 07:51:10 2024-06-04 09:01:56 1:10:46 0:40:38 0:30:08 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7740473 2024-06-04 07:19:29 2024-06-04 07:51:21 2024-06-04 08:44:49 0:53:28 0:23:49 0:29:39 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7740474 2024-06-04 07:19:31 2024-06-04 07:51:51 2024-06-04 08:24:27 0:32:36 0:21:44 0:10:52 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-06-04T08:19:16.442104+0000 mon.smithi072 (mon.0) 858 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740475 2024-06-04 07:19:32 2024-06-04 07:51:51 2024-06-04 08:38:00 0:46:09 0:15:59 0:30:10 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7740476 2024-06-04 07:19:33 2024-06-04 07:52:22 2024-06-04 08:37:56 0:45:34 0:15:34 0:30:00 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} 2
pass 7740477 2024-06-04 07:19:35 2024-06-04 07:57:03 2024-06-04 08:37:23 0:40:20 0:27:09 0:13:11 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7740478 2024-06-04 07:19:36 2024-06-04 07:57:03 2024-06-04 09:20:24 1:23:21 0:57:27 0:25:54 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
fail 7740479 2024-06-04 07:19:37 2024-06-04 07:57:13 2024-06-04 08:51:06 0:53:53 0:41:59 0:11:54 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7740480 2024-06-04 07:19:39 2024-06-04 07:57:24 2024-06-04 08:35:38 0:38:14 0:25:18 0:12:56 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
dead 7740481 2024-06-04 07:19:40 2024-06-04 07:57:24 2024-06-04 08:58:16 1:00:52 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds

fail 7740482 2024-06-04 07:19:41 2024-06-04 07:57:55 2024-06-04 08:40:33 0:42:38 0:18:16 0:24:22 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-06-04T08:37:04.811282+0000 mon.smithi031 (mon.0) 781 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740483 2024-06-04 07:19:42 2024-06-04 07:57:55 2024-06-04 09:25:32 1:27:37 1:01:42 0:25:55 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7740484 2024-06-04 07:19:44 2024-06-04 07:58:15 2024-06-04 08:49:26 0:51:11 0:20:53 0:30:18 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7740485 2024-06-04 07:19:45 2024-06-04 07:58:16 2024-06-04 09:07:11 1:08:55 0:40:04 0:28:51 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
dead 7740486 2024-06-04 07:19:46 2024-06-04 07:58:16 2024-06-04 08:03:31 0:05:15 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi165

pass 7740487 2024-06-04 07:19:48 2024-06-04 08:02:27 2024-06-04 08:40:08 0:37:41 0:19:58 0:17:43 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7740488 2024-06-04 07:19:49 2024-06-04 08:08:28 2024-06-04 08:49:33 0:41:05 0:24:08 0:16:57 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7740489 2024-06-04 07:19:50 2024-06-04 08:09:59 2024-06-04 08:49:04 0:39:05 0:20:58 0:18:07 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} 2
pass 7740490 2024-06-04 07:19:52 2024-06-04 08:10:09 2024-06-04 09:08:02 0:57:53 0:48:23 0:09:30 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7740491 2024-06-04 07:19:53 2024-06-04 08:10:10 2024-06-04 09:32:23 1:22:13 1:07:31 0:14:42 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-06-04T09:20:00.000131+0000 mon.smithi086 (mon.0) 282 : cluster [WRN] osd.1 (root=default,host=smithi086) is down" in cluster log

dead 7740492 2024-06-04 07:19:54 2024-06-04 08:11:20 2024-06-04 20:20:53 12:09:33 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

fail 7740493 2024-06-04 07:19:55 2024-06-04 08:11:21 2024-06-04 08:46:46 0:35:25 0:20:04 0:15:21 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-06-04T08:44:32.089452+0000 mon.a (mon.0) 780 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7740494 2024-06-04 07:19:57 2024-06-04 08:11:51 2024-06-04 09:03:10 0:51:19 0:39:42 0:11:37 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-06-04T08:40:10.366247+0000 mon.a (mon.0) 934 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740495 2024-06-04 07:19:58 2024-06-04 08:13:32 2024-06-04 09:38:53 1:25:21 1:06:35 0:18:46 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
fail 7740496 2024-06-04 07:19:59 2024-06-04 08:13:52 2024-06-04 09:31:51 1:17:59 0:58:39 0:19:20 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-06-04T09:25:10.497479+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740497 2024-06-04 07:20:01 2024-06-04 08:16:53 2024-06-04 09:07:34 0:50:41 0:22:46 0:27:55 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7740498 2024-06-04 07:20:02 2024-06-04 08:20:44 2024-06-04 08:42:17 0:21:33 0:12:54 0:08:39 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7740499 2024-06-04 07:20:03 2024-06-04 08:20:54 2024-06-04 09:06:15 0:45:21 0:24:06 0:21:15 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7740500 2024-06-04 07:20:04 2024-06-04 08:22:45 2024-06-04 09:29:59 1:07:14 0:45:31 0:21:43 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
fail 7740501 2024-06-04 07:20:06 2024-06-04 08:22:55 2024-06-04 09:02:02 0:39:07 0:20:42 0:18:25 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-06-04T08:55:57.059730+0000 mon.a (mon.0) 770 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740502 2024-06-04 07:20:07 2024-06-04 08:22:55 2024-06-04 08:57:16 0:34:21 0:21:21 0:13:00 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7740503 2024-06-04 07:20:08 2024-06-04 08:24:36 2024-06-04 09:30:21 1:05:45 0:50:38 0:15:07 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7740504 2024-06-04 07:20:10 2024-06-04 08:27:37 2024-06-04 09:49:35 1:21:58 0:59:33 0:22:25 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7740505 2024-06-04 07:20:11 2024-06-04 08:28:17 2024-06-04 09:29:53 1:01:36 0:34:40 0:26:56 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7740506 2024-06-04 07:20:12 2024-06-04 08:32:28 2024-06-04 09:37:28 1:05:00 0:44:10 0:20:50 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-06-04T09:26:26.168820+0000 mgr.smithi169.cnevhp (mgr.14244) 1 : cluster [ERR] Failed to load ceph-mgr modules: k8sevents" in cluster log

pass 7740507 2024-06-04 07:20:13 2024-06-04 08:34:19 2024-06-04 09:17:26 0:43:07 0:22:06 0:21:01 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7740508 2024-06-04 07:20:15 2024-06-04 08:34:29 2024-06-04 09:19:59 0:45:30 0:34:05 0:11:25 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
fail 7740509 2024-06-04 07:20:16 2024-06-04 08:34:50 2024-06-04 09:00:01 0:25:11 0:14:27 0:10:44 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7740510 2024-06-04 07:20:17 2024-06-04 08:35:40 2024-06-04 09:24:41 0:49:01 0:26:35 0:22:26 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7740511 2024-06-04 07:20:19 2024-06-04 08:35:40 2024-06-04 09:03:42 0:28:02 0:18:45 0:09:17 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7740512 2024-06-04 07:20:20 2024-06-04 08:36:11 2024-06-04 09:07:26 0:31:15 0:19:07 0:12:08 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7740513 2024-06-04 07:20:21 2024-06-04 08:37:31 2024-06-04 10:12:37 1:35:06 1:12:59 0:22:07 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
fail 7740514 2024-06-04 07:20:23 2024-06-04 08:37:42 2024-06-04 09:09:34 0:31:52 0:21:10 0:10:42 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-06-04T09:03:19.425726+0000 mon.smithi018 (mon.0) 794 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740515 2024-06-04 07:20:24 2024-06-04 08:38:02 2024-06-04 09:43:10 1:05:08 0:43:21 0:21:47 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7740516 2024-06-04 07:20:25 2024-06-04 08:38:02 2024-06-04 09:19:37 0:41:35 0:17:49 0:23:46 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
dead 7740517 2024-06-04 07:20:27 2024-06-04 08:38:03 2024-06-04 08:39:47 0:01:44 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi151

pass 7740518 2024-06-04 07:20:28 2024-06-04 08:38:43 2024-06-04 09:33:11 0:54:28 0:31:53 0:22:35 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7740519 2024-06-04 07:20:30 2024-06-04 08:40:14 2024-06-04 09:31:23 0:51:09 0:24:33 0:26:36 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/on orchestrator_cli} 2
pass 7740520 2024-06-04 07:20:31 2024-06-04 08:40:14 2024-06-04 09:29:03 0:48:49 0:25:05 0:23:44 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7740521 2024-06-04 07:20:32 2024-06-04 08:40:34 2024-06-04 09:15:16 0:34:42 0:21:26 0:13:16 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7740522 2024-06-04 07:20:33 2024-06-04 08:40:35 2024-06-04 09:27:18 0:46:43 0:21:26 0:25:17 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-06-04T09:23:01.450070+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7740523 2024-06-04 07:20:35 2024-06-04 08:41:25 2024-06-04 09:58:27 1:17:02 0:51:55 0:25:07 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi161 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 684ada34-2253-11ef-bc9b-c7b262605968 -e sha1=a3660b9f66881bad0297951a4e84df75193d23b3 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

dead 7740524 2024-06-04 07:20:36 2024-06-04 08:41:26 2024-06-04 08:44:30 0:03:04 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi059

pass 7740525 2024-06-04 07:20:37 2024-06-04 08:43:26 2024-06-04 09:27:23 0:43:57 0:23:41 0:20:16 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7740526 2024-06-04 07:20:39 2024-06-04 08:44:27 2024-06-04 09:27:22 0:42:55 0:22:15 0:20:40 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_basic} 2
dead 7740527 2024-06-04 07:20:40 2024-06-04 08:44:27 2024-06-04 08:45:41 0:01:14 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi186

pass 7740528 2024-06-04 07:20:41 2024-06-04 08:44:37 2024-06-04 09:49:52 1:05:15 0:37:19 0:27:56 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
fail 7740529 2024-06-04 07:20:42 2024-06-04 08:46:48 2024-06-04 09:52:08 1:05:20 0:37:06 0:28:14 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7740530 2024-06-04 07:20:44 2024-06-04 08:48:59 2024-06-04 09:45:58 0:56:59 0:24:15 0:32:44 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-06-04T09:42:40.153555+0000 mon.a (mon.0) 415 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7740531 2024-06-04 07:20:45 2024-06-04 08:48:59 2024-06-04 09:20:40 0:31:41 0:22:07 0:09:34 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7740532 2024-06-04 07:20:46 2024-06-04 08:49:09 2024-06-04 10:08:24 1:19:15 0:48:09 0:31:06 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7740533 2024-06-04 07:20:47 2024-06-04 08:49:30 2024-06-04 09:39:19 0:49:49 0:16:31 0:33:18 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7740534 2024-06-04 07:20:49 2024-06-04 08:49:40 2024-06-04 09:35:02 0:45:22 0:33:28 0:11:54 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7740535 2024-06-04 07:20:50 2024-06-04 08:52:03 2024-06-04 09:31:59 0:39:56 0:23:34 0:16:22 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
pass 7740536 2024-06-04 07:20:51 2024-06-04 08:57:24 2024-06-04 09:54:48 0:57:24 0:32:21 0:25:03 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
dead 7740537 2024-06-04 07:20:53 2024-06-04 08:58:04 2024-06-04 10:00:18 1:02:14 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds

pass 7740538 2024-06-04 07:20:54 2024-06-04 09:00:05 2024-06-04 09:45:16 0:45:11 0:20:02 0:25:09 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} 2
fail 7740539 2024-06-04 07:20:55 2024-06-04 09:00:05 2024-06-04 09:49:26 0:49:21 0:23:57 0:25:24 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-06-04T09:44:20.005906+0000 mon.smithi178 (mon.0) 880 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740540 2024-06-04 07:20:57 2024-06-04 09:00:06 2024-06-04 10:00:22 1:00:16 0:50:07 0:10:09 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7740541 2024-06-04 07:20:58 2024-06-04 09:00:06 2024-06-04 10:06:55 1:06:49 0:41:55 0:24:54 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7740542 2024-06-04 07:20:59 2024-06-04 09:00:07 2024-06-04 09:58:44 0:58:37 0:33:33 0:25:04 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7740543 2024-06-04 07:21:00 2024-06-04 09:01:57 2024-06-04 09:36:03 0:34:06 0:24:09 0:09:57 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7740544 2024-06-04 07:21:02 2024-06-04 09:02:07 2024-06-04 10:26:08 1:24:01 0:58:18 0:25:43 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7740545 2024-06-04 07:21:03 2024-06-04 09:03:18 2024-06-04 09:44:42 0:41:24 0:18:11 0:23:13 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-06-04T09:40:09.716408+0000 mon.smithi139 (mon.0) 837 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740546 2024-06-04 07:21:04 2024-06-04 09:03:48 2024-06-04 09:48:53 0:45:05 0:23:03 0:22:02 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7740547 2024-06-04 07:21:06 2024-06-04 09:07:19 2024-06-04 09:55:27 0:48:08 0:37:26 0:10:42 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7740548 2024-06-04 07:21:07 2024-06-04 09:07:30 2024-06-04 09:37:11 0:29:41 0:18:57 0:10:44 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7740549 2024-06-04 07:21:08 2024-06-04 09:07:40 2024-06-04 09:37:48 0:30:08 0:18:42 0:11:26 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} 2
pass 7740550 2024-06-04 07:21:09 2024-06-04 09:08:10 2024-06-04 09:45:38 0:37:28 0:27:29 0:09:59 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7740551 2024-06-04 07:21:11 2024-06-04 09:08:11 2024-06-04 10:16:39 1:08:28 0:53:09 0:15:19 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7740552 2024-06-04 07:21:12 2024-06-04 09:09:41 2024-06-04 10:18:34 1:08:53 0:52:44 0:16:09 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi038 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3660b9f66881bad0297951a4e84df75193d23b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7740553 2024-06-04 07:21:13 2024-06-04 09:15:22 2024-06-04 10:35:19 1:19:57 0:57:07 0:22:50 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7740554 2024-06-04 07:21:14 2024-06-04 09:19:43 2024-06-04 09:55:15 0:35:32 0:21:27 0:14:05 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-06-04T09:49:39.395578+0000 mon.smithi029 (mon.0) 786 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7740555 2024-06-04 07:21:16 2024-06-04 09:20:04 2024-06-04 10:14:25 0:54:21 0:41:23 0:12:58 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7740556 2024-06-04 07:21:17 2024-06-04 09:22:45 2024-06-04 09:54:21 0:31:36 0:19:18 0:12:18 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
dead 7740557 2024-06-04 07:21:18 2024-06-04 09:24:45 2024-06-04 09:26:39 0:01:54 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi167

dead 7740558 2024-06-04 07:21:20 2024-06-04 09:25:36 2024-06-04 09:26:40 0:01:04 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi155

dead 7740559 2024-06-04 07:21:21 2024-06-04 09:25:36 2024-06-04 09:28:30 0:02:54 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi188

pass 7740560 2024-06-04 07:21:22 2024-06-04 09:27:27 2024-06-04 09:58:28 0:31:01 0:16:55 0:14:06 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7740561 2024-06-04 07:21:23 2024-06-04 09:27:27 2024-06-04 10:08:21 0:40:54 0:19:07 0:21:47 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7740562 2024-06-04 07:21:25 2024-06-04 09:27:27 2024-06-04 09:55:19 0:27:52 0:13:30 0:14:22 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom} 2
pass 7740563 2024-06-04 07:21:26 2024-06-04 09:27:28 2024-06-04 11:10:14 1:42:46 1:21:58 0:20:48 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
dead 7740564 2024-06-04 07:21:27 2024-06-04 09:28:58 2024-06-04 21:38:11 12:09:13 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7740565 2024-06-04 07:21:28 2024-06-04 09:29:09 2024-06-04 10:41:24 1:12:15 0:53:05 0:19:10 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7740566 2024-06-04 07:21:30 2024-06-04 09:30:09 2024-06-04 10:42:32 1:12:23 0:49:28 0:22:55 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3