Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7844144 2024-08-08 17:54:51 2024-08-08 17:58:58 2024-08-08 18:29:55 0:30:57 0:21:43 0:09:14 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7844145 2024-08-08 17:54:52 2024-08-08 17:58:58 2024-08-08 18:24:17 0:25:19 0:16:26 0:08:53 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
pass 7844146 2024-08-08 17:54:53 2024-08-08 17:58:58 2024-08-08 18:42:20 0:43:22 0:33:31 0:09:51 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7844147 2024-08-08 17:54:55 2024-08-08 17:59:19 2024-08-08 18:58:03 0:58:44 0:43:43 0:15:01 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7844148 2024-08-08 17:54:56 2024-08-08 18:01:29 2024-08-08 18:46:29 0:45:00 0:35:12 0:09:48 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7844149 2024-08-08 17:54:57 2024-08-08 18:01:30 2024-08-08 18:24:35 0:23:05 0:13:53 0:09:12 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7844150 2024-08-08 17:54:59 2024-08-08 18:01:40 2024-08-08 18:25:00 0:23:20 0:13:14 0:10:06 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7844151 2024-08-08 17:55:00 2024-08-08 18:01:40 2024-08-08 18:31:28 0:29:48 0:20:12 0:09:36 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7844152 2024-08-08 17:55:02 2024-08-08 18:02:01 2024-08-08 18:35:48 0:33:47 0:23:43 0:10:04 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7844153 2024-08-08 17:55:03 2024-08-08 18:02:01 2024-08-08 18:30:22 0:28:21 0:19:01 0:09:20 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} 2
pass 7844154 2024-08-08 17:55:04 2024-08-08 18:02:52 2024-08-08 18:27:49 0:24:57 0:16:20 0:08:37 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7844155 2024-08-08 17:55:06 2024-08-08 18:02:52 2024-08-08 18:25:26 0:22:34 0:11:11 0:11:23 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7844156 2024-08-08 17:55:07 2024-08-08 18:04:33 2024-08-08 18:26:58 0:22:25 0:10:30 0:11:55 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7844157 2024-08-08 17:55:08 2024-08-08 18:05:33 2024-08-08 18:51:24 0:45:51 0:35:00 0:10:51 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7844158 2024-08-08 17:55:10 2024-08-08 18:05:53 2024-08-08 18:40:54 0:35:01 0:23:57 0:11:04 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7844159 2024-08-08 17:55:11 2024-08-08 18:06:04 2024-08-08 18:29:11 0:23:07 0:13:00 0:10:07 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7844160 2024-08-08 17:55:12 2024-08-08 18:06:24 2024-08-08 18:32:14 0:25:50 0:15:41 0:10:09 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7844161 2024-08-08 17:55:14 2024-08-08 18:07:05 2024-08-08 18:37:26 0:30:21 0:20:54 0:09:27 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7844162 2024-08-08 17:55:15 2024-08-08 18:07:55 2024-08-08 18:31:44 0:23:49 0:12:34 0:11:15 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7844163 2024-08-08 17:55:16 2024-08-08 18:08:26 2024-08-08 18:27:35 0:19:09 0:10:34 0:08:35 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} 2
pass 7844164 2024-08-08 17:55:17 2024-08-08 18:08:26 2024-08-08 18:44:03 0:35:37 0:25:55 0:09:42 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7844165 2024-08-08 17:55:19 2024-08-08 18:08:26 2024-08-08 19:06:31 0:58:05 0:43:55 0:14:10 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
fail 7844166 2024-08-08 17:55:20 2024-08-08 18:12:57 2024-08-08 18:49:04 0:36:07 0:25:38 0:10:29 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

Command failed on smithi053 with status 5: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de50a7c969c464f1af48fc4fd9870c061342194a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 708af280-55b4-11ef-bccd-c7b262605968 -- bash -c \'set -e\nset -x\nceph orch apply node-exporter\nceph orch apply grafana\nceph orch apply alertmanager\nceph orch apply prometheus\nsleep 240\nceph orch ls\nceph orch ps\nceph orch host ls\nMON_DAEMON=$(ceph orch ps --daemon-type mon -f json | jq -r \'"\'"\'last | .daemon_name\'"\'"\')\nGRAFANA_HOST=$(ceph orch ps --daemon-type grafana -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nPROM_HOST=$(ceph orch ps --daemon-type prometheus -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nALERTM_HOST=$(ceph orch ps --daemon-type alertmanager -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nGRAFANA_IP=$(ceph orch host ls -f json | jq -r --arg GRAFANA_HOST "$GRAFANA_HOST" \'"\'"\'.[] | select(.hostname==$GRAFANA_HOST) | .addr\'"\'"\')\nPROM_IP=$(ceph orch host ls -f json | jq -r --arg PROM_HOST "$PROM_HOST" \'"\'"\'.[] | select(.hostname==$PROM_HOST) | .addr\'"\'"\')\nALERTM_IP=$(ceph orch host ls -f json | jq -r --arg ALERTM_HOST "$ALERTM_HOST" \'"\'"\'.[] | select(.hostname==$ALERTM_HOST) | .addr\'"\'"\')\n# check each host node-exporter metrics endpoint is responsive\nALL_HOST_IPS=$(ceph orch host ls -f json | jq -r \'"\'"\'.[] | .addr\'"\'"\')\nfor ip in $ALL_HOST_IPS; do\n curl -s http://${ip}:9100/metric\ndone\n# check grafana endpoints are responsive and database health is okay\ncurl -k -s https://${GRAFANA_IP}:3000/api/health\ncurl -k -s https://${GRAFANA_IP}:3000/api/health | jq -e \'"\'"\'.database == "ok"\'"\'"\'\n# stop mon daemon in order to trigger an alert\nceph orch daemon stop $MON_DAEMON\nsleep 120\n# check prometheus endpoints are responsive and mon down alert is firing\ncurl -s http://${PROM_IP}:9095/api/v1/status/config\ncurl -s http://${PROM_IP}:9095/api/v1/status/config | jq -e \'"\'"\'.status == "success"\'"\'"\'\ncurl -s http://${PROM_IP}:9095/api/v1/alerts\ncurl -s http://${PROM_IP}:9095/api/v1/alerts | jq -e \'"\'"\'.data | .alerts | .[] | select(.labels | .alertname == "CephMonDown") | .state == "firing"\'"\'"\'\n# check alertmanager endpoints are responsive and mon down alert is active\ncurl -s http://${ALERTM_IP}:9093/api/v1/status\ncurl -s http://${ALERTM_IP}:9093/api/v1/alerts\ncurl -s http://${ALERTM_IP}:9093/api/v1/alerts | jq -e \'"\'"\'.data | .[] | select(.labels | .alertname == "CephMonDown") | .status | .state == "active"\'"\'"\'\n\''

fail 7844167 2024-08-08 17:55:22 2024-08-08 18:13:28 2024-08-08 18:31:32 0:18:04 0:06:44 0:11:20 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi076 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm'

pass 7844168 2024-08-08 17:55:23 2024-08-08 18:13:38 2024-08-08 18:36:34 0:22:56 0:14:18 0:08:38 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7844169 2024-08-08 17:55:24 2024-08-08 18:13:38 2024-08-08 19:07:26 0:53:48 0:42:30 0:11:18 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi117 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2550950-55b3-11ef-bccd-c7b262605968 -e sha1=de50a7c969c464f1af48fc4fd9870c061342194a -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

fail 7844170 2024-08-08 17:55:26 2024-08-08 18:13:49 2024-08-08 18:34:54 0:21:05 0:09:31 0:11:34 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi019 with status 5: 'sudo systemctl stop ceph-8e0bbaec-55b4-11ef-bccd-c7b262605968@mon.a'

pass 7844171 2024-08-08 17:55:27 2024-08-08 18:15:40 2024-08-08 18:39:47 0:24:07 0:13:00 0:11:07 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7844172 2024-08-08 17:55:28 2024-08-08 18:16:50 2024-08-08 18:50:01 0:33:11 0:21:19 0:11:52 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7844173 2024-08-08 17:55:30 2024-08-08 18:18:41 2024-08-08 18:43:02 0:24:21 0:13:17 0:11:04 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7844174 2024-08-08 17:55:31 2024-08-08 18:20:01 2024-08-08 18:53:25 0:33:24 0:20:06 0:13:18 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7844175 2024-08-08 17:55:33 2024-08-08 18:23:32 2024-08-08 18:47:20 0:23:48 0:13:44 0:10:04 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7844176 2024-08-08 17:55:34 2024-08-08 18:23:43 2024-08-08 18:45:46 0:22:03 0:11:24 0:10:39 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} 2
pass 7844177 2024-08-08 17:55:35 2024-08-08 18:24:33 2024-08-08 19:08:02 0:43:29 0:33:02 0:10:27 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7844178 2024-08-08 17:55:37 2024-08-08 18:24:53 2024-08-09 02:34:29 8:09:36 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7844179 2024-08-08 17:55:38 2024-08-08 18:25:14 2024-08-08 18:46:34 0:21:20 0:11:38 0:09:42 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7844180 2024-08-08 17:55:39 2024-08-08 18:25:44 2024-08-08 19:26:17 1:00:33 0:49:40 0:10:53 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7844181 2024-08-08 17:55:41 2024-08-08 18:26:25 2024-08-08 19:00:45 0:34:20 0:23:11 0:11:09 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7844182 2024-08-08 17:55:42 2024-08-08 18:27:15 2024-08-08 18:52:50 0:25:35 0:16:33 0:09:02 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7844183 2024-08-08 17:55:44 2024-08-08 18:27:16 2024-08-08 18:50:55 0:23:39 0:14:51 0:08:48 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7844184 2024-08-08 17:55:45 2024-08-08 18:27:46 2024-08-08 18:49:33 0:21:47 0:13:00 0:08:47 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
fail 7844185 2024-08-08 17:55:46 2024-08-08 18:28:06 2024-08-08 18:53:20 0:25:14 0:15:09 0:10:05 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
Failure Reason:

reached maximum tries (121) after waiting for 120 seconds

pass 7844186 2024-08-08 17:55:48 2024-08-08 18:28:07 2024-08-08 18:50:18 0:22:11 0:12:28 0:09:43 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7844187 2024-08-08 17:55:49 2024-08-08 18:29:17 2024-08-08 18:55:06 0:25:49 0:14:34 0:11:15 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7844188 2024-08-08 17:55:50 2024-08-08 18:30:08 2024-08-08 19:00:07 0:29:59 0:19:24 0:10:35 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7844189 2024-08-08 17:55:51 2024-08-08 18:30:38 2024-08-08 19:14:38 0:44:00 0:34:19 0:09:41 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7844190 2024-08-08 17:55:53 2024-08-08 18:31:39 2024-08-08 18:53:05 0:21:26 0:10:55 0:10:31 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7844191 2024-08-08 17:55:54 2024-08-08 18:31:49 2024-08-08 18:50:24 0:18:35 0:07:01 0:11:34 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi001 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm'

pass 7844192 2024-08-08 17:55:56 2024-08-08 18:32:00 2024-08-08 18:53:39 0:21:39 0:12:33 0:09:06 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7844193 2024-08-08 17:55:57 2024-08-08 18:32:30 2024-08-08 19:44:00 1:11:30 1:03:02 0:08:28 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi170 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c5fc465e-55b6-11ef-bccd-c7b262605968 -e sha1=de50a7c969c464f1af48fc4fd9870c061342194a -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

pass 7844194 2024-08-08 17:55:58 2024-08-08 18:32:30 2024-08-08 19:17:32 0:45:02 0:32:37 0:12:25 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7844195 2024-08-08 17:56:00 2024-08-08 18:35:01 2024-08-08 19:04:30 0:29:29 0:19:35 0:09:54 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7844196 2024-08-08 17:56:01 2024-08-08 18:35:01 2024-08-08 18:58:09 0:23:08 0:13:15 0:09:53 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7844197 2024-08-08 17:56:02 2024-08-08 18:35:12 2024-08-08 19:05:00 0:29:48 0:18:48 0:11:00 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7844198 2024-08-08 17:56:04 2024-08-08 18:35:12 2024-08-08 19:05:38 0:30:26 0:18:28 0:11:58 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7844199 2024-08-08 17:56:05 2024-08-08 18:36:03 2024-08-08 19:07:38 0:31:35 0:21:05 0:10:30 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7844200 2024-08-08 17:56:06 2024-08-08 18:36:03 2024-08-08 19:09:52 0:33:49 0:23:21 0:10:28 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7844201 2024-08-08 17:56:08 2024-08-08 18:36:53 2024-08-08 18:52:34 0:15:41 0:06:14 0:09:27 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7844202 2024-08-08 17:56:09 2024-08-08 18:37:44 2024-08-08 19:22:35 0:44:51 0:33:28 0:11:23 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7844203 2024-08-08 17:56:10 2024-08-08 18:39:44 2024-08-08 19:02:40 0:22:56 0:13:45 0:09:11 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7844204 2024-08-08 17:56:12 2024-08-08 18:39:45 2024-08-08 19:02:38 0:22:53 0:13:15 0:09:38 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7844205 2024-08-08 17:56:13 2024-08-08 18:39:45 2024-08-08 19:03:46 0:24:01 0:13:54 0:10:07 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7844206 2024-08-08 17:56:14 2024-08-08 18:41:06 2024-08-08 19:04:07 0:23:01 0:12:44 0:10:17 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
pass 7844207 2024-08-08 17:56:16 2024-08-08 18:41:06 2024-08-08 19:03:41 0:22:35 0:11:17 0:11:18 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7844208 2024-08-08 17:56:17 2024-08-08 18:42:37 2024-08-08 19:26:23 0:43:46 0:34:24 0:09:22 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7844209 2024-08-08 17:56:19 2024-08-08 18:43:17 2024-08-08 19:09:16 0:25:59 0:14:24 0:11:35 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7844210 2024-08-08 17:56:20 2024-08-08 18:44:18 2024-08-08 19:08:17 0:23:59 0:13:11 0:10:48 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7844211 2024-08-08 17:56:21 2024-08-08 18:45:08 2024-08-08 19:06:57 0:21:49 0:10:59 0:10:50 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_basic} 2
pass 7844212 2024-08-08 17:56:23 2024-08-08 18:45:59 2024-08-08 19:10:07 0:24:08 0:13:54 0:10:14 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7844213 2024-08-08 17:56:24 2024-08-08 18:46:49 2024-08-08 19:31:41 0:44:52 0:34:30 0:10:22 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7844214 2024-08-08 17:56:25 2024-08-08 18:46:50 2024-08-08 19:10:12 0:23:22 0:13:55 0:09:27 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7844215 2024-08-08 17:56:27 2024-08-08 18:47:00 2024-08-08 19:19:54 0:32:54 0:22:29 0:10:25 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7844216 2024-08-08 17:56:28 2024-08-08 18:47:30 2024-08-08 19:06:19 0:18:49 0:07:07 0:11:42 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi053 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm'

fail 7844217 2024-08-08 17:56:29 2024-08-08 18:49:21 2024-08-08 19:06:19 0:16:58 0:06:35 0:10:23 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-d30482f6-55b8-11ef-bccd-c7b262605968@mon.smithi062'

fail 7844218 2024-08-08 17:56:31 2024-08-08 18:49:21 2024-08-08 19:43:04 0:53:43 0:43:14 0:10:29 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da824f4a-55b8-11ef-bccd-c7b262605968 -e sha1=de50a7c969c464f1af48fc4fd9870c061342194a -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

pass 7844219 2024-08-08 17:56:32 2024-08-08 18:49:42 2024-08-08 19:34:13 0:44:31 0:34:04 0:10:27 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7844220 2024-08-08 17:56:34 2024-08-08 18:50:12 2024-08-08 19:24:06 0:33:54 0:23:04 0:10:50 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
pass 7844221 2024-08-08 17:56:35 2024-08-08 18:50:13 2024-08-08 19:13:27 0:23:14 0:14:04 0:09:10 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7844222 2024-08-08 17:56:36 2024-08-08 18:50:33 2024-08-08 19:14:27 0:23:54 0:12:51 0:11:03 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7844223 2024-08-08 17:56:38 2024-08-08 18:51:14 2024-08-08 19:12:23 0:21:09 0:11:26 0:09:43 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} 2
pass 7844224 2024-08-08 17:56:39 2024-08-08 18:51:34 2024-08-08 19:17:15 0:25:41 0:16:14 0:09:27 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7844225 2024-08-08 17:56:40 2024-08-08 18:52:14 2024-08-08 19:26:05 0:33:51 0:23:39 0:10:12 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7844226 2024-08-08 17:56:42 2024-08-08 18:52:55 2024-08-08 19:16:03 0:23:08 0:13:27 0:09:41 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7844227 2024-08-08 17:56:43 2024-08-08 18:53:05 2024-08-08 19:27:10 0:34:05 0:23:22 0:10:43 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7844228 2024-08-08 17:56:44 2024-08-08 18:53:06 2024-08-08 19:39:01 0:45:55 0:34:43 0:11:12 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7844229 2024-08-08 17:56:46 2024-08-08 18:53:26 2024-08-08 19:16:50 0:23:24 0:13:49 0:09:35 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7844230 2024-08-08 17:56:47 2024-08-08 18:53:36 2024-08-08 19:17:16 0:23:40 0:11:54 0:11:46 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7844231 2024-08-08 17:56:48 2024-08-08 18:53:47 2024-08-08 19:52:04 0:58:17 0:47:56 0:10:21 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7844232 2024-08-08 17:56:50 2024-08-08 18:53:57 2024-08-08 19:24:47 0:30:50 0:19:45 0:11:05 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7844233 2024-08-08 17:56:51 2024-08-08 18:55:18 2024-08-08 19:24:32 0:29:14 0:18:16 0:10:58 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} 2
pass 7844234 2024-08-08 17:56:53 2024-08-08 18:56:48 2024-08-08 19:32:46 0:35:58 0:25:31 0:10:27 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7844235 2024-08-08 17:56:54 2024-08-08 18:56:49 2024-08-08 19:41:55 0:45:06 0:34:41 0:10:25 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
fail 7844236 2024-08-08 17:56:55 2024-08-08 18:56:59 2024-08-08 19:30:46 0:33:47 0:19:36 0:14:11 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

Command failed on smithi066 with status 5: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de50a7c969c464f1af48fc4fd9870c061342194a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d14319a8-55ba-11ef-bccd-c7b262605968 -- bash -c \'set -e\nset -x\nceph orch apply node-exporter\nceph orch apply grafana\nceph orch apply alertmanager\nceph orch apply prometheus\nsleep 240\nceph orch ls\nceph orch ps\nceph orch host ls\nMON_DAEMON=$(ceph orch ps --daemon-type mon -f json | jq -r \'"\'"\'last | .daemon_name\'"\'"\')\nGRAFANA_HOST=$(ceph orch ps --daemon-type grafana -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nPROM_HOST=$(ceph orch ps --daemon-type prometheus -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nALERTM_HOST=$(ceph orch ps --daemon-type alertmanager -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nGRAFANA_IP=$(ceph orch host ls -f json | jq -r --arg GRAFANA_HOST "$GRAFANA_HOST" \'"\'"\'.[] | select(.hostname==$GRAFANA_HOST) | .addr\'"\'"\')\nPROM_IP=$(ceph orch host ls -f json | jq -r --arg PROM_HOST "$PROM_HOST" \'"\'"\'.[] | select(.hostname==$PROM_HOST) | .addr\'"\'"\')\nALERTM_IP=$(ceph orch host ls -f json | jq -r --arg ALERTM_HOST "$ALERTM_HOST" \'"\'"\'.[] | select(.hostname==$ALERTM_HOST) | .addr\'"\'"\')\n# check each host node-exporter metrics endpoint is responsive\nALL_HOST_IPS=$(ceph orch host ls -f json | jq -r \'"\'"\'.[] | .addr\'"\'"\')\nfor ip in $ALL_HOST_IPS; do\n curl -s http://${ip}:9100/metric\ndone\n# check grafana endpoints are responsive and database health is okay\ncurl -k -s https://${GRAFANA_IP}:3000/api/health\ncurl -k -s https://${GRAFANA_IP}:3000/api/health | jq -e \'"\'"\'.database == "ok"\'"\'"\'\n# stop mon daemon in order to trigger an alert\nceph orch daemon stop $MON_DAEMON\nsleep 120\n# check prometheus endpoints are responsive and mon down alert is firing\ncurl -s http://${PROM_IP}:9095/api/v1/status/config\ncurl -s http://${PROM_IP}:9095/api/v1/status/config | jq -e \'"\'"\'.status == "success"\'"\'"\'\ncurl -s http://${PROM_IP}:9095/api/v1/alerts\ncurl -s http://${PROM_IP}:9095/api/v1/alerts | jq -e \'"\'"\'.data | .alerts | .[] | select(.labels | .alertname == "CephMonDown") | .state == "firing"\'"\'"\'\n# check alertmanager endpoints are responsive and mon down alert is active\ncurl -s http://${ALERTM_IP}:9093/api/v1/status\ncurl -s http://${ALERTM_IP}:9093/api/v1/alerts\ncurl -s http://${ALERTM_IP}:9093/api/v1/alerts | jq -e \'"\'"\'.data | .[] | select(.labels | .alertname == "CephMonDown") | .status | .state == "active"\'"\'"\'\n\''

pass 7844237 2024-08-08 17:56:57 2024-08-08 18:58:20 2024-08-08 19:23:29 0:25:09 0:14:33 0:10:36 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7844238 2024-08-08 17:56:58 2024-08-08 18:58:30 2024-08-08 19:50:57 0:52:27 0:39:07 0:13:20 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7844239 2024-08-08 17:56:59 2024-08-08 19:06:00 2024-08-08 19:35:25 0:29:25 0:20:13 0:09:12 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7844240 2024-08-08 17:57:01 2024-08-08 19:06:01 2024-08-08 19:47:31 0:41:30 0:32:41 0:08:49 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7844241 2024-08-08 17:57:02 2024-08-08 19:06:01 2024-08-08 19:36:38 0:30:37 0:20:15 0:10:22 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
fail 7844242 2024-08-08 17:57:03 2024-08-08 19:06:01 2024-08-08 19:27:56 0:21:55 0:11:27 0:10:28 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi159 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm'

pass 7844243 2024-08-08 17:57:05 2024-08-08 19:06:02 2024-08-08 19:33:57 0:27:55 0:17:53 0:10:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7844244 2024-08-08 17:57:06 2024-08-08 19:06:02 2024-08-08 20:18:47 1:12:45 1:02:25 0:10:20 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi032 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c11b7f06-55bb-11ef-bccd-c7b262605968 -e sha1=de50a7c969c464f1af48fc4fd9870c061342194a -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

pass 7844245 2024-08-08 17:57:08 2024-08-08 19:06:03 2024-08-08 19:35:35 0:29:32 0:17:56 0:11:36 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7844246 2024-08-08 17:57:09 2024-08-08 19:06:03 2024-08-08 19:29:49 0:23:46 0:13:24 0:10:22 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom} 2
dead 7844247 2024-08-08 17:57:10 2024-08-08 19:06:03 2024-08-09 03:15:38 8:09:35 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7844248 2024-08-08 17:57:12 2024-08-08 19:06:34 2024-08-08 19:45:40 0:39:06 0:29:54 0:09:12 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
fail 7844249 2024-08-08 17:57:13 2024-08-08 19:06:34 2024-08-08 19:32:05 0:25:31 0:15:10 0:10:21 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-8c336abe-55bc-11ef-bccd-c7b262605968@mon.a'