Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7892287 2024-09-06 13:43:14 2024-09-06 13:47:54 2024-09-06 14:45:32 0:57:38 0:47:44 0:09:54 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 7892288 2024-09-06 13:43:16 2024-09-06 13:47:54 2024-09-06 14:12:56 0:25:02 0:18:14 0:06:48 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892289 2024-09-06 13:43:17 2024-09-06 13:48:04 2024-09-06 14:22:18 0:34:14 0:23:29 0:10:45 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892290 2024-09-06 13:43:18 2024-09-06 13:48:25 2024-09-06 14:13:01 0:24:36 0:16:45 0:07:51 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_dom} 4
Failure Reason:

timeout expired in wait_until_healthy

pass 7892291 2024-09-06 13:43:20 2024-09-06 13:49:16 2024-09-06 14:29:58 0:40:42 0:32:55 0:07:47 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7892292 2024-09-06 13:43:21 2024-09-06 13:50:36 2024-09-06 14:13:32 0:22:56 0:15:40 0:07:16 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-09-06T14:03:34.218843+0000 mon.a (mon.0) 70 : cluster [WRN] Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY)" in cluster log

fail 7892293 2024-09-06 13:43:22 2024-09-06 13:50:37 2024-09-06 14:13:09 0:22:32 0:15:12 0:07:20 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7892294 2024-09-06 13:43:24 2024-09-06 13:52:17 2024-09-06 14:11:33 0:19:16 0:12:15 0:07:01 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
Failure Reason:

"2024-09-06T14:04:36.782801+0000 mgr.y (mgr.4131) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

fail 7892295 2024-09-06 13:43:25 2024-09-06 13:52:38 2024-09-06 14:27:07 0:34:29 0:23:20 0:11:09 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892296 2024-09-06 13:43:27 2024-09-06 13:53:08 2024-09-06 14:20:00 0:26:52 0:17:56 0:08:56 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-09-06T14:07:06.591128+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY)" in cluster log

fail 7892297 2024-09-06 13:43:28 2024-09-06 13:54:49 2024-09-06 14:18:46 0:23:57 0:16:55 0:07:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892298 2024-09-06 13:43:29 2024-09-06 13:55:50 2024-09-06 14:16:41 0:20:51 0:15:21 0:05:30 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7892299 2024-09-06 13:43:31 2024-09-06 13:55:50 2024-09-06 14:19:56 0:24:06 0:15:42 0:08:24 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 7892300 2024-09-06 13:43:32 2024-09-06 13:56:20 2024-09-06 14:10:05 0:13:45 0:05:36 0:08:09 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
fail 7892301 2024-09-06 13:43:33 2024-09-06 13:57:11 2024-09-06 14:24:23 0:27:12 0:17:17 0:09:55 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_ips} 4
Failure Reason:

timeout expired in wait_until_healthy

fail 7892302 2024-09-06 13:43:35 2024-09-06 13:59:12 2024-09-06 14:23:09 0:23:57 0:16:56 0:07:01 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892303 2024-09-06 13:43:36 2024-09-06 14:00:02 2024-09-06 14:35:10 0:35:08 0:22:59 0:12:09 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892305 2024-09-06 13:43:37 2024-09-06 14:01:13 2024-09-06 14:41:35 0:40:22 0:31:30 0:08:52 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-06T14:23:53.865774+0000 mgr.smithi103.ebvdwq (mgr.24395) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

fail 7892307 2024-09-06 13:43:39 2024-09-06 14:02:04 2024-09-06 15:13:34 1:11:30 0:58:51 0:12:39 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi005 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2a23c53e-6c5b-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

fail 7892309 2024-09-06 13:43:40 2024-09-06 14:03:54 2024-09-06 14:28:04 0:24:10 0:16:26 0:07:44 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892311 2024-09-06 13:43:42 2024-09-06 14:05:05 2024-09-06 14:37:00 0:31:55 0:22:00 0:09:55 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892313 2024-09-06 13:43:43 2024-09-06 14:05:15 2024-09-06 14:33:07 0:27:52 0:19:58 0:07:54 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892315 2024-09-06 13:43:44 2024-09-06 14:05:46 2024-09-06 14:33:12 0:27:26 0:20:18 0:07:08 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892317 2024-09-06 13:43:46 2024-09-06 14:05:58 2024-09-06 14:38:37 0:32:39 0:22:10 0:10:29 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892319 2024-09-06 13:43:47 2024-09-06 14:07:08 2024-09-06 14:32:13 0:25:05 0:16:17 0:08:48 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892321 2024-09-06 13:43:48 2024-09-06 14:09:19 2024-09-06 14:43:35 0:34:16 0:25:38 0:08:38 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

timeout expired in wait_until_healthy

fail 7892323 2024-09-06 13:43:50 2024-09-06 14:09:50 2024-09-06 14:33:14 0:23:24 0:16:40 0:06:44 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892325 2024-09-06 13:43:51 2024-09-06 14:10:00 2024-09-06 14:29:10 0:19:10 0:12:45 0:06:25 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892327 2024-09-06 13:43:53 2024-09-06 14:10:21 2024-09-06 14:50:03 0:39:42 0:29:30 0:10:12 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892329 2024-09-06 13:43:54 2024-09-06 14:10:21 2024-09-06 14:38:22 0:28:01 0:19:29 0:08:32 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

timeout expired in wait_until_healthy

fail 7892331 2024-09-06 13:43:55 2024-09-06 14:11:22 2024-09-06 14:43:19 0:31:57 0:22:32 0:09:25 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892333 2024-09-06 13:43:57 2024-09-06 14:11:52 2024-09-06 14:38:07 0:26:15 0:17:44 0:08:31 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892335 2024-09-06 13:43:58 2024-09-06 14:13:13 2024-09-06 14:52:08 0:38:55 0:32:24 0:06:31 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-06T14:35:33.163949+0000 mgr.smithi192.ahxhxy (mgr.24427) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

fail 7892337 2024-09-06 13:44:00 2024-09-06 14:13:14 2024-09-06 14:38:20 0:25:06 0:17:49 0:07:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892339 2024-09-06 13:44:01 2024-09-06 14:13:24 2024-09-06 14:36:39 0:23:15 0:16:09 0:07:06 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 7892341 2024-09-06 13:44:03 2024-09-06 14:13:25 2024-09-06 14:55:05 0:41:40 0:33:42 0:07:58 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7892343 2024-09-06 13:44:04 2024-09-06 14:13:25 2024-09-06 14:35:10 0:21:45 0:13:57 0:07:48 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892345 2024-09-06 13:44:05 2024-09-06 14:14:06 2024-09-06 14:38:45 0:24:39 0:16:35 0:08:04 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892347 2024-09-06 13:44:07 2024-09-06 14:15:26 2024-09-06 14:42:52 0:27:26 0:19:38 0:07:48 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892349 2024-09-06 13:44:08 2024-09-06 14:15:47 2024-09-06 14:41:55 0:26:08 0:19:07 0:07:01 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892351 2024-09-06 13:44:09 2024-09-06 14:16:57 2024-09-06 14:39:53 0:22:56 0:15:09 0:07:47 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

timeout expired in wait_until_healthy

pass 7892353 2024-09-06 13:44:11 2024-09-06 14:18:58 2024-09-06 14:40:08 0:21:10 0:12:58 0:08:12 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
fail 7892355 2024-09-06 13:44:12 2024-09-06 14:18:58 2024-09-06 14:40:53 0:21:55 0:13:23 0:08:32 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
Failure Reason:

reached maximum tries (120) after waiting for 120 seconds

fail 7892357 2024-09-06 13:44:13 2024-09-06 14:19:39 2024-09-06 14:40:54 0:21:15 0:14:49 0:06:26 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892359 2024-09-06 13:44:15 2024-09-06 14:19:49 2024-09-06 14:51:40 0:31:51 0:22:34 0:09:17 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892361 2024-09-06 13:44:16 2024-09-06 14:20:00 2024-09-06 14:43:20 0:23:20 0:16:03 0:07:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892363 2024-09-06 13:44:17 2024-09-06 14:20:10 2024-09-06 14:54:21 0:34:11 0:24:07 0:10:04 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

timeout expired in wait_until_healthy

fail 7892365 2024-09-06 13:44:19 2024-09-06 14:20:11 2024-09-06 15:21:40 1:01:29 0:52:28 0:09:01 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 7892367 2024-09-06 13:44:20 2024-09-06 14:22:32 2024-09-06 15:12:38 0:50:06 0:41:51 0:08:15 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a4aba2-6c5c-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

fail 7892369 2024-09-06 13:44:22 2024-09-06 14:23:22 2024-09-06 14:56:18 0:32:56 0:21:13 0:11:43 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892373 2024-09-06 13:44:26 2024-09-06 14:24:43 2024-09-06 14:47:57 0:23:14 0:16:42 0:06:32 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892375 2024-09-06 13:44:27 2024-09-06 14:24:43 2024-09-06 14:52:13 0:27:30 0:18:24 0:09:06 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892377 2024-09-06 13:44:29 2024-09-06 14:27:24 2024-09-06 14:59:46 0:32:22 0:22:35 0:09:47 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892379 2024-09-06 13:44:30 2024-09-06 14:28:14 2024-09-06 15:02:51 0:34:37 0:23:36 0:11:01 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892381 2024-09-06 13:44:31 2024-09-06 14:29:25 2024-09-06 14:49:25 0:20:00 0:12:36 0:07:24 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_basic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892383 2024-09-06 13:44:33 2024-09-06 14:30:16 2024-09-06 15:14:27 0:44:11 0:30:35 0:13:36 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892384 2024-09-06 13:44:34 2024-09-06 14:32:26 2024-09-06 14:58:41 0:26:15 0:19:05 0:07:10 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

timeout expired in wait_until_healthy

fail 7892386 2024-09-06 13:44:36 2024-09-06 14:33:17 2024-09-06 14:54:06 0:20:49 0:13:46 0:07:03 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7892388 2024-09-06 13:44:38 2024-09-06 14:33:17 2024-09-06 14:52:26 0:19:09 0:12:21 0:06:48 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
Failure Reason:

"2024-09-06T14:45:39.155589+0000 mgr.z (mgr.4123) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

fail 7892390 2024-09-06 13:44:39 2024-09-06 14:33:28 2024-09-06 14:56:09 0:22:41 0:16:27 0:06:14 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892392 2024-09-06 13:44:41 2024-09-06 14:33:28 2024-09-06 14:54:26 0:20:58 0:15:09 0:05:49 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7892394 2024-09-06 13:44:42 2024-09-06 14:33:29 2024-09-06 14:58:42 0:25:13 0:15:52 0:09:21 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

timeout expired in wait_until_healthy

fail 7892396 2024-09-06 13:44:44 2024-09-06 14:35:19 2024-09-06 15:00:34 0:25:15 0:17:21 0:07:54 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892398 2024-09-06 13:44:45 2024-09-06 14:35:20 2024-09-06 15:02:09 0:26:49 0:17:49 0:09:00 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892400 2024-09-06 13:44:47 2024-09-06 14:36:50 2024-09-06 15:02:21 0:25:31 0:17:28 0:08:03 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_basic} 4
Failure Reason:

timeout expired in wait_until_healthy

fail 7892402 2024-09-06 13:44:48 2024-09-06 14:37:21 2024-09-06 15:16:33 0:39:12 0:32:42 0:06:30 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-06T15:00:03.867409+0000 mgr.smithi159.kjctuv (mgr.24421) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

pass 7892404 2024-09-06 13:44:50 2024-09-06 14:37:21 2024-09-06 15:44:13 1:06:52 0:49:40 0:17:12 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7892406 2024-09-06 13:44:51 2024-09-06 14:38:22 2024-09-06 15:01:27 0:23:05 0:16:37 0:06:28 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

timeout expired in wait_until_healthy

fail 7892408 2024-09-06 13:44:53 2024-09-06 14:38:32 2024-09-06 15:12:17 0:33:45 0:23:54 0:09:51 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892410 2024-09-06 13:44:54 2024-09-06 14:38:43 2024-09-06 15:01:43 0:23:00 0:16:39 0:06:21 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892411 2024-09-06 13:44:56 2024-09-06 14:38:53 2024-09-06 15:16:31 0:37:38 0:26:17 0:11:21 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_ctdb_res_dom} 4
Failure Reason:

timeout expired in wait_until_healthy

fail 7892412 2024-09-06 13:44:57 2024-09-06 14:40:24 2024-09-06 15:04:09 0:23:45 0:15:40 0:08:05 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7892413 2024-09-06 13:44:58 2024-09-06 14:41:05 2024-09-06 15:04:29 0:23:24 0:16:26 0:06:58 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892414 2024-09-06 13:45:00 2024-09-06 14:41:15 2024-09-06 15:07:09 0:25:54 0:19:09 0:06:45 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892415 2024-09-06 13:45:01 2024-09-06 14:41:45 2024-09-06 15:05:06 0:23:21 0:16:51 0:06:30 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892416 2024-09-06 13:45:03 2024-09-06 14:42:06 2024-09-06 15:10:43 0:28:37 0:20:04 0:08:33 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892417 2024-09-06 13:45:04 2024-09-06 14:42:56 2024-09-06 15:22:53 0:39:57 0:30:27 0:09:30 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892418 2024-09-06 13:45:05 2024-09-06 14:43:07 2024-09-06 15:06:11 0:23:04 0:15:50 0:07:14 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892419 2024-09-06 13:45:07 2024-09-06 14:43:07 2024-09-06 15:06:49 0:23:42 0:17:04 0:06:38 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ips} 4
Failure Reason:

timeout expired in wait_until_healthy

fail 7892420 2024-09-06 13:45:08 2024-09-06 14:43:38 2024-09-06 15:18:03 0:34:25 0:23:05 0:11:20 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892421 2024-09-06 13:45:10 2024-09-06 14:43:38 2024-09-06 15:46:31 1:02:53 0:53:05 0:09:48 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 7892422 2024-09-06 13:45:11 2024-09-06 14:43:49 2024-09-06 15:57:34 1:13:45 1:04:37 0:09:08 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi169 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bab55310-6c60-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

fail 7892423 2024-09-06 13:45:13 2024-09-06 14:43:49 2024-09-06 15:06:41 0:22:52 0:16:13 0:06:39 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892424 2024-09-06 13:45:14 2024-09-06 14:43:50 2024-09-06 15:06:56 0:23:06 0:15:23 0:07:43 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 7892425 2024-09-06 13:45:15 2024-09-06 14:45:50 2024-09-06 15:17:56 0:32:06 0:20:20 0:11:46 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
fail 7892426 2024-09-06 13:45:17 2024-09-06 14:48:11 2024-09-06 15:22:33 0:34:22 0:22:56 0:11:26 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892427 2024-09-06 13:45:18 2024-09-06 14:48:32 2024-09-06 15:10:50 0:22:18 0:13:52 0:08:26 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892428 2024-09-06 13:45:20 2024-09-06 14:49:43 2024-09-06 15:13:02 0:23:19 0:16:26 0:06:53 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892429 2024-09-06 13:45:21 2024-09-06 14:50:03 2024-09-06 15:44:55 0:54:52 0:43:39 0:11:13 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

timeout expired in wait_until_healthy

fail 7892430 2024-09-06 13:45:23 2024-09-06 14:50:34 2024-09-06 15:25:40 0:35:06 0:23:33 0:11:33 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892431 2024-09-06 13:45:24 2024-09-06 14:51:54 2024-09-06 15:22:01 0:30:07 0:20:37 0:09:30 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892432 2024-09-06 13:45:25 2024-09-06 14:52:25 2024-09-06 15:19:25 0:27:00 0:20:18 0:06:42 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892433 2024-09-06 13:45:27 2024-09-06 14:52:35 2024-09-06 15:19:38 0:27:03 0:19:20 0:07:43 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7892434 2024-09-06 13:45:28 2024-09-06 14:52:46 2024-09-06 15:03:53 0:11:07 0:05:25 0:05:42 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7892435 2024-09-06 13:45:30 2024-09-06 14:52:56 2024-09-06 15:35:08 0:42:12 0:34:25 0:07:47 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-06T15:16:39.737939+0000 mgr.smithi194.wpqxze (mgr.24375) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes" in cluster log

fail 7892436 2024-09-06 13:45:32 2024-09-06 14:54:17 2024-09-06 15:17:38 0:23:21 0:16:26 0:06:55 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7892437 2024-09-06 13:45:33 2024-09-06 14:54:37 2024-09-06 15:34:18 0:39:41 0:32:31 0:07:10 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
fail 7892438 2024-09-06 13:45:34 2024-09-06 14:54:38 2024-09-06 15:18:59 0:24:21 0:16:58 0:07:23 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892439 2024-09-06 13:45:36 2024-09-06 14:55:18 2024-09-06 15:37:50 0:42:32 0:30:57 0:11:35 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7892440 2024-09-06 13:45:37 2024-09-06 14:56:19 2024-09-06 15:19:29 0:23:10 0:16:37 0:06:33 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy