Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7886970 2024-09-02 21:08:53 2024-09-02 21:11:08 2024-09-02 21:40:36 0:29:28 0:20:30 0:08:58 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7886971 2024-09-02 21:08:54 2024-09-02 21:11:09 2024-09-02 21:29:18 0:18:09 0:10:17 0:07:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7886972 2024-09-02 21:08:56 2024-09-02 21:11:29 2024-09-02 21:29:17 0:17:48 0:11:07 0:06:41 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7886973 2024-09-02 21:08:57 2024-09-02 21:12:20 2024-09-02 22:03:48 0:51:28 0:44:27 0:07:01 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
dead 7886974 2024-09-02 21:08:58 2024-09-02 21:12:51 2024-09-03 05:21:46 8:08:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7886975 2024-09-02 21:09:00 2024-09-02 21:13:01 2024-09-02 21:36:57 0:23:56 0:15:19 0:08:37 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7886976 2024-09-02 21:09:01 2024-09-02 21:13:32 2024-09-02 21:46:15 0:32:43 0:21:34 0:11:09 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7886977 2024-09-02 21:09:02 2024-09-02 21:14:42 2024-09-02 21:52:36 0:37:54 0:30:09 0:07:45 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7886978 2024-09-02 21:09:04 2024-09-02 21:15:43 2024-09-02 21:53:18 0:37:35 0:31:04 0:06:31 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7886979 2024-09-02 21:09:05 2024-09-02 21:16:03 2024-09-02 21:50:45 0:34:42 0:28:24 0:06:18 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7886980 2024-09-02 21:09:06 2024-09-02 21:16:04 2024-09-02 21:29:22 0:13:18 0:07:08 0:06:10 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7886981 2024-09-02 21:09:07 2024-09-02 21:16:34 2024-09-02 21:40:51 0:24:17 0:14:19 0:09:58 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
dead 7886982 2024-09-02 21:09:09 2024-09-02 21:17:05 2024-09-02 22:17:21 1:00:16 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Error reimaging machines: reached maximum tries (240) after waiting for 3600 seconds

fail 7886983 2024-09-02 21:09:10 2024-09-02 21:17:05 2024-09-02 21:44:57 0:27:52 0:20:12 0:07:40 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-09-02T21:28:14.951770+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7886984 2024-09-02 21:09:11 2024-09-02 21:17:46 2024-09-02 21:37:02 0:19:16 0:09:36 0:09:40 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7886985 2024-09-02 21:09:13 2024-09-02 21:20:07 2024-09-02 21:41:31 0:21:24 0:09:33 0:11:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7886986 2024-09-02 21:09:14 2024-09-02 21:24:18 2024-09-02 21:39:31 0:15:13 0:08:21 0:06:52 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
fail 7886987 2024-09-02 21:09:15 2024-09-02 21:24:18 2024-09-02 21:42:29 0:18:11 0:07:56 0:10:15 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi043 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7886988 2024-09-02 21:09:16 2024-09-02 21:24:49 2024-09-02 21:41:10 0:16:21 0:07:53 0:08:28 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7886989 2024-09-02 21:09:17 2024-09-02 21:25:39 2024-09-02 22:03:30 0:37:51 0:29:36 0:08:15 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
dead 7886990 2024-09-02 21:09:19 2024-09-02 21:26:10 2024-09-03 05:35:25 8:09:15 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

hit max job timeout

pass 7886991 2024-09-02 21:09:20 2024-09-02 21:26:21 2024-09-02 21:43:35 0:17:14 0:09:57 0:07:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7886992 2024-09-02 21:09:21 2024-09-02 21:26:31 2024-09-02 21:54:57 0:28:26 0:18:50 0:09:36 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7886993 2024-09-02 21:09:23 2024-09-02 21:29:22 2024-09-02 21:59:05 0:29:43 0:20:00 0:09:43 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7886994 2024-09-02 21:09:24 2024-09-02 21:29:22 2024-09-02 22:02:41 0:33:19 0:26:09 0:07:10 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7886995 2024-09-02 21:09:25 2024-09-02 21:29:33 2024-09-02 22:02:00 0:32:27 0:21:22 0:11:05 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7886996 2024-09-02 21:09:27 2024-09-02 21:29:33 2024-09-02 22:06:00 0:36:27 0:25:14 0:11:13 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7886997 2024-09-02 21:09:28 2024-09-02 21:30:24 2024-09-02 21:47:43 0:17:19 0:10:54 0:06:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7886998 2024-09-02 21:09:29 2024-09-02 21:30:34 2024-09-02 21:48:33 0:17:59 0:09:54 0:08:05 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7886999 2024-09-02 21:09:31 2024-09-02 21:31:05 2024-09-02 22:18:30 0:47:25 0:35:32 0:11:53 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887000 2024-09-02 21:09:32 2024-09-02 21:35:26 2024-09-02 21:52:30 0:17:04 0:10:32 0:06:32 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
pass 7887001 2024-09-02 21:09:33 2024-09-02 21:35:26 2024-09-02 21:52:05 0:16:39 0:07:39 0:09:00 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7887002 2024-09-02 21:09:35 2024-09-02 21:36:37 2024-09-02 21:53:58 0:17:21 0:10:30 0:06:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7887003 2024-09-02 21:09:36 2024-09-02 21:37:08 2024-09-02 22:05:15 0:28:07 0:17:25 0:10:42 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7887004 2024-09-02 21:09:37 2024-09-02 21:37:18 2024-09-02 22:08:52 0:31:34 0:21:11 0:10:23 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7887005 2024-09-02 21:09:38 2024-09-02 21:37:19 2024-09-02 22:27:19 0:50:00 0:40:09 0:09:51 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7887006 2024-09-02 21:09:40 2024-09-02 21:37:39 2024-09-02 21:57:28 0:19:49 0:11:16 0:08:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7887007 2024-09-02 21:09:41 2024-09-02 21:40:30 2024-09-02 21:55:41 0:15:11 0:07:58 0:07:13 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7887008 2024-09-02 21:09:42 2024-09-02 21:40:31 2024-09-02 22:10:20 0:29:49 0:19:27 0:10:22 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7887009 2024-09-02 21:09:44 2024-09-02 21:40:51 2024-09-02 22:36:30 0:55:39 0:46:21 0:09:18 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7887010 2024-09-02 21:09:45 2024-09-02 21:41:02 2024-09-02 21:58:13 0:17:11 0:10:58 0:06:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} 1
pass 7887011 2024-09-02 21:09:46 2024-09-02 21:41:12 2024-09-02 22:51:17 1:10:05 0:59:51 0:10:14 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7887012 2024-09-02 21:09:47 2024-09-02 21:41:23 2024-09-02 22:01:08 0:19:45 0:11:30 0:08:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7887013 2024-09-02 21:09:49 2024-09-02 21:41:33 2024-09-02 22:18:52 0:37:19 0:29:57 0:07:22 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-02T22:10:00.000138+0000 mon.smithi057 (mon.0) 522 : cluster [WRN] osd.5 (root=default,host=smithi094) is down" in cluster log

pass 7887014 2024-09-02 21:09:50 2024-09-02 21:41:44 2024-09-02 22:15:37 0:33:53 0:23:10 0:10:43 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
pass 7887015 2024-09-02 21:09:51 2024-09-02 21:41:54 2024-09-02 22:12:22 0:30:28 0:19:28 0:11:00 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7887016 2024-09-02 21:09:52 2024-09-02 21:42:45 2024-09-02 22:17:24 0:34:39 0:23:31 0:11:08 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7887017 2024-09-02 21:09:54 2024-09-02 21:43:45 2024-09-02 21:54:46 0:11:01 0:03:26 0:07:35 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7887018 2024-09-02 21:09:55 2024-09-02 21:43:46 2024-09-02 22:02:16 0:18:30 0:10:48 0:07:42 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7887019 2024-09-02 21:09:56 2024-09-02 21:45:06 2024-09-02 22:05:37 0:20:31 0:12:34 0:07:57 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7887020 2024-09-02 21:09:58 2024-09-02 21:46:37 2024-09-02 22:04:41 0:18:04 0:10:19 0:07:45 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7887021 2024-09-02 21:09:59 2024-09-02 21:47:48 2024-09-02 22:04:48 0:17:00 0:11:25 0:05:35 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7887022 2024-09-02 21:10:00 2024-09-02 21:47:58 2024-09-02 22:25:08 0:37:10 0:30:32 0:06:38 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7887023 2024-09-02 21:10:02 2024-09-02 21:47:59 2024-09-02 22:59:54 1:11:55 1:00:38 0:11:17 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7887024 2024-09-02 21:10:03 2024-09-02 21:47:59 2024-09-02 22:18:55 0:30:56 0:19:01 0:11:55 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7887025 2024-09-02 21:10:04 2024-09-02 21:48:50 2024-09-02 22:24:09 0:35:19 0:20:56 0:14:23 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7887026 2024-09-02 21:10:06 2024-09-02 21:52:21 2024-09-02 22:34:14 0:41:53 0:34:08 0:07:45 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887027 2024-09-02 21:10:07 2024-09-02 21:52:41 2024-09-02 22:21:26 0:28:45 0:19:39 0:09:06 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7887028 2024-09-02 21:10:08 2024-09-02 21:54:12 2024-09-02 22:18:43 0:24:31 0:14:19 0:10:12 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7887029 2024-09-02 21:10:10 2024-09-02 21:55:03 2024-09-02 22:10:51 0:15:48 0:08:19 0:07:29 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7887030 2024-09-02 21:10:11 2024-09-02 21:55:13 2024-09-02 22:13:07 0:17:54 0:10:16 0:07:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7887031 2024-09-02 21:10:12 2024-09-02 21:55:54 2024-09-02 22:10:51 0:14:57 0:09:00 0:05:57 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
fail 7887032 2024-09-02 21:10:14 2024-09-02 21:55:54 2024-09-02 22:14:04 0:18:10 0:07:47 0:10:23 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi137 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7887033 2024-09-02 21:10:15 2024-09-02 21:56:35 2024-09-02 22:13:30 0:16:55 0:08:42 0:08:13 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7887034 2024-09-02 21:10:16 2024-09-02 21:58:25 2024-09-02 22:17:46 0:19:21 0:12:18 0:07:03 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
pass 7887035 2024-09-02 21:10:18 2024-09-02 21:58:46 2024-09-02 22:17:51 0:19:05 0:11:31 0:07:34 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7887036 2024-09-02 21:10:19 2024-09-02 21:58:46 2024-09-02 22:16:17 0:17:31 0:10:56 0:06:35 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7887037 2024-09-02 21:10:20 2024-09-02 21:59:17 2024-09-02 22:52:59 0:53:42 0:44:36 0:09:06 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
dead 7887038 2024-09-02 21:10:22 2024-09-02 22:01:28 2024-09-03 06:12:29 8:11:01 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7887039 2024-09-02 21:10:23 2024-09-02 22:02:18 2024-09-02 22:19:39 0:17:21 0:11:25 0:05:56 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7887040 2024-09-02 21:10:25 2024-09-02 22:02:29 2024-09-02 22:19:35 0:17:06 0:09:57 0:07:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7887041 2024-09-02 21:10:26 2024-09-02 22:02:29 2024-09-02 23:03:53 1:01:24 0:54:34 0:06:50 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7887042 2024-09-02 21:10:27 2024-09-02 22:03:00 2024-09-02 22:22:50 0:19:50 0:11:51 0:07:59 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7887043 2024-09-02 21:10:29 2024-09-02 22:03:40 2024-09-02 22:29:12 0:25:32 0:18:38 0:06:54 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
fail 7887044 2024-09-02 21:10:30 2024-09-02 22:04:11 2024-09-02 22:39:47 0:35:36 0:28:20 0:07:16 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-02T22:30:00.000188+0000 mon.smithi017 (mon.0) 330 : cluster [WRN] pg 2.4 is active+undersized+degraded, acting [0,4]" in cluster log

pass 7887045 2024-09-02 21:10:31 2024-09-02 22:04:51 2024-09-02 22:17:52 0:13:01 0:06:53 0:06:08 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7887046 2024-09-02 21:10:33 2024-09-02 22:05:02 2024-09-02 22:33:32 0:28:30 0:18:12 0:10:18 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7887047 2024-09-02 21:10:34 2024-09-02 22:05:32 2024-09-02 22:20:49 0:15:17 0:09:25 0:05:52 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7887048 2024-09-02 21:10:35 2024-09-02 22:05:53 2024-09-02 22:21:13 0:15:20 0:09:13 0:06:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7887049 2024-09-02 21:10:37 2024-09-02 22:06:13 2024-09-02 22:40:24 0:34:11 0:24:31 0:09:40 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7887050 2024-09-02 21:10:38 2024-09-02 22:06:34 2024-09-02 22:38:50 0:32:16 0:20:30 0:11:46 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7887051 2024-09-02 21:10:39 2024-09-02 22:09:15 2024-09-02 22:27:33 0:18:18 0:10:06 0:08:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7887052 2024-09-02 21:10:41 2024-09-02 22:10:35 2024-09-02 22:26:44 0:16:09 0:07:47 0:08:22 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7887053 2024-09-02 21:10:42 2024-09-02 22:11:06 2024-09-02 22:31:10 0:20:04 0:09:37 0:10:27 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi078 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a24861198cbbd7c00ffec1cc106c51135f10976 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0b7d067e-697a-11ef-bcd5-c7b262605968 -- bash -c \'set -e\nset -x\nwhile true; do TOKEN=$(ceph rgw realm tokens | jq -r \'"\'"\'.[0].token\'"\'"\'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done\nTOKENS=$(ceph rgw realm tokens)\necho $TOKENS | jq --exit-status \'"\'"\'.[0].realm == "myrealm1"\'"\'"\'\necho $TOKENS | jq --exit-status \'"\'"\'.[0].token\'"\'"\'\nTOKEN_JSON=$(ceph rgw realm tokens | jq -r \'"\'"\'.[0].token\'"\'"\' | base64 --decode)\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.realm_name == "myrealm1"\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.endpoint | test("http://.+:\\\\d+")\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.access_key\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.secret\'"\'"\'\n\''

pass 7887054 2024-09-02 21:10:43 2024-09-02 22:12:17 2024-09-02 22:29:16 0:16:59 0:10:52 0:06:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7887055 2024-09-02 21:10:44 2024-09-02 22:12:27 2024-09-02 22:29:25 0:16:58 0:10:05 0:06:53 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7887056 2024-09-02 21:10:46 2024-09-02 22:12:38 2024-09-02 23:05:05 0:52:27 0:42:19 0:10:08 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
fail 7887057 2024-09-02 21:10:47 2024-09-02 22:13:18 2024-09-02 22:55:00 0:41:42 0:34:38 0:07:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887058 2024-09-02 21:10:48 2024-09-02 22:13:49 2024-09-02 22:43:15 0:29:26 0:19:24 0:10:02 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7887059 2024-09-02 21:10:50 2024-09-02 22:13:49 2024-09-02 22:43:34 0:29:45 0:18:01 0:11:44 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7887060 2024-09-02 21:10:51 2024-09-02 22:15:50 2024-09-02 22:46:15 0:30:25 0:20:20 0:10:05 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7887061 2024-09-02 21:10:52 2024-09-02 22:16:30 2024-09-02 22:44:43 0:28:13 0:20:17 0:07:56 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7887062 2024-09-02 21:10:53 2024-09-02 22:17:41 2024-09-02 22:51:35 0:33:54 0:24:27 0:09:27 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7887063 2024-09-02 21:10:55 2024-09-02 22:18:02 2024-09-02 23:13:37 0:55:35 0:45:45 0:09:50 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7887064 2024-09-02 21:10:56 2024-09-02 22:18:02 2024-09-02 22:37:45 0:19:43 0:12:24 0:07:19 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7887065 2024-09-02 21:10:57 2024-09-02 22:18:43 2024-09-02 22:35:58 0:17:15 0:11:11 0:06:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7887066 2024-09-02 21:10:59 2024-09-02 22:18:53 2024-09-02 22:38:05 0:19:12 0:11:19 0:07:53 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7887067 2024-09-02 21:11:00 2024-09-02 22:19:03 2024-09-02 22:36:40 0:17:37 0:10:13 0:07:24 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7887068 2024-09-02 21:11:01 2024-09-02 22:19:14 2024-09-02 22:34:51 0:15:37 0:08:05 0:07:32 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
pass 7887069 2024-09-02 21:11:02 2024-09-02 22:19:45 2024-09-02 22:51:33 0:31:48 0:21:13 0:10:35 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7887070 2024-09-02 21:11:04 2024-09-02 22:19:55 2024-09-02 22:58:18 0:38:23 0:30:27 0:07:56 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7887071 2024-09-02 21:11:05 2024-09-02 22:21:06 2024-09-02 22:56:28 0:35:22 0:28:15 0:07:07 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7887072 2024-09-02 21:11:06 2024-09-02 22:21:26 2024-09-02 22:58:37 0:37:11 0:30:51 0:06:20 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7887073 2024-09-02 21:11:08 2024-09-02 22:21:37 2024-09-02 22:57:28 0:35:51 0:28:46 0:07:05 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7887074 2024-09-02 21:11:09 2024-09-02 22:21:47 2024-09-02 22:38:45 0:16:58 0:10:33 0:06:25 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7887075 2024-09-02 21:11:11 2024-09-02 22:21:48 2024-09-02 22:46:54 0:25:06 0:14:19 0:10:47 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7887076 2024-09-02 21:11:12 2024-09-02 22:23:08 2024-09-02 22:51:20 0:28:12 0:20:40 0:07:32 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
fail 7887077 2024-09-02 21:11:13 2024-09-02 22:24:19 2024-09-02 22:43:09 0:18:50 0:07:47 0:11:03 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi159 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7887078 2024-09-02 21:11:15 2024-09-02 22:25:19 2024-09-02 22:44:38 0:19:19 0:09:32 0:09:47 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7887079 2024-09-02 21:11:16 2024-09-02 22:27:00 2024-09-02 22:45:59 0:18:59 0:12:20 0:06:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7887080 2024-09-02 21:11:17 2024-09-02 22:27:01 2024-09-02 22:55:11 0:28:10 0:18:56 0:09:14 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7887081 2024-09-02 21:11:19 2024-09-02 22:27:41 2024-09-02 22:42:50 0:15:09 0:08:03 0:07:06 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7887082 2024-09-02 21:11:20 2024-09-02 22:27:52 2024-09-02 23:23:02 0:55:10 0:44:41 0:10:29 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7887083 2024-09-02 21:11:22 2024-09-02 22:29:22 2024-09-02 22:59:01 0:29:39 0:19:28 0:10:11 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7887084 2024-09-02 21:11:23 2024-09-02 22:29:33 2024-09-02 22:48:38 0:19:05 0:12:29 0:06:36 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7887085 2024-09-02 21:11:24 2024-09-02 22:29:43 2024-09-02 23:00:57 0:31:14 0:19:30 0:11:44 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7887086 2024-09-02 21:11:26 2024-09-02 22:31:24 2024-09-02 23:02:57 0:31:33 0:20:49 0:10:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7887087 2024-09-02 21:11:27 2024-09-02 22:31:24 2024-09-02 22:51:14 0:19:50 0:10:54 0:08:56 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7887088 2024-09-02 21:11:28 2024-09-02 22:33:45 2024-09-02 22:45:53 0:12:08 0:03:28 0:08:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7887089 2024-09-02 21:11:30 2024-09-02 22:34:26 2024-09-02 22:52:12 0:17:46 0:10:54 0:06:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7887090 2024-09-02 21:11:31 2024-09-02 22:35:07 2024-09-02 23:23:07 0:48:00 0:40:17 0:07:43 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c5a98da4-697c-11ef-bcd5-c7b262605968 -e sha1=4a24861198cbbd7c00ffec1cc106c51135f10976 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7887091 2024-09-02 21:11:32 2024-09-02 22:36:07 2024-09-02 23:29:46 0:53:39 0:46:29 0:07:10 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
fail 7887092 2024-09-02 21:11:34 2024-09-02 22:36:48 2024-09-02 23:20:20 0:43:32 0:35:24 0:08:08 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887093 2024-09-02 21:11:35 2024-09-02 22:36:58 2024-09-02 23:05:27 0:28:29 0:20:08 0:08:21 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7887094 2024-09-02 21:11:36 2024-09-02 22:38:19 2024-09-02 22:53:51 0:15:32 0:08:16 0:07:16 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7887095 2024-09-02 21:11:38 2024-09-02 22:38:59 2024-09-02 22:56:06 0:17:07 0:10:12 0:06:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7887096 2024-09-02 21:11:39 2024-09-02 22:39:00 2024-09-02 22:56:51 0:17:51 0:10:29 0:07:22 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7887097 2024-09-02 21:11:41 2024-09-02 22:40:00 2024-09-02 22:57:30 0:17:30 0:10:20 0:07:10 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7887098 2024-09-02 21:11:42 2024-09-02 22:40:41 2024-09-02 23:12:33 0:31:52 0:20:00 0:11:52 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7887099 2024-09-02 21:11:43 2024-09-02 22:43:02 2024-09-02 23:08:04 0:25:02 0:18:12 0:06:50 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
dead 7887100 2024-09-02 21:11:45 2024-09-02 22:43:02 2024-09-03 06:52:26 8:09:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7887101 2024-09-02 21:11:46 2024-09-02 22:43:33 2024-09-02 23:00:25 0:16:52 0:08:34 0:08:18 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7887102 2024-09-02 21:11:47 2024-09-02 22:44:53 2024-09-02 23:18:39 0:33:46 0:22:52 0:10:54 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
pass 7887103 2024-09-02 21:11:48 2024-09-02 22:45:04 2024-09-02 23:05:50 0:20:46 0:11:38 0:09:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7887104 2024-09-02 21:11:50 2024-09-02 22:46:15 2024-09-02 23:29:23 0:43:08 0:35:55 0:07:13 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887105 2024-09-02 21:11:51 2024-09-02 22:46:25 2024-09-02 23:10:15 0:23:50 0:12:51 0:10:59 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7887106 2024-09-02 21:11:53 2024-09-02 22:46:35 2024-09-02 23:04:32 0:17:57 0:09:30 0:08:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7887107 2024-09-02 21:11:54 2024-09-02 22:47:16 2024-09-02 23:16:30 0:29:14 0:19:03 0:10:11 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7887108 2024-09-02 21:11:55 2024-09-02 22:48:57 2024-09-02 23:10:06 0:21:09 0:11:57 0:09:12 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7887109 2024-09-02 21:11:57 2024-09-02 22:51:18 2024-09-02 23:18:44 0:27:26 0:18:47 0:08:39 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7887110 2024-09-02 21:11:58 2024-09-02 22:51:18 2024-09-03 00:03:33 1:12:15 1:02:34 0:09:41 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7887111 2024-09-02 21:11:59 2024-09-02 22:51:29 2024-09-02 23:08:40 0:17:11 0:09:37 0:07:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7887112 2024-09-02 21:12:00 2024-09-02 22:51:29 2024-09-02 23:08:02 0:16:33 0:10:14 0:06:19 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7887113 2024-09-02 21:12:02 2024-09-02 22:51:30 2024-09-02 23:08:27 0:16:57 0:10:19 0:06:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7887114 2024-09-02 21:12:03 2024-09-02 22:51:30 2024-09-02 23:41:24 0:49:54 0:41:10 0:08:44 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7887115 2024-09-02 21:12:04 2024-09-02 22:51:50 2024-09-02 23:18:51 0:27:01 0:20:29 0:06:32 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7887116 2024-09-02 21:12:06 2024-09-02 22:51:51 2024-09-02 23:24:07 0:32:16 0:22:09 0:10:07 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7887117 2024-09-02 21:12:07 2024-09-02 22:52:21 2024-09-02 23:16:41 0:24:20 0:15:46 0:08:34 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7887118 2024-09-02 21:12:08 2024-09-02 22:53:12 2024-09-02 23:07:37 0:14:25 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Failed to reconnect to smithi062

fail 7887119 2024-09-02 21:12:09 2024-09-02 22:54:03 2024-09-02 23:30:19 0:36:16 0:29:08 0:07:08 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-02T23:20:00.000329+0000 mon.smithi121 (mon.0) 403 : cluster [WRN] osd.3 (root=default,host=smithi167) is down" in cluster log

pass 7887120 2024-09-02 21:12:11 2024-09-02 22:55:13 2024-09-02 23:12:21 0:17:08 0:10:30 0:06:38 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7887121 2024-09-02 21:12:12 2024-09-02 22:55:24 2024-09-02 23:22:33 0:27:09 0:14:35 0:12:34 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
fail 7887122 2024-09-02 21:12:14 2024-09-02 22:56:24 2024-09-02 23:14:39 0:18:15 0:07:57 0:10:18 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi017 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7887123 2024-09-02 21:12:15 2024-09-02 22:57:05 2024-09-02 23:12:34 0:15:29 0:07:44 0:07:45 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7887124 2024-09-02 21:12:16 2024-09-02 22:57:45 2024-09-02 23:14:44 0:16:59 0:10:21 0:06:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7887125 2024-09-02 21:12:17 2024-09-02 22:57:46 2024-09-02 23:28:11 0:30:25 0:20:06 0:10:19 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
pass 7887126 2024-09-02 21:12:19 2024-09-02 22:58:36 2024-09-02 23:13:46 0:15:10 0:08:21 0:06:49 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7887127 2024-09-02 21:12:20 2024-09-02 23:31:18 1506 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7887128 2024-09-02 21:12:21 2024-09-02 23:00:07 2024-09-02 23:19:38 0:19:31 0:11:36 0:07:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
dead 7887129 2024-09-02 21:12:23 2024-09-02 23:00:38 2024-09-03 07:11:22 8:10:44 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

hit max job timeout

pass 7887130 2024-09-02 21:12:24 2024-09-02 23:01:19 2024-09-02 23:39:35 0:38:16 0:25:58 0:12:18 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7887131 2024-09-02 21:12:25 2024-09-02 23:03:19 2024-09-02 23:35:47 0:32:28 0:22:05 0:10:23 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7887132 2024-09-02 21:12:27 2024-09-02 23:04:10 2024-09-02 23:22:04 0:17:54 0:10:06 0:07:48 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7887133 2024-09-02 21:12:28 2024-09-02 23:04:51 2024-09-02 23:22:19 0:17:28 0:11:09 0:06:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7887134 2024-09-02 21:12:29 2024-09-02 23:05:21 2024-09-02 23:59:24 0:54:03 0:44:28 0:09:35 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7887135 2024-09-02 21:12:30 2024-09-02 23:05:41 2024-09-02 23:24:41 0:19:00 0:12:07 0:06:53 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
fail 7887136 2024-09-02 21:12:32 2024-09-02 23:05:42 2024-09-02 23:49:38 0:43:56 0:35:36 0:08:20 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7887137 2024-09-02 21:12:33 2024-09-02 23:06:02 2024-09-02 23:23:03 0:17:01 0:11:07 0:05:54 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7887138 2024-09-02 21:12:35 2024-09-02 23:06:13 2024-09-02 23:24:52 0:18:39 0:09:22 0:09:17 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7887139 2024-09-02 21:12:36 2024-09-02 23:07:54 2024-09-02 23:27:00 0:19:06 0:13:11 0:05:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7887140 2024-09-02 21:12:37 2024-09-02 23:08:14 2024-09-02 23:45:51 0:37:37 0:30:20 0:07:17 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7887141 2024-09-02 21:12:38 2024-09-02 23:08:45 2024-09-02 23:42:49 0:34:04 0:23:11 0:10:53 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7887142 2024-09-02 21:12:40 2024-09-02 23:08:55 2024-09-02 23:41:17 0:32:22 0:25:04 0:07:18 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7887143 2024-09-02 21:12:41 2024-09-02 23:10:16 2024-09-02 23:25:40 0:15:24 0:09:02 0:06:22 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
Failure Reason:

"2024-09-02T23:24:15.035876+0000 mon.a (mon.0) 342 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7887144 2024-09-02 21:12:42 2024-09-02 23:10:36 2024-09-02 23:29:41 0:19:05 0:10:17 0:08:48 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7887145 2024-09-02 21:12:44 2024-09-02 23:12:47 2024-09-02 23:29:43 0:16:56 0:11:15 0:05:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7887146 2024-09-02 21:12:45 2024-09-02 23:12:47 2024-09-02 23:28:53 0:16:06 0:08:50 0:07:16 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7887147 2024-09-02 21:12:46 2024-09-02 23:13:48 2024-09-02 23:32:47 0:18:59 0:11:58 0:07:01 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7887148 2024-09-02 21:12:47 2024-09-02 23:13:58 2024-09-02 23:30:58 0:17:00 0:10:53 0:06:07 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
pass 7887149 2024-09-02 21:12:49 2024-09-02 23:13:59 2024-09-02 23:33:40 0:19:41 0:12:16 0:07:25 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7887150 2024-09-02 21:12:50 2024-09-02 23:14:39 2024-09-02 23:40:13 0:25:34 0:18:21 0:07:13 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 7887151 2024-09-02 21:12:52 2024-09-02 23:50:01 1714 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-09-02T23:40:00.000137+0000 mon.smithi017 (mon.0) 470 : cluster [WRN] osd.4 (root=default,host=smithi204) is down" in cluster log

pass 7887152 2024-09-02 21:12:53 2024-09-02 23:14:50 2024-09-03 00:03:57 0:49:07 0:38:12 0:10:55 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7887153 2024-09-02 21:12:54 2024-09-02 23:16:11 2024-09-02 23:44:27 0:28:16 0:18:23 0:09:53 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7887154 2024-09-02 21:12:56 2024-09-02 23:16:52 2024-09-02 23:46:27 0:29:35 0:19:10 0:10:25 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2