Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7765784 2024-06-20 17:50:19 2024-06-20 22:55:30 2024-06-20 23:37:06 0:41:36 0:32:43 0:08:53 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7765785 2024-06-20 17:50:20 2024-06-20 22:55:31 2024-06-20 23:28:57 0:33:26 0:22:21 0:11:05 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7765786 2024-06-20 17:50:21 2024-06-20 22:57:12 2024-06-20 23:20:21 0:23:09 0:14:32 0:08:37 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7765787 2024-06-20 17:50:22 2024-06-20 22:57:23 2024-06-20 23:23:20 0:25:57 0:14:20 0:11:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7765788 2024-06-20 17:50:22 2024-06-20 22:59:55 2024-06-20 23:22:38 0:22:43 0:11:00 0:11:43 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7765789 2024-06-20 17:50:23 2024-06-20 23:01:26 2024-06-20 23:27:12 0:25:46 0:15:23 0:10:23 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7765790 2024-06-20 17:50:24 2024-06-20 23:01:57 2024-06-20 23:30:33 0:28:36 0:13:13 0:15:23 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7765791 2024-06-20 17:50:25 2024-06-20 23:07:00 2024-06-20 23:42:46 0:35:46 0:19:10 0:16:36 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7765792 2024-06-20 17:50:26 2024-06-20 23:13:03 2024-06-20 23:50:25 0:37:22 0:18:57 0:18:25 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7765793 2024-06-20 17:50:26 2024-06-20 23:21:19 2024-06-20 23:52:55 0:31:36 0:20:58 0:10:38 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7765794 2024-06-20 17:50:27 2024-06-20 23:22:40 2024-06-20 23:51:30 0:28:50 0:17:11 0:11:39 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7765795 2024-06-20 17:50:28 2024-06-20 23:23:21 2024-06-21 00:10:35 0:47:14 0:32:38 0:14:36 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7765796 2024-06-20 17:50:29 2024-06-20 23:27:14 2024-06-20 23:54:14 0:27:00 0:14:37 0:12:23 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7765797 2024-06-20 17:50:30 2024-06-20 23:29:06 2024-06-21 00:14:08 0:45:02 0:35:54 0:09:08 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7765798 2024-06-20 17:50:31 2024-06-20 23:29:06 2024-06-20 23:54:59 0:25:53 0:15:15 0:10:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7765799 2024-06-20 17:50:31 2024-06-20 23:29:17 2024-06-20 23:52:15 0:22:58 0:13:49 0:09:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} 1
pass 7765800 2024-06-20 17:50:32 2024-06-20 23:29:18 2024-06-20 23:53:13 0:23:55 0:13:50 0:10:05 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7765801 2024-06-20 17:50:33 2024-06-20 23:30:09 2024-06-20 23:55:11 0:25:02 0:07:27 0:17:35 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi084 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7765802 2024-06-20 17:50:34 2024-06-20 23:37:04 2024-06-21 00:46:59 1:09:55 0:59:06 0:10:49 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7765803 2024-06-20 17:50:35 2024-06-20 23:37:15 2024-06-21 00:14:52 0:37:37 0:22:54 0:14:43 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7765804 2024-06-20 17:50:35 2024-06-20 23:41:08 2024-06-21 00:14:23 0:33:15 0:23:20 0:09:55 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7765805 2024-06-20 17:50:36 2024-06-20 23:41:09 2024-06-21 00:43:46 1:02:37 0:43:58 0:18:39 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7765806 2024-06-20 17:50:37 2024-06-20 23:50:35 2024-06-21 00:29:40 0:39:05 0:29:09 0:09:56 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7765807 2024-06-20 17:50:38 2024-06-20 23:50:36 2024-06-21 00:16:30 0:25:54 0:15:01 0:10:53 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7765808 2024-06-20 17:50:39 2024-06-20 23:51:07 2024-06-21 00:14:31 0:23:24 0:14:00 0:09:24 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
fail 7765809 2024-06-20 17:50:39 2024-06-20 23:51:08 2024-06-21 00:27:01 0:35:53 0:22:32 0:13:21 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-06-21T00:09:58.019893+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7765810 2024-06-20 17:50:40 2024-06-20 23:52:59 2024-06-21 00:16:24 0:23:25 0:12:27 0:10:58 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7765811 2024-06-20 17:50:41 2024-06-20 23:53:20 2024-06-21 00:30:11 0:36:51 0:25:58 0:10:53 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7765812 2024-06-20 17:50:42 2024-06-20 23:54:22 2024-06-21 00:22:39 0:28:17 0:16:43 0:11:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7765813 2024-06-20 17:50:43 2024-06-20 23:55:03 2024-06-21 00:15:57 0:20:54 0:11:36 0:09:18 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7765814 2024-06-20 17:50:43 2024-06-20 23:55:04 2024-06-21 00:16:48 0:21:44 0:11:25 0:10:19 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7765815 2024-06-20 17:50:44 2024-06-20 23:55:15 2024-06-21 00:10:49 0:15:34 0:06:06 0:09:28 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7765816 2024-06-20 17:50:45 2024-06-20 23:55:46 2024-06-21 00:22:46 0:27:00 0:16:31 0:10:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7765817 2024-06-20 17:50:46 2024-06-20 23:55:57 2024-06-21 00:59:18 1:03:21 0:50:36 0:12:45 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7765818 2024-06-20 17:50:47 2024-06-21 00:00:20 2024-06-21 00:30:17 0:29:57 0:19:20 0:10:37 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7765819 2024-06-20 17:50:47 2024-06-21 00:00:32 2024-06-21 01:22:05 1:21:33 1:05:37 0:15:56 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7765820 2024-06-20 17:50:48 2024-06-21 00:07:38 2024-06-21 00:41:07 0:33:29 0:21:08 0:12:21 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7765821 2024-06-20 17:50:49 2024-06-21 00:08:59 2024-06-21 00:43:16 0:34:17 0:21:00 0:13:17 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7765822 2024-06-20 17:50:50 2024-06-21 00:10:41 2024-06-21 00:35:56 0:25:15 0:14:48 0:10:27 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7765823 2024-06-20 17:50:51 2024-06-21 00:10:53 2024-06-21 00:48:00 0:37:07 0:23:30 0:13:37 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7765824 2024-06-20 17:50:51 2024-06-21 00:12:55 2024-06-21 00:35:16 0:22:21 0:11:06 0:11:15 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7765825 2024-06-20 17:50:52 2024-06-21 00:14:16 2024-06-21 00:37:36 0:23:20 0:13:36 0:09:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
dead 7765826 2024-06-20 17:50:53 2024-06-21 00:14:27 2024-06-21 00:34:08 0:19:41 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7765827 2024-06-20 17:50:54 2024-06-21 00:14:38 2024-06-21 00:40:18 0:25:40 0:15:30 0:10:10 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
pass 7765828 2024-06-20 17:50:55 2024-06-21 00:14:59 2024-06-21 00:46:15 0:31:16 0:20:19 0:10:57 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7765829 2024-06-20 17:50:55 2024-06-21 00:16:32 2024-06-21 01:02:22 0:45:50 0:34:42 0:11:08 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7765830 2024-06-20 17:50:56 2024-06-21 00:16:34 2024-06-21 00:58:34 0:42:00 0:30:26 0:11:34 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7765831 2024-06-20 17:50:57 2024-06-21 00:16:56 2024-06-21 00:43:40 0:26:44 0:14:36 0:12:08 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7765832 2024-06-20 17:50:58 2024-06-21 00:18:09 2024-06-21 00:48:25 0:30:16 0:17:07 0:13:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7765833 2024-06-20 17:50:59 2024-06-21 00:21:25 2024-06-21 00:45:05 0:23:40 0:12:20 0:11:20 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-06-21T00:40:00.000204+0000 mon.a (mon.0) 488 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

fail 7765834 2024-06-20 17:50:59 2024-06-21 00:22:07 2024-06-21 01:20:08 0:58:01 0:47:38 0:10:23 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-06-21T00:54:12.634708+0000 mon.a (mon.0) 928 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

dead 7765835 2024-06-20 17:51:00 2024-06-21 00:22:19 2024-06-21 00:27:08 0:04:49 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

Error reimaging machines: list index out of range

pass 7765836 2024-06-20 17:51:01 2024-06-21 00:22:21 2024-06-21 00:51:50 0:29:29 0:15:12 0:14:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7765837 2024-06-20 17:51:02 2024-06-21 00:26:57 2024-06-21 00:49:42 0:22:45 0:13:45 0:09:00 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7765838 2024-06-20 17:51:03 2024-06-21 00:26:59 2024-06-21 00:48:39 0:21:40 0:12:13 0:09:27 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7765839 2024-06-20 17:51:04 2024-06-21 00:27:11 2024-06-21 00:51:14 0:24:03 0:13:16 0:10:47 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7765840 2024-06-20 17:51:04 2024-06-21 00:27:13 2024-06-21 00:59:36 0:32:23 0:19:34 0:12:49 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7765841 2024-06-20 17:51:05 2024-06-21 00:29:58 2024-06-21 01:00:12 0:30:14 0:19:25 0:10:49 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7765842 2024-06-20 17:51:06 2024-06-21 00:30:20 2024-06-21 00:53:30 0:23:10 0:13:18 0:09:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7765843 2024-06-20 17:51:07 2024-06-21 00:30:22 2024-06-21 01:07:19 0:36:57 0:26:44 0:10:13 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7765844 2024-06-20 17:51:08 2024-06-21 00:31:45 2024-06-21 00:57:38 0:25:53 0:14:08 0:11:45 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7765845 2024-06-20 17:51:08 2024-06-21 00:34:49 2024-06-21 01:22:36 0:47:47 0:37:06 0:10:41 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7765846 2024-06-20 17:51:09 2024-06-21 00:34:50 2024-06-21 00:52:27 0:17:37 0:07:29 0:10:08 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi110 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7765847 2024-06-20 17:51:10 2024-06-21 00:35:10 2024-06-21 01:06:52 0:31:42 0:22:03 0:09:39 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7765848 2024-06-20 17:51:11 2024-06-21 00:35:21 2024-06-21 01:05:43 0:30:22 0:19:54 0:10:28 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7765849 2024-06-20 17:51:12 2024-06-21 00:36:02 2024-06-21 01:23:02 0:47:00 0:35:01 0:11:59 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7765850 2024-06-20 17:51:12 2024-06-21 00:37:14 2024-06-21 01:21:15 0:44:01 0:33:02 0:10:59 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7765851 2024-06-20 17:51:13 2024-06-21 00:37:35 2024-06-21 01:01:14 0:23:39 0:13:13 0:10:26 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7765852 2024-06-20 17:51:14 2024-06-21 00:37:46 2024-06-21 01:00:42 0:22:56 0:13:14 0:09:42 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7765853 2024-06-20 17:51:15 2024-06-21 00:37:47 2024-06-21 00:58:33 0:20:46 0:11:41 0:09:05 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7765854 2024-06-20 17:51:16 2024-06-21 00:37:48 2024-06-21 00:59:42 0:21:54 0:11:00 0:10:54 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7765855 2024-06-20 17:51:16 2024-06-21 00:37:49 2024-06-21 01:03:51 0:26:02 0:15:30 0:10:32 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7765856 2024-06-20 17:51:17 2024-06-21 00:37:49 2024-06-21 01:05:50 0:28:01 0:14:14 0:13:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7765857 2024-06-20 17:51:18 2024-06-21 00:40:21 2024-06-21 01:10:41 0:30:20 0:20:11 0:10:09 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
pass 7765858 2024-06-20 17:51:19 2024-06-21 00:40:22 2024-06-21 01:01:52 0:21:30 0:11:52 0:09:38 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7765859 2024-06-20 17:51:20 2024-06-21 00:40:43 2024-06-21 01:06:19 0:25:36 0:14:56 0:10:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
dead 7765860 2024-06-20 17:51:20 2024-06-21 00:41:14 2024-06-21 12:47:59 12:06:45 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7765861 2024-06-20 17:51:21 2024-06-21 00:41:25 2024-06-21 01:10:52 0:29:27 0:16:40 0:12:47 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7765862 2024-06-20 17:51:22 2024-06-21 00:43:37 2024-06-21 01:17:58 0:34:21 0:22:56 0:11:25 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7765863 2024-06-20 17:51:23 2024-06-21 00:43:48 2024-06-21 01:07:27 0:23:39 0:13:50 0:09:49 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7765864 2024-06-20 17:51:24 2024-06-21 00:43:49 2024-06-21 01:26:04 0:42:15 0:32:04 0:10:11 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7765865 2024-06-20 17:51:25 2024-06-21 00:45:11 2024-06-21 01:10:01 0:24:50 0:15:11 0:09:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7765866 2024-06-20 17:51:25 2024-06-21 00:45:12 2024-06-21 01:49:31 1:04:19 0:52:39 0:11:40 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7765867 2024-06-20 17:51:26 2024-06-21 00:46:24 2024-06-21 01:10:30 0:24:06 0:12:59 0:11:07 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7765868 2024-06-20 17:51:27 2024-06-21 00:47:06 2024-06-21 01:11:14 0:24:08 0:13:31 0:10:37 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7765869 2024-06-20 17:51:28 2024-06-21 00:47:38 2024-06-21 01:15:57 0:28:19 0:16:50 0:11:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7765870 2024-06-20 17:51:29 2024-06-21 00:48:09 2024-06-21 01:09:09 0:21:00 0:11:45 0:09:15 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
pass 7765871 2024-06-20 17:51:29 2024-06-21 00:48:10 2024-06-21 01:21:49 0:33:39 0:24:45 0:08:54 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7765872 2024-06-20 17:51:30 2024-06-21 00:48:11 2024-06-21 01:21:36 0:33:25 0:23:09 0:10:16 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7765873 2024-06-20 17:51:31 2024-06-21 00:48:33 2024-06-21 01:11:58 0:23:25 0:13:15 0:10:10 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7765874 2024-06-20 17:51:32 2024-06-21 00:48:54 2024-06-21 01:25:15 0:36:21 0:25:53 0:10:28 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7765875 2024-06-20 17:51:33 2024-06-21 00:49:46 2024-06-21 01:17:18 0:27:32 0:14:56 0:12:36 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7765876 2024-06-20 17:51:33 2024-06-21 00:51:17 2024-06-21 01:14:29 0:23:12 0:11:11 0:12:01 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7765877 2024-06-20 17:51:34 2024-06-21 00:53:20 2024-06-21 01:22:55 0:29:35 0:19:21 0:10:14 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7765878 2024-06-20 17:51:35 2024-06-21 00:53:21 2024-06-21 01:16:11 0:22:50 0:13:59 0:08:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7765879 2024-06-20 17:51:36 2024-06-21 00:53:22 2024-06-21 01:42:48 0:49:26 0:37:06 0:12:20 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7765880 2024-06-20 17:51:37 2024-06-21 00:55:24 2024-06-21 01:45:27 0:50:03 0:38:08 0:11:55 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7765881 2024-06-20 17:51:37 2024-06-21 00:56:55 2024-06-21 01:25:17 0:28:22 0:18:27 0:09:55 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7765882 2024-06-20 17:51:38 2024-06-21 00:57:46 2024-06-21 01:28:21 0:30:35 0:20:05 0:10:30 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7765883 2024-06-20 17:51:39 2024-06-21 00:57:57 2024-06-21 01:12:22 0:14:25 0:06:16 0:08:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7765884 2024-06-20 17:51:40 2024-06-21 00:57:58 2024-06-21 02:12:10 1:14:12 1:03:45 0:10:27 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7765885 2024-06-20 17:51:41 2024-06-21 00:58:39 2024-06-21 01:30:47 0:32:08 0:21:00 0:11:08 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7765886 2024-06-20 17:51:41 2024-06-21 00:58:40 2024-06-21 01:40:18 0:41:38 0:31:06 0:10:32 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7765887 2024-06-20 17:51:42 2024-06-21 00:59:21 2024-06-21 01:50:49 0:51:28 0:42:40 0:08:48 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi098 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 554299e8-2f6b-11ef-bc9d-c7b262605968 -e sha1=c65be8102fd0c62c21484f7d2c7085bf8cb6a8fd -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7765888 2024-06-20 17:51:43 2024-06-21 00:59:42 2024-06-21 01:26:57 0:27:15 0:17:17 0:09:58 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7765889 2024-06-20 17:51:44 2024-06-21 00:59:53 2024-06-21 01:23:31 0:23:38 0:13:55 0:09:43 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-06-21T01:22:08.485515+0000 mon.a (mon.0) 40 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

fail 7765890 2024-06-20 17:51:45 2024-06-21 01:00:14 2024-06-21 01:17:50 0:17:36 0:07:29 0:10:07 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi112 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7765891 2024-06-20 17:51:45 2024-06-21 01:00:25 2024-06-21 01:34:18 0:33:53 0:22:57 0:10:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7765892 2024-06-20 17:51:46 2024-06-21 01:00:47 2024-06-21 02:02:40 1:01:53 0:51:43 0:10:10 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
fail 7765893 2024-06-20 17:51:47 2024-06-21 01:01:18 2024-06-21 01:48:55 0:47:37 0:37:27 0:10:10 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7765894 2024-06-20 17:51:48 2024-06-21 01:01:30 2024-06-21 01:55:03 0:53:33 0:44:11 0:09:22 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7765895 2024-06-20 17:51:49 2024-06-21 01:02:02 2024-06-21 01:51:35 0:49:33 0:40:31 0:09:02 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7765896 2024-06-20 17:51:49 2024-06-21 01:02:03 2024-06-21 01:20:53 0:18:50 0:09:54 0:08:56 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_adoption} 1
pass 7765897 2024-06-20 17:51:50 2024-06-21 01:02:05 2024-06-21 01:25:58 0:23:53 0:11:48 0:12:05 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
pass 7765898 2024-06-20 17:51:51 2024-06-21 01:02:26 2024-06-21 01:25:43 0:23:17 0:12:48 0:10:29 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7765899 2024-06-20 17:51:52 2024-06-21 01:02:59 2024-06-21 01:40:45 0:37:46 0:26:06 0:11:40 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-06-21T01:20:32.351072+0000 mon.a (mon.0) 208 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7765900 2024-06-20 17:51:53 2024-06-21 01:03:31 2024-06-21 01:26:56 0:23:25 0:12:41 0:10:44 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7765901 2024-06-20 17:51:53 2024-06-21 01:03:54 2024-06-21 01:30:05 0:26:11 0:14:48 0:11:23 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7765902 2024-06-20 17:51:54 2024-06-21 01:03:55 2024-06-21 01:28:10 0:24:15 0:14:19 0:09:56 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7765903 2024-06-20 17:51:55 2024-06-21 01:04:57 2024-06-21 01:25:56 0:20:59 0:11:35 0:09:24 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7765904 2024-06-20 17:51:56 2024-06-21 01:05:01 2024-06-21 01:28:49 0:23:48 0:11:37 0:12:11 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7765905 2024-06-20 17:51:57 2024-06-21 01:05:12 2024-06-21 01:39:30 0:34:18 0:23:44 0:10:34 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
pass 7765906 2024-06-20 17:51:57 2024-06-21 01:05:54 2024-06-21 01:29:37 0:23:43 0:13:57 0:09:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7765907 2024-06-20 17:51:58 2024-06-21 01:06:27 2024-06-21 01:47:33 0:41:06 0:31:21 0:09:45 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7765908 2024-06-20 17:51:59 2024-06-21 01:06:28 2024-06-21 01:36:25 0:29:57 0:20:31 0:09:26 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7765909 2024-06-20 17:52:00 2024-06-21 01:07:00 2024-06-21 01:32:42 0:25:42 0:14:42 0:11:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7765910 2024-06-20 17:52:01 2024-06-21 01:07:32 2024-06-21 01:30:51 0:23:19 0:13:13 0:10:06 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7765911 2024-06-20 17:52:01 2024-06-21 01:07:34 2024-06-21 01:30:25 0:22:51 0:13:31 0:09:20 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7765912 2024-06-20 17:52:02 2024-06-21 01:07:35 2024-06-21 01:30:40 0:23:05 0:13:27 0:09:38 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_cephadm_timeout} 1
pass 7765913 2024-06-20 17:52:03 2024-06-21 01:07:36 2024-06-21 01:29:17 0:21:41 0:11:19 0:10:22 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7765914 2024-06-20 17:52:04 2024-06-21 01:08:29 2024-06-21 01:31:29 0:23:00 0:14:20 0:08:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7765915 2024-06-20 17:52:05 2024-06-21 01:08:40 2024-06-21 01:49:45 0:41:05 0:32:04 0:09:01 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7765916 2024-06-20 17:52:06 2024-06-21 01:08:52 2024-06-21 01:59:00 0:50:08 0:40:33 0:09:35 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7765917 2024-06-20 17:52:06 2024-06-21 01:09:14 2024-06-21 01:41:31 0:32:17 0:22:41 0:09:36 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7765918 2024-06-20 17:52:07 2024-06-21 01:10:06 2024-06-21 01:56:08 0:46:02 0:35:13 0:10:49 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7765919 2024-06-20 17:52:08 2024-06-21 01:10:27 2024-06-21 01:40:03 0:29:36 0:19:00 0:10:36 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7765920 2024-06-20 17:52:09 2024-06-21 01:10:49 2024-06-21 01:58:12 0:47:23 0:36:27 0:10:56 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7765921 2024-06-20 17:52:10 2024-06-21 01:11:01 2024-06-21 01:36:26 0:25:25 0:15:06 0:10:19 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7765922 2024-06-20 17:52:10 2024-06-21 01:11:02 2024-06-21 01:37:00 0:25:58 0:15:36 0:10:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7765923 2024-06-20 17:52:11 2024-06-21 01:11:23 2024-06-21 01:35:30 0:24:07 0:12:15 0:11:52 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7765924 2024-06-20 17:52:12 2024-06-21 01:12:25 2024-06-21 01:44:41 0:32:16 0:20:28 0:11:48 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7765925 2024-06-20 17:52:13 2024-06-21 01:13:17 2024-06-21 01:39:28 0:26:11 0:15:56 0:10:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7765926 2024-06-20 17:52:14 2024-06-21 01:14:40 2024-06-21 01:48:41 0:34:01 0:21:15 0:12:46 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
dead 7765927 2024-06-20 17:52:14 2024-06-21 01:16:02 2024-06-21 01:16:14 0:00:12 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli} 1
pass 7765928 2024-06-20 17:52:15 2024-06-21 01:16:14 2024-06-21 01:45:51 0:29:37 0:19:28 0:10:09 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7765929 2024-06-20 17:52:16 2024-06-21 01:16:15 2024-06-21 01:52:08 0:35:53 0:24:03 0:11:50 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
fail 7765930 2024-06-20 17:52:17 2024-06-21 01:17:27 2024-06-21 02:04:56 0:47:29 0:37:50 0:09:39 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7765931 2024-06-20 17:52:18 2024-06-21 01:17:48 2024-06-21 01:45:32 0:27:44 0:16:38 0:11:06 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7765932 2024-06-20 17:52:18 2024-06-21 01:18:00 2024-06-21 01:40:50 0:22:50 0:13:25 0:09:25 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7765933 2024-06-20 17:52:19 2024-06-21 01:18:01 2024-06-21 01:48:47 0:30:46 0:16:08 0:14:38 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7765934 2024-06-20 17:52:20 2024-06-21 01:21:05 2024-06-21 01:46:27 0:25:22 0:14:47 0:10:35 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
fail 7765935 2024-06-20 17:52:21 2024-06-21 01:21:26 2024-06-21 01:39:31 0:18:05 0:07:27 0:10:38 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi129 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7765936 2024-06-20 17:52:22 2024-06-21 01:21:58 2024-06-21 02:29:38 1:07:40 0:57:06 0:10:34 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
fail 7765937 2024-06-20 17:52:23 2024-06-21 01:22:09 2024-06-21 01:54:13 0:32:04 0:22:44 0:09:20 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-06-21T01:50:00.000242+0000 mon.smithi042 (mon.0) 816 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7765938 2024-06-20 17:52:23 2024-06-21 01:22:41 2024-06-21 01:56:01 0:33:20 0:23:16 0:10:04 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7765939 2024-06-20 17:52:24 2024-06-21 01:23:03 2024-06-21 01:59:53 0:36:50 0:24:16 0:12:34 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli_mon} 5
pass 7765940 2024-06-20 17:52:25 2024-06-21 01:24:05 2024-06-21 01:47:59 0:23:54 0:14:15 0:09:39 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7765941 2024-06-20 17:52:26 2024-06-21 01:24:16 2024-06-21 01:46:29 0:22:13 0:11:57 0:10:16 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7765942 2024-06-20 17:52:27 2024-06-21 01:25:18 2024-06-21 02:00:54 0:35:36 0:25:24 0:10:12 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7765943 2024-06-20 17:52:27 2024-06-21 01:25:19 2024-06-21 01:51:23 0:26:04 0:14:08 0:11:56 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7765944 2024-06-20 17:52:28 2024-06-21 01:26:01 2024-06-21 01:48:41 0:22:40 0:13:23 0:09:17 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
pass 7765945 2024-06-20 17:52:29 2024-06-21 01:26:02 2024-06-21 01:47:11 0:21:09 0:12:41 0:08:28 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
fail 7765946 2024-06-20 17:52:30 2024-06-21 01:26:14 2024-06-21 02:04:03 0:37:49 0:27:22 0:10:27 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-06-21T01:51:42.781372+0000 mon.a (mon.0) 954 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7765947 2024-06-20 17:52:31 2024-06-21 01:27:06 2024-06-21 01:50:02 0:22:56 0:11:45 0:11:11 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7765948 2024-06-20 17:52:31 2024-06-21 01:27:07 2024-06-21 01:53:04 0:25:57 0:15:13 0:10:44 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7765949 2024-06-20 17:52:32 2024-06-21 01:28:20 2024-06-21 02:12:12 0:43:52 0:33:35 0:10:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7765950 2024-06-20 17:52:33 2024-06-21 01:28:32 2024-06-21 02:10:27 0:41:55 0:31:57 0:09:58 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-06-21T02:00:00.000252+0000 mon.smithi028 (mon.0) 380 : cluster 3 [WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering" in cluster log

pass 7765951 2024-06-20 17:52:34 2024-06-21 01:28:53 2024-06-21 02:04:50 0:35:57 0:26:43 0:09:14 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7765952 2024-06-20 17:52:35 2024-06-21 01:29:25 2024-06-21 01:54:19 0:24:54 0:15:35 0:09:19 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c65be8102fd0c62c21484f7d2c7085bf8cb6a8fd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7765953 2024-06-20 17:52:35 2024-06-21 01:29:26 2024-06-21 01:55:28 0:26:02 0:15:33 0:10:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7765954 2024-06-20 17:52:36 2024-06-21 01:29:49 2024-06-21 02:32:19 1:02:30 0:51:51 0:10:39 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7765955 2024-06-20 17:52:37 2024-06-21 01:30:10 2024-06-21 01:51:23 0:21:13 0:11:35 0:09:38 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_adoption} 1
pass 7765956 2024-06-20 17:52:38 2024-06-21 01:30:31 2024-06-21 02:00:12 0:29:41 0:18:51 0:10:50 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7765957 2024-06-20 17:52:39 2024-06-21 01:30:43 2024-06-21 01:55:42 0:24:59 0:13:30 0:11:29 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7765958 2024-06-20 17:52:39 2024-06-21 01:30:44 2024-06-21 01:54:08 0:23:24 0:13:12 0:10:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7765959 2024-06-20 17:52:40 2024-06-21 01:30:55 2024-06-21 01:50:58 0:20:03 0:10:32 0:09:31 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c65be8102fd0c62c21484f7d2c7085bf8cb6a8fd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7765960 2024-06-20 17:52:41 2024-06-21 01:30:57 2024-06-21 02:01:07 0:30:10 0:20:40 0:09:30 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2