Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7657670 2024-04-15 22:08:37 2024-04-15 23:32:54 2024-04-16 00:05:13 0:32:19 0:21:33 0:10:46 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7657671 2024-04-15 22:08:37 2024-04-15 23:32:55 2024-04-15 23:55:15 0:22:20 0:12:02 0:10:18 smithi main centos 8.stream orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/classic task/test_adoption} 1
pass 7657672 2024-04-15 22:08:38 2024-04-15 23:33:55 2024-04-16 00:01:30 0:27:35 0:17:07 0:10:28 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7657673 2024-04-15 22:08:39 2024-04-15 23:33:56 2024-04-16 00:07:30 0:33:34 0:26:11 0:07:23 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7657674 2024-04-15 22:08:40 2024-04-15 23:33:56 2024-04-16 00:19:23 0:45:27 0:35:35 0:09:52 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657675 2024-04-15 22:08:41 2024-04-15 23:33:56 2024-04-16 00:27:19 0:53:23 0:43:27 0:09:56 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7657676 2024-04-15 22:08:42 2024-04-15 23:33:57 2024-04-16 00:15:32 0:41:35 0:34:33 0:07:02 smithi main rhel 8.6 orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/nfs} 1
fail 7657677 2024-04-15 22:08:43 2024-04-15 23:33:57 2024-04-15 23:50:08 0:16:11 0:06:03 0:10:08 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi060 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7657678 2024-04-15 22:08:44 2024-04-15 23:33:57 2024-04-16 00:01:32 0:27:35 0:15:34 0:12:01 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} 2
pass 7657679 2024-04-15 22:08:45 2024-04-15 23:36:38 2024-04-16 00:24:50 0:48:12 0:36:48 0:11:24 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7657680 2024-04-15 22:08:46 2024-04-15 23:37:09 2024-04-16 00:06:31 0:29:22 0:18:53 0:10:29 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7657681 2024-04-15 22:08:47 2024-04-15 23:37:09 2024-04-16 00:00:10 0:23:01 0:13:44 0:09:17 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} 1
pass 7657682 2024-04-15 22:08:48 2024-04-15 23:37:10 2024-04-16 00:02:08 0:24:58 0:13:44 0:11:14 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7657683 2024-04-15 22:08:49 2024-04-15 23:38:20 2024-04-16 00:40:54 1:02:34 0:50:25 0:12:09 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7657684 2024-04-15 22:08:50 2024-04-15 23:41:11 2024-04-16 00:11:51 0:30:40 0:18:54 0:11:46 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_host_drain} 3
pass 7657685 2024-04-15 22:08:51 2024-04-15 23:41:11 2024-04-16 00:37:41 0:56:30 0:48:24 0:08:06 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7657686 2024-04-15 22:08:52 2024-04-15 23:41:42 2024-04-16 00:10:55 0:29:13 0:19:04 0:10:09 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7657687 2024-04-15 22:08:52 2024-04-15 23:41:42 2024-04-16 00:07:10 0:25:28 0:15:45 0:09:43 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7657688 2024-04-15 22:08:53 2024-04-15 23:41:53 2024-04-16 00:09:29 0:27:36 0:20:34 0:07:02 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7657689 2024-04-15 22:08:54 2024-04-15 23:41:53 2024-04-16 00:07:55 0:26:02 0:16:02 0:10:00 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7657690 2024-04-15 22:08:55 2024-04-15 23:42:53 2024-04-16 00:30:51 0:47:58 0:38:18 0:09:40 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7657691 2024-04-15 22:08:56 2024-04-15 23:42:54 2024-04-16 00:16:21 0:33:27 0:26:17 0:07:10 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7657692 2024-04-15 22:08:57 2024-04-15 23:42:54 2024-04-16 00:12:00 0:29:06 0:21:32 0:07:34 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7657693 2024-04-15 22:08:58 2024-04-15 23:44:35 2024-04-16 00:33:50 0:49:15 0:40:44 0:08:31 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657694 2024-04-15 22:08:59 2024-04-15 23:44:35 2024-04-16 00:11:55 0:27:20 0:20:18 0:07:02 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7657695 2024-04-15 22:09:00 2024-04-15 23:44:56 2024-04-16 00:48:06 1:03:10 0:55:51 0:07:19 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7657696 2024-04-15 22:09:01 2024-04-15 23:44:56 2024-04-16 00:15:31 0:30:35 0:18:39 0:11:56 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7657697 2024-04-15 22:09:02 2024-04-15 23:45:37 2024-04-16 00:19:50 0:34:13 0:25:56 0:08:17 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7657698 2024-04-15 22:09:03 2024-04-15 23:46:27 2024-04-16 00:35:47 0:49:20 0:39:52 0:09:28 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7657699 2024-04-15 22:09:04 2024-04-15 23:46:28 2024-04-16 00:15:48 0:29:20 0:21:44 0:07:36 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7657700 2024-04-15 22:09:05 2024-04-15 23:48:48 2024-04-16 00:37:09 0:48:21 0:37:15 0:11:06 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657701 2024-04-15 22:09:06 2024-04-15 23:48:49 2024-04-16 00:14:28 0:25:39 0:16:15 0:09:24 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7657702 2024-04-15 22:09:07 2024-04-15 23:49:19 2024-04-16 00:12:28 0:23:09 0:14:31 0:08:38 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7657703 2024-04-15 22:09:08 2024-04-15 23:49:20 2024-04-16 00:20:54 0:31:34 0:25:35 0:05:59 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/classic task/test_orch_cli} 1
pass 7657704 2024-04-15 22:09:09 2024-04-15 23:50:00 2024-04-16 00:17:07 0:27:07 0:20:13 0:06:54 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7657705 2024-04-15 22:09:10 2024-04-15 23:50:00 2024-04-16 00:37:35 0:47:35 0:35:59 0:11:36 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7657706 2024-04-15 22:09:11 2024-04-15 23:51:41 2024-04-16 00:23:06 0:31:25 0:21:08 0:10:17 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7657707 2024-04-15 22:09:12 2024-04-15 23:51:42 2024-04-16 00:27:53 0:36:11 0:27:25 0:08:46 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7657708 2024-04-15 22:09:13 2024-04-15 23:54:43 2024-04-16 00:48:37 0:53:54 0:44:01 0:09:53 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7657709 2024-04-15 22:09:14 2024-04-15 23:54:43 2024-04-16 00:48:32 0:53:49 0:44:47 0:09:02 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7657710 2024-04-15 22:09:15 2024-04-15 23:55:24 2024-04-16 00:31:04 0:35:40 0:25:01 0:10:39 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7657711 2024-04-15 22:09:16 2024-04-15 23:55:55 2024-04-16 00:25:01 0:29:06 0:21:33 0:07:33 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7657712 2024-04-15 22:09:17 2024-04-15 23:55:55 2024-04-16 00:53:01 0:57:06 0:40:53 0:16:13 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657713 2024-04-15 22:09:18 2024-04-16 00:01:39 2024-04-16 00:48:48 0:47:09 0:36:11 0:10:58 smithi main ubuntu 20.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7657714 2024-04-15 22:09:19 2024-04-16 00:02:29 2024-04-16 00:28:22 0:25:53 0:19:38 0:06:15 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7657715 2024-04-15 22:09:20 2024-04-16 00:02:30 2024-04-16 00:37:30 0:35:00 0:24:15 0:10:45 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7657716 2024-04-15 22:09:21 2024-04-16 00:03:30 2024-04-16 00:26:23 0:22:53 0:17:02 0:05:51 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7657717 2024-04-15 22:09:22 2024-04-16 00:03:31 2024-04-16 00:33:40 0:30:09 0:16:49 0:13:20 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7657718 2024-04-15 22:09:23 2024-04-16 00:04:01 2024-04-16 00:34:20 0:30:19 0:19:23 0:10:56 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7657719 2024-04-15 22:09:23 2024-04-16 00:04:02 2024-04-16 00:47:44 0:43:42 0:36:53 0:06:49 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7657720 2024-04-15 22:09:24 2024-04-16 00:04:42 2024-04-16 00:53:30 0:48:48 0:39:12 0:09:36 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7657721 2024-04-15 22:09:25 2024-04-16 00:04:43 2024-04-16 00:24:50 0:20:07 0:06:05 0:14:02 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi062 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7657722 2024-04-15 22:09:26 2024-04-16 00:06:03 2024-04-16 00:49:47 0:43:44 0:34:20 0:09:24 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657723 2024-04-15 22:09:27 2024-04-16 00:06:04 2024-04-16 00:30:47 0:24:43 0:13:28 0:11:15 smithi main ubuntu 20.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7657724 2024-04-15 22:09:28 2024-04-16 00:06:34 2024-04-16 00:32:22 0:25:48 0:16:16 0:09:32 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7657725 2024-04-15 22:09:29 2024-04-16 00:07:15 2024-04-16 00:34:07 0:26:52 0:19:56 0:06:56 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 7657726 2024-04-15 22:09:30 2024-04-16 00:07:15 2024-04-16 00:31:21 0:24:06 0:14:12 0:09:54 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
fail 7657727 2024-04-15 22:09:31 2024-04-16 00:07:56 2024-04-16 00:30:09 0:22:13 0:11:54 0:10:19 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi045 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1f10a1c441d6255eaa3105af60f09fbca74c76c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7657728 2024-04-15 22:09:32 2024-04-16 00:09:16 2024-04-16 00:30:15 0:20:59 0:12:13 0:08:46 smithi main centos 8.stream orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} 1
pass 7657729 2024-04-15 22:09:33 2024-04-16 00:09:17 2024-04-16 00:36:15 0:26:58 0:16:52 0:10:06 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7657730 2024-04-15 22:09:34 2024-04-16 00:09:17 2024-04-16 00:37:10 0:27:53 0:16:32 0:11:21 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7657731 2024-04-15 22:09:35 2024-04-16 00:09:37 2024-04-16 00:34:15 0:24:38 0:17:25 0:07:13 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7657732 2024-04-15 22:09:36 2024-04-16 00:10:58 2024-04-16 01:11:04 1:00:06 0:50:24 0:09:42 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7657733 2024-04-15 22:09:37 2024-04-16 00:11:59 2024-04-16 01:06:50 0:54:51 0:46:24 0:08:27 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7657734 2024-04-15 22:09:38 2024-04-16 00:11:59 2024-04-16 00:39:26 0:27:27 0:21:01 0:06:26 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7657735 2024-04-15 22:09:39 2024-04-16 00:12:09 2024-04-16 00:29:02 0:16:53 0:07:57 0:08:56 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm_repos} 1
fail 7657736 2024-04-15 22:09:40 2024-04-16 01:01:50 2440 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657737 2024-04-15 22:09:41 2024-04-16 00:12:30 2024-04-16 01:03:47 0:51:17 0:39:37 0:11:40 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7657738 2024-04-15 22:09:42 2024-04-16 00:14:31 2024-04-16 00:42:40 0:28:09 0:19:46 0:08:23 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
fail 7657739 2024-04-15 22:09:43 2024-04-16 00:15:31 2024-04-16 01:11:03 0:55:32 0:45:16 0:10:16 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

'2024-04-16T01:01:05.553774+00:00 smithi129 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog

pass 7657740 2024-04-15 22:09:44 2024-04-16 00:15:42 2024-04-16 00:42:45 0:27:03 0:17:26 0:09:37 smithi main centos 8.stream orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/classic task/test_cephadm_timeout} 1
pass 7657741 2024-04-15 22:09:45 2024-04-16 00:15:52 2024-04-16 00:43:40 0:27:48 0:17:15 0:10:33 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7657742 2024-04-15 22:09:46 2024-04-16 00:16:23 2024-04-16 00:59:09 0:42:46 0:32:16 0:10:30 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
pass 7657743 2024-04-15 22:09:47 2024-04-16 00:17:13 2024-04-16 00:51:37 0:34:24 0:21:29 0:12:55 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7657744 2024-04-15 22:09:48 2024-04-16 00:19:24 2024-04-16 00:53:04 0:33:40 0:25:56 0:07:44 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7657745 2024-04-15 22:09:49 2024-04-16 00:19:54 2024-04-16 00:47:45 0:27:51 0:18:21 0:09:30 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7657746 2024-04-15 22:09:50 2024-04-16 00:19:55 2024-04-16 01:10:48 0:50:53 0:37:23 0:13:30 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657747 2024-04-15 22:09:51 2024-04-16 00:23:16 2024-04-16 00:51:56 0:28:40 0:18:26 0:10:14 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7657748 2024-04-15 22:09:52 2024-04-16 00:24:07 2024-04-16 00:47:25 0:23:18 0:13:11 0:10:07 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7657749 2024-04-15 22:09:53 2024-04-16 00:24:07 2024-04-16 01:36:03 1:11:56 1:04:18 0:07:38 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7657750 2024-04-15 22:09:54 2024-04-16 00:24:57 2024-04-16 00:54:47 0:29:50 0:18:58 0:10:52 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7657751 2024-04-15 22:09:55 2024-04-16 00:25:08 2024-04-16 00:59:38 0:34:30 0:26:00 0:08:30 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_host_drain} 3
pass 7657752 2024-04-15 22:09:56 2024-04-16 00:26:28 2024-04-16 01:02:47 0:36:19 0:26:06 0:10:13 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7657753 2024-04-15 22:09:57 2024-04-16 00:27:29 2024-04-16 01:00:39 0:33:10 0:27:02 0:06:08 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/connectivity task/test_orch_cli} 1
pass 7657754 2024-04-15 22:09:58 2024-04-16 00:27:59 2024-04-16 00:55:09 0:27:10 0:21:10 0:06:00 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7657755 2024-04-15 22:09:59 2024-04-16 00:28:00 2024-04-16 00:58:24 0:30:24 0:23:18 0:07:06 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7657756 2024-04-15 22:09:59 2024-04-16 00:28:30 2024-04-16 01:34:48 1:06:18 0:55:49 0:10:29 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7657757 2024-04-15 22:10:01 2024-04-16 00:28:51 2024-04-16 01:20:49 0:51:58 0:40:47 0:11:11 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657758 2024-04-15 22:10:01 2024-04-16 00:29:11 2024-04-16 00:55:12 0:26:01 0:15:21 0:10:40 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7657759 2024-04-15 22:10:02 2024-04-16 00:29:42 2024-04-16 00:52:46 0:23:04 0:16:12 0:06:52 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

Command failed on smithi055 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d03f4430-fb8a-11ee-bc8f-c7b262605968 -- ceph osd stat -f json'

pass 7657760 2024-04-15 22:10:03 2024-04-16 00:29:42 2024-04-16 00:55:22 0:25:40 0:16:12 0:09:28 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7657761 2024-04-15 22:10:04 2024-04-16 00:30:23 2024-04-16 01:17:49 0:47:26 0:40:51 0:06:35 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7657762 2024-04-15 22:10:05 2024-04-16 00:30:53 2024-04-16 01:20:16 0:49:23 0:38:32 0:10:51 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7657763 2024-04-15 22:10:06 2024-04-16 00:30:54 2024-04-16 01:01:28 0:30:34 0:19:49 0:10:45 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7657764 2024-04-15 22:10:07 2024-04-16 00:31:14 2024-04-16 01:13:58 0:42:44 0:33:52 0:08:52 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/classic task/test_orch_cli_mon} 5
pass 7657765 2024-04-15 22:10:08 2024-04-16 00:35:39 2024-04-16 01:02:45 0:27:06 0:19:45 0:07:21 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7657766 2024-04-15 22:10:09 2024-04-16 00:35:40 2024-04-16 00:51:31 0:15:51 0:05:50 0:10:01 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/flannel rook/master} 1
Failure Reason:

Command failed on smithi073 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7657767 2024-04-15 22:10:10 2024-04-16 00:35:40 2024-04-16 01:25:23 0:49:43 0:37:30 0:12:13 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657768 2024-04-15 22:10:11 2024-04-16 00:37:11 2024-04-16 01:32:44 0:55:33 0:44:57 0:10:36 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7657769 2024-04-15 22:10:12 2024-04-16 00:37:11 2024-04-16 01:22:21 0:45:10 0:38:46 0:06:24 smithi main rhel 8.6 orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/nfs} 1
pass 7657770 2024-04-15 22:10:13 2024-04-16 00:37:11 2024-04-16 01:08:41 0:31:30 0:24:06 0:07:24 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 7657771 2024-04-15 22:10:14 2024-04-16 00:37:32 2024-04-16 01:25:42 0:48:10 0:38:36 0:09:34 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7657772 2024-04-15 22:10:15 2024-04-16 00:37:42 2024-04-16 01:04:54 0:27:12 0:15:53 0:11:19 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7657773 2024-04-15 22:10:16 2024-04-16 00:39:33 2024-04-16 01:07:22 0:27:49 0:17:15 0:10:34 smithi main ubuntu 20.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7657774 2024-04-15 22:10:17 2024-04-16 00:39:33 2024-04-16 01:06:02 0:26:29 0:13:14 0:13:15 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7657775 2024-04-15 22:10:18 2024-04-16 00:42:44 2024-04-16 01:08:57 0:26:13 0:16:38 0:09:35 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7657776 2024-04-15 22:10:19 2024-04-16 00:43:45 2024-04-16 01:12:49 0:29:04 0:16:52 0:12:12 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7657777 2024-04-15 22:10:20 2024-04-16 00:47:26 2024-04-16 01:13:08 0:25:42 0:16:32 0:09:10 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7657778 2024-04-15 22:10:21 2024-04-16 00:47:26 2024-04-16 01:24:56 0:37:30 0:30:40 0:06:50 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7657779 2024-04-15 22:10:22 2024-04-16 00:47:47 2024-04-16 01:47:46 0:59:59 0:49:20 0:10:39 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7657780 2024-04-15 22:10:23 2024-04-16 00:47:47 2024-04-16 01:17:13 0:29:26 0:23:32 0:05:54 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7657781 2024-04-15 22:10:24 2024-04-16 00:48:07 2024-04-16 01:15:47 0:27:40 0:18:22 0:09:18 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} 3
fail 7657782 2024-04-15 22:10:25 2024-04-16 00:48:38 2024-04-16 01:40:31 0:51:53 0:40:34 0:11:19 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657783 2024-04-15 22:10:26 2024-04-16 00:48:58 2024-04-16 01:09:07 0:20:09 0:10:29 0:09:40 smithi main ubuntu 20.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/connectivity task/test_adoption} 1
pass 7657784 2024-04-15 22:10:27 2024-04-16 00:48:59 2024-04-16 01:23:18 0:34:19 0:23:53 0:10:26 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7657785 2024-04-15 22:10:28 2024-04-16 00:48:59 2024-04-16 01:31:31 0:42:32 0:31:02 0:11:30 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
dead 7657786 2024-04-15 22:10:28 2024-04-16 00:49:50 2024-04-16 00:52:14 0:02:24 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi188

pass 7657787 2024-04-15 22:10:29 2024-04-16 00:51:10 2024-04-16 01:30:29 0:39:19 0:33:02 0:06:17 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7657788 2024-04-15 22:10:30 2024-04-16 00:51:11 2024-04-16 01:17:46 0:26:35 0:15:18 0:11:17 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7657789 2024-04-15 22:10:31 2024-04-16 00:52:01 2024-04-16 01:20:11 0:28:10 0:18:00 0:10:10 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7657790 2024-04-15 22:10:33 2024-04-16 00:52:22 2024-04-16 01:22:30 0:30:08 0:23:14 0:06:54 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7657791 2024-04-15 22:10:34 2024-04-16 00:53:13 2024-04-16 01:42:28 0:49:15 0:39:30 0:09:45 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7657792 2024-04-15 22:10:35 2024-04-16 00:53:33 2024-04-16 01:20:35 0:27:02 0:15:39 0:11:23 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7657793 2024-04-15 22:10:36 2024-04-16 00:54:53 2024-04-16 01:18:22 0:23:29 0:14:09 0:09:20 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7657794 2024-04-15 22:10:37 2024-04-16 00:55:14 2024-04-16 01:20:40 0:25:26 0:16:42 0:08:44 smithi main centos 8.stream orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_timeout} 1
pass 7657795 2024-04-15 22:10:37 2024-04-16 00:55:14 2024-04-16 01:22:24 0:27:10 0:17:27 0:09:43 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7657796 2024-04-15 22:10:38 2024-04-16 00:55:25 2024-04-16 01:53:28 0:58:03 0:43:29 0:14:34 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7657797 2024-04-15 22:10:39 2024-04-16 00:58:25 2024-04-16 01:24:23 0:25:58 0:16:18 0:09:40 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7657798 2024-04-15 22:10:40 2024-04-16 00:59:16 2024-04-16 01:26:45 0:27:29 0:19:49 0:07:40 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi196 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f1f10a1c441d6255eaa3105af60f09fbca74c76c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7657799 2024-04-15 22:10:41 2024-04-16 00:59:46 2024-04-16 01:54:58 0:55:12 0:44:55 0:10:17 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7657800 2024-04-15 22:10:42 2024-04-16 00:59:47 2024-04-16 01:28:59 0:29:12 0:21:40 0:07:32 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7657801 2024-04-15 22:10:43 2024-04-16 01:01:37 2024-04-16 01:29:57 0:28:20 0:21:23 0:06:57 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7657802 2024-04-15 22:10:44 2024-04-16 01:02:48 2024-04-16 01:54:12 0:51:24 0:41:04 0:10:20 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657803 2024-04-15 22:10:45 2024-04-16 01:02:48 2024-04-16 02:03:04 1:00:16 0:50:59 0:09:17 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7657804 2024-04-15 22:10:46 2024-04-16 01:03:49 2024-04-16 01:30:33 0:26:44 0:17:51 0:08:53 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7657805 2024-04-15 22:10:47 2024-04-16 01:04:59 2024-04-16 01:23:15 0:18:16 0:07:23 0:10:53 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7657806 2024-04-15 22:10:48 2024-04-16 01:05:00 2024-04-16 01:41:11 0:36:11 0:25:13 0:10:58 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
pass 7657807 2024-04-15 22:10:49 2024-04-16 01:06:10 2024-04-16 01:31:37 0:25:27 0:16:53 0:08:34 smithi main centos 8.stream orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/connectivity task/test_orch_cli} 1
pass 7657808 2024-04-15 22:10:50 2024-04-16 01:06:11 2024-04-16 01:34:10 0:27:59 0:17:22 0:10:37 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7657809 2024-04-15 22:10:51 2024-04-16 01:06:51 2024-04-16 01:22:42 0:15:51 0:06:03 0:09:48 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/host rook/1.7.2} 3
Failure Reason:

Command failed on smithi055 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7657810 2024-04-15 22:10:52 2024-04-16 01:06:52 2024-04-16 02:12:42 1:05:50 0:53:36 0:12:14 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7657811 2024-04-15 22:10:53 2024-04-16 01:06:52 2024-04-16 01:39:04 0:32:12 0:20:27 0:11:45 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7657812 2024-04-15 22:10:54 2024-04-16 01:06:52 2024-04-16 01:52:14 0:45:22 0:36:28 0:08:54 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7657813 2024-04-15 22:10:55 2024-04-16 01:07:13 2024-04-16 01:38:55 0:31:42 0:24:18 0:07:24 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
pass 7657814 2024-04-15 22:10:56 2024-04-16 01:07:13 2024-04-16 01:35:52 0:28:39 0:17:46 0:10:53 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7657815 2024-04-15 22:10:57 2024-04-16 01:08:44 2024-04-16 01:33:48 0:25:04 0:15:21 0:09:43 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} 1
pass 7657816 2024-04-15 22:10:59 2024-04-16 01:09:04 2024-04-16 01:32:31 0:23:27 0:13:38 0:09:49 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7657817 2024-04-15 22:10:59 2024-04-16 01:09:15 2024-04-16 01:36:25 0:27:10 0:15:42 0:11:28 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7657818 2024-04-15 22:11:00 2024-04-16 01:10:55 2024-04-16 01:35:58 0:25:03 0:18:16 0:06:47 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7657819 2024-04-15 22:11:01 2024-04-16 01:11:05 2024-04-16 01:50:12 0:39:07 0:26:30 0:12:37 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7657820 2024-04-15 22:11:02 2024-04-16 01:12:56 2024-04-16 02:03:04 0:50:08 0:43:38 0:06:30 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7657821 2024-04-15 22:11:04 2024-04-16 01:13:17 2024-04-16 01:41:16 0:27:59 0:17:17 0:10:42 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7657822 2024-04-15 22:11:04 2024-04-16 01:14:07 2024-04-16 01:59:21 0:45:14 0:37:22 0:07:52 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/classic task/test_orch_cli_mon} 5
pass 7657823 2024-04-15 22:11:06 2024-04-16 01:15:48 2024-04-16 01:44:31 0:28:43 0:21:11 0:07:32 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7657824 2024-04-15 22:11:07 2024-04-16 01:17:18 2024-04-16 01:47:39 0:30:21 0:23:02 0:07:19 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7657825 2024-04-15 22:11:08 2024-04-16 01:17:49 2024-04-16 01:45:08 0:27:19 0:18:49 0:08:30 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_host_drain} 3
fail 7657826 2024-04-15 22:11:09 2024-04-16 01:17:59 2024-04-16 02:09:40 0:51:41 0:42:31 0:09:10 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657827 2024-04-15 22:11:10 2024-04-16 01:18:30 2024-04-16 02:15:32 0:57:02 0:49:42 0:07:20 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7657828 2024-04-15 22:11:11 2024-04-16 01:20:20 2024-04-16 01:47:34 0:27:14 0:20:31 0:06:43 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7657829 2024-04-15 22:11:12 2024-04-16 01:20:21 2024-04-16 02:16:25 0:56:04 0:45:23 0:10:41 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

'2024-04-16T02:06:52.420449+00:00 smithi103 kernel: rcu: INFO: rcu_sched self-detected stall on CPU ' in syslog

pass 7657830 2024-04-15 22:11:13 2024-04-16 01:20:41 2024-04-16 01:49:06 0:28:25 0:18:05 0:10:20 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7657831 2024-04-15 22:11:14 2024-04-16 01:20:42 2024-04-16 02:13:54 0:53:12 0:45:24 0:07:48 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
dead 7657832 2024-04-15 22:11:15 2024-04-16 01:22:22 2024-04-16 01:23:26 0:01:04 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi079

pass 7657833 2024-04-15 22:11:16 2024-04-16 01:22:23 2024-04-16 01:49:23 0:27:00 0:18:20 0:08:40 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7657834 2024-04-15 22:11:17 2024-04-16 01:22:23 2024-04-16 01:49:19 0:26:56 0:21:18 0:05:38 smithi main rhel 8.6 orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/connectivity task/test_adoption} 1
pass 7657835 2024-04-15 22:11:18 2024-04-16 01:22:23 2024-04-16 01:49:17 0:26:54 0:19:48 0:07:06 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7657836 2024-04-15 22:11:19 2024-04-16 01:22:24 2024-04-16 02:03:28 0:41:04 0:31:07 0:09:57 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7657837 2024-04-15 22:11:20 2024-04-16 01:22:24 2024-04-16 01:49:25 0:27:01 0:17:18 0:09:43 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7657838 2024-04-15 22:11:21 2024-04-16 01:22:24 2024-04-16 01:46:45 0:24:21 0:13:23 0:10:58 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7657839 2024-04-15 22:11:22 2024-04-16 01:23:25 2024-04-16 01:58:46 0:35:21 0:28:36 0:06:45 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7657840 2024-04-15 22:11:23 2024-04-16 01:23:35 2024-04-16 01:49:34 0:25:59 0:15:38 0:10:21 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7657841 2024-04-15 22:11:24 2024-04-16 01:24:26 2024-04-16 01:57:45 0:33:19 0:24:30 0:08:49 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7657842 2024-04-15 22:11:25 2024-04-16 01:25:26 2024-04-16 01:50:50 0:25:24 0:16:14 0:09:10 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7657843 2024-04-15 22:11:26 2024-04-16 01:25:47 2024-04-16 02:25:02 0:59:15 0:47:44 0:11:31 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
fail 7657844 2024-04-15 22:11:27 2024-04-16 01:25:47 2024-04-16 02:14:25 0:48:38 0:39:31 0:09:07 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7657845 2024-04-15 22:11:28 2024-04-16 01:29:08 2024-04-16 01:57:54 0:28:46 0:18:08 0:10:38 smithi main ubuntu 20.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/classic task/test_cephadm_timeout} 1
pass 7657846 2024-04-15 22:11:29 2024-04-16 01:29:58 2024-04-16 02:06:54 0:36:56 0:25:13 0:11:43 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7657847 2024-04-15 22:11:30 2024-04-16 01:30:39 2024-04-16 02:21:50 0:51:11 0:41:45 0:09:26 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7657848 2024-04-15 22:11:31 2024-04-16 01:30:39 2024-04-16 02:20:24 0:49:45 0:38:08 0:11:37 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7657849 2024-04-15 22:11:33 2024-04-16 01:31:40 2024-04-16 01:58:58 0:27:18 0:20:16 0:07:02 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7657850 2024-04-15 22:11:34 2024-04-16 01:31:40 2024-04-16 02:04:51 0:33:11 0:20:40 0:12:31 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3