Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7592124 2024-03-11 22:08:26 2024-03-12 00:12:38 2024-03-12 00:31:01 0:18:23 0:07:20 0:11:03 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7592125 2024-03-11 22:08:27 2024-03-12 00:12:39 2024-03-12 00:59:57 0:47:18 0:34:58 0:12:20 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592126 2024-03-11 22:08:28 2024-03-12 00:14:49 2024-03-12 00:44:36 0:29:47 0:23:10 0:06:37 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
pass 7592127 2024-03-11 22:08:29 2024-03-12 00:14:50 2024-03-12 00:42:28 0:27:38 0:16:57 0:10:41 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7592128 2024-03-11 22:08:30 2024-03-12 00:15:00 2024-03-12 00:36:25 0:21:25 0:14:48 0:06:37 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 7592129 2024-03-11 22:08:30 2024-03-12 00:15:00 2024-03-12 00:39:08 0:24:08 0:13:42 0:10:26 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7592130 2024-03-11 22:08:31 2024-03-12 00:15:41 2024-03-12 00:39:34 0:23:53 0:16:01 0:07:52 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7592131 2024-03-11 22:08:32 2024-03-12 00:15:41 2024-03-12 00:44:35 0:28:54 0:17:26 0:11:28 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7592132 2024-03-11 22:08:33 2024-03-12 00:17:12 2024-03-12 00:44:38 0:27:26 0:16:27 0:10:59 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7592133 2024-03-11 22:08:34 2024-03-12 00:17:12 2024-03-12 00:42:56 0:25:44 0:19:35 0:06:09 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7592134 2024-03-11 22:08:35 2024-03-12 00:17:43 2024-03-12 01:00:38 0:42:55 0:31:23 0:11:32 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7592135 2024-03-11 22:08:36 2024-03-12 00:17:43 2024-03-12 00:47:37 0:29:54 0:22:00 0:07:54 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7592136 2024-03-11 22:08:37 2024-03-12 00:18:33 2024-03-12 01:07:34 0:49:01 0:40:52 0:08:09 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7592137 2024-03-11 22:08:38 2024-03-12 00:18:34 2024-03-12 01:07:57 0:49:23 0:40:43 0:08:40 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592138 2024-03-11 22:08:39 2024-03-12 00:18:44 2024-03-12 00:45:19 0:26:35 0:15:41 0:10:54 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli} 1
pass 7592139 2024-03-11 22:08:40 2024-03-12 00:18:44 2024-03-12 00:43:53 0:25:09 0:19:14 0:05:55 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7592140 2024-03-11 22:08:41 2024-03-12 00:18:45 2024-03-12 01:14:07 0:55:22 0:44:49 0:10:33 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

'2024-03-12T01:05:06.529728+00:00 smithi063 kernel: rcu: INFO: rcu_sched self-detected stall on CPU ' in syslog

pass 7592141 2024-03-11 22:08:42 2024-03-12 00:20:55 2024-03-12 00:50:34 0:29:39 0:18:10 0:11:29 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7592142 2024-03-11 22:08:43 2024-03-12 00:22:36 2024-03-12 00:38:59 0:16:23 0:05:58 0:10:25 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi106 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7592143 2024-03-11 22:08:43 2024-03-12 00:22:47 2024-03-12 00:53:25 0:30:38 0:20:09 0:10:29 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7592144 2024-03-11 22:08:44 2024-03-12 00:23:27 2024-03-12 01:00:33 0:37:06 0:27:26 0:09:40 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7592145 2024-03-11 22:08:45 2024-03-12 00:23:27 2024-03-12 00:48:34 0:25:07 0:17:55 0:07:12 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7592146 2024-03-11 22:08:46 2024-03-12 00:23:28 2024-03-12 01:22:48 0:59:20 0:50:15 0:09:05 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7592147 2024-03-11 22:08:47 2024-03-12 00:23:28 2024-03-12 01:11:20 0:47:52 0:36:26 0:11:26 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7592148 2024-03-11 22:08:48 2024-03-12 00:27:59 2024-03-12 01:13:28 0:45:29 0:35:06 0:10:23 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592149 2024-03-11 22:08:49 2024-03-12 00:28:00 2024-03-12 00:57:06 0:29:06 0:17:13 0:11:53 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7592150 2024-03-11 22:08:50 2024-03-12 00:29:00 2024-03-12 00:52:04 0:23:04 0:13:08 0:09:56 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7592151 2024-03-11 22:08:51 2024-03-12 00:29:01 2024-03-12 01:17:59 0:48:58 0:40:22 0:08:36 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7592152 2024-03-11 22:08:52 2024-03-12 00:29:01 2024-03-12 00:54:19 0:25:18 0:16:35 0:08:43 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7592153 2024-03-11 22:08:53 2024-03-12 00:29:01 2024-03-12 01:16:16 0:47:15 0:38:13 0:09:02 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7592154 2024-03-11 22:08:54 2024-03-12 00:29:32 2024-03-12 01:03:34 0:34:02 0:23:31 0:10:31 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7592155 2024-03-11 22:08:55 2024-03-12 00:31:02 2024-03-12 00:58:47 0:27:45 0:17:27 0:10:18 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7592156 2024-03-11 22:08:55 2024-03-12 00:31:23 2024-03-12 00:58:15 0:26:52 0:20:51 0:06:01 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7592157 2024-03-11 22:08:56 2024-03-12 00:31:23 2024-03-12 01:07:28 0:36:05 0:23:51 0:12:14 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7592158 2024-03-11 22:08:57 2024-03-12 00:33:14 2024-03-12 01:24:34 0:51:20 0:42:26 0:08:54 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592159 2024-03-11 22:08:58 2024-03-12 00:33:14 2024-03-12 01:03:56 0:30:42 0:19:55 0:10:47 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7592160 2024-03-11 22:08:59 2024-03-12 00:36:05 2024-03-12 01:08:26 0:32:21 0:21:25 0:10:56 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7592161 2024-03-11 22:09:00 2024-03-12 00:36:05 2024-03-12 01:43:22 1:07:17 0:59:52 0:07:25 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7592162 2024-03-11 22:09:01 2024-03-12 00:36:06 2024-03-12 01:11:39 0:35:33 0:29:27 0:06:06 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7592163 2024-03-11 22:09:02 2024-03-12 00:36:16 2024-03-12 01:11:32 0:35:16 0:20:23 0:14:53 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7592164 2024-03-11 22:09:03 2024-03-12 00:39:17 2024-03-12 01:32:16 0:52:59 0:41:00 0:11:59 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592165 2024-03-11 22:09:04 2024-03-12 00:39:38 2024-03-12 01:36:29 0:56:51 0:44:54 0:11:57 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7592166 2024-03-11 22:09:05 2024-03-12 00:41:28 2024-03-12 01:21:11 0:39:43 0:29:50 0:09:53 smithi main centos 8.stream orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_8} tasks/nfs} 1
pass 7592167 2024-03-11 22:09:06 2024-03-12 00:41:28 2024-03-12 01:05:16 0:23:48 0:14:15 0:09:33 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} 2
pass 7592168 2024-03-11 22:09:07 2024-03-12 00:41:29 2024-03-12 01:07:55 0:26:26 0:15:04 0:11:22 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7592169 2024-03-11 22:09:08 2024-03-12 00:42:29 2024-03-12 01:45:56 1:03:27 0:49:03 0:14:24 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7592170 2024-03-11 22:09:08 2024-03-12 00:43:20 2024-03-12 01:11:06 0:27:46 0:17:58 0:09:48 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7592171 2024-03-11 22:09:09 2024-03-12 00:43:20 2024-03-12 01:09:02 0:25:42 0:15:26 0:10:16 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7592172 2024-03-11 22:09:10 2024-03-12 00:44:01 2024-03-12 01:07:09 0:23:08 0:13:33 0:09:35 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7592173 2024-03-11 22:09:11 2024-03-12 00:44:01 2024-03-12 01:08:14 0:24:13 0:13:07 0:11:06 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7592174 2024-03-11 22:09:12 2024-03-12 00:44:42 2024-03-12 01:48:59 1:04:17 0:54:23 0:09:54 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7592175 2024-03-11 22:09:13 2024-03-12 00:44:42 2024-03-12 01:05:57 0:21:15 0:12:31 0:08:44 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_adoption} 1
pass 7592176 2024-03-11 22:09:14 2024-03-12 00:45:23 2024-03-12 01:12:48 0:27:25 0:15:22 0:12:03 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7592177 2024-03-11 22:09:15 2024-03-12 00:47:43 2024-03-12 01:27:47 0:40:04 0:33:34 0:06:30 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7592178 2024-03-11 22:09:16 2024-03-12 00:48:44 2024-03-12 01:37:45 0:49:01 0:40:41 0:08:20 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7592179 2024-03-11 22:09:17 2024-03-12 00:50:34 2024-03-12 01:18:08 0:27:34 0:16:51 0:10:43 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_ca_signed_key} 2
pass 7592180 2024-03-11 22:09:18 2024-03-12 00:50:45 2024-03-12 01:17:58 0:27:13 0:20:59 0:06:14 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7592181 2024-03-11 22:09:19 2024-03-12 00:50:45 2024-03-12 01:36:59 0:46:14 0:36:51 0:09:23 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592182 2024-03-11 22:09:19 2024-03-12 00:51:46 2024-03-12 01:20:49 0:29:03 0:17:19 0:11:44 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7592183 2024-03-11 22:09:20 2024-03-12 00:51:46 2024-03-12 01:32:53 0:41:07 0:33:51 0:07:16 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7592184 2024-03-11 22:09:21 2024-03-12 00:51:56 2024-03-12 01:07:56 0:16:00 0:05:46 0:10:14 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

Command failed on smithi144 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7592185 2024-03-11 22:09:22 2024-03-12 00:51:57 2024-03-12 01:14:54 0:22:57 0:15:02 0:07:55 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7592186 2024-03-11 22:09:23 2024-03-12 00:51:57 2024-03-12 01:47:32 0:55:35 0:43:47 0:11:48 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
fail 7592187 2024-03-11 22:09:24 2024-03-12 00:53:28 2024-03-12 01:20:15 0:26:47 0:21:07 0:05:40 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=583c7cd94fcfcfa9abcbbb46bafd029ba8504cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7592188 2024-03-11 22:09:25 2024-03-12 00:53:28 2024-03-12 01:24:08 0:30:40 0:19:20 0:11:20 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7592189 2024-03-11 22:09:26 2024-03-12 00:53:59 2024-03-12 01:54:11 1:00:12 0:49:50 0:10:22 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
fail 7592190 2024-03-11 22:09:27 2024-03-12 00:53:59 2024-03-12 01:47:40 0:53:41 0:43:36 0:10:05 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592191 2024-03-11 22:09:28 2024-03-12 00:54:29 2024-03-12 01:23:07 0:28:38 0:16:59 0:11:39 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7592192 2024-03-11 22:09:29 2024-03-12 00:55:10 2024-03-12 01:21:08 0:25:58 0:13:38 0:12:20 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7592193 2024-03-11 22:09:30 2024-03-12 00:57:11 2024-03-12 01:18:14 0:21:03 0:13:58 0:07:05 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_cephadm_repos} 1
pass 7592194 2024-03-11 22:09:31 2024-03-12 00:57:11 2024-03-12 01:39:17 0:42:06 0:32:08 0:09:58 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7592195 2024-03-11 22:09:32 2024-03-12 00:58:21 2024-03-12 01:26:05 0:27:44 0:20:48 0:06:56 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7592196 2024-03-11 22:09:32 2024-03-12 00:58:32 2024-03-12 01:33:51 0:35:19 0:25:16 0:10:03 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7592197 2024-03-11 22:09:33 2024-03-12 00:58:32 2024-03-12 01:26:21 0:27:49 0:17:38 0:10:11 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7592198 2024-03-11 22:09:34 2024-03-12 00:58:53 2024-03-12 01:27:21 0:28:28 0:20:22 0:08:06 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7592199 2024-03-11 22:09:35 2024-03-12 01:00:03 2024-03-12 01:55:48 0:55:45 0:44:56 0:10:49 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7592200 2024-03-11 22:09:36 2024-03-12 01:00:44 2024-03-12 01:28:29 0:27:45 0:20:52 0:06:53 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7592201 2024-03-11 22:09:37 2024-03-12 01:00:44 2024-03-12 01:28:43 0:27:59 0:15:59 0:12:00 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7592202 2024-03-11 22:09:38 2024-03-12 01:50:07 2089 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592203 2024-03-11 22:09:39 2024-03-12 01:03:35 2024-03-12 01:51:58 0:48:23 0:38:43 0:09:40 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7592204 2024-03-11 22:09:40 2024-03-12 01:04:06 2024-03-12 01:31:17 0:27:11 0:18:51 0:08:20 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7592205 2024-03-11 22:09:41 2024-03-12 01:05:26 2024-03-12 01:42:26 0:37:00 0:26:13 0:10:47 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7592206 2024-03-11 22:09:42 2024-03-12 01:07:17 2024-03-12 01:33:05 0:25:48 0:18:29 0:07:19 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7592207 2024-03-11 22:09:42 2024-03-12 01:07:27 2024-03-12 01:32:54 0:25:27 0:16:12 0:09:15 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} 1
pass 7592208 2024-03-11 22:09:43 2024-03-12 01:07:28 2024-03-12 01:41:32 0:34:04 0:24:14 0:09:50 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7592209 2024-03-11 22:09:44 2024-03-12 01:07:28 2024-03-12 01:30:41 0:23:13 0:17:08 0:06:05 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7592210 2024-03-11 22:09:45 2024-03-12 01:07:28 2024-03-12 02:26:43 1:19:15 1:09:40 0:09:35 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592211 2024-03-11 22:09:46 2024-03-12 01:07:39 2024-03-12 01:39:37 0:31:58 0:24:49 0:07:09 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 7592212 2024-03-11 22:09:47 2024-03-12 01:08:29 2024-03-12 01:35:59 0:27:30 0:16:41 0:10:49 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7592213 2024-03-11 22:09:48 2024-03-12 01:08:30 2024-03-12 01:34:02 0:25:32 0:18:25 0:07:07 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 7592214 2024-03-11 22:09:49 2024-03-12 01:09:10 2024-03-12 01:35:10 0:26:00 0:13:27 0:12:33 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7592215 2024-03-11 22:09:50 2024-03-12 01:11:11 2024-03-12 02:14:15 1:03:04 0:53:25 0:09:39 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7592216 2024-03-11 22:09:51 2024-03-12 01:11:21 2024-03-12 02:06:25 0:55:04 0:46:05 0:08:59 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7592217 2024-03-11 22:09:52 2024-03-12 01:11:22 2024-03-12 01:49:16 0:37:54 0:28:05 0:09:49 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} 5
pass 7592218 2024-03-11 22:09:53 2024-03-12 01:11:42 2024-03-12 01:40:01 0:28:19 0:17:16 0:11:03 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7592219 2024-03-11 22:09:53 2024-03-12 01:12:53 2024-03-12 02:17:54 1:05:01 0:53:48 0:11:13 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7592220 2024-03-11 22:09:54 2024-03-12 01:13:33 2024-03-12 01:49:25 0:35:52 0:24:33 0:11:19 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7592221 2024-03-11 22:09:55 2024-03-12 01:36:01 2024-03-12 02:03:39 0:27:38 0:20:41 0:06:57 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7592222 2024-03-11 22:09:56 2024-03-12 01:36:31 2024-03-12 02:08:35 0:32:04 0:25:00 0:07:04 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} 3
pass 7592223 2024-03-11 22:09:57 2024-03-12 01:37:02 2024-03-12 02:22:49 0:45:47 0:35:44 0:10:03 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592224 2024-03-11 22:09:58 2024-03-12 01:37:52 2024-03-12 02:08:35 0:30:43 0:19:34 0:11:09 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7592225 2024-03-11 22:09:59 2024-03-12 01:38:43 2024-03-12 02:05:36 0:26:53 0:18:44 0:08:09 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7592226 2024-03-11 22:10:00 2024-03-12 01:38:43 2024-03-12 01:54:59 0:16:16 0:05:59 0:10:17 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi116 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7592227 2024-03-11 22:10:01 2024-03-12 01:38:44 2024-03-12 02:12:24 0:33:40 0:27:39 0:06:01 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 7592228 2024-03-11 22:10:02 2024-03-12 01:39:24 2024-03-12 02:32:49 0:53:25 0:44:10 0:09:15 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

'2024-03-12T02:23:18.856963+00:00 smithi044 kernel: rcu: INFO: rcu_sched self-detected stall on CPU ' in syslog

pass 7592229 2024-03-11 22:10:03 2024-03-12 01:39:45 2024-03-12 02:29:08 0:49:23 0:42:15 0:07:08 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7592230 2024-03-11 22:10:04 2024-03-12 01:40:05 2024-03-12 02:15:47 0:35:42 0:24:16 0:11:26 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7592231 2024-03-11 22:10:05 2024-03-12 01:41:36 2024-03-12 02:16:26 0:34:50 0:26:23 0:08:27 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7592232 2024-03-11 22:10:06 2024-03-12 01:42:06 2024-03-12 02:09:15 0:27:09 0:17:44 0:09:25 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7592233 2024-03-11 22:10:07 2024-03-12 01:42:06 2024-03-12 03:03:40 1:21:34 1:11:37 0:09:57 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592234 2024-03-11 22:10:07 2024-03-12 01:42:27 2024-03-12 02:10:29 0:28:02 0:17:21 0:10:41 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7592235 2024-03-11 22:10:08 2024-03-12 01:43:27 2024-03-12 02:12:56 0:29:29 0:13:37 0:15:52 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7592236 2024-03-11 22:10:09 2024-03-12 01:45:58 2024-03-12 02:34:13 0:48:15 0:37:34 0:10:41 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7592237 2024-03-11 22:10:10 2024-03-12 01:45:58 2024-03-12 02:14:59 0:29:01 0:17:08 0:11:53 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7592238 2024-03-11 22:10:11 2024-03-12 01:46:59 2024-03-12 02:12:48 0:25:49 0:15:12 0:10:37 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7592239 2024-03-11 22:10:12 2024-03-12 01:47:39 2024-03-12 02:07:15 0:19:36 0:10:37 0:08:59 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} 1
pass 7592240 2024-03-11 22:10:13 2024-03-12 01:47:40 2024-03-12 02:40:25 0:52:45 0:45:21 0:07:24 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7592241 2024-03-11 22:10:14 2024-03-12 01:49:00 2024-03-12 02:16:30 0:27:30 0:19:44 0:07:46 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7592242 2024-03-11 22:10:15 2024-03-12 01:49:21 2024-03-12 02:30:31 0:41:10 0:31:30 0:09:40 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7592243 2024-03-11 22:10:16 2024-03-12 01:49:21 2024-03-12 02:16:54 0:27:33 0:16:32 0:11:01 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7592244 2024-03-11 22:10:17 2024-03-12 01:49:22 2024-03-12 02:34:46 0:45:24 0:35:11 0:10:13 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592245 2024-03-11 22:10:18 2024-03-12 01:49:22 2024-03-12 02:38:30 0:49:08 0:37:56 0:11:12 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7592246 2024-03-11 22:10:18 2024-03-12 01:49:32 2024-03-12 02:15:45 0:26:13 0:15:38 0:10:35 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7592247 2024-03-11 22:10:19 2024-03-12 01:50:13 2024-03-12 02:16:43 0:26:30 0:17:44 0:08:46 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7592248 2024-03-11 22:10:20 2024-03-12 01:50:13 2024-03-12 03:12:47 1:22:34 1:08:35 0:13:59 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7592249 2024-03-11 22:10:21 2024-03-12 01:52:04 2024-03-12 02:19:21 0:27:17 0:15:11 0:12:06 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7592250 2024-03-11 22:10:22 2024-03-12 01:54:04 2024-03-12 02:14:55 0:20:51 0:11:22 0:09:29 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi073 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=583c7cd94fcfcfa9abcbbb46bafd029ba8504cb0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7592251 2024-03-11 22:10:23 2024-03-12 01:54:05 2024-03-12 02:52:53 0:58:48 0:46:53 0:11:55 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7592252 2024-03-11 22:10:24 2024-03-12 01:54:45 2024-03-12 02:49:02 0:54:17 0:44:06 0:10:11 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7592253 2024-03-11 22:10:25 2024-03-12 01:55:56 2024-03-12 02:34:45 0:38:49 0:28:18 0:10:31 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7592254 2024-03-11 22:10:26 2024-03-12 01:55:56 2024-03-12 02:28:40 0:32:44 0:24:58 0:07:46 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} 2
fail 7592255 2024-03-11 22:10:27 2024-03-12 02:35:25 1395 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

Command failed on smithi090 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 7592256 2024-03-11 22:10:28 2024-03-12 02:01:28 2024-03-12 02:28:51 0:27:23 0:15:59 0:11:24 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7592257 2024-03-11 22:10:29 2024-03-12 02:03:48 2024-03-12 02:28:32 0:24:44 0:13:18 0:11:26 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7592258 2024-03-11 22:10:30 2024-03-12 02:05:39 2024-03-12 02:29:47 0:24:08 0:13:09 0:10:59 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7592259 2024-03-11 22:10:31 2024-03-12 02:06:30 2024-03-12 02:41:49 0:35:19 0:24:31 0:10:48 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7592260 2024-03-11 22:10:32 2024-03-12 02:08:40 2024-03-12 02:35:53 0:27:13 0:21:27 0:05:46 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7592261 2024-03-11 22:10:33 2024-03-12 02:08:40 2024-03-12 02:36:12 0:27:32 0:17:05 0:10:27 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7592262 2024-03-11 22:10:34 2024-03-12 02:08:41 2024-03-12 02:31:30 0:22:49 0:14:30 0:08:19 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7592263 2024-03-11 22:10:35 2024-03-12 02:09:21 2024-03-12 02:38:39 0:29:18 0:23:14 0:06:04 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7592264 2024-03-11 22:10:36 2024-03-12 02:09:32 2024-03-12 02:34:28 0:24:56 0:15:50 0:09:06 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7592265 2024-03-11 22:10:37 2024-03-12 02:09:32 2024-03-12 02:53:00 0:43:28 0:34:39 0:08:49 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7592266 2024-03-11 22:10:38 2024-03-12 02:09:32 2024-03-12 02:25:22 0:15:50 0:05:53 0:09:57 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/flannel rook/1.7.2} 1
Failure Reason:

Command failed on smithi064 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7592267 2024-03-11 22:10:39 2024-03-12 02:09:33 2024-03-12 02:50:41 0:41:08 0:35:16 0:05:52 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7592268 2024-03-11 22:10:40 2024-03-12 02:09:33 2024-03-12 03:12:42 1:03:09 0:53:32 0:09:37 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7592269 2024-03-11 22:10:41 2024-03-12 02:09:33 2024-03-12 02:54:36 0:45:03 0:34:48 0:10:15 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7592270 2024-03-11 22:10:42 2024-03-12 02:09:34 2024-03-12 02:34:32 0:24:58 0:19:19 0:05:39 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7592271 2024-03-11 22:10:43 2024-03-12 02:09:34 2024-03-12 02:36:56 0:27:22 0:17:30 0:09:52 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7592272 2024-03-11 22:10:44 2024-03-12 02:09:34 2024-03-12 02:34:51 0:25:17 0:18:13 0:07:04 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7592273 2024-03-11 22:10:45 2024-03-12 02:09:35 2024-03-12 02:42:11 0:32:36 0:22:50 0:09:46 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7592274 2024-03-11 22:10:46 2024-03-12 02:09:45 2024-03-12 03:01:43 0:51:58 0:44:50 0:07:08 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7592275 2024-03-11 22:10:47 2024-03-12 02:09:45 2024-03-12 02:40:28 0:30:43 0:19:05 0:11:38 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_orch_cli} 1
fail 7592276 2024-03-11 22:10:49 2024-03-12 02:09:46 2024-03-12 03:07:22 0:57:36 0:43:06 0:14:30 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7592277 2024-03-11 22:10:50 2024-03-12 02:12:26 2024-03-12 02:40:05 0:27:39 0:18:49 0:08:50 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7592278 2024-03-11 22:10:51 2024-03-12 02:12:57 2024-03-12 02:37:37 0:24:40 0:14:08 0:10:32 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7592279 2024-03-11 22:10:52 2024-03-12 02:12:57 2024-03-12 02:41:12 0:28:15 0:20:43 0:07:32 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7592280 2024-03-11 22:10:53 2024-03-12 02:14:18 2024-03-12 02:58:01 0:43:43 0:34:17 0:09:26 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7592281 2024-03-11 22:10:53 2024-03-12 02:15:08 2024-03-12 02:45:16 0:30:08 0:16:59 0:13:09 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7592282 2024-03-11 22:10:55 2024-03-12 02:15:49 2024-03-12 02:49:59 0:34:10 0:24:54 0:09:16 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7592283 2024-03-11 22:10:56 2024-03-12 02:15:49 2024-03-12 03:12:42 0:56:53 0:45:21 0:11:32 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7592284 2024-03-11 22:10:57 2024-03-12 02:16:30 2024-03-12 02:55:22 0:38:52 0:26:21 0:12:31 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli_mon} 5
pass 7592285 2024-03-11 22:10:58 2024-03-12 02:16:50 2024-03-12 02:44:33 0:27:43 0:20:42 0:07:01 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7592286 2024-03-11 22:10:58 2024-03-12 02:17:00 2024-03-12 03:00:18 0:43:18 0:31:00 0:12:18 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7592287 2024-03-11 22:11:00 2024-03-12 02:18:01 2024-03-12 03:04:55 0:46:54 0:35:23 0:11:31 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7592288 2024-03-11 22:11:01 2024-03-12 02:19:32 2024-03-12 02:45:50 0:26:18 0:17:16 0:09:02 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7592289 2024-03-11 22:11:02 2024-03-12 02:22:52 2024-03-12 02:54:12 0:31:20 0:18:30 0:12:50 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_rgw_multisite} 3
pass 7592290 2024-03-11 22:11:03 2024-03-12 02:25:03 2024-03-12 03:24:31 0:59:28 0:49:32 0:09:56 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7592291 2024-03-11 22:11:04 2024-03-12 02:25:03 2024-03-12 02:48:37 0:23:34 0:17:19 0:06:15 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7592292 2024-03-11 22:11:05 2024-03-12 02:25:04 2024-03-12 03:18:07 0:53:03 0:45:54 0:07:09 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7592293 2024-03-11 22:11:06 2024-03-12 02:25:04 2024-03-12 02:52:52 0:27:48 0:18:41 0:09:07 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2