Pulpito

teuthology-2024-05-03_21:08:03-orch-squid-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
teuthology 2024-05-03 21:08:03 2024-05-06 11:10:21 2024-05-07 01:13:37 14:03:16 orch squid smithi 70ce953 160 23 2

Average wait time: 0:08:32

See other runs of suite 'orch' on branch 'squid'?

See other runs on branch 'squid'?

See other runs scheduled on 2024-05-03?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7688075 2024-05-03 21:08:43 2024-05-06 11:10:21 2024-05-06 11:32:11 0:21:50 0:14:56 0:06:54 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7688076 2024-05-03 21:08:44 2024-05-06 11:11:22 2024-05-06 11:41:31 0:30:09 0:19:41 0:10:28 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7688077 2024-05-03 21:08:45 2024-05-06 11:11:22 2024-05-06 12:06:45 0:55:23 0:48:38 0:06:45 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7688078 2024-05-03 21:08:46 2024-05-06 11:11:23 2024-05-06 11:36:12 0:24:49 0:18:04 0:06:45 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7688079 2024-05-03 21:08:47 2024-05-06 11:11:33 2024-05-06 11:40:34 0:29:01 0:23:25 0:05:36 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rotate-keys} 2
pass 7688080 2024-05-03 21:08:48 2024-05-06 11:11:33 2024-05-06 11:44:41 0:33:08 0:21:24 0:11:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7688081 2024-05-03 21:08:49 2024-05-06 11:13:04 2024-05-06 11:25:47 0:12:43 0:06:05 0:06:38 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7688082 2024-05-03 21:08:50 2024-05-06 11:13:04 2024-05-06 11:54:54 0:41:50 0:34:13 0:07:37 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7688083 2024-05-03 21:08:51 2024-05-06 11:13:15 2024-05-06 11:54:34 0:41:19 0:34:02 0:07:17 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7688084 2024-05-03 21:08:52 2024-05-06 11:13:15 2024-05-06 12:09:18 0:56:03 0:44:46 0:11:17 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7688085 2024-05-03 21:08:53 2024-05-06 11:13:15 2024-05-06 11:29:16 0:16:01 0:09:18 0:06:43 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7688086 2024-05-03 21:08:54 2024-05-06 11:13:56 2024-05-06 11:40:11 0:26:15 0:14:09 0:12:06 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7688087 2024-05-03 21:08:55 2024-05-06 11:36:50 2024-05-06 11:57:21 0:20:31 0:12:42 0:07:49 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7688088 2024-05-03 21:08:56 2024-05-06 11:38:20 2024-05-06 12:09:16 0:30:56 0:25:03 0:05:53 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-05-06T11:50:49.940448+0000 mon.a (mon.0) 211 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7688089 2024-05-03 21:08:57 2024-05-06 11:38:21 2024-05-06 11:58:59 0:20:38 0:12:07 0:08:31 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7688090 2024-05-03 21:08:58 2024-05-06 11:39:51 2024-05-06 11:59:39 0:19:48 0:12:51 0:06:57 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7688091 2024-05-03 21:08:59 2024-05-06 11:40:12 2024-05-06 11:57:04 0:16:52 0:10:49 0:06:03 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7688092 2024-05-03 21:09:00 2024-05-06 11:40:12 2024-05-06 11:58:50 0:18:38 0:10:34 0:08:04 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7688093 2024-05-03 21:09:01 2024-05-06 11:41:33 2024-05-06 12:33:32 0:51:59 0:43:59 0:08:00 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi153 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03778604-0b9f-11ef-bc97-c7b262605968 -e sha1=70ce9539b62a15b9de429c1f0e91a1e012b099aa -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7688094 2024-05-03 21:09:02 2024-05-06 11:42:33 2024-05-06 12:02:56 0:20:23 0:13:11 0:07:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7688095 2024-05-03 21:09:03 2024-05-06 11:43:54 2024-05-06 12:02:48 0:18:54 0:13:04 0:05:50 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-05-06T12:00:00.000126+0000 mon.a (mon.0) 429 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

pass 7688096 2024-05-03 21:09:04 2024-05-06 11:43:55 2024-05-06 12:14:23 0:30:28 0:19:55 0:10:33 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7688097 2024-05-03 21:09:05 2024-05-06 11:44:45 2024-05-06 13:01:11 1:16:26 1:05:03 0:11:23 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7688098 2024-05-03 21:09:06 2024-05-06 11:45:26 2024-05-06 12:24:13 0:38:47 0:27:06 0:11:41 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7688099 2024-05-03 21:09:07 2024-05-06 11:45:26 2024-05-06 12:06:29 0:21:03 0:14:08 0:06:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
dead 7688100 2024-05-03 21:09:08 2024-05-06 11:45:36 2024-05-06 23:57:13 12:11:37 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

hit max job timeout

pass 7688101 2024-05-03 21:09:09 2024-05-06 11:48:47 2024-05-06 12:31:54 0:43:07 0:36:07 0:07:00 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7688102 2024-05-03 21:09:10 2024-05-06 11:48:57 2024-05-06 12:25:54 0:36:57 0:23:01 0:13:56 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
fail 7688103 2024-05-03 21:09:11 2024-05-06 11:51:48 2024-05-06 12:35:10 0:43:22 0:36:03 0:07:19 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688104 2024-05-03 21:09:12 2024-05-06 11:51:59 2024-05-06 12:13:07 0:21:08 0:14:05 0:07:03 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
pass 7688105 2024-05-03 21:09:13 2024-05-06 11:51:59 2024-05-06 12:09:26 0:17:27 0:11:14 0:06:13 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7688106 2024-05-03 21:09:15 2024-05-06 11:52:19 2024-05-06 12:13:35 0:21:16 0:13:56 0:07:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7688107 2024-05-03 21:09:16 2024-05-06 11:52:40 2024-05-06 12:28:04 0:35:24 0:21:41 0:13:43 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7688108 2024-05-03 21:09:17 2024-05-06 11:52:50 2024-05-06 12:12:00 0:19:10 0:13:19 0:05:51 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7688109 2024-05-03 21:09:18 2024-05-06 11:52:50 2024-05-06 12:15:19 0:22:29 0:15:21 0:07:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7688110 2024-05-03 21:09:19 2024-05-06 11:54:11 2024-05-06 12:13:29 0:19:18 0:11:35 0:07:43 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7688111 2024-05-03 21:09:20 2024-05-06 11:54:21 2024-05-06 12:24:51 0:30:30 0:19:15 0:11:15 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7688112 2024-05-03 21:09:21 2024-05-06 11:54:22 2024-05-06 12:31:57 0:37:35 0:30:18 0:07:17 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
fail 7688113 2024-05-03 21:09:22 2024-05-06 11:54:42 2024-05-06 12:15:26 0:20:44 0:07:42 0:13:02 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi050 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7688114 2024-05-03 21:09:23 2024-05-06 11:56:43 2024-05-06 12:44:39 0:47:56 0:38:33 0:09:23 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7688115 2024-05-03 21:09:24 2024-05-06 11:56:43 2024-05-06 12:20:32 0:23:49 0:15:31 0:08:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7688116 2024-05-03 21:09:25 2024-05-06 11:57:24 2024-05-06 12:22:59 0:25:35 0:18:10 0:07:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7688117 2024-05-03 21:09:26 2024-05-06 11:58:04 2024-05-06 12:37:20 0:39:16 0:31:57 0:07:19 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7688118 2024-05-03 21:09:27 2024-05-06 11:58:05 2024-05-06 12:27:26 0:29:21 0:19:41 0:09:40 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
pass 7688119 2024-05-03 21:09:28 2024-05-06 11:58:05 2024-05-06 12:25:36 0:27:31 0:19:09 0:08:22 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7688120 2024-05-03 21:09:29 2024-05-06 11:58:05 2024-05-06 12:32:45 0:34:40 0:23:34 0:11:06 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7688121 2024-05-03 21:09:30 2024-05-06 11:58:56 2024-05-06 12:44:00 0:45:04 0:33:32 0:11:32 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7688122 2024-05-03 21:09:31 2024-05-06 11:59:46 2024-05-06 12:23:59 0:24:13 0:14:07 0:10:06 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7688123 2024-05-03 21:09:32 2024-05-06 12:02:57 2024-05-06 12:26:48 0:23:51 0:16:03 0:07:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7688124 2024-05-03 21:09:33 2024-05-06 12:02:57 2024-05-06 12:22:00 0:19:03 0:13:00 0:06:03 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7688125 2024-05-03 21:09:34 2024-05-06 12:02:58 2024-05-06 12:33:24 0:30:26 0:19:52 0:10:34 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7688126 2024-05-03 21:09:35 2024-05-06 12:03:28 2024-05-06 12:25:17 0:21:49 0:14:29 0:07:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7688127 2024-05-03 21:09:36 2024-05-06 12:04:09 2024-05-06 12:48:58 0:44:49 0:35:45 0:09:04 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7688128 2024-05-03 21:09:37 2024-05-06 12:05:29 2024-05-06 12:36:14 0:30:45 0:20:23 0:10:22 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7688129 2024-05-03 21:09:38 2024-05-06 12:06:20 2024-05-06 12:27:47 0:21:27 0:15:33 0:05:54 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
fail 7688130 2024-05-03 21:09:39 2024-05-06 12:06:30 2024-05-06 12:52:01 0:45:31 0:37:23 0:08:08 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688131 2024-05-03 21:09:40 2024-05-06 12:06:51 2024-05-06 12:41:01 0:34:10 0:25:18 0:08:52 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7688132 2024-05-03 21:09:41 2024-05-06 12:09:21 2024-05-06 12:33:11 0:23:50 0:14:16 0:09:34 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7688133 2024-05-03 21:09:42 2024-05-06 12:09:32 2024-05-06 12:32:23 0:22:51 0:12:18 0:10:33 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7688134 2024-05-03 21:09:43 2024-05-06 12:12:53 2024-05-06 12:35:38 0:22:45 0:15:44 0:07:01 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7688135 2024-05-03 21:09:44 2024-05-06 12:12:53 2024-05-06 12:43:06 0:30:13 0:19:44 0:10:29 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
pass 7688136 2024-05-03 21:09:45 2024-05-06 12:12:54 2024-05-06 12:33:02 0:20:08 0:12:26 0:07:42 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7688137 2024-05-03 21:09:46 2024-05-06 12:13:14 2024-05-06 12:36:33 0:23:19 0:15:56 0:07:23 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7688138 2024-05-03 21:09:47 2024-05-06 12:13:15 2024-05-06 12:54:33 0:41:18 0:32:26 0:08:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7688139 2024-05-03 21:09:48 2024-05-06 12:13:35 2024-05-06 12:42:33 0:28:58 0:23:05 0:05:53 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
fail 7688140 2024-05-03 21:09:49 2024-05-06 12:13:35 2024-05-06 12:48:51 0:35:16 0:28:39 0:06:37 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-05-06T12:36:44.308566+0000 mon.a (mon.0) 1005 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7688141 2024-05-03 21:09:50 2024-05-06 12:13:36 2024-05-06 12:30:32 0:16:56 0:11:08 0:05:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7688142 2024-05-03 21:09:51 2024-05-06 12:13:36 2024-05-06 12:49:47 0:36:11 0:25:38 0:10:33 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7688143 2024-05-03 21:09:52 2024-05-06 12:13:36 2024-05-06 12:34:45 0:21:09 0:15:23 0:05:46 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7688144 2024-05-03 21:09:53 2024-05-06 12:13:37 2024-05-06 13:17:26 1:03:49 0:54:53 0:08:56 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7688145 2024-05-03 21:09:54 2024-05-06 12:13:37 2024-05-06 12:37:02 0:23:25 0:16:30 0:06:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7688146 2024-05-03 21:09:55 2024-05-06 12:13:38 2024-05-06 12:35:35 0:21:57 0:13:52 0:08:05 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
pass 7688147 2024-05-03 21:09:56 2024-05-06 12:14:28 2024-05-06 12:52:38 0:38:10 0:31:06 0:07:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7688148 2024-05-03 21:09:57 2024-05-06 12:15:29 2024-05-06 12:30:22 0:14:53 0:08:58 0:05:55 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7688149 2024-05-03 21:09:58 2024-05-06 12:15:29 2024-05-06 12:48:37 0:33:08 0:18:40 0:14:28 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7688150 2024-05-03 21:09:59 2024-05-06 12:20:40 2024-05-06 12:41:05 0:20:25 0:12:19 0:08:06 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7688151 2024-05-03 21:10:00 2024-05-06 12:22:00 2024-05-06 12:45:05 0:23:05 0:13:37 0:09:28 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7688152 2024-05-03 21:10:01 2024-05-06 12:23:01 2024-05-06 12:52:52 0:29:51 0:20:30 0:09:21 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7688153 2024-05-03 21:10:02 2024-05-06 12:23:01 2024-05-06 13:07:12 0:44:11 0:35:42 0:08:29 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
fail 7688154 2024-05-03 21:10:03 2024-05-06 12:24:02 2024-05-06 12:43:51 0:19:49 0:09:25 0:10:24 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70ce9539b62a15b9de429c1f0e91a1e012b099aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7688155 2024-05-03 21:10:04 2024-05-06 12:24:22 2024-05-06 12:46:16 0:21:54 0:14:27 0:07:27 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7688156 2024-05-03 21:10:05 2024-05-06 12:24:53 2024-05-06 12:42:56 0:18:03 0:11:06 0:06:57 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7688157 2024-05-03 21:10:06 2024-05-06 12:25:26 2024-05-06 12:46:59 0:21:33 0:15:08 0:06:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
fail 7688158 2024-05-03 21:10:07 2024-05-06 12:25:47 2024-05-06 12:43:23 0:17:36 0:07:36 0:10:00 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/master} 1
Failure Reason:

Command failed on smithi053 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7688159 2024-05-03 21:10:08 2024-05-06 12:26:12 2024-05-06 12:45:31 0:19:19 0:13:25 0:05:54 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7688160 2024-05-03 21:10:09 2024-05-06 12:26:23 2024-05-06 13:27:56 1:01:33 0:53:50 0:07:43 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7688161 2024-05-03 21:10:10 2024-05-06 12:26:51 2024-05-06 12:47:26 0:20:35 0:13:02 0:07:33 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_extra_daemon_features} 2
fail 7688162 2024-05-03 21:10:12 2024-05-06 12:27:02 2024-05-06 13:10:12 0:43:10 0:36:35 0:06:35 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688163 2024-05-03 21:10:13 2024-05-06 12:27:03 2024-05-06 12:57:26 0:30:23 0:19:44 0:10:39 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7688164 2024-05-03 21:10:14 2024-05-06 12:27:49 2024-05-06 12:55:53 0:28:04 0:18:32 0:09:32 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7688165 2024-05-03 21:10:15 2024-05-06 12:27:56 2024-05-06 13:01:30 0:33:34 0:20:45 0:12:49 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7688166 2024-05-03 21:10:16 2024-05-06 12:28:22 2024-05-06 13:06:22 0:38:00 0:25:57 0:12:03 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7688167 2024-05-03 21:10:17 2024-05-06 12:29:39 2024-05-06 13:39:18 1:09:39 1:00:13 0:09:26 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-05-06T12:50:41.079789+0000 mon.a (mon.0) 449 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7688168 2024-05-03 21:10:18 2024-05-06 12:29:39 2024-05-06 12:50:33 0:20:54 0:15:02 0:05:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7688169 2024-05-03 21:10:19 2024-05-06 12:29:39 2024-05-06 12:51:35 0:21:56 0:15:08 0:06:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} 3
pass 7688170 2024-05-03 21:10:20 2024-05-06 12:30:40 2024-05-06 12:52:54 0:22:14 0:15:24 0:06:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7688171 2024-05-03 21:10:21 2024-05-06 12:32:01 2024-05-06 12:53:09 0:21:08 0:13:15 0:07:53 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7688172 2024-05-03 21:10:22 2024-05-06 12:32:01 2024-05-06 13:16:27 0:44:26 0:32:56 0:11:30 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
pass 7688173 2024-05-03 21:10:23 2024-05-06 12:32:31 2024-05-06 13:04:43 0:32:12 0:21:48 0:10:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7688174 2024-05-03 21:10:24 2024-05-06 12:32:52 2024-05-06 13:10:59 0:38:07 0:30:45 0:07:22 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7688175 2024-05-03 21:10:25 2024-05-06 12:33:12 2024-05-06 12:52:05 0:18:53 0:13:11 0:05:42 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7688176 2024-05-03 21:10:26 2024-05-06 12:33:13 2024-05-06 13:12:23 0:39:10 0:32:39 0:06:31 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7688177 2024-05-03 21:10:27 2024-05-06 12:33:13 2024-05-06 13:14:28 0:41:15 0:34:12 0:07:03 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7688178 2024-05-03 21:10:28 2024-05-06 12:33:33 2024-05-06 13:12:47 0:39:14 0:33:18 0:05:56 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7688179 2024-05-03 21:10:29 2024-05-06 12:33:34 2024-05-06 12:53:47 0:20:13 0:12:31 0:07:42 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7688180 2024-05-03 21:10:30 2024-05-06 12:34:54 2024-05-06 12:59:13 0:24:19 0:13:52 0:10:27 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
fail 7688181 2024-05-03 21:10:31 2024-05-06 12:35:45 2024-05-06 13:09:25 0:33:40 0:25:14 0:08:26 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-05-06T12:49:14.102403+0000 mon.a (mon.0) 208 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7688182 2024-05-03 21:10:32 2024-05-06 12:36:15 2024-05-06 12:55:53 0:19:38 0:12:18 0:07:20 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7688183 2024-05-03 21:10:33 2024-05-06 12:36:36 2024-05-06 13:00:14 0:23:38 0:16:11 0:07:27 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7688184 2024-05-03 21:10:34 2024-05-06 12:37:06 2024-05-06 12:54:12 0:17:06 0:10:52 0:06:14 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7688185 2024-05-03 21:10:35 2024-05-06 12:37:06 2024-05-06 12:58:34 0:21:28 0:10:58 0:10:30 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7688186 2024-05-03 21:10:36 2024-05-06 12:41:07 2024-05-06 13:05:46 0:24:39 0:17:04 0:07:35 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7688187 2024-05-03 21:10:37 2024-05-06 12:41:08 2024-05-06 13:11:20 0:30:12 0:19:23 0:10:49 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7688188 2024-05-03 21:10:38 2024-05-06 12:41:08 2024-05-06 13:07:38 0:26:30 0:18:46 0:07:44 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7688189 2024-05-03 21:10:39 2024-05-06 12:42:39 2024-05-06 13:12:38 0:29:59 0:20:46 0:09:13 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7688190 2024-05-03 21:10:40 2024-05-06 12:42:59 2024-05-06 13:04:34 0:21:35 0:14:55 0:06:40 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7688191 2024-05-03 21:10:41 2024-05-06 12:42:59 2024-05-06 13:05:36 0:22:37 0:14:47 0:07:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7688192 2024-05-03 21:10:42 2024-05-06 12:44:10 2024-05-06 13:14:15 0:30:05 0:22:42 0:07:23 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
fail 7688193 2024-05-03 21:10:43 2024-05-06 12:44:40 2024-05-06 13:24:07 0:39:27 0:32:42 0:06:45 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-05-06T12:57:53.154046+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7688194 2024-05-03 21:10:44 2024-05-06 12:45:01 2024-05-06 13:45:16 1:00:15 0:49:37 0:10:38 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7688195 2024-05-03 21:10:45 2024-05-06 12:45:01 2024-05-06 13:03:56 0:18:55 0:13:14 0:05:41 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite} 3
fail 7688196 2024-05-03 21:10:46 2024-05-06 12:45:02 2024-05-06 13:30:46 0:45:44 0:38:00 0:07:44 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688197 2024-05-03 21:10:47 2024-05-06 12:45:02 2024-05-06 13:17:41 0:32:39 0:24:11 0:08:28 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7688198 2024-05-03 21:10:48 2024-05-06 12:46:23 2024-05-06 13:04:11 0:17:48 0:10:54 0:06:54 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7688199 2024-05-03 21:10:49 2024-05-06 12:47:03 2024-05-06 13:09:33 0:22:30 0:14:02 0:08:28 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7688200 2024-05-03 21:10:50 2024-05-06 12:47:33 2024-05-06 13:09:52 0:22:19 0:14:01 0:08:18 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7688201 2024-05-03 21:10:51 2024-05-06 12:48:44 2024-05-06 13:18:57 0:30:13 0:19:34 0:10:39 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7688202 2024-05-03 21:10:52 2024-05-06 12:49:04 2024-05-06 13:21:55 0:32:51 0:22:00 0:10:51 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
fail 7688203 2024-05-03 21:10:53 2024-05-06 12:49:55 2024-05-06 13:09:29 0:19:34 0:07:27 0:12:07 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/host rook/1.7.2} 3
Failure Reason:

Command failed on smithi104 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7688204 2024-05-03 21:10:54 2024-05-06 12:53:02 2024-05-06 13:18:11 0:25:09 0:17:45 0:07:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7688205 2024-05-03 21:10:55 2024-05-06 12:53:02 2024-05-06 13:12:21 0:19:19 0:11:38 0:07:41 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7688206 2024-05-03 21:10:56 2024-05-06 12:53:12 2024-05-06 13:17:15 0:24:03 0:15:30 0:08:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7688207 2024-05-03 21:10:57 2024-05-06 12:54:13 2024-05-06 13:39:05 0:44:52 0:36:46 0:08:06 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688208 2024-05-03 21:10:58 2024-05-06 12:55:54 2024-05-06 13:19:30 0:23:36 0:12:52 0:10:44 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7688209 2024-05-03 21:10:59 2024-05-06 12:55:54 2024-05-06 13:16:32 0:20:38 0:12:56 0:07:42 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7688210 2024-05-03 21:11:00 2024-05-06 12:57:34 2024-05-06 13:28:04 0:30:30 0:19:24 0:11:06 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7688211 2024-05-03 21:11:01 2024-05-06 12:58:35 2024-05-06 13:20:18 0:21:43 0:14:27 0:07:16 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7688212 2024-05-03 21:11:02 2024-05-06 12:59:15 2024-05-06 13:30:13 0:30:58 0:18:55 0:12:03 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7688213 2024-05-03 21:11:03 2024-05-06 13:00:16 2024-05-06 14:14:11 1:13:55 1:04:43 0:09:12 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7688214 2024-05-03 21:11:04 2024-05-06 13:00:36 2024-05-06 13:59:40 0:59:04 0:51:50 0:07:14 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
fail 7688215 2024-05-03 21:11:05 2024-05-06 13:00:37 2024-05-06 13:22:16 0:21:39 0:11:46 0:09:53 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-2749716c-0bab-11ef-bc97-c7b262605968@mon.a'

pass 7688216 2024-05-03 21:11:06 2024-05-06 13:00:37 2024-05-06 13:19:37 0:19:00 0:13:12 0:05:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7688217 2024-05-03 21:11:07 2024-05-06 13:00:37 2024-05-06 13:21:43 0:21:06 0:13:37 0:07:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7688218 2024-05-03 21:11:08 2024-05-06 13:00:38 2024-05-06 13:21:38 0:21:00 0:14:11 0:06:49 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm} 1
pass 7688219 2024-05-03 21:11:09 2024-05-06 13:00:38 2024-05-06 14:08:33 1:07:55 0:56:58 0:10:57 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7688220 2024-05-03 21:11:10 2024-05-06 13:00:39 2024-05-06 13:34:46 0:34:07 0:20:29 0:13:38 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7688221 2024-05-03 21:11:11 2024-05-06 13:01:39 2024-05-06 13:33:39 0:32:00 0:19:37 0:12:23 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
dead 7688222 2024-05-03 21:11:12 2024-05-06 13:04:00 2024-05-07 01:13:37 12:09:37 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

hit max job timeout

pass 7688223 2024-05-03 21:11:13 2024-05-06 13:04:20 2024-05-06 13:25:17 0:20:57 0:13:38 0:07:19 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7688224 2024-05-03 21:11:14 2024-05-06 13:04:20 2024-05-06 13:28:00 0:23:40 0:13:55 0:09:45 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7688225 2024-05-03 21:11:15 2024-05-06 13:04:21 2024-05-06 13:22:16 0:17:55 0:10:27 0:07:28 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7688226 2024-05-03 21:11:16 2024-05-06 13:04:41 2024-05-06 13:26:13 0:21:32 0:13:49 0:07:43 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7688227 2024-05-03 21:11:17 2024-05-06 13:04:52 2024-05-06 13:35:30 0:30:38 0:20:09 0:10:29 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
pass 7688228 2024-05-03 21:11:18 2024-05-06 13:05:42 2024-05-06 13:25:19 0:19:37 0:11:46 0:07:51 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7688229 2024-05-03 21:11:19 2024-05-06 13:05:53 2024-05-06 13:19:24 0:13:31 0:05:50 0:07:41 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7688230 2024-05-03 21:11:20 2024-05-06 13:06:23 2024-05-06 14:12:19 1:05:56 0:57:05 0:08:51 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-05-06T13:50:00.000291+0000 mon.a (mon.0) 2095 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

pass 7688231 2024-05-03 21:11:22 2024-05-06 13:07:14 2024-05-06 13:37:04 0:29:50 0:22:20 0:07:30 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7688232 2024-05-03 21:11:23 2024-05-06 13:07:44 2024-05-06 13:29:21 0:21:37 0:15:15 0:06:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7688233 2024-05-03 21:11:24 2024-05-06 13:07:44 2024-05-06 13:48:02 0:40:18 0:26:14 0:14:04 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7688234 2024-05-03 21:11:25 2024-05-06 13:11:05 2024-05-06 13:43:23 0:32:18 0:22:13 0:10:05 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7688235 2024-05-03 21:11:26 2024-05-06 13:11:25 2024-05-06 13:42:14 0:30:49 0:19:24 0:11:25 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7688236 2024-05-03 21:11:27 2024-05-06 13:12:26 2024-05-06 13:31:34 0:19:08 0:13:17 0:05:51 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7688237 2024-05-03 21:11:28 2024-05-06 13:12:26 2024-05-06 13:33:59 0:21:33 0:14:55 0:06:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7688238 2024-05-03 21:11:29 2024-05-06 13:12:27 2024-05-06 13:55:51 0:43:24 0:36:20 0:07:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7688239 2024-05-03 21:11:30 2024-05-06 13:12:47 2024-05-06 13:31:56 0:19:09 0:12:34 0:06:35 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7688240 2024-05-03 21:11:31 2024-05-06 13:12:57 2024-05-06 13:32:31 0:19:34 0:12:37 0:06:57 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7688241 2024-05-03 21:11:32 2024-05-06 13:15:38 2024-05-06 13:39:24 0:23:46 0:16:22 0:07:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7688242 2024-05-03 21:11:33 2024-05-06 13:16:18 2024-05-06 13:37:09 0:20:51 0:15:18 0:05:33 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_host_drain} 3
pass 7688243 2024-05-03 21:11:34 2024-05-06 13:16:18 2024-05-06 13:53:06 0:36:48 0:30:53 0:05:55 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7688244 2024-05-03 21:11:35 2024-05-06 13:16:19 2024-05-06 13:49:54 0:33:35 0:23:40 0:09:55 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7688245 2024-05-03 21:11:36 2024-05-06 13:16:29 2024-05-06 14:11:23 0:54:54 0:48:41 0:06:13 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-05-06T13:44:23.366285+0000 mon.a (mon.0) 996 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7688246 2024-05-03 21:11:37 2024-05-06 13:16:30 2024-05-06 14:04:12 0:47:42 0:39:05 0:08:37 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7688247 2024-05-03 21:11:38 2024-05-06 13:16:30 2024-05-06 13:38:33 0:22:03 0:13:19 0:08:44 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7688248 2024-05-03 21:11:39 2024-05-06 13:17:30 2024-05-06 13:34:54 0:17:24 0:07:28 0:09:56 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi175 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7688249 2024-05-03 21:11:40 2024-05-06 13:17:31 2024-05-06 13:38:56 0:21:25 0:14:07 0:07:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7688250 2024-05-03 21:11:41 2024-05-06 14:03:28 2024-05-06 14:28:24 0:24:56 0:15:23 0:09:33 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7688251 2024-05-03 21:11:42 2024-05-06 14:03:28 2024-05-06 14:27:07 0:23:39 0:13:53 0:09:46 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7688252 2024-05-03 21:11:43 2024-05-06 14:04:18 2024-05-06 14:29:27 0:25:09 0:18:51 0:06:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7688253 2024-05-03 21:11:44 2024-05-06 14:04:19 2024-05-06 14:34:32 0:30:13 0:17:30 0:12:43 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7688254 2024-05-03 21:11:45 2024-05-06 14:05:29 2024-05-06 14:34:43 0:29:14 0:18:52 0:10:22 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi153 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70ce9539b62a15b9de429c1f0e91a1e012b099aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

pass 7688255 2024-05-03 21:11:46 2024-05-06 14:07:30 2024-05-06 14:55:50 0:48:20 0:37:36 0:10:44 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7688256 2024-05-03 21:11:47 2024-05-06 14:08:01 2024-05-06 14:36:48 0:28:47 0:18:20 0:10:27 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7688257 2024-05-03 21:11:48 2024-05-06 14:08:41 2024-05-06 14:38:39 0:29:58 0:19:57 0:10:01 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7688258 2024-05-03 21:11:49 2024-05-06 14:09:01 2024-05-06 14:49:12 0:40:11 0:25:18 0:14:53 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7688259 2024-05-03 21:11:50 2024-05-06 14:12:52 2024-05-06 14:42:58 0:30:06 0:20:52 0:09:14 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2