Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7675428 2024-04-26 21:08:39 2024-04-27 00:47:13 2024-04-27 01:05:03 0:17:50 0:10:38 0:07:12 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7675429 2024-04-26 21:08:40 2024-04-27 00:47:14 2024-04-27 01:25:51 0:38:37 0:27:46 0:10:51 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7675430 2024-04-26 21:08:41 2024-04-27 00:47:14 2024-04-27 01:06:08 0:18:54 0:13:14 0:05:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7675431 2024-04-26 21:08:42 2024-04-27 00:47:14 2024-04-27 01:18:51 0:31:37 0:23:52 0:07:45 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7675432 2024-04-26 21:08:43 2024-04-27 00:47:25 2024-04-27 01:59:32 1:12:07 1:03:24 0:08:43 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7675433 2024-04-26 21:08:44 2024-04-27 00:47:25 2024-04-27 01:19:20 0:31:55 0:20:05 0:11:50 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7675434 2024-04-26 21:08:45 2024-04-27 00:47:26 2024-04-27 01:33:55 0:46:29 0:37:55 0:08:34 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7675435 2024-04-26 21:08:46 2024-04-27 00:47:26 2024-04-27 01:38:11 0:50:45 0:37:25 0:13:20 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli_mon} 5
pass 7675436 2024-04-26 21:08:46 2024-04-27 00:47:26 2024-04-27 01:17:59 0:30:33 0:18:27 0:12:06 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7675437 2024-04-26 21:08:47 2024-04-27 00:47:27 2024-04-27 01:16:56 0:29:29 0:20:21 0:09:08 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7675438 2024-04-26 21:08:48 2024-04-27 00:47:27 2024-04-27 01:19:11 0:31:44 0:20:43 0:11:01 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7675439 2024-04-26 21:08:49 2024-04-27 00:47:27 2024-04-27 01:11:41 0:24:14 0:14:34 0:09:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7675440 2024-04-26 21:08:50 2024-04-27 00:47:28 2024-04-27 01:10:51 0:23:23 0:15:10 0:08:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_set_mon_crush_locations} 3
dead 7675441 2024-04-26 21:08:51 2024-04-27 00:47:28 2024-04-27 12:57:50 12:10:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7675442 2024-04-26 21:08:52 2024-04-27 00:47:29 2024-04-27 01:22:08 0:34:39 0:21:44 0:12:55 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7675443 2024-04-26 21:08:53 2024-04-27 00:47:29 2024-04-27 01:27:32 0:40:03 0:31:26 0:08:37 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi139 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8a4fbfe0-0431-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

fail 7675444 2024-04-26 21:08:54 2024-04-27 00:47:29 2024-04-27 01:07:16 0:19:47 0:07:17 0:12:30 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi145 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7675445 2024-04-26 21:08:55 2024-04-27 00:47:30 2024-04-27 01:30:04 0:42:34 0:33:46 0:08:48 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-27T01:10:35.997918+0000 mon.smithi104 (mon.0) 859 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7675446 2024-04-26 21:08:56 2024-04-27 00:47:30 2024-04-27 01:40:55 0:53:25 0:45:07 0:08:18 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7675447 2024-04-26 21:08:57 2024-04-27 00:47:30 2024-04-27 01:03:06 0:15:36 0:09:23 0:06:13 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7675448 2024-04-26 21:08:58 2024-04-27 00:47:31 2024-04-27 01:13:06 0:25:35 0:14:25 0:11:10 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7675449 2024-04-26 21:08:59 2024-04-27 00:47:31 2024-04-27 01:09:00 0:21:29 0:12:23 0:09:06 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7675450 2024-04-26 21:09:00 2024-04-27 00:47:32 2024-04-27 01:21:50 0:34:18 0:25:13 0:09:05 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-27T01:01:01.674425+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7675451 2024-04-26 21:09:01 2024-04-27 00:47:32 2024-04-27 01:08:04 0:20:32 0:12:22 0:08:10 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7675452 2024-04-26 21:09:02 2024-04-27 00:47:32 2024-04-27 01:10:55 0:23:23 0:15:09 0:08:14 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7675453 2024-04-26 21:09:03 2024-04-27 00:47:33 2024-04-27 01:07:59 0:20:26 0:12:48 0:07:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7675454 2024-04-26 21:09:04 2024-04-27 00:47:33 2024-04-27 01:10:31 0:22:58 0:10:49 0:12:09 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7675455 2024-04-26 21:09:05 2024-04-27 00:47:33 2024-04-27 01:06:05 0:18:32 0:10:51 0:07:41 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7675456 2024-04-26 21:09:06 2024-04-27 00:47:34 2024-04-27 01:42:30 0:54:56 0:43:26 0:11:30 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
fail 7675457 2024-04-26 21:09:07 2024-04-27 00:47:34 2024-04-27 01:37:30 0:49:56 0:37:22 0:12:34 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-27T01:22:06.884080+0000 mon.a (mon.0) 947 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7675458 2024-04-26 21:09:08 2024-04-27 00:47:34 2024-04-27 01:33:29 0:45:55 0:35:48 0:10:07 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
pass 7675459 2024-04-26 21:09:09 2024-04-27 00:47:35 2024-04-27 01:07:09 0:19:34 0:10:47 0:08:47 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_ca_signed_key} 2
pass 7675460 2024-04-26 21:09:10 2024-04-27 00:47:35 2024-04-27 01:11:38 0:24:03 0:14:23 0:09:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7675461 2024-04-26 21:09:11 2024-04-27 00:47:35 2024-04-27 01:32:38 0:45:03 0:20:07 0:24:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7675462 2024-04-26 21:09:12 2024-04-27 01:02:48 2024-04-27 01:23:30 0:20:42 0:13:47 0:06:55 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm} 1
pass 7675463 2024-04-26 21:09:13 2024-04-27 01:02:48 2024-04-27 01:24:19 0:21:31 0:13:48 0:07:43 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7675464 2024-04-26 21:09:14 2024-04-27 01:02:59 2024-04-27 01:23:34 0:20:35 0:13:10 0:07:25 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7675465 2024-04-26 21:09:15 2024-04-27 01:02:59 2024-04-27 02:23:58 1:20:59 1:11:37 0:09:22 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi110 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7eb047ca-0433-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c 'ceph orch ps'"

pass 7675466 2024-04-26 21:09:16 2024-04-27 01:02:59 2024-04-27 01:21:32 0:18:33 0:13:11 0:05:22 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
pass 7675467 2024-04-26 21:09:17 2024-04-27 01:03:00 2024-04-27 01:22:18 0:19:18 0:10:43 0:08:35 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7675468 2024-04-26 21:09:18 2024-04-27 01:05:10 2024-04-27 01:26:28 0:21:18 0:13:47 0:07:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7675469 2024-04-26 21:09:19 2024-04-27 01:05:11 2024-04-27 01:25:59 0:20:48 0:09:06 0:11:42 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi045 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7675470 2024-04-26 21:09:19 2024-04-27 01:06:11 2024-04-27 01:49:46 0:43:35 0:35:33 0:08:02 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7675471 2024-04-26 21:09:21 2024-04-27 01:06:11 2024-04-27 01:35:21 0:29:10 0:22:00 0:07:10 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 7675472 2024-04-26 21:09:22 2024-04-27 01:06:12 2024-04-27 01:39:05 0:32:53 0:21:10 0:11:43 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7675473 2024-04-26 21:09:22 2024-04-27 01:07:12 2024-04-27 01:29:20 0:22:08 0:13:57 0:08:11 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7675474 2024-04-26 21:09:23 2024-04-27 01:08:03 2024-04-27 01:29:36 0:21:33 0:14:57 0:06:36 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7675475 2024-04-26 21:09:24 2024-04-27 01:08:13 2024-04-27 01:27:42 0:19:29 0:11:11 0:08:18 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7675476 2024-04-26 21:09:25 2024-04-27 01:10:34 2024-04-27 01:29:53 0:19:19 0:12:52 0:06:27 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_extra_daemon_features} 2
Failure Reason:

"2024-04-27T01:27:50.045357+0000 mon.a (mon.0) 15 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

pass 7675477 2024-04-26 21:09:26 2024-04-27 01:10:54 2024-04-27 01:40:44 0:29:50 0:19:31 0:10:19 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7675478 2024-04-26 21:09:27 2024-04-27 01:11:05 2024-04-27 02:00:47 0:49:42 0:41:58 0:07:44 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi102 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d2f2b9c-0434-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7675479 2024-04-26 21:09:28 2024-04-27 01:11:45 2024-04-27 01:34:35 0:22:50 0:14:56 0:07:54 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7675480 2024-04-26 21:09:29 2024-04-27 01:11:46 2024-04-27 01:58:11 0:46:25 0:37:06 0:09:19 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7675481 2024-04-26 21:09:30 2024-04-27 01:13:06 2024-04-27 01:42:46 0:29:40 0:19:59 0:09:41 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
pass 7675482 2024-04-26 21:09:31 2024-04-27 01:13:07 2024-04-27 01:46:22 0:33:15 0:19:11 0:14:04 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7675483 2024-04-26 21:09:33 2024-04-27 01:16:27 2024-04-27 01:50:37 0:34:10 0:24:12 0:09:58 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7675484 2024-04-26 21:09:33 2024-04-27 01:16:58 2024-04-27 01:39:50 0:22:52 0:14:28 0:08:24 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_host_drain} 3
pass 7675485 2024-04-26 21:09:35 2024-04-27 01:18:08 2024-04-27 02:11:08 0:53:00 0:46:22 0:06:38 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7675486 2024-04-26 21:09:36 2024-04-27 01:18:09 2024-04-27 01:41:25 0:23:16 0:15:51 0:07:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7675487 2024-04-26 21:09:36 2024-04-27 01:18:19 2024-04-27 02:08:07 0:49:48 0:39:47 0:10:01 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rotate-keys} 2
fail 7675488 2024-04-26 21:09:37 2024-04-27 01:18:29 2024-04-27 01:35:56 0:17:27 0:07:32 0:09:55 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi002 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7675489 2024-04-26 21:09:38 2024-04-27 01:18:30 2024-04-27 01:37:30 0:19:00 0:12:31 0:06:29 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7675490 2024-04-26 21:09:39 2024-04-27 01:18:30 2024-04-27 01:40:23 0:21:53 0:14:32 0:07:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7675491 2024-04-26 21:09:40 2024-04-27 01:19:21 2024-04-27 01:40:05 0:20:44 0:13:31 0:07:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7675492 2024-04-26 21:09:41 2024-04-27 01:19:21 2024-04-27 01:49:00 0:29:39 0:20:55 0:08:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7675493 2024-04-26 21:09:42 2024-04-27 01:19:21 2024-04-27 01:59:58 0:40:37 0:26:19 0:14:18 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-04-27T01:50:00.000246+0000 mon.a (mon.0) 817 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 1 stray daemon(s) not managed by cephadm" in cluster log

fail 7675494 2024-04-26 21:09:43 2024-04-27 01:21:42 2024-04-27 05:08:20 3:46:38 3:34:57 0:11:41 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi071 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7675495 2024-04-26 21:09:44 2024-04-27 01:22:13 2024-04-27 01:54:46 0:32:33 0:23:44 0:08:49 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7675496 2024-04-26 21:09:45 2024-04-27 01:23:43 2024-04-27 01:41:50 0:18:07 0:10:57 0:07:10 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7675497 2024-04-26 21:09:46 2024-04-27 01:24:24 2024-04-27 01:43:17 0:18:53 0:11:17 0:07:36 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7675498 2024-04-26 21:09:47 2024-04-27 01:25:54 2024-04-27 01:47:52 0:21:58 0:13:27 0:08:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7675499 2024-04-26 21:09:48 2024-04-27 01:26:35 2024-04-27 01:46:47 0:20:12 0:12:04 0:08:08 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
pass 7675500 2024-04-26 21:09:49 2024-04-27 01:27:45 2024-04-27 01:46:16 0:18:31 0:10:52 0:07:39 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7675501 2024-04-26 21:09:50 2024-04-27 01:28:56 2024-04-27 01:55:12 0:26:16 0:17:50 0:08:26 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7675502 2024-04-26 21:09:51 2024-04-27 01:29:46 2024-04-27 01:54:13 0:24:27 0:13:37 0:10:50 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7675503 2024-04-26 21:09:52 2024-04-27 01:32:47 2024-04-27 02:55:37 1:22:50 1:11:55 0:10:55 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7675504 2024-04-26 21:09:53 2024-04-27 01:33:38 2024-04-27 01:52:48 0:19:10 0:13:17 0:05:53 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7675505 2024-04-26 21:09:54 2024-04-27 01:33:58 2024-04-27 02:23:31 0:49:33 0:40:30 0:09:03 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-27T01:53:50.367521+0000 mon.a (mon.0) 327 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7675506 2024-04-26 21:09:55 2024-04-27 01:33:59 2024-04-27 02:09:42 0:35:43 0:26:03 0:09:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7675507 2024-04-26 21:09:56 2024-04-27 01:33:59 2024-04-27 02:30:58 0:56:59 0:50:46 0:06:13 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7675508 2024-04-26 21:09:57 2024-04-27 01:33:59 2024-04-27 01:52:54 0:18:55 0:12:59 0:05:56 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_rgw_multisite} 3
pass 7675509 2024-04-26 21:09:58 2024-04-27 01:34:00 2024-04-27 01:55:36 0:21:36 0:14:52 0:06:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7675510 2024-04-26 21:09:59 2024-04-27 01:34:00 2024-04-27 02:35:32 1:01:32 0:51:15 0:10:17 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7675511 2024-04-26 21:10:00 2024-04-27 01:34:41 2024-04-27 01:50:32 0:15:51 0:08:48 0:07:03 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7675512 2024-04-26 21:10:01 2024-04-27 01:35:31 2024-04-27 02:05:11 0:29:40 0:18:03 0:11:37 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7675513 2024-04-26 21:10:02 2024-04-27 01:37:32 2024-04-27 01:57:05 0:19:33 0:12:20 0:07:13 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7675514 2024-04-26 21:10:03 2024-04-27 01:38:12 2024-04-27 01:58:27 0:20:15 0:12:31 0:07:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7675515 2024-04-26 21:10:04 2024-04-27 01:38:13 2024-04-27 02:11:22 0:33:09 0:21:51 0:11:18 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7675516 2024-04-26 21:10:05 2024-04-27 01:39:13 2024-04-27 02:10:02 0:30:49 0:20:02 0:10:47 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7675517 2024-04-26 21:10:06 2024-04-27 01:39:54 2024-04-27 02:16:48 0:36:54 0:29:12 0:07:42 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7675518 2024-04-26 21:10:07 2024-04-27 01:39:54 2024-04-27 02:01:09 0:21:15 0:14:40 0:06:35 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7675519 2024-04-26 21:10:08 2024-04-27 01:40:24 2024-04-27 01:59:47 0:19:23 0:13:27 0:05:56 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7675520 2024-04-26 21:10:09 2024-04-27 01:40:45 2024-04-27 01:58:44 0:17:59 0:11:03 0:06:56 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7675521 2024-04-26 21:10:10 2024-04-27 01:41:35 2024-04-27 02:03:59 0:22:24 0:11:12 0:11:12 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi178 with status 5: 'sudo systemctl stop ceph-ebbe5b12-0439-11ef-bc93-c7b262605968@mon.a'

pass 7675522 2024-04-26 21:10:11 2024-04-27 01:41:56 2024-04-27 02:11:41 0:29:45 0:21:53 0:07:52 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7675523 2024-04-26 21:10:12 2024-04-27 01:42:36 2024-04-27 02:03:39 0:21:03 0:13:42 0:07:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-27T02:00:00.000123+0000 mon.smithi073 (mon.0) 823 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s)" in cluster log

pass 7675524 2024-04-26 21:10:13 2024-04-27 01:42:37 2024-04-27 02:01:55 0:19:18 0:12:54 0:06:24 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7675525 2024-04-26 21:10:14 2024-04-27 01:42:47 2024-04-27 04:14:53 2:32:06 2:21:43 0:10:23 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi029 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4c587076-0439-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c 'ceph orch ps'"

pass 7675526 2024-04-26 21:10:15 2024-04-27 01:43:28 2024-04-27 02:15:56 0:32:28 0:20:48 0:11:40 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7675527 2024-04-26 21:10:16 2024-04-27 01:46:18 2024-04-27 02:14:22 0:28:04 0:18:03 0:10:01 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7675528 2024-04-26 21:10:17 2024-04-27 01:46:19 2024-04-27 02:16:32 0:30:13 0:20:21 0:09:52 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7675529 2024-04-26 21:10:18 2024-04-27 01:46:29 2024-04-27 02:05:57 0:19:28 0:13:16 0:06:12 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_cephadm} 1
fail 7675530 2024-04-26 21:10:19 2024-04-27 01:46:49 2024-04-27 02:41:20 0:54:31 0:46:55 0:07:36 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-04-27T02:12:38.282810+0000 mon.a (mon.0) 967 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7675531 2024-04-26 21:10:20 2024-04-27 01:48:00 2024-04-27 02:10:12 0:22:12 0:15:02 0:07:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7675532 2024-04-26 21:10:21 2024-04-27 01:49:10 2024-04-27 02:31:54 0:42:44 0:35:52 0:06:52 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7675533 2024-04-26 21:10:22 2024-04-27 01:49:21 2024-04-27 02:06:42 0:17:21 0:07:24 0:09:57 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi082 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

dead 7675534 2024-04-26 21:10:23 2024-04-27 01:49:21 2024-04-27 01:50:25 0:01:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi113

pass 7675535 2024-04-26 21:10:24 2024-04-27 01:49:22 2024-04-27 02:02:24 0:13:02 0:05:39 0:07:23 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7675536 2024-04-26 21:10:25 2024-04-27 01:49:22 2024-04-27 02:10:24 0:21:02 0:13:37 0:07:25 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7675537 2024-04-26 21:10:26 2024-04-27 01:49:42 2024-04-27 02:24:27 0:34:45 0:22:01 0:12:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-04-27T02:20:00.000229+0000 mon.smithi113 (mon.0) 970 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 1 stray daemon(s) not managed by cephadm" in cluster log

pass 7675538 2024-04-26 21:10:27 2024-04-27 01:50:33 2024-04-27 02:11:42 0:21:09 0:14:33 0:06:36 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7675539 2024-04-26 21:10:28 2024-04-27 01:50:33 2024-04-27 02:40:15 0:49:42 0:39:31 0:10:11 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
fail 7675540 2024-04-26 21:10:29 2024-04-27 01:50:44 2024-04-27 02:30:02 0:39:18 0:30:36 0:08:42 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi031 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c61eb24-043a-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

fail 7675541 2024-04-26 21:10:30 2024-04-27 01:52:54 2024-04-27 02:34:04 0:41:10 0:34:04 0:07:06 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-27T02:14:44.978233+0000 mon.smithi008 (mon.0) 882 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7675542 2024-04-26 21:10:31 2024-04-27 01:52:55 2024-04-27 02:48:36 0:55:41 0:45:26 0:10:15 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7675543 2024-04-26 21:10:32 2024-04-27 01:52:55 2024-04-27 02:13:38 0:20:43 0:12:24 0:08:19 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7675544 2024-04-26 21:10:33 2024-04-27 01:54:15 2024-04-27 02:18:33 0:24:18 0:14:22 0:09:56 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
fail 7675545 2024-04-26 21:10:34 2024-04-27 01:54:56 2024-04-27 02:27:58 0:33:02 0:25:41 0:07:21 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-27T02:07:08.704008+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

dead 7675546 2024-04-26 21:10:35 2024-04-27 01:54:56 2024-04-27 02:14:57 0:20:01 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7675547 2024-04-26 21:10:36 2024-04-27 01:55:17 2024-04-27 02:18:25 0:23:08 0:15:55 0:07:13 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7675548 2024-04-26 21:10:37 2024-04-27 01:55:17 2024-04-27 02:23:01 0:27:44 0:18:56 0:08:48 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7675549 2024-04-26 21:10:38 2024-04-27 01:55:38 2024-04-27 02:14:42 0:19:04 0:10:13 0:08:51 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7675550 2024-04-26 21:10:39 2024-04-27 01:57:08 2024-04-27 02:31:34 0:34:26 0:19:48 0:14:38 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_extra_daemon_features} 2
pass 7675551 2024-04-26 21:10:40 2024-04-27 01:58:29 2024-04-27 02:22:06 0:23:37 0:16:17 0:07:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7675552 2024-04-26 21:10:41 2024-04-27 01:58:49 2024-04-27 02:27:18 0:28:29 0:18:56 0:09:33 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7675553 2024-04-26 21:10:42 2024-04-27 01:59:40 2024-04-27 02:50:47 0:51:07 0:43:32 0:07:35 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
fail 7675554 2024-04-26 21:10:43 2024-04-27 01:59:50 2024-04-27 02:34:35 0:34:45 0:20:56 0:13:49 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-04-27T02:30:00.000226+0000 mon.smithi001 (mon.0) 867 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7675555 2024-04-26 21:10:44 2024-04-27 02:01:10 2024-04-27 02:23:10 0:22:00 0:14:38 0:07:22 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_host_drain} 3
pass 7675556 2024-04-26 21:10:45 2024-04-27 02:02:01 2024-04-27 02:26:22 0:24:21 0:13:13 0:11:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7675557 2024-04-26 21:10:46 2024-04-27 02:05:02 2024-04-27 03:10:36 1:05:34 0:56:25 0:09:09 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-27T02:39:22.894803+0000 mon.a (mon.0) 916 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7675558 2024-04-26 21:10:47 2024-04-27 02:05:02 2024-04-27 03:05:55 1:00:53 0:51:46 0:09:07 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi053 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ef33c28-043c-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c 'ceph orch ps'"

pass 7675559 2024-04-26 21:10:48 2024-04-27 02:05:03 2024-04-27 02:36:07 0:31:04 0:24:23 0:06:41 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7675560 2024-04-26 21:10:49 2024-04-27 02:05:03 2024-04-27 02:22:36 0:17:33 0:10:23 0:07:10 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7675561 2024-04-26 21:10:50 2024-04-27 02:05:03 2024-04-27 02:29:22 0:24:19 0:13:07 0:11:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7675562 2024-04-26 21:10:51 2024-04-27 02:08:14 2024-04-27 03:06:48 0:58:34 0:51:21 0:07:13 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7675563 2024-04-26 21:10:52 2024-04-27 02:09:45 2024-04-27 02:28:47 0:19:02 0:12:49 0:06:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7675564 2024-04-26 21:10:53 2024-04-27 02:09:45 2024-04-27 02:31:38 0:21:53 0:13:48 0:08:05 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7675565 2024-04-26 21:10:54 2024-04-27 02:10:06 2024-04-27 02:39:50 0:29:44 0:19:58 0:09:46 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7675566 2024-04-26 21:10:55 2024-04-27 02:10:16 2024-04-27 02:44:04 0:33:48 0:24:44 0:09:04 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7675567 2024-04-26 21:10:56 2024-04-27 02:10:26 2024-04-27 03:21:08 1:10:42 1:00:02 0:10:40 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7675568 2024-04-26 21:10:57 2024-04-27 02:11:17 2024-04-27 02:34:54 0:23:37 0:16:58 0:06:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7675569 2024-04-26 21:10:58 2024-04-27 02:11:27 2024-04-27 02:28:56 0:17:29 0:11:08 0:06:21 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7675570 2024-04-26 21:10:59 2024-04-27 02:11:48 2024-04-27 02:49:48 0:38:00 0:25:23 0:12:37 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_monitoring_stack_basic} 3
pass 7675571 2024-04-26 21:11:00 2024-04-27 02:13:48 2024-04-27 02:35:46 0:21:58 0:14:41 0:07:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7675572 2024-04-26 21:11:01 2024-04-27 02:14:29 2024-04-27 02:54:20 0:39:51 0:32:28 0:07:23 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1714185549.3107042 mon.smithi038 (mon.0) 897 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7675573 2024-04-26 21:11:02 2024-04-27 02:14:49 2024-04-27 02:36:52 0:22:03 0:12:12 0:09:51 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
dead 7675574 2024-04-26 21:11:03 2024-04-27 02:14:50 2024-04-27 02:34:25 0:19:35 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7675575 2024-04-26 21:11:04 2024-04-27 02:15:20 2024-04-27 02:46:30 0:31:10 0:19:05 0:12:05 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7675576 2024-04-26 21:11:05 2024-04-27 02:16:41 2024-04-27 02:46:44 0:30:03 0:19:12 0:10:51 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7675577 2024-04-26 21:11:06 2024-04-27 02:16:51 2024-04-27 02:37:41 0:20:50 0:12:25 0:08:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7675578 2024-04-26 21:11:07 2024-04-27 02:18:32 2024-04-27 02:36:16 0:17:44 0:07:27 0:10:17 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi044 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7675579 2024-04-26 21:11:08 2024-04-27 02:18:42 2024-04-27 02:39:19 0:20:37 0:12:46 0:07:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7675580 2024-04-26 21:11:09 2024-04-27 02:20:33 2024-04-27 02:49:34 0:29:01 0:22:03 0:06:58 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
pass 7675581 2024-04-26 21:11:10 2024-04-27 02:20:53 2024-04-27 02:41:26 0:20:33 0:13:24 0:07:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7675582 2024-04-26 21:11:12 2024-04-27 02:22:14 2024-04-27 03:00:26 0:38:12 0:30:38 0:07:34 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
fail 7675583 2024-04-26 21:11:13 2024-04-27 02:22:45 2024-04-27 03:02:15 0:39:30 0:32:09 0:07:21 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-04-27T02:35:55.249713+0000 mon.a (mon.0) 374 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7675584 2024-04-26 21:11:14 2024-04-27 02:23:15 2024-04-27 02:49:53 0:26:38 0:15:24 0:11:14 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7675585 2024-04-26 21:11:15 2024-04-27 02:26:26 2024-04-27 02:48:28 0:22:02 0:13:41 0:08:21 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7675586 2024-04-26 21:11:16 2024-04-27 02:27:26 2024-04-27 03:00:36 0:33:10 0:21:33 0:11:37 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7675587 2024-04-26 21:11:17 2024-04-27 02:28:57 2024-04-27 02:58:45 0:29:48 0:20:48 0:09:00 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7675588 2024-04-26 21:11:18 2024-04-27 02:28:57 2024-04-27 03:14:43 0:45:46 0:37:07 0:08:39 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7675589 2024-04-26 21:11:19 2024-04-27 02:29:28 2024-04-27 02:48:26 0:18:58 0:12:52 0:06:06 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7675590 2024-04-26 21:11:20 2024-04-27 02:29:28 2024-04-27 02:47:57 0:18:29 0:10:45 0:07:44 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7675591 2024-04-26 21:11:21 2024-04-27 02:30:59 2024-04-27 02:49:52 0:18:53 0:10:17 0:08:36 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7675592 2024-04-26 21:11:22 2024-04-27 02:31:39 2024-04-27 02:53:15 0:21:36 0:14:10 0:07:26 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7675593 2024-04-26 21:11:23 2024-04-27 02:31:39 2024-04-27 03:01:23 0:29:44 0:20:23 0:09:21 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
pass 7675594 2024-04-26 21:11:24 2024-04-27 02:32:00 2024-04-27 02:52:01 0:20:01 0:11:03 0:08:58 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7675595 2024-04-26 21:11:25 2024-04-27 02:34:40 2024-04-27 02:54:24 0:19:44 0:11:56 0:07:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_ca_signed_key} 2
pass 7675596 2024-04-26 21:11:26 2024-04-27 02:35:01 2024-04-27 02:59:06 0:24:05 0:15:35 0:08:30 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7675597 2024-04-26 21:11:27 2024-04-27 02:35:51 2024-04-27 03:23:50 0:47:59 0:38:56 0:09:03 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7675598 2024-04-26 21:11:28 2024-04-27 02:36:12 2024-04-27 03:08:07 0:31:55 0:21:48 0:10:07 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7675599 2024-04-26 21:11:29 2024-04-27 02:36:12 2024-04-27 02:55:15 0:19:03 0:13:07 0:05:56 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7675600 2024-04-26 21:11:30 2024-04-27 02:36:23 2024-04-27 03:19:01 0:42:38 0:36:23 0:06:15 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7675601 2024-04-26 21:11:31 2024-04-27 02:36:23 2024-04-27 03:05:14 0:28:51 0:19:27 0:09:24 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_cephadm} 1
pass 7675602 2024-04-26 21:11:32 2024-04-27 02:36:23 2024-04-27 02:59:20 0:22:57 0:15:26 0:07:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7675603 2024-04-26 21:11:33 2024-04-27 02:36:24 2024-04-27 03:09:18 0:32:54 0:25:31 0:07:23 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 87b7627e-0440-11ef-bc93-c7b262605968 -e sha1=b22e2ebdeb24376882b7bda2a7329c8cccc2276a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

pass 7675604 2024-04-26 21:11:34 2024-04-27 02:36:24 2024-04-27 02:55:20 0:18:56 0:13:00 0:05:56 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7675605 2024-04-26 21:11:35 2024-04-27 02:36:24 2024-04-27 02:55:22 0:18:58 0:12:41 0:06:17 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7675606 2024-04-26 21:11:36 2024-04-27 02:36:25 2024-04-27 02:59:21 0:22:56 0:17:22 0:05:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7675607 2024-04-26 21:11:37 2024-04-27 02:36:25 2024-04-27 02:47:58 0:11:33 0:05:26 0:06:07 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_cephadm_repos} 1
pass 7675608 2024-04-26 21:11:38 2024-04-27 02:36:25 2024-04-27 03:00:10 0:23:45 0:15:27 0:08:18 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7675609 2024-04-26 21:11:39 2024-04-27 02:36:26 2024-04-27 03:10:41 0:34:15 0:23:37 0:10:38 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7675610 2024-04-26 21:11:40 2024-04-27 02:36:26 2024-04-27 03:49:50 1:13:24 1:00:39 0:12:45 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-27T03:02:10.930339+0000 mon.a (mon.0) 616 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7675611 2024-04-26 21:11:41 2024-04-27 02:36:26 2024-04-27 02:57:13 0:20:47 0:13:08 0:07:39 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7675612 2024-04-26 21:11:42 2024-04-27 02:37:47 2024-04-27 02:58:41 0:20:54 0:14:45 0:06:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2