Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7668550 2024-04-22 20:10:26 2024-04-22 20:11:59 2024-04-22 20:43:34 0:31:35 0:20:24 0:11:11 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7668551 2024-04-22 20:10:27 2024-04-22 20:32:54 879 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-04-22T20:28:40.592028+0000 mon.smithi038 (mon.0) 790 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7668552 2024-04-22 20:10:28 2024-04-22 20:11:59 2024-04-22 20:36:23 0:24:24 0:16:00 0:08:24 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm} 1
pass 7668553 2024-04-22 20:10:29 2024-04-22 20:12:00 2024-04-22 20:34:34 0:22:34 0:14:17 0:08:17 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7668554 2024-04-22 20:10:30 2024-04-22 20:12:00 2024-04-22 20:42:50 0:30:50 0:22:15 0:08:35 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} 2
fail 7668555 2024-04-22 20:10:31 2024-04-22 20:12:00 2024-04-23 00:01:38 3:49:38 3:36:54 0:12:44 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi138 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8254cb5a247caa8e3d35e534a1fefe2362a0a4b8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7668556 2024-04-22 20:10:32 2024-04-22 20:12:01 2024-04-22 21:01:29 0:49:28 0:37:13 0:12:15 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7668557 2024-04-22 20:10:32 2024-04-22 20:12:01 2024-04-22 20:41:48 0:29:47 0:18:54 0:10:53 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7668558 2024-04-22 20:10:33 2024-04-22 20:12:02 2024-04-22 20:43:15 0:31:13 0:19:33 0:11:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7668559 2024-04-22 20:10:34 2024-04-22 20:12:02 2024-04-22 20:50:32 0:38:30 0:30:50 0:07:40 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7668560 2024-04-22 20:10:35 2024-04-22 20:12:03 2024-04-22 20:34:55 0:22:52 0:13:57 0:08:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7668561 2024-04-22 20:10:36 2024-04-22 20:12:03 2024-04-22 20:33:38 0:21:35 0:09:13 0:12:22 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi165 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8254cb5a247caa8e3d35e534a1fefe2362a0a4b8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7668562 2024-04-22 20:10:37 2024-04-22 20:12:03 2024-04-22 20:33:59 0:21:56 0:13:34 0:08:22 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-04-22T20:29:34.534825+0000 mon.smithi089 (mon.0) 823 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668563 2024-04-22 20:10:38 2024-04-22 20:12:04 2024-04-22 20:37:07 0:25:03 0:17:23 0:07:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7668564 2024-04-22 20:10:39 2024-04-22 20:12:04 2024-04-22 20:44:24 0:32:20 0:21:20 0:11:00 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7668565 2024-04-22 20:10:40 2024-04-22 20:12:04 2024-04-22 20:34:51 0:22:47 0:13:54 0:08:53 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_extra_daemon_features} 2
fail 7668566 2024-04-22 20:10:41 2024-04-22 20:12:05 2024-04-22 20:57:29 0:45:24 0:38:26 0:06:58 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7668567 2024-04-22 20:10:42 2024-04-22 20:12:05 2024-04-22 20:55:21 0:43:16 0:34:12 0:09:04 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7668568 2024-04-22 20:10:43 2024-04-22 20:12:06 2024-04-22 20:56:38 0:44:32 0:36:47 0:07:45 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-04-22T20:32:45.561312+0000 mon.a (mon.0) 616 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668569 2024-04-22 20:10:44 2024-04-22 20:12:06 2024-04-22 20:28:58 0:16:52 0:09:34 0:07:18 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_adoption} 1
pass 7668570 2024-04-22 20:10:45 2024-04-22 20:12:06 2024-04-22 20:29:04 0:16:58 0:11:15 0:05:43 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
fail 7668571 2024-04-22 20:10:46 2024-04-22 20:12:07 2024-04-22 20:33:48 0:21:41 0:08:17 0:13:24 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi078 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7668572 2024-04-22 20:10:46 2024-04-22 20:12:07 2024-04-22 20:32:32 0:20:25 0:12:47 0:07:38 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/deploy-raw} 2
fail 7668573 2024-04-22 20:10:47 2024-04-22 20:12:07 2024-04-22 20:45:08 0:33:01 0:24:35 0:08:26 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-22T20:26:26.581539+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7668574 2024-04-22 20:10:48 2024-04-22 20:12:08 2024-04-22 20:34:03 0:21:55 0:14:17 0:07:38 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
pass 7668575 2024-04-22 20:10:49 2024-04-22 20:12:08 2024-04-22 20:31:50 0:19:42 0:12:45 0:06:57 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7668576 2024-04-22 20:10:50 2024-04-22 20:12:29 2024-04-22 20:30:51 0:18:22 0:10:58 0:07:24 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7668577 2024-04-22 20:10:51 2024-04-22 20:12:29 2024-04-22 20:33:24 0:20:55 0:11:13 0:09:42 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7668578 2024-04-22 20:10:52 2024-04-22 20:16:20 2024-04-22 21:05:25 0:49:05 0:42:57 0:06:08 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi102 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77c35402-00e6-11ef-bc93-c7b262605968 -e sha1=56e81df3aeb98b717efe2ab0537a8c60249f95f7 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7668579 2024-04-22 20:10:53 2024-04-22 20:16:20 2024-04-22 20:46:00 0:29:40 0:23:06 0:06:34 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7668580 2024-04-22 20:10:54 2024-04-22 20:16:51 2024-04-22 20:39:37 0:22:46 0:13:13 0:09:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7668581 2024-04-22 20:10:55 2024-04-22 20:20:32 2024-04-22 21:04:02 0:43:30 0:35:23 0:08:07 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
fail 7668582 2024-04-22 20:10:56 2024-04-22 20:20:52 2024-04-22 20:45:00 0:24:08 0:15:02 0:09:06 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-04-22T20:39:22.726043+0000 mon.a (mon.0) 590 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7668583 2024-04-22 20:10:56 2024-04-22 20:21:53 2024-04-22 20:45:27 0:23:34 0:14:44 0:08:50 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-04-22T20:37:05.053988+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668584 2024-04-22 20:10:57 2024-04-22 20:24:03 2024-04-22 20:57:30 0:33:27 0:19:31 0:13:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7668585 2024-04-22 20:10:58 2024-04-22 20:25:44 2024-04-22 20:44:59 0:19:15 0:12:21 0:06:54 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7668586 2024-04-22 20:10:59 2024-04-22 20:25:54 2024-04-22 20:47:35 0:21:41 0:13:53 0:07:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-22T20:43:42.808901+0000 mon.smithi005 (mon.0) 819 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668587 2024-04-22 20:11:00 2024-04-22 20:26:45 2024-04-22 20:48:13 0:21:28 0:13:10 0:08:18 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7668588 2024-04-22 20:11:01 2024-04-22 20:29:05 2024-04-22 21:34:12 1:05:07 0:56:24 0:08:43 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi042 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92a6a74a-00e8-11ef-bc93-c7b262605968 -e sha1=56e81df3aeb98b717efe2ab0537a8c60249f95f7 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

fail 7668589 2024-04-22 20:11:02 2024-04-22 20:29:06 2024-04-22 20:49:21 0:20:15 0:13:06 0:07:09 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-04-22T20:48:06.957905+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7668590 2024-04-22 20:11:03 2024-04-22 20:30:26 2024-04-22 20:48:14 0:17:48 0:10:19 0:07:29 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7668591 2024-04-22 20:11:04 2024-04-22 20:30:37 2024-04-22 20:52:06 0:21:29 0:13:52 0:07:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7668592 2024-04-22 20:11:05 2024-04-22 20:30:57 2024-04-22 21:04:01 0:33:04 0:21:24 0:11:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7668593 2024-04-22 20:11:05 2024-04-22 20:31:58 2024-04-22 21:01:53 0:29:55 0:19:02 0:10:53 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7668594 2024-04-22 20:11:06 2024-04-22 20:32:18 2024-04-22 21:29:43 0:57:25 0:48:44 0:08:41 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
dead 7668595 2024-04-22 20:11:07 2024-04-22 20:32:19 2024-04-22 20:33:23 0:01:04 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi131

fail 7668596 2024-04-22 20:11:08 2024-04-22 20:32:19 2024-04-22 20:58:45 0:26:26 0:18:20 0:08:06 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-04-22T20:49:07.944687+0000 mon.a (mon.0) 380 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668597 2024-04-22 20:11:09 2024-04-22 20:33:29 2024-04-22 20:54:45 0:21:16 0:14:38 0:06:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7668598 2024-04-22 20:11:10 2024-04-22 20:33:40 2024-04-22 20:53:38 0:19:58 0:11:05 0:08:53 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-22T20:48:07.710873+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668599 2024-04-22 20:11:11 2024-04-22 20:34:20 2024-04-22 21:26:07 0:51:47 0:41:08 0:10:39 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-22T20:54:24.957447+0000 mon.a (mon.0) 375 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668600 2024-04-22 20:11:12 2024-04-22 20:34:31 2024-04-22 20:59:02 0:24:31 0:15:16 0:09:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7668601 2024-04-22 20:11:13 2024-04-22 20:34:41 2024-04-22 21:08:49 0:34:08 0:24:59 0:09:09 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7668602 2024-04-22 20:11:14 2024-04-22 20:34:52 2024-04-22 20:54:52 0:20:00 0:12:46 0:07:14 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7668603 2024-04-22 20:11:15 2024-04-22 20:35:02 2024-04-22 21:20:54 0:45:52 0:37:04 0:08:48 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7668604 2024-04-22 20:11:16 2024-04-22 20:37:13 2024-04-22 21:06:41 0:29:28 0:19:35 0:09:53 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-04-22T21:03:56.596692+0000 mon.a (mon.0) 540 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7668605 2024-04-22 20:11:16 2024-04-22 20:37:13 2024-04-22 20:57:02 0:19:49 0:12:49 0:07:00 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7668606 2024-04-22 20:11:17 2024-04-22 20:37:54 2024-04-22 21:09:36 0:31:42 0:19:07 0:12:35 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
fail 7668607 2024-04-22 20:11:18 2024-04-22 20:39:44 2024-04-22 21:13:34 0:33:50 0:23:26 0:10:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-04-22T21:05:31.734664+0000 mon.smithi096 (mon.0) 849 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7668608 2024-04-22 20:11:19 2024-04-22 20:39:55 2024-04-22 21:04:40 0:24:45 0:15:40 0:09:05 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-04-22T21:00:19.719204+0000 mon.smithi007 (mon.0) 1003 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668609 2024-04-22 20:11:20 2024-04-22 20:41:55 2024-04-22 21:18:59 0:37:04 0:23:25 0:13:39 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-04-22T21:09:42.113159+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668610 2024-04-22 20:11:21 2024-04-22 20:42:56 2024-04-22 21:40:37 0:57:41 0:50:25 0:07:16 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
fail 7668611 2024-04-22 20:11:22 2024-04-22 20:43:16 2024-04-22 21:04:59 0:21:43 0:13:56 0:07:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-04-22T21:00:24.231067+0000 mon.smithi113 (mon.0) 855 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7668612 2024-04-22 20:11:23 2024-04-22 20:43:37 2024-04-22 21:27:25 0:43:48 0:33:15 0:10:33 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7668613 2024-04-22 20:11:24 2024-04-22 20:43:47 2024-04-22 21:05:36 0:21:49 0:13:08 0:08:41 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7668614 2024-04-22 20:11:25 2024-04-22 20:44:28 2024-04-22 21:16:48 0:32:20 0:21:55 0:10:25 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-04-22T21:12:10.041963+0000 mon.smithi060 (mon.0) 785 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7668615 2024-04-22 20:11:26 2024-04-22 20:45:08 2024-04-22 21:08:06 0:22:58 0:11:17 0:11:41 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-f7374b76-00eb-11ef-bc93-c7b262605968@mon.a'

dead 7668616 2024-04-22 20:11:27 2024-04-22 20:46:09 2024-04-23 08:57:16 12:11:07 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

hit max job timeout

fail 7668617 2024-04-22 20:11:28 2024-04-22 20:47:59 2024-04-22 21:06:09 0:18:10 0:07:36 0:10:34 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi105 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7668618 2024-04-22 20:11:29 2024-04-22 20:48:00 2024-04-22 21:19:11 0:31:11 0:23:37 0:07:34 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli_mon} 5
pass 7668619 2024-04-22 20:11:30 2024-04-22 20:48:00 2024-04-22 21:12:04 0:24:04 0:13:51 0:10:13 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7668620 2024-04-22 20:11:31 2024-04-22 20:48:00 2024-04-22 21:05:34 0:17:34 0:10:29 0:07:05 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7668621 2024-04-22 20:11:32 2024-04-22 20:48:01 2024-04-22 21:06:59 0:18:58 0:12:54 0:06:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7668622 2024-04-22 20:11:33 2024-04-22 20:48:01 2024-04-22 21:06:51 0:18:50 0:12:20 0:06:30 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7668623 2024-04-22 20:11:34 2024-04-22 20:48:01 2024-04-22 21:09:50 0:21:49 0:11:39 0:10:10 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-22T21:04:50.443867+0000 mon.a (mon.0) 445 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668624 2024-04-22 20:11:35 2024-04-22 20:50:42 2024-04-22 21:12:02 0:21:20 0:14:01 0:07:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7668625 2024-04-22 20:11:36 2024-04-22 20:51:03 2024-04-22 21:13:21 0:22:18 0:13:57 0:08:21 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7668626 2024-04-22 20:11:37 2024-04-22 20:52:13 2024-04-22 21:24:58 0:32:45 0:22:03 0:10:42 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-04-22T21:20:20.230384+0000 mon.smithi081 (mon.0) 806 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668627 2024-04-22 20:11:38 2024-04-22 20:53:24 2024-04-22 21:16:49 0:23:25 0:14:00 0:09:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm} 1
pass 7668628 2024-04-22 20:11:39 2024-04-22 20:54:54 2024-04-22 21:50:15 0:55:21 0:47:44 0:07:37 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7668629 2024-04-22 20:11:40 2024-04-22 20:54:55 2024-04-22 21:32:03 0:37:08 0:30:35 0:06:33 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7668630 2024-04-22 20:11:41 2024-04-22 20:54:55 2024-04-22 21:31:14 0:36:19 0:25:14 0:11:05 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7668631 2024-04-22 20:11:42 2024-04-22 20:55:26 2024-04-22 21:25:34 0:30:08 0:22:32 0:07:36 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7668632 2024-04-22 20:11:43 2024-04-22 20:56:16 2024-04-22 21:18:15 0:21:59 0:14:32 0:07:27 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7668633 2024-04-22 20:11:44 2024-04-22 20:57:07 2024-04-22 21:09:59 0:12:52 0:05:32 0:07:20 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm_repos} 1
pass 7668634 2024-04-22 20:11:45 2024-04-22 20:57:07 2024-04-22 21:34:45 0:37:38 0:31:25 0:06:13 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7668635 2024-04-22 20:11:46 2024-04-22 20:57:37 2024-04-22 21:12:40 0:15:03 0:09:19 0:05:44 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_adoption} 1
pass 7668636 2024-04-22 20:11:46 2024-04-22 20:57:48 2024-04-22 21:30:19 0:32:31 0:18:39 0:13:52 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7668637 2024-04-22 20:11:47 2024-04-22 20:59:08 2024-04-22 21:18:46 0:19:38 0:12:15 0:07:23 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7668638 2024-04-22 20:11:48 2024-04-22 20:59:29 2024-04-22 21:20:54 0:21:25 0:13:04 0:08:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7668639 2024-04-22 20:11:49 2024-04-22 21:01:39 2024-04-22 21:35:32 0:33:53 0:20:49 0:13:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7668640 2024-04-22 20:11:50 2024-04-22 21:01:40 2024-04-22 21:31:43 0:30:03 0:19:44 0:10:19 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_extra_daemon_features} 2
Failure Reason:

"2024-04-22T21:25:28.937843+0000 mon.a (mon.0) 345 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668641 2024-04-22 20:11:51 2024-04-22 21:01:40 2024-04-22 21:23:11 0:21:31 0:13:49 0:07:42 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7668642 2024-04-22 20:11:52 2024-04-22 21:02:00 2024-04-22 21:20:31 0:18:31 0:10:30 0:08:01 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7668643 2024-04-22 20:11:53 2024-04-22 21:03:31 2024-04-22 22:03:30 0:59:59 0:49:20 0:10:39 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7668644 2024-04-22 20:11:54 2024-04-22 21:03:31 2024-04-22 21:22:26 0:18:55 0:12:05 0:06:50 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7668645 2024-04-22 20:11:55 2024-04-22 21:03:32 2024-04-22 21:26:44 0:23:12 0:15:09 0:08:03 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-04-22T21:18:59.678570+0000 mon.a (mon.0) 655 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7668646 2024-04-22 20:11:56 2024-04-22 21:03:32 2024-04-22 21:24:42 0:21:10 0:14:02 0:07:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-22T21:21:17.765393+0000 mon.smithi050 (mon.0) 823 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668647 2024-04-22 20:11:57 2024-04-22 21:03:33 2024-04-22 21:44:44 0:41:11 0:33:59 0:07:12 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
fail 7668648 2024-04-22 20:11:58 2024-04-22 21:03:33 2024-04-22 21:25:12 0:21:39 0:14:48 0:06:51 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-04-22T21:23:31.776169+0000 mon.a (mon.0) 737 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

fail 7668649 2024-04-22 20:11:59 2024-04-22 21:04:03 2024-04-22 22:04:55 1:00:52 0:51:28 0:09:24 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7668650 2024-04-22 20:12:00 2024-04-22 21:36:05 1155 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-04-22T21:33:28.980647+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7668651 2024-04-22 20:12:01 2024-04-22 21:05:44 2024-04-22 21:33:26 0:27:42 0:18:20 0:09:22 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7668652 2024-04-22 20:12:02 2024-04-22 21:05:45 2024-04-22 21:36:42 0:30:57 0:20:13 0:10:44 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7668653 2024-04-22 20:12:03 2024-04-22 21:07:05 2024-04-22 22:16:45 1:09:40 0:57:46 0:11:54 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7668654 2024-04-22 20:12:04 2024-04-23 02:20:05 2024-04-23 02:41:57 0:21:52 0:14:38 0:07:14 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7668655 2024-04-22 20:12:05 2024-04-23 02:20:56 2024-04-23 02:42:48 0:21:52 0:13:18 0:08:34 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7668656 2024-04-22 20:12:06 2024-04-23 02:21:06 2024-04-23 02:43:45 0:22:39 0:12:53 0:09:46 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-04-23T02:37:14.249761+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668657 2024-04-22 20:12:07 2024-04-23 02:44:14 904 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7668658 2024-04-22 20:12:08 2024-04-23 02:22:57 2024-04-23 03:21:28 0:58:31 0:48:34 0:09:57 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
fail 7668659 2024-04-22 20:12:09 2024-04-23 02:23:38 2024-04-23 02:57:57 0:34:19 0:22:31 0:11:48 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-04-23T02:54:50.369434+0000 mon.smithi079 (mon.0) 965 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668660 2024-04-22 20:12:10 2024-04-23 02:26:09 2024-04-23 03:05:48 0:39:39 0:26:39 0:13:00 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7668661 2024-04-22 20:12:11 2024-04-23 02:27:19 2024-04-23 03:04:49 0:37:30 0:30:26 0:07:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7668662 2024-04-22 20:12:12 2024-04-23 02:27:30 2024-04-23 02:45:24 0:17:54 0:07:19 0:10:35 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/master} 1
Failure Reason:

Command failed on smithi171 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7668663 2024-04-22 20:12:13 2024-04-23 02:27:30 2024-04-23 03:09:43 0:42:13 0:34:15 0:07:58 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7668664 2024-04-22 20:12:14 2024-04-23 02:28:21 2024-04-23 03:26:12 0:57:51 0:47:09 0:10:42 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
Failure Reason:

"2024-04-23T02:53:51.751808+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

fail 7668665 2024-04-22 20:12:15 2024-04-23 02:28:31 2024-04-23 02:47:15 0:18:44 0:12:35 0:06:09 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-04-23T02:45:28.392400+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7668666 2024-04-22 20:12:16 2024-04-23 02:28:31 2024-04-23 02:47:06 0:18:35 0:10:52 0:07:43 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
pass 7668667 2024-04-22 20:12:17 2024-04-23 02:30:12 2024-04-23 03:00:01 0:29:49 0:20:47 0:09:02 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7668668 2024-04-22 20:12:18 2024-04-23 02:30:22 2024-04-23 03:03:37 0:33:15 0:25:20 0:07:55 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-23T02:43:43.548051+0000 mon.a (mon.0) 208 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7668669 2024-04-22 20:12:19 2024-04-23 02:30:23 2024-04-23 02:50:11 0:19:48 0:12:03 0:07:45 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
fail 7668670 2024-04-22 20:12:20 2024-04-23 02:31:03 2024-04-23 02:56:05 0:25:02 0:18:09 0:06:53 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-04-23T02:50:08.198086+0000 mon.smithi012 (mon.0) 872 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7668671 2024-04-22 20:12:21 2024-04-23 02:31:04 2024-04-23 02:58:48 0:27:44 0:18:23 0:09:21 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7668672 2024-04-22 20:12:22 2024-04-23 02:31:04 2024-04-23 02:51:15 0:20:11 0:11:25 0:08:46 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7668673 2024-04-22 20:12:23 2024-04-23 02:32:14 2024-04-23 03:17:09 0:44:55 0:32:40 0:12:15 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7668674 2024-04-22 20:12:24 2024-04-23 02:33:15 2024-04-23 03:09:24 0:36:09 0:24:50 0:11:19 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7668675 2024-04-22 20:12:25 2024-04-23 02:33:35 2024-04-23 02:57:20 0:23:45 0:16:37 0:07:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7668676 2024-04-22 20:12:26 2024-04-23 02:34:06 2024-04-23 02:55:40 0:21:34 0:13:25 0:08:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-04-23T02:50:40.713423+0000 mon.a (mon.0) 382 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668677 2024-04-22 20:12:27 2024-04-23 02:34:46 2024-04-23 03:09:46 0:35:00 0:23:40 0:11:20 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-04-23T03:04:18.607793+0000 mon.smithi029 (mon.0) 859 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7668678 2024-04-22 20:12:28 2024-04-23 02:34:47 2024-04-23 02:55:04 0:20:17 0:12:39 0:07:38 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7668679 2024-04-22 20:12:29 2024-04-23 03:38:47 3350 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
fail 7668680 2024-04-22 20:12:29 2024-04-23 02:35:48 2024-04-23 02:55:01 0:19:13 0:12:58 0:06:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-04-23T02:52:05.441977+0000 mon.smithi136 (mon.0) 784 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7668681 2024-04-22 20:12:30 2024-04-23 02:36:08 2024-04-23 03:19:51 0:43:43 0:35:08 0:08:35 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-04-23T02:51:40.703663+0000 mon.a (mon.0) 660 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668682 2024-04-22 20:12:31 2024-04-23 02:36:58 2024-04-23 03:00:01 0:23:03 0:14:47 0:08:16 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_set_mon_crush_locations} 3
fail 7668683 2024-04-22 20:12:32 2024-04-23 02:38:59 2024-04-23 03:38:36 0:59:37 0:51:57 0:07:40 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7668684 2024-04-22 20:12:33 2024-04-23 02:39:40 2024-04-23 03:17:25 0:37:45 0:28:36 0:09:09 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli_mon} 5
pass 7668685 2024-04-22 20:12:34 2024-04-23 02:41:00 2024-04-23 02:59:09 0:18:09 0:10:34 0:07:35 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
pass 7668686 2024-04-22 20:12:35 2024-04-23 02:42:01 2024-04-23 03:03:53 0:21:52 0:13:43 0:08:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7668687 2024-04-22 20:12:36 2024-04-23 02:42:51 2024-04-23 03:15:31 0:32:40 0:21:32 0:11:08 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7668688 2024-04-22 20:12:37 2024-04-23 02:43:52 2024-04-23 03:17:30 0:33:38 0:25:53 0:07:45 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
fail 7668689 2024-04-22 20:12:38 2024-04-23 02:44:02 2024-04-23 03:06:00 0:21:58 0:13:48 0:08:10 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-04-23T03:01:56.038329+0000 mon.smithi150 (mon.0) 830 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668690 2024-04-22 20:12:39 2024-04-23 02:44:23 2024-04-23 03:07:15 0:22:52 0:13:31 0:09:21 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7668691 2024-04-22 20:12:40 2024-04-23 02:46:03 2024-04-23 03:11:22 0:25:19 0:18:04 0:07:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7668692 2024-04-22 20:12:41 2024-04-23 02:46:14 2024-04-23 03:05:18 0:19:04 0:12:04 0:07:00 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-23T02:59:50.193605+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7668693 2024-04-22 20:12:41 2024-04-23 02:46:24 2024-04-23 03:10:12 0:23:48 0:16:25 0:07:23 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-04-23T03:06:55.022390+0000 mon.a (mon.0) 1033 : cluster [WRN] Health check failed: 2 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN)" in cluster log

pass 7668694 2024-04-22 20:12:42 2024-04-23 02:46:55 2024-04-23 03:26:19 0:39:24 0:32:06 0:07:18 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7668695 2024-04-22 20:12:43 2024-04-23 02:47:15 2024-04-23 03:10:56 0:23:41 0:16:21 0:07:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7668696 2024-04-22 20:12:44 2024-04-23 02:47:26 2024-04-23 03:17:02 0:29:36 0:20:06 0:09:30 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm} 1
pass 7668697 2024-04-22 20:12:45 2024-04-23 02:47:36 2024-04-23 03:28:19 0:40:43 0:33:46 0:06:57 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7668698 2024-04-22 20:12:46 2024-04-23 02:47:37 2024-04-23 03:09:21 0:21:44 0:12:21 0:09:23 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_adoption} 1
pass 7668699 2024-04-22 20:12:47 2024-04-23 02:47:37 2024-04-23 03:08:35 0:20:58 0:14:10 0:06:48 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7668700 2024-04-22 20:12:48 2024-04-23 02:47:37 2024-04-23 03:20:13 0:32:36 0:19:17 0:13:19 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7668701 2024-04-22 20:12:49 2024-04-23 02:50:18 2024-04-23 03:18:17 0:27:59 0:18:44 0:09:15 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
dead 7668702 2024-04-22 20:12:50 2024-04-23 02:50:28 2024-04-23 14:58:59 12:08:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

hit max job timeout

fail 7668703 2024-04-22 20:12:50 2024-04-23 02:50:29 2024-04-23 03:34:23 0:43:54 0:35:10 0:08:44 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-23T03:13:50.889301+0000 mon.a (mon.0) 1204 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668704 2024-04-22 20:12:51 2024-04-23 02:51:19 2024-04-23 03:04:21 0:13:02 0:05:50 0:07:12 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm_repos} 1
pass 7668705 2024-04-22 20:12:52 2024-04-23 02:51:20 2024-04-23 03:14:26 0:23:06 0:13:35 0:09:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7668706 2024-04-22 20:12:53 2024-04-23 02:52:50 2024-04-23 04:06:43 1:13:53 1:01:00 0:12:53 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-23T03:15:00.278508+0000 mon.a (mon.0) 379 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668707 2024-04-22 20:12:54 2024-04-23 02:55:01 2024-04-23 03:22:50 0:27:49 0:18:25 0:09:24 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7668708 2024-04-22 20:12:55 2024-04-23 02:55:11 2024-04-23 03:12:51 0:17:40 0:07:32 0:10:08 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/host rook/1.7.2} 3
Failure Reason:

Command failed on smithi055 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7668709 2024-04-22 20:12:56 2024-04-23 02:55:22 2024-04-23 03:26:52 0:31:30 0:22:09 0:09:21 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-23T03:21:32.615176+0000 mon.smithi026 (mon.0) 803 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668710 2024-04-22 20:12:57 2024-04-23 02:55:22 2024-04-23 03:54:14 0:58:52 0:47:27 0:11:25 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7668711 2024-04-22 20:12:58 2024-04-23 02:56:33 2024-04-23 03:16:49 0:20:16 0:12:44 0:07:32 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_extra_daemon_features} 2
fail 7668712 2024-04-22 20:12:59 2024-04-23 02:57:23 2024-04-23 03:44:04 0:46:41 0:38:13 0:08:28 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7668713 2024-04-22 20:13:00 2024-04-23 02:59:04 2024-04-23 03:20:06 0:21:02 0:13:04 0:07:58 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-04-23T03:17:09.956814+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7668714 2024-04-22 20:13:01 2024-04-23 02:59:04 2024-04-23 03:16:24 0:17:20 0:10:43 0:06:37 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/on orchestrator_cli} 2
pass 7668715 2024-04-22 20:13:02 2024-04-23 02:59:15 2024-04-23 03:17:08 0:17:53 0:11:05 0:06:48 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
pass 7668716 2024-04-22 20:13:02 2024-04-23 03:00:06 2024-04-23 03:21:05 0:20:59 0:14:09 0:06:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7668717 2024-04-22 20:13:03 2024-04-23 03:00:06 2024-04-23 03:29:34 0:29:28 0:19:57 0:09:31 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
fail 7668718 2024-04-22 20:13:04 2024-04-23 03:00:07 2024-04-23 03:23:21 0:23:14 0:11:13 0:12:01 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-23T03:17:33.111689+0000 mon.a (mon.0) 397 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668719 2024-04-22 20:13:05 2024-04-23 03:02:37 2024-04-23 03:24:08 0:21:31 0:14:33 0:06:58 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7668720 2024-04-22 20:13:06 2024-04-23 03:03:08 2024-04-23 03:24:09 0:21:01 0:14:54 0:06:07 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7668721 2024-04-22 20:13:07 2024-04-23 03:03:08 2024-04-23 03:22:09 0:19:01 0:13:03 0:05:58 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7668722 2024-04-22 20:13:08 2024-04-23 03:03:09 2024-04-23 03:36:41 0:33:32 0:23:55 0:09:37 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-04-23T03:26:28.797540+0000 mon.a (mon.0) 470 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7668723 2024-04-22 20:13:09 2024-04-23 03:03:09 2024-04-23 03:35:18 0:32:09 0:21:48 0:10:21 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-04-23T03:31:27.284644+0000 mon.smithi012 (mon.0) 968 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7668724 2024-04-22 20:13:10 2024-04-23 03:03:09 2024-04-23 03:44:56 0:41:47 0:32:58 0:08:49 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7668725 2024-04-22 20:13:11 2024-04-23 03:03:10 2024-04-23 03:24:41 0:21:31 0:14:48 0:06:43 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7668726 2024-04-22 20:13:12 2024-04-23 03:03:10 2024-04-23 03:44:40 0:41:30 0:34:22 0:07:08 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7668727 2024-04-22 20:13:12 2024-04-23 03:03:11 2024-04-23 03:22:02 0:18:51 0:12:28 0:06:23 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7668728 2024-04-22 20:13:13 2024-04-23 03:03:11 2024-04-23 03:42:09 0:38:58 0:31:41 0:07:17 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7668729 2024-04-22 20:13:14 2024-04-23 03:03:12 2024-04-23 03:24:09 0:20:57 0:12:18 0:08:39 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-04-23T03:22:14.149796+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7668730 2024-04-22 20:13:15 2024-04-23 03:04:52 2024-04-23 03:25:34 0:20:42 0:12:57 0:07:45 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7668731 2024-04-22 20:13:16 2024-04-23 03:05:53 2024-04-23 03:25:34 0:19:41 0:11:51 0:07:50 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
fail 7668732 2024-04-22 20:13:17 2024-04-23 03:05:53 2024-04-23 03:30:32 0:24:39 0:16:19 0:08:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-04-23T03:24:28.601685+0000 mon.smithi037 (mon.0) 869 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7668733 2024-04-22 20:13:18 2024-04-23 03:07:24 2024-04-23 03:42:23 0:34:59 0:23:53 0:11:06 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7668734 2024-04-22 20:13:19 2024-04-23 03:08:44 2024-04-23 03:42:44 0:34:00 0:26:54 0:07:06 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-04-23T03:31:41.459718+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668735 2024-04-22 20:13:20 2024-04-23 03:09:35 2024-04-23 03:35:07 0:25:32 0:18:42 0:06:50 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-04-23T03:25:59.390711+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668736 2024-04-22 20:13:21 2024-04-23 03:09:45 2024-04-23 03:31:46 0:22:01 0:13:49 0:08:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-04-23T03:27:05.908978+0000 mon.smithi064 (mon.0) 838 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

dead 7668737 2024-04-22 20:13:22 2024-04-23 03:09:56 2024-04-23 15:20:14 12:10:18 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

hit max job timeout