Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7654530 2024-04-12 21:08:39 2024-04-12 21:10:11 2024-04-12 21:40:39 0:30:28 0:20:18 0:10:10 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
fail 7654531 2024-04-12 21:08:40 2024-04-12 21:10:11 2024-04-12 22:00:31 0:50:20 0:38:34 0:11:46 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7654532 2024-04-12 21:08:41 2024-04-12 21:11:12 2024-04-12 22:01:06 0:49:54 0:37:17 0:12:37 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli_mon} 5
pass 7654533 2024-04-12 21:08:42 2024-04-12 21:12:52 2024-04-12 21:43:32 0:30:40 0:19:38 0:11:02 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7654534 2024-04-12 21:08:43 2024-04-12 21:13:53 2024-04-12 21:46:31 0:32:38 0:21:01 0:11:37 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7654535 2024-04-12 21:08:44 2024-04-12 21:14:23 2024-04-12 21:41:49 0:27:26 0:14:21 0:13:05 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7654536 2024-04-12 21:08:45 2024-04-12 21:15:44 2024-04-12 21:43:21 0:27:37 0:15:50 0:11:47 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7654537 2024-04-12 21:08:46 2024-04-12 21:15:54 2024-04-12 21:51:23 0:35:29 0:18:42 0:16:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7654538 2024-04-12 21:08:47 2024-04-12 21:22:06 2024-04-12 21:54:34 0:32:28 0:21:56 0:10:32 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7654539 2024-04-12 21:08:48 2024-04-12 21:22:46 2024-04-12 22:12:25 0:49:39 0:38:48 0:10:51 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7654540 2024-04-12 21:08:49 2024-04-12 21:23:16 2024-04-12 21:42:18 0:19:02 0:07:28 0:11:34 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi022 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7654541 2024-04-12 21:08:50 2024-04-12 21:24:37 2024-04-12 22:07:29 0:42:52 0:34:29 0:08:23 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-12T21:49:24.974022+0000 mon.smithi123 (mon.0) 863 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7654542 2024-04-12 21:08:51 2024-04-12 21:24:37 2024-04-12 22:09:25 0:44:48 0:34:38 0:10:10 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7654543 2024-04-12 21:08:52 2024-04-12 21:24:38 2024-04-12 21:43:31 0:18:53 0:10:42 0:08:11 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7654544 2024-04-12 21:08:53 2024-04-12 21:24:38 2024-04-12 21:48:16 0:23:38 0:12:16 0:11:22 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7654545 2024-04-12 21:08:54 2024-04-12 21:24:59 2024-04-12 21:48:31 0:23:32 0:13:06 0:10:26 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7654546 2024-04-12 21:08:55 2024-04-12 21:25:19 2024-04-12 22:06:41 0:41:22 0:25:35 0:15:47 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-12T21:48:03.044204+0000 mon.a (mon.0) 210 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

dead 7654547 2024-04-12 21:08:56 2024-04-12 21:30:30 2024-04-13 09:40:47 12:10:17 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

hit max job timeout

pass 7654548 2024-04-12 21:08:57 2024-04-12 21:31:51 2024-04-12 21:55:38 0:23:47 0:13:28 0:10:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7654549 2024-04-12 21:08:58 2024-04-12 21:32:21 2024-04-12 21:53:14 0:20:53 0:11:29 0:09:24 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
fail 7654550 2024-04-12 21:08:59 2024-04-12 21:32:21 2024-04-12 21:53:44 0:21:23 0:11:41 0:09:42 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-12T21:49:05.007293+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7654551 2024-04-12 21:09:00 2024-04-12 21:32:42 2024-04-12 22:29:17 0:56:35 0:44:16 0:12:19 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
fail 7654552 2024-04-12 21:09:01 2024-04-12 21:35:22 2024-04-12 22:13:43 0:38:21 0:27:52 0:10:29 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-12T21:54:02.431933+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7654553 2024-04-12 21:09:02 2024-04-12 21:36:33 2024-04-12 22:42:08 1:05:35 0:52:09 0:13:26 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-12T22:10:00.000155+0000 mon.a (mon.0) 2531 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled" in cluster log

pass 7654554 2024-04-12 21:09:03 2024-04-12 21:38:44 2024-04-12 21:59:52 0:21:08 0:11:28 0:09:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7654555 2024-04-12 21:09:04 2024-04-12 21:38:54 2024-04-12 22:05:34 0:26:40 0:13:59 0:12:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7654556 2024-04-12 21:09:05 2024-04-12 21:39:14 2024-04-12 22:09:14 0:30:00 0:20:21 0:09:39 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7654557 2024-04-12 21:09:06 2024-04-12 21:39:45 2024-04-12 22:02:26 0:22:41 0:13:13 0:09:28 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7654558 2024-04-12 21:09:07 2024-04-12 21:39:45 2024-04-12 22:04:46 0:25:01 0:15:05 0:09:56 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7654559 2024-04-12 21:09:08 2024-04-12 21:39:55 2024-04-12 22:02:52 0:22:57 0:14:08 0:08:49 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7654560 2024-04-12 21:09:09 2024-04-12 21:39:56 2024-04-13 01:32:59 3:53:03 3:38:48 0:14:15 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi090 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7654561 2024-04-12 21:09:10 2024-04-12 21:40:46 2024-04-12 22:05:30 0:24:44 0:14:43 0:10:01 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
pass 7654562 2024-04-12 21:09:11 2024-04-12 21:40:47 2024-04-12 22:08:12 0:27:25 0:14:57 0:12:28 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7654563 2024-04-12 21:09:12 2024-04-12 21:41:57 2024-04-12 22:01:35 0:19:38 0:08:55 0:10:43 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7654564 2024-04-12 21:09:13 2024-04-12 21:41:57 2024-04-12 22:30:48 0:48:51 0:36:47 0:12:04 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-12T22:20:00.000117+0000 mon.a (mon.0) 2129 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

fail 7654565 2024-04-12 21:09:14 2024-04-12 21:43:28 2024-04-12 22:18:52 0:35:24 0:22:27 0:12:57 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

"2024-04-12T22:10:00.000161+0000 mon.a (mon.0) 869 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

pass 7654566 2024-04-12 21:09:15 2024-04-12 21:43:38 2024-04-12 22:15:27 0:31:49 0:21:48 0:10:01 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7654567 2024-04-12 21:09:16 2024-04-12 21:43:39 2024-04-12 22:12:26 0:28:47 0:14:56 0:13:51 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7654568 2024-04-12 21:09:17 2024-04-12 21:46:40 2024-04-12 22:13:28 0:26:48 0:15:27 0:11:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-04-12T22:10:00.000195+0000 mon.smithi087 (mon.0) 905 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 1/654 objects degraded (0.153%), 1 pg degraded" in cluster log

pass 7654569 2024-04-12 21:09:18 2024-04-12 21:48:20 2024-04-12 22:12:25 0:24:05 0:12:03 0:12:02 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7654570 2024-04-12 21:09:19 2024-04-12 21:49:21 2024-04-12 22:15:54 0:26:33 0:14:16 0:12:17 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7654571 2024-04-12 21:09:20 2024-04-12 21:49:21 2024-04-12 22:21:22 0:32:01 0:19:26 0:12:35 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7654572 2024-04-12 21:09:21 2024-04-12 21:51:32 2024-04-12 23:06:50 1:15:18 1:02:09 0:13:09 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-04-12T22:16:04.201493+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7654573 2024-04-12 21:09:22 2024-04-12 21:54:43 2024-04-12 22:19:45 0:25:02 0:15:52 0:09:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7654574 2024-04-12 21:09:23 2024-04-12 21:54:43 2024-04-12 22:36:17 0:41:34 0:31:17 0:10:17 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi022 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 87f752c6-f919-11ee-bc8d-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

pass 7654575 2024-04-12 21:09:24 2024-04-12 21:55:13 2024-04-12 22:24:46 0:29:33 0:19:36 0:09:57 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
pass 7654576 2024-04-12 21:09:25 2024-04-12 21:55:14 2024-04-12 22:29:03 0:33:49 0:23:53 0:09:56 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7654577 2024-04-12 21:09:26 2024-04-12 21:55:14 2024-04-12 22:20:33 0:25:19 0:15:23 0:09:56 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} 3
fail 7654578 2024-04-12 21:09:27 2024-04-12 21:55:14 2024-04-12 22:40:22 0:45:08 0:35:23 0:09:45 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

"2024-04-12T22:20:00.000134+0000 mon.a (mon.0) 936 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

pass 7654579 2024-04-12 21:09:28 2024-04-12 21:55:35 2024-04-12 22:27:02 0:31:27 0:16:50 0:14:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7654580 2024-04-12 21:09:29 2024-04-12 21:59:56 2024-04-12 22:51:40 0:51:44 0:38:56 0:12:48 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys} 2
Failure Reason:

"2024-04-12T22:23:23.942795+0000 mon.a (mon.0) 199 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7654581 2024-04-12 21:09:30 2024-04-12 22:01:16 2024-04-12 22:24:34 0:23:18 0:13:39 0:09:39 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7654582 2024-04-12 21:09:31 2024-04-12 22:01:17 2024-04-12 22:18:46 0:17:29 0:07:14 0:10:15 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/1.7.2} 1
Failure Reason:

Command failed on smithi092 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7654583 2024-04-12 21:09:32 2024-04-12 22:01:17 2024-04-12 22:27:59 0:26:42 0:15:31 0:11:11 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7654584 2024-04-12 21:09:33 2024-04-12 22:02:18 2024-04-12 22:25:13 0:22:55 0:13:36 0:09:19 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7654585 2024-04-12 21:09:34 2024-04-12 22:02:18 2024-04-12 22:32:37 0:30:19 0:19:39 0:10:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7654586 2024-04-12 21:09:35 2024-04-12 22:02:58 2024-04-12 22:40:27 0:37:29 0:25:36 0:11:53 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7654587 2024-04-12 21:09:36 2024-04-12 22:04:49 2024-04-13 01:58:16 3:53:27 3:37:49 0:15:38 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi063 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7654588 2024-04-12 21:09:37 2024-04-12 22:05:40 2024-04-12 22:44:37 0:38:57 0:24:21 0:14:36 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7654589 2024-04-12 21:09:38 2024-04-12 22:08:20 2024-04-12 22:33:02 0:24:42 0:14:20 0:10:22 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7654590 2024-04-12 21:09:39 2024-04-12 22:09:21 2024-04-12 22:33:35 0:24:14 0:14:45 0:09:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7654591 2024-04-12 21:09:40 2024-04-12 22:10:51 2024-04-12 22:33:47 0:22:56 0:13:42 0:09:14 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7654592 2024-04-12 21:09:41 2024-04-12 22:10:52 2024-04-12 22:33:49 0:22:57 0:12:43 0:10:14 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-12T22:27:13.187720+0000 mon.a (mon.0) 266 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7654593 2024-04-12 21:09:42 2024-04-12 22:10:52 2024-04-12 22:42:49 0:31:57 0:19:28 0:12:29 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7654594 2024-04-12 21:09:43 2024-04-12 22:10:53 2024-04-12 22:35:56 0:25:03 0:15:53 0:09:10 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7654595 2024-04-12 21:09:44 2024-04-12 22:10:53 2024-04-12 23:24:52 1:13:59 1:02:39 0:11:20 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-12T22:33:27.338482+0000 mon.a (mon.0) 201 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7654596 2024-04-12 21:09:45 2024-04-12 22:11:03 2024-04-12 22:36:13 0:25:10 0:14:28 0:10:42 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7654597 2024-04-12 21:09:46 2024-04-12 22:11:04 2024-04-12 22:56:12 0:45:08 0:32:49 0:12:19 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-12T22:29:16.646813+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7654598 2024-04-12 21:09:47 2024-04-12 22:12:34 2024-04-12 22:48:23 0:35:49 0:25:24 0:10:25 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7654599 2024-04-12 21:09:48 2024-04-12 22:12:35 2024-04-12 23:00:41 0:48:06 0:35:28 0:12:38 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-12T22:50:00.000258+0000 mon.a (mon.0) 2855 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled" in cluster log

pass 7654600 2024-04-12 21:09:49 2024-04-12 22:15:35 2024-04-12 22:42:35 0:27:00 0:14:21 0:12:39 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7654601 2024-04-12 21:09:50 2024-04-12 22:15:56 2024-04-12 22:44:50 0:28:54 0:15:39 0:13:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7654602 2024-04-12 21:09:51 2024-04-12 22:19:47 2024-04-12 23:40:03 1:20:16 1:08:46 0:11:30 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7654603 2024-04-12 21:09:52 2024-04-12 22:20:37 2024-04-12 22:41:22 0:20:45 0:10:24 0:10:21 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7654604 2024-04-12 21:09:53 2024-04-12 22:20:38 2024-04-12 22:49:22 0:28:44 0:18:26 0:10:18 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7654605 2024-04-12 21:09:54 2024-04-12 22:21:28 2024-04-12 22:47:47 0:26:19 0:13:00 0:13:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7654606 2024-04-12 21:09:55 2024-04-12 22:24:39 2024-04-12 22:57:59 0:33:20 0:22:16 0:11:04 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7654607 2024-04-12 21:09:56 2024-04-12 22:26:20 2024-04-12 22:58:00 0:31:40 0:20:36 0:11:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7654608 2024-04-12 21:09:57 2024-04-12 22:26:20 2024-04-12 23:07:07 0:40:47 0:31:30 0:09:17 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7654609 2024-04-12 21:09:58 2024-04-12 22:26:20 2024-04-12 22:51:21 0:25:01 0:14:29 0:10:32 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7654610 2024-04-12 21:09:59 2024-04-12 22:26:21 2024-04-12 22:51:39 0:25:18 0:14:04 0:11:14 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7654611 2024-04-12 21:10:00 2024-04-12 22:26:21 2024-04-12 22:47:56 0:21:35 0:11:55 0:09:40 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7654612 2024-04-12 21:10:01 2024-04-12 22:26:31 2024-04-12 22:50:23 0:23:52 0:11:14 0:12:38 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-a29b4344-f91e-11ee-bc8d-c7b262605968@mon.a'

pass 7654613 2024-04-12 21:10:02 2024-04-12 22:28:02 2024-04-12 23:00:58 0:32:56 0:23:21 0:09:35 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7654614 2024-04-12 21:10:03 2024-04-12 22:28:02 2024-04-12 22:53:11 0:25:09 0:15:01 0:10:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-12T22:50:00.000115+0000 mon.smithi132 (mon.0) 819 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s)" in cluster log

pass 7654615 2024-04-12 21:10:04 2024-04-12 22:28:02 2024-04-12 22:52:30 0:24:28 0:13:39 0:10:49 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7654616 2024-04-12 21:10:05 2024-04-12 22:29:13 2024-04-12 23:34:44 1:05:31 0:52:13 0:13:18 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi031 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7007fc74-f91e-11ee-bc8d-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch ps'"

pass 7654617 2024-04-12 21:10:06 2024-04-12 22:29:23 2024-04-12 22:59:22 0:29:59 0:19:36 0:10:23 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7654618 2024-04-12 21:10:07 2024-04-12 22:29:24 2024-04-12 23:04:13 0:34:49 0:20:24 0:14:25 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7654619 2024-04-12 21:10:08 2024-04-12 22:32:45 2024-04-12 22:56:02 0:23:17 0:13:07 0:10:10 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi062 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7654620 2024-04-12 21:10:09 2024-04-12 22:33:05 2024-04-12 23:41:15 1:08:10 0:56:49 0:11:21 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-04-12T22:56:08.140325+0000 mon.a (mon.0) 480 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7654621 2024-04-12 21:10:10 2024-04-12 22:33:35 2024-04-12 22:59:25 0:25:50 0:15:29 0:10:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
fail 7654622 2024-04-12 21:10:11 2024-04-12 22:33:56 2024-04-12 23:21:07 0:47:11 0:35:34 0:11:37 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-04-12T23:00:00.000125+0000 mon.a (mon.0) 898 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

pass 7654623 2024-04-12 21:10:12 2024-04-12 22:35:56 2024-04-12 23:01:29 0:25:33 0:15:41 0:09:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7654624 2024-04-12 21:10:13 2024-04-12 22:36:17 2024-04-12 22:59:16 0:22:59 0:07:28 0:15:31 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi059 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7654625 2024-04-12 21:10:14 2024-04-12 22:41:28 2024-04-12 22:58:33 0:17:05 0:06:34 0:10:31 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7654626 2024-04-12 21:10:15 2024-04-12 22:41:48 2024-04-12 23:04:45 0:22:57 0:14:15 0:08:42 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7654627 2024-04-12 21:10:16 2024-04-12 22:41:49 2024-04-12 23:13:40 0:31:51 0:21:38 0:10:13 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7654628 2024-04-12 21:10:17 2024-04-12 22:41:49 2024-04-12 23:06:40 0:24:51 0:16:06 0:08:45 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7654629 2024-04-12 21:10:18 2024-04-12 22:41:50 2024-04-12 23:29:19 0:47:29 0:38:45 0:08:44 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-04-12T23:02:44.858973+0000 mon.a (mon.0) 200 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7654630 2024-04-12 21:10:19 2024-04-12 22:41:50 2024-04-13 00:00:10 1:18:20 1:07:13 0:11:07 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7654631 2024-04-12 21:10:19 2024-04-12 22:41:50 2024-04-12 23:26:54 0:45:04 0:34:26 0:10:38 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-12T22:59:59.987381+0000 mon.smithi144 (mon.0) 504 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7654632 2024-04-12 21:10:21 2024-04-12 22:41:51 2024-04-12 23:25:07 0:43:16 0:33:28 0:09:48 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7654633 2024-04-12 21:10:22 2024-04-12 22:41:51 2024-04-12 23:06:27 0:24:36 0:13:50 0:10:46 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7654634 2024-04-12 21:10:23 2024-04-12 22:41:52 2024-04-12 23:05:15 0:23:23 0:12:39 0:10:44 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
dead 7654635 2024-04-12 21:10:24 2024-04-12 22:41:52 2024-04-12 22:43:06 0:01:14 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi156

pass 7654636 2024-04-12 21:10:25 2024-04-12 22:42:02 2024-04-12 23:09:08 0:27:06 0:16:56 0:10:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7654637 2024-04-12 21:10:26 2024-04-12 22:42:03 2024-04-12 23:10:16 0:28:13 0:18:42 0:09:31 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
fail 7654638 2024-04-12 21:10:27 2024-04-12 22:43:13 2024-04-12 23:07:54 0:24:41 0:11:41 0:13:00 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-12T23:01:53.045966+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7654639 2024-04-12 21:10:28 2024-04-12 22:44:44 2024-04-12 23:15:36 0:30:52 0:20:01 0:10:51 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7654640 2024-04-12 21:10:29 2024-04-12 22:44:44 2024-04-12 23:12:03 0:27:19 0:17:44 0:09:35 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7654641 2024-04-12 21:10:30 2024-04-12 22:44:45 2024-04-12 23:12:29 0:27:44 0:18:53 0:08:51 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7654642 2024-04-12 21:10:31 2024-04-12 22:44:55 2024-04-12 23:49:08 1:04:13 0:51:17 0:12:56 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-12T23:20:00.000152+0000 mon.a (mon.0) 2897 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 3 pool(s) do not have an application enabled" in cluster log

pass 7654643 2024-04-12 21:10:32 2024-04-12 22:47:56 2024-04-12 23:20:54 0:32:58 0:20:59 0:11:59 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7654644 2024-04-12 21:10:33 2024-04-12 22:48:06 2024-04-12 23:13:40 0:25:34 0:15:47 0:09:47 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_host_drain} 3
pass 7654645 2024-04-12 21:10:34 2024-04-12 22:48:27 2024-04-12 23:12:38 0:24:11 0:14:03 0:10:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7654646 2024-04-12 21:10:35 2024-04-12 22:49:27 2024-04-12 23:46:39 0:57:12 0:46:17 0:10:55 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-12T23:19:15.021788+0000 mon.a (mon.0) 890 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7654647 2024-04-12 21:10:36 2024-04-12 22:51:28 2024-04-13 02:43:08 3:51:40 3:38:55 0:12:45 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi195 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7654648 2024-04-12 21:10:36 2024-04-12 22:51:48 2024-04-12 23:32:31 0:40:43 0:24:46 0:15:57 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7654649 2024-04-12 21:10:37 2024-04-12 22:57:20 2024-04-12 23:22:41 0:25:21 0:14:40 0:10:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7654650 2024-04-12 21:10:39 2024-04-12 22:57:20 2024-04-13 00:00:19 1:02:59 0:52:59 0:10:00 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-12T23:30:00.002056+0000 mon.a (mon.0) 2726 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled" in cluster log

pass 7654651 2024-04-12 21:10:39 2024-04-12 22:57:20 2024-04-12 23:22:06 0:24:46 0:14:12 0:10:34 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7654652 2024-04-12 21:10:41 2024-04-12 22:57:21 2024-04-12 23:23:15 0:25:54 0:14:42 0:11:12 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-04-12T23:20:00.000143+0000 mon.smithi022 (mon.0) 850 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

pass 7654653 2024-04-12 21:10:42 2024-04-12 22:57:41 2024-04-12 23:27:11 0:29:30 0:20:12 0:09:18 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7654654 2024-04-12 21:10:43 2024-04-12 22:57:42 2024-04-12 23:34:02 0:36:20 0:25:10 0:11:10 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7654655 2024-04-12 21:10:44 2024-04-12 22:57:42 2024-04-13 00:11:13 1:13:31 1:03:13 0:10:18 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-12T23:19:02.335624+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7654656 2024-04-12 21:10:45 2024-04-12 22:57:42 2024-04-12 23:25:11 0:27:29 0:18:05 0:09:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7654657 2024-04-12 21:10:46 2024-04-12 22:57:43 2024-04-12 23:21:21 0:23:38 0:12:33 0:11:05 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-12T23:15:16.697771+0000 mon.a (mon.0) 266 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7654658 2024-04-12 21:10:47 2024-04-12 22:57:53 2024-04-12 23:33:44 0:35:51 0:25:45 0:10:06 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7654659 2024-04-12 21:10:48 2024-04-12 22:58:04 2024-04-12 23:26:42 0:28:38 0:16:19 0:12:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7654660 2024-04-12 21:10:49 2024-04-12 22:59:24 2024-04-12 23:42:41 0:43:17 0:34:05 0:09:12 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1712964447.628707 mon.smithi047 (mon.0) 908 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7654661 2024-04-12 21:10:50 2024-04-12 22:59:35 2024-04-12 23:22:47 0:23:12 0:12:12 0:11:00 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7654662 2024-04-12 21:10:51 2024-04-12 23:01:05 2024-04-12 23:24:53 0:23:48 0:13:24 0:10:24 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7654663 2024-04-12 21:10:52 2024-04-12 23:01:36 2024-04-12 23:33:55 0:32:19 0:18:49 0:13:30 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7654664 2024-04-12 21:10:53 2024-04-12 23:04:16 2024-04-12 23:29:55 0:25:39 0:14:38 0:11:01 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7654665 2024-04-12 21:10:54 2024-04-12 23:04:47 2024-04-12 23:28:43 0:23:56 0:13:52 0:10:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7654666 2024-04-12 21:10:55 2024-04-12 23:05:17 2024-04-12 23:26:27 0:21:10 0:07:36 0:13:34 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi049 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7654667 2024-04-12 21:10:56 2024-04-12 23:06:48 2024-04-12 23:40:03 0:33:15 0:22:49 0:10:26 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7654668 2024-04-12 21:10:57 2024-04-12 23:07:08 2024-04-12 23:34:23 0:27:15 0:14:27 0:12:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7654669 2024-04-12 21:10:58 2024-04-12 23:09:09 2024-04-12 23:55:29 0:46:20 0:32:48 0:13:32 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-04-12T23:50:00.000240+0000 mon.a (mon.0) 1930 : cluster 3 [WRN] OSD_DOWN: 1 osds down" in cluster log

fail 7654670 2024-04-12 21:10:59 2024-04-12 23:12:10 2024-04-13 00:02:04 0:49:54 0:39:16 0:10:38 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-04-12T23:32:16.757661+0000 mon.a (mon.0) 329 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7654671 2024-04-12 21:11:00 2024-04-12 23:12:30 2024-04-12 23:39:48 0:27:18 0:16:49 0:10:29 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7654672 2024-04-12 21:11:01 2024-04-12 23:12:41 2024-04-12 23:38:44 0:26:03 0:14:47 0:11:16 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7654673 2024-04-12 21:11:02 2024-04-12 23:13:31 2024-04-12 23:44:57 0:31:26 0:21:22 0:10:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-04-12T23:40:00.000199+0000 mon.smithi037 (mon.0) 797 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

pass 7654674 2024-04-12 21:11:03 2024-04-12 23:13:31 2024-04-12 23:43:17 0:29:46 0:19:50 0:09:56 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7654675 2024-04-12 21:11:04 2024-04-12 23:13:32 2024-04-13 00:00:16 0:46:44 0:37:04 0:09:40 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7654676 2024-04-12 21:11:05 2024-04-12 23:13:32 2024-04-12 23:36:08 0:22:36 0:14:19 0:08:17 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7654677 2024-04-12 21:11:06 2024-04-12 23:13:32 2024-04-12 23:34:27 0:20:55 0:12:11 0:08:44 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7654678 2024-04-12 21:11:07 2024-04-12 23:13:33 2024-04-12 23:36:38 0:23:05 0:14:27 0:08:38 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7654679 2024-04-12 21:11:08 2024-04-12 23:13:33 2024-04-12 23:43:13 0:29:40 0:20:36 0:09:04 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
fail 7654680 2024-04-12 21:11:09 2024-04-12 23:13:33 2024-04-12 23:41:30 0:27:57 0:12:24 0:15:33 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-12T23:35:21.613844+0000 mon.a (mon.0) 266 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7654681 2024-04-12 21:11:10 2024-04-12 23:15:44 2024-04-12 23:42:33 0:26:49 0:12:24 0:14:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7654682 2024-04-12 21:11:11 2024-04-12 23:20:55 2024-04-12 23:48:00 0:27:05 0:16:10 0:10:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
fail 7654683 2024-04-12 21:11:12 2024-04-12 23:22:46 2024-04-13 00:12:41 0:49:55 0:39:06 0:10:49 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-04-12T23:44:15.295328+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7654684 2024-04-12 21:11:13 2024-04-12 23:22:56 2024-04-12 23:56:54 0:33:58 0:21:34 0:12:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7654685 2024-04-12 21:11:14 2024-04-13 00:14:51 2024-04-13 00:40:17 0:25:26 0:13:57 0:11:29 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7654686 2024-04-12 21:11:15 2024-04-13 00:15:21 2024-04-13 01:02:24 0:47:03 0:36:38 0:10:25 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-13T00:40:00.000154+0000 mon.a (mon.0) 855 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

fail 7654687 2024-04-12 21:11:16 2024-04-13 00:15:41 2024-04-13 00:41:08 0:25:27 0:16:59 0:08:28 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=98423fadeecbba811088c3136f8295dae6dfe870 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7654688 2024-04-12 21:11:17 2024-04-13 00:15:42 2024-04-13 00:42:37 0:26:55 0:15:24 0:11:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7654689 2024-04-12 21:11:18 2024-04-13 00:15:42 2024-04-13 00:59:46 0:44:04 0:33:08 0:10:56 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1712969020.8192904 mon.smithi138 (mon.0) 938 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7654690 2024-04-12 21:11:19 2024-04-13 00:16:23 2024-04-13 00:39:17 0:22:54 0:13:56 0:08:58 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7654691 2024-04-12 21:11:20 2024-04-13 00:16:23 2024-04-13 00:48:01 0:31:38 0:17:51 0:13:47 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7654692 2024-04-12 21:11:21 2024-04-13 00:20:54 2024-04-13 00:38:59 0:18:05 0:06:24 0:11:41 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7654693 2024-04-12 21:11:22 2024-04-13 00:20:55 2024-04-13 00:46:35 0:25:40 0:15:38 0:10:02 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7654694 2024-04-12 21:11:23 2024-04-13 00:20:55 2024-04-13 00:58:33 0:37:38 0:24:31 0:13:07 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7654695 2024-04-12 21:11:24 2024-04-13 00:22:36 2024-04-13 01:15:52 0:53:16 0:42:02 0:11:14 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi070 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e61dd2d0-f92d-11ee-bc8d-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7654696 2024-04-12 21:11:25 2024-04-13 00:22:56 2024-04-13 00:46:49 0:23:53 0:14:13 0:09:40 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7654697 2024-04-12 21:11:26 2024-04-13 00:23:47 2024-04-13 00:46:55 0:23:08 0:14:46 0:08:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7654698 2024-04-12 21:11:27 2024-04-13 00:23:47 2024-04-13 00:48:13 0:24:26 0:11:17 0:13:09 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7654699 2024-04-12 21:11:28 2024-04-13 00:26:28 2024-04-13 01:26:17 0:59:49 0:49:34 0:10:15 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-13T00:48:26.192517+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7654700 2024-04-12 21:11:29 2024-04-13 00:26:38 2024-04-13 01:41:12 1:14:34 1:00:55 0:13:39 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-13T00:52:26.997253+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7654701 2024-04-12 21:11:30 2024-04-13 00:27:39 2024-04-13 00:51:32 0:23:53 0:13:34 0:10:19 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_extra_daemon_features} 2
fail 7654702 2024-04-12 21:11:31 2024-04-13 00:28:29 2024-04-13 00:54:28 0:25:59 0:14:20 0:11:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-04-13T00:50:00.000157+0000 mon.smithi071 (mon.0) 831 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log