Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7641811 2024-04-05 21:08:35 2024-04-06 01:45:40 2024-04-06 02:11:22 0:25:42 0:14:57 0:10:45 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7641812 2024-04-05 21:08:36 2024-04-06 01:45:40 2024-04-06 02:18:42 0:33:02 0:23:40 0:09:22 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
fail 7641813 2024-04-05 21:08:37 2024-04-06 01:45:41 2024-04-06 02:34:30 0:48:49 0:37:40 0:11:09 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-04-06T02:20:00.000125+0000 mon.a (mon.0) 1661 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

pass 7641814 2024-04-05 21:08:38 2024-04-06 01:47:21 2024-04-06 02:19:11 0:31:50 0:20:24 0:11:26 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_rgw_multisite} 3
fail 7641815 2024-04-05 21:08:39 2024-04-06 01:47:32 2024-04-06 02:37:19 0:49:47 0:38:05 0:11:42 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7641816 2024-04-05 21:08:40 2024-04-06 01:47:52 2024-04-06 02:40:43 0:52:51 0:39:32 0:13:19 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli_mon} 5
pass 7641817 2024-04-05 21:08:41 2024-04-06 01:49:43 2024-04-06 02:19:29 0:29:46 0:19:39 0:10:07 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7641818 2024-04-05 21:08:42 2024-04-06 01:49:43 2024-04-06 02:23:13 0:33:30 0:21:17 0:12:13 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7641819 2024-04-05 21:08:43 2024-04-06 01:51:34 2024-04-06 02:16:57 0:25:23 0:15:09 0:10:14 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7641820 2024-04-05 21:08:44 2024-04-06 01:51:34 2024-04-06 02:22:35 0:31:01 0:19:54 0:11:07 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7641821 2024-04-05 21:08:45 2024-04-06 01:53:25 2024-04-06 02:25:50 0:32:25 0:19:46 0:12:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
dead 7641822 2024-04-05 21:08:46 2024-04-06 01:54:56 2024-04-06 01:56:00 0:01:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi016

dead 7641823 2024-04-05 21:08:47 2024-04-06 01:54:56 2024-04-06 01:56:00 0:01:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi072

fail 7641824 2024-04-05 21:08:48 2024-04-06 01:54:56 2024-04-06 02:12:21 0:17:25 0:07:30 0:09:55 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi006 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

dead 7641825 2024-04-05 21:08:49 2024-04-06 01:54:57 2024-04-06 01:56:01 0:01:04 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi086

pass 7641826 2024-04-05 21:08:50 2024-04-06 01:54:57 2024-04-06 02:43:14 0:48:17 0:40:01 0:08:16 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7641827 2024-04-05 21:08:51 2024-04-06 01:54:57 2024-04-06 02:15:49 0:20:52 0:11:11 0:09:41 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} 1
pass 7641828 2024-04-05 21:08:52 2024-04-06 01:54:58 2024-04-06 02:18:53 0:23:55 0:14:09 0:09:46 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7641829 2024-04-05 21:08:53 2024-04-06 01:54:58 2024-04-06 02:20:14 0:25:16 0:14:32 0:10:44 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7641830 2024-04-05 21:08:54 2024-04-06 01:54:58 2024-04-06 02:34:06 0:39:08 0:27:21 0:11:47 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-06T02:14:24.984165+0000 mon.a (mon.0) 207 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7641831 2024-04-05 21:08:55 2024-04-06 01:54:59 2024-04-06 02:22:28 0:27:29 0:16:43 0:10:46 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7641832 2024-04-05 21:08:56 2024-04-06 01:55:29 2024-04-06 02:25:38 0:30:09 0:13:27 0:16:42 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7641833 2024-04-05 21:08:58 2024-04-06 01:56:10 2024-04-06 02:19:28 0:23:18 0:13:24 0:09:54 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7641834 2024-04-05 21:08:59 2024-04-06 01:56:10 2024-04-06 02:21:11 0:25:01 0:14:28 0:10:33 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7641835 2024-04-05 21:09:00 2024-04-06 01:56:10 2024-04-06 02:55:49 0:59:39 0:49:01 0:10:38 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-06T02:30:00.000144+0000 mon.a (mon.0) 2702 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

fail 7641836 2024-04-05 21:09:01 2024-04-06 01:56:51 2024-04-06 02:34:21 0:37:30 0:27:51 0:09:39 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-06T02:12:50.871332+0000 mon.a (mon.0) 166 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7641837 2024-04-05 21:09:02 2024-04-06 01:57:11 2024-04-06 03:00:38 1:03:27 0:52:45 0:10:42 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-06T02:30:00.000194+0000 mon.a (mon.0) 2648 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled" in cluster log

pass 7641838 2024-04-05 21:09:03 2024-04-06 01:57:32 2024-04-06 02:18:50 0:21:18 0:11:38 0:09:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_ca_signed_key} 2
pass 7641839 2024-04-05 21:09:04 2024-04-06 01:57:52 2024-04-06 02:22:55 0:25:03 0:16:00 0:09:03 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7641840 2024-04-05 21:09:05 2024-04-06 01:57:53 2024-04-06 02:28:04 0:30:11 0:20:17 0:09:54 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7641841 2024-04-05 21:09:06 2024-04-06 01:58:03 2024-04-06 02:21:38 0:23:35 0:13:19 0:10:16 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi088 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7641842 2024-04-05 21:09:07 2024-04-06 01:58:03 2024-04-06 02:25:43 0:27:40 0:15:01 0:12:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7641843 2024-04-05 21:09:08 2024-04-06 02:00:34 2024-04-06 02:27:14 0:26:40 0:14:22 0:12:18 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7641844 2024-04-05 21:09:09 2024-04-06 02:02:15 2024-04-06 05:53:14 3:50:59 3:36:17 0:14:42 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi133 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7641845 2024-04-05 21:09:10 2024-04-06 02:03:15 2024-04-06 02:30:40 0:27:25 0:14:40 0:12:45 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} 1
pass 7641846 2024-04-05 21:09:11 2024-04-06 02:03:56 2024-04-06 02:29:38 0:25:42 0:14:49 0:10:53 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7641847 2024-04-05 21:09:12 2024-04-06 02:03:56 2024-04-06 02:24:38 0:20:42 0:09:04 0:11:38 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi045 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7641848 2024-04-05 21:09:13 2024-04-06 02:05:07 2024-04-06 03:21:24 1:16:17 1:05:04 0:11:13 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-06T02:30:00.000134+0000 mon.a (mon.0) 878 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

fail 7641849 2024-04-05 21:09:14 2024-04-06 02:06:17 2024-04-06 02:39:17 0:33:00 0:22:39 0:10:21 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

"2024-04-06T02:25:12.472069+0000 mon.a (mon.0) 193 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7641850 2024-04-05 21:09:15 2024-04-06 02:08:08 2024-04-06 02:42:11 0:34:03 0:21:46 0:12:17 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7641851 2024-04-05 21:09:16 2024-04-06 02:10:28 2024-04-06 02:35:23 0:24:55 0:15:27 0:09:28 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7641852 2024-04-05 21:09:17 2024-04-06 02:10:29 2024-04-06 02:37:11 0:26:42 0:15:17 0:11:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7641853 2024-04-05 21:09:18 2024-04-06 02:11:29 2024-04-06 02:38:26 0:26:57 0:12:01 0:14:56 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-06T02:33:36.296177+0000 mon.a (mon.0) 268 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7641854 2024-04-05 21:09:19 2024-04-06 02:16:41 2024-04-06 02:42:24 0:25:43 0:15:23 0:10:20 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7641855 2024-04-05 21:09:20 2024-04-06 02:17:01 2024-04-06 02:48:36 0:31:35 0:19:37 0:11:58 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7641856 2024-04-05 21:09:21 2024-04-06 02:18:52 2024-04-06 03:18:34 0:59:42 0:49:52 0:09:50 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi134 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3882bf10-f3be-11ee-b649-cb9ed24678a4 -e sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

fail 7641857 2024-04-05 21:09:22 2024-04-06 02:18:52 2024-04-06 02:44:21 0:25:29 0:15:46 0:09:43 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-04-06T02:40:00.000148+0000 mon.smithi046 (mon.0) 781 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7641858 2024-04-05 21:09:23 2024-04-06 02:19:02 2024-04-06 03:06:17 0:47:15 0:37:14 0:10:01 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7641859 2024-04-05 21:09:24 2024-04-06 02:19:13 2024-04-06 02:48:39 0:29:26 0:19:32 0:09:54 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} 1
pass 7641860 2024-04-05 21:09:25 2024-04-06 02:19:13 2024-04-06 02:53:46 0:34:33 0:24:07 0:10:26 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7641861 2024-04-05 21:09:26 2024-04-06 02:19:33 2024-04-06 02:47:29 0:27:56 0:15:45 0:12:11 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_host_drain} 3
pass 7641862 2024-04-05 21:09:27 2024-04-06 02:20:14 2024-04-06 03:12:05 0:51:51 0:42:13 0:09:38 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7641863 2024-04-05 21:09:28 2024-04-06 02:20:14 2024-04-06 02:47:18 0:27:04 0:16:35 0:10:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7641864 2024-04-05 21:09:29 2024-04-06 02:20:15 2024-04-06 03:10:51 0:50:36 0:39:54 0:10:42 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
Failure Reason:

"2024-04-06T02:43:55.828535+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7641865 2024-04-05 21:09:30 2024-04-06 02:20:55 2024-04-06 02:44:18 0:23:23 0:13:54 0:09:29 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7641866 2024-04-05 21:09:31 2024-04-06 02:21:16 2024-04-06 02:40:34 0:19:18 0:07:27 0:11:51 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi137 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7641867 2024-04-05 21:09:32 2024-04-06 02:22:36 2024-04-06 02:47:49 0:25:13 0:15:44 0:09:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7641868 2024-04-05 21:09:33 2024-04-06 02:22:36 2024-04-06 02:47:37 0:25:01 0:16:30 0:08:31 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7641869 2024-04-05 21:09:34 2024-04-06 02:22:37 2024-04-06 02:54:46 0:32:09 0:21:06 0:11:03 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7641870 2024-04-05 21:09:35 2024-04-06 02:22:57 2024-04-06 02:59:05 0:36:08 0:25:45 0:10:23 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7641871 2024-04-05 21:09:36 2024-04-06 02:23:18 2024-04-06 03:34:01 1:10:43 0:57:18 0:13:25 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi105 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 130df578-f3bf-11ee-b649-cb9ed24678a4 -e sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

pass 7641872 2024-04-05 21:09:37 2024-04-06 02:24:48 2024-04-06 03:00:43 0:35:55 0:24:41 0:11:14 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} 5
pass 7641873 2024-04-05 21:09:38 2024-04-06 02:25:49 2024-04-06 02:49:20 0:23:31 0:12:19 0:11:12 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7641874 2024-04-05 21:09:39 2024-04-06 02:25:49 2024-04-06 02:50:48 0:24:59 0:14:37 0:10:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7641875 2024-04-05 21:09:40 2024-04-06 02:25:49 2024-04-06 02:48:25 0:22:36 0:12:54 0:09:42 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7641876 2024-04-05 21:09:41 2024-04-06 02:25:50 2024-04-06 02:49:03 0:23:13 0:12:52 0:10:21 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-06T02:43:37.545714+0000 mon.a (mon.0) 268 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7641877 2024-04-05 21:09:42 2024-04-06 02:26:10 2024-04-06 02:54:57 0:28:47 0:19:59 0:08:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7641878 2024-04-05 21:09:43 2024-04-06 02:26:11 2024-04-06 02:51:29 0:25:18 0:15:25 0:09:53 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7641879 2024-04-05 21:09:44 2024-04-06 02:26:11 2024-04-06 03:15:40 0:49:29 0:36:00 0:13:29 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-06T03:00:00.000119+0000 mon.a (mon.0) 1538 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

pass 7641880 2024-04-05 21:09:45 2024-04-06 02:28:12 2024-04-06 02:55:24 0:27:12 0:14:31 0:12:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7641881 2024-04-05 21:09:46 2024-04-06 02:29:42 2024-04-06 03:15:38 0:45:56 0:34:16 0:11:40 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-06T02:47:35.709474+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7641882 2024-04-05 21:09:47 2024-04-06 02:32:33 2024-04-06 03:11:03 0:38:30 0:25:22 0:13:08 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7641883 2024-04-05 21:09:48 2024-04-06 02:35:24 2024-04-06 03:41:03 1:05:39 0:52:08 0:13:31 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-06T03:10:00.000134+0000 mon.a (mon.0) 2633 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled" in cluster log

pass 7641884 2024-04-05 21:09:49 2024-04-06 02:37:14 2024-04-06 03:10:11 0:32:57 0:17:50 0:15:07 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7641885 2024-04-05 21:09:50 2024-04-06 02:40:45 2024-04-06 03:09:01 0:28:16 0:16:28 0:11:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7641886 2024-04-05 21:09:51 2024-04-06 02:40:46 2024-04-06 03:28:28 0:47:42 0:37:30 0:10:12 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7641887 2024-04-05 21:09:52 2024-04-06 02:41:36 2024-04-06 03:00:25 0:18:49 0:10:11 0:08:38 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} 1
pass 7641888 2024-04-05 21:09:53 2024-04-06 02:41:36 2024-04-06 03:10:59 0:29:23 0:18:47 0:10:36 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7641889 2024-04-05 21:09:55 2024-04-06 02:41:37 2024-04-06 03:04:54 0:23:17 0:13:51 0:09:26 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7641890 2024-04-05 21:09:56 2024-04-06 02:41:37 2024-04-06 03:15:50 0:34:13 0:22:49 0:11:24 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7641891 2024-04-05 21:09:57 2024-04-06 02:41:38 2024-04-06 03:11:06 0:29:28 0:20:29 0:08:59 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7641892 2024-04-05 21:09:58 2024-04-06 02:41:38 2024-04-06 03:26:35 0:44:57 0:35:47 0:09:10 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-06T03:10:00.000151+0000 mon.a (mon.0) 2017 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

pass 7641893 2024-04-05 21:09:59 2024-04-06 02:41:38 2024-04-06 03:06:44 0:25:06 0:15:14 0:09:52 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7641894 2024-04-05 21:10:00 2024-04-06 02:41:39 2024-04-06 03:04:33 0:22:54 0:14:08 0:08:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7641895 2024-04-05 21:10:01 2024-04-06 02:41:39 2024-04-06 03:05:54 0:24:15 0:12:02 0:12:13 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-06T03:00:15.984364+0000 mon.a (mon.0) 211 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7641896 2024-04-05 21:10:02 2024-04-06 02:42:30 2024-04-06 03:05:36 0:23:06 0:11:13 0:11:53 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-0dc1790c-f3c2-11ee-b649-cb9ed24678a4@mon.a'

fail 7641897 2024-04-05 21:10:03 2024-04-06 02:43:20 2024-04-06 03:17:24 0:34:04 0:22:37 0:11:27 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-04-06T03:10:00.000216+0000 mon.a (mon.0) 991 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

pass 7641898 2024-04-05 21:10:04 2024-04-06 02:44:21 2024-04-06 03:12:34 0:28:13 0:15:25 0:12:48 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7641899 2024-04-05 21:10:05 2024-04-06 02:47:21 2024-04-06 03:12:16 0:24:55 0:14:18 0:10:37 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7641900 2024-04-05 21:10:06 2024-04-06 02:47:32 2024-04-06 06:39:26 3:51:54 3:38:32 0:13:22 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi162 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7641901 2024-04-05 21:10:07 2024-04-06 02:47:42 2024-04-06 03:17:26 0:29:44 0:19:20 0:10:24 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} 1
pass 7641902 2024-04-05 21:10:08 2024-04-06 02:47:53 2024-04-06 03:18:15 0:30:22 0:20:35 0:09:47 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7641903 2024-04-05 21:10:09 2024-04-06 02:48:33 2024-04-06 03:11:42 0:23:09 0:13:10 0:09:59 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7641904 2024-04-05 21:10:10 2024-04-06 02:48:43 2024-04-06 03:56:10 1:07:27 0:57:29 0:09:58 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-04-06T03:11:19.053643+0000 mon.a (mon.0) 477 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7641905 2024-04-05 21:10:11 2024-04-06 02:48:44 2024-04-06 03:16:57 0:28:13 0:16:00 0:12:13 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
fail 7641906 2024-04-05 21:10:12 2024-04-06 02:49:24 2024-04-06 04:06:03 1:16:39 1:05:06 0:11:33 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

"2024-04-06T03:12:53.821259+0000 mon.a (mon.0) 199 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7641907 2024-04-05 21:10:13 2024-04-06 02:50:05 2024-04-06 03:15:57 0:25:52 0:16:06 0:09:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7641908 2024-04-05 21:10:14 2024-04-06 02:50:55 2024-04-06 03:09:42 0:18:47 0:07:18 0:11:29 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

Command failed on smithi088 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7641909 2024-04-05 21:10:15 2024-04-06 02:51:35 2024-04-06 03:06:43 0:15:08 0:06:15 0:08:53 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7641910 2024-04-05 21:10:16 2024-04-06 02:51:36 2024-04-06 03:19:31 0:27:55 0:14:14 0:13:41 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7641911 2024-04-05 21:10:17 2024-04-06 02:53:57 2024-04-06 03:26:29 0:32:32 0:21:50 0:10:42 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7641912 2024-04-05 21:10:18 2024-04-06 02:54:47 2024-04-06 03:19:55 0:25:08 0:16:20 0:08:48 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7641913 2024-04-05 21:10:19 2024-04-06 02:54:57 2024-04-06 03:45:57 0:51:00 0:39:41 0:11:19 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
fail 7641914 2024-04-05 21:10:20 2024-04-06 02:55:28 2024-04-06 03:43:19 0:47:51 0:38:18 0:09:33 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7641915 2024-04-05 21:10:21 2024-04-06 02:56:08 2024-04-06 03:41:34 0:45:26 0:34:47 0:10:39 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-06T03:22:06.681997+0000 mon.smithi060 (mon.0) 866 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7641916 2024-04-05 21:10:22 2024-04-06 02:56:39 2024-04-06 03:52:42 0:56:03 0:44:58 0:11:05 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7641917 2024-04-05 21:10:23 2024-04-06 02:56:39 2024-04-06 03:23:51 0:27:12 0:13:18 0:13:54 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7641918 2024-04-05 21:10:24 2024-04-06 02:57:09 2024-04-06 03:26:02 0:28:53 0:18:53 0:10:00 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7641919 2024-04-05 21:10:25 2024-04-06 02:57:10 2024-04-06 03:32:21 0:35:11 0:25:49 0:09:22 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7641920 2024-04-05 21:10:26 2024-04-06 02:57:10 2024-04-06 03:26:14 0:29:04 0:17:18 0:11:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7641921 2024-04-05 21:10:27 2024-04-06 02:59:11 2024-04-06 03:20:06 0:20:55 0:11:42 0:09:13 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7641922 2024-04-05 21:10:28 2024-04-06 02:59:11 2024-04-06 03:21:54 0:22:43 0:11:28 0:11:15 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7641923 2024-04-05 21:10:29 2024-04-06 03:00:52 2024-04-06 03:30:16 0:29:24 0:19:56 0:09:28 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} 2
pass 7641924 2024-04-05 21:10:30 2024-04-06 03:00:52 2024-04-06 03:33:46 0:32:54 0:17:41 0:15:13 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7641925 2024-04-05 21:10:31 2024-04-06 03:04:43 2024-04-06 03:35:11 0:30:28 0:19:11 0:11:17 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7641926 2024-04-05 21:10:32 2024-04-06 03:05:04 2024-04-06 03:54:02 0:48:58 0:36:12 0:12:46 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-06T03:40:00.000118+0000 mon.a (mon.0) 1093 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

pass 7641927 2024-04-05 21:10:33 2024-04-06 03:05:54 2024-04-06 03:37:23 0:31:29 0:21:44 0:09:45 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
fail 7641928 2024-04-05 21:10:34 2024-04-06 03:05:54 2024-04-06 03:34:03 0:28:09 0:16:11 0:11:58 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-04-06T03:30:00.000251+0000 mon.a (mon.0) 764 : cluster 3 [WRN] CEPHADM_STRAY_DAEMON: 1 stray daemon(s) not managed by cephadm" in cluster log

pass 7641929 2024-04-05 21:10:35 2024-04-06 03:06:45 2024-04-06 03:31:48 0:25:03 0:13:50 0:11:13 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7641930 2024-04-05 21:10:36 2024-04-06 03:06:45 2024-04-06 04:09:24 1:02:39 0:48:58 0:13:41 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-06T03:26:11.350826+0000 mon.a (mon.0) 167 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7641931 2024-04-05 21:10:37 2024-04-06 03:09:06 2024-04-06 04:21:14 1:12:08 0:57:40 0:14:28 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi040 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 719b93f6-f3c5-11ee-b649-cb9ed24678a4 -e sha1=9f192350ba5fe6d0a365b251a8c2af61f56a5fa6 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

pass 7641932 2024-04-05 21:10:38 2024-04-06 03:10:17 2024-04-06 03:48:41 0:38:24 0:26:23 0:12:01 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
fail 7641933 2024-04-05 21:10:39 2024-04-06 03:11:07 2024-04-06 03:36:10 0:25:03 0:14:31 0:10:32 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-04-06T03:30:00.000134+0000 mon.smithi070 (mon.0) 715 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded" in cluster log

fail 7641934 2024-04-05 21:10:40 2024-04-06 03:11:08 2024-04-06 04:12:05 1:00:57 0:51:28 0:09:29 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-04-06T03:40:00.000178+0000 mon.a (mon.0) 2093 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

pass 7641935 2024-04-05 21:10:41 2024-04-06 03:11:08 2024-04-06 03:38:53 0:27:45 0:16:23 0:11:22 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7641936 2024-04-05 21:10:42 2024-04-06 03:12:08 2024-04-06 03:36:53 0:24:45 0:15:00 0:09:45 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7641937 2024-04-05 21:10:43 2024-04-06 03:12:19 2024-04-06 03:42:10 0:29:51 0:20:17 0:09:34 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7641938 2024-04-05 21:10:44 2024-04-06 03:12:39 2024-04-06 03:50:11 0:37:32 0:27:24 0:10:08 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7641939 2024-04-05 21:10:45 2024-04-06 03:12:39 2024-04-06 03:59:33 0:46:54 0:37:11 0:09:43 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-06T03:40:00.000182+0000 mon.a (mon.0) 1143 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

pass 7641940 2024-04-05 21:10:46 2024-04-06 03:12:40 2024-04-06 03:41:56 0:29:16 0:18:43 0:10:33 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7641941 2024-04-05 21:10:48 2024-04-06 03:12:40 2024-04-06 03:36:18 0:23:38 0:12:44 0:10:54 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7641942 2024-04-05 21:10:49 2024-04-06 03:12:41 2024-04-06 03:48:32 0:35:51 0:25:37 0:10:14 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7641943 2024-04-05 21:10:50 2024-04-06 03:12:41 2024-04-06 03:37:47 0:25:06 0:15:56 0:09:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7641944 2024-04-05 21:10:51 2024-04-06 03:12:41 2024-04-06 03:57:43 0:45:02 0:34:41 0:10:21 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1712374934.1108444 mon.smithi094 (mon.0) 914 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7641945 2024-04-05 21:10:52 2024-04-06 03:12:52 2024-04-06 03:34:37 0:21:45 0:12:26 0:09:19 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7641946 2024-04-05 21:10:53 2024-04-06 03:12:52 2024-04-06 03:38:34 0:25:42 0:14:08 0:11:34 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7641947 2024-04-05 21:10:54 2024-04-06 03:12:53 2024-04-06 03:42:58 0:30:05 0:20:45 0:09:20 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7641948 2024-04-05 21:10:55 2024-04-06 03:12:53 2024-04-06 03:43:45 0:30:52 0:16:04 0:14:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7641949 2024-04-05 21:10:56 2024-04-06 03:15:54 2024-04-06 03:39:01 0:23:07 0:14:17 0:08:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7641950 2024-04-05 21:10:57 2024-04-06 03:15:54 2024-04-06 03:35:53 0:19:59 0:07:31 0:12:28 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi072 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7641951 2024-04-05 21:10:58 2024-04-06 03:17:05 2024-04-06 03:50:38 0:33:33 0:23:09 0:10:24 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 7641952 2024-04-05 21:10:59 2024-04-06 03:17:35 2024-04-06 03:35:11 0:17:36 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

failed to install new kernel version within timeout

dead 7641953 2024-04-05 21:11:00 2024-04-06 03:18:16 2024-04-06 03:20:40 0:02:24 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi006

fail 7641954 2024-04-05 21:11:01 2024-04-06 03:19:36 2024-04-06 04:09:28 0:49:52 0:40:04 0:09:48 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-04-06T03:40:48.413098+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7641955 2024-04-05 21:11:02 2024-04-06 03:19:57 2024-04-06 03:27:48 0:07:51 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi006 with status 1: 'sudo yum install -y kernel'

pass 7641956 2024-04-05 21:11:03 2024-04-06 03:20:47 2024-04-06 03:47:00 0:26:13 0:15:58 0:10:15 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7641957 2024-04-05 21:11:04 2024-04-06 03:21:58 2024-04-06 03:53:58 0:32:00 0:21:18 0:10:42 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7641958 2024-04-05 21:11:05 2024-04-06 03:21:58 2024-04-06 03:55:43 0:33:45 0:20:22 0:13:23 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7641959 2024-04-05 21:11:06 2024-04-06 03:26:09 2024-04-06 04:45:33 1:19:24 1:09:38 0:09:46 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7641960 2024-04-05 21:11:07 2024-04-06 03:26:19 2024-04-06 03:49:12 0:22:53 0:13:44 0:09:09 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7641961 2024-04-05 21:11:08 2024-04-06 03:26:20 2024-04-06 03:47:35 0:21:15 0:11:59 0:09:16 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7641962 2024-04-05 21:11:09 2024-04-06 03:26:30 2024-04-06 03:51:13 0:24:43 0:14:26 0:10:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7641963 2024-04-05 21:11:10 2024-04-06 03:28:21 2024-04-06 03:51:30 0:23:09 0:13:00 0:10:09 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7641964 2024-04-05 21:11:11 2024-04-06 03:28:21 2024-04-06 03:51:30 0:23:09 0:12:32 0:10:37 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-06T03:45:35.228879+0000 mon.a (mon.0) 268 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7641965 2024-04-05 21:11:12 2024-04-06 03:28:22 2024-04-06 03:51:15 0:22:53 0:12:35 0:10:18 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
dead 7641966 2024-04-05 21:11:13 2024-04-06 03:28:22 2024-04-06 03:35:17 0:06:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

SSH connection to smithi006 was lost: 'sudo yum install -y kernel'

fail 7641967 2024-04-05 21:11:14 2024-04-06 03:28:22 2024-04-06 04:18:00 0:49:38 0:39:13 0:10:25 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-04-06T03:49:45.277903+0000 mon.a (mon.0) 201 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7641968 2024-04-05 21:11:15 2024-04-06 03:28:23 2024-04-06 03:59:50 0:31:27 0:21:47 0:09:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7641969 2024-04-05 21:11:16 2024-04-06 03:28:23 2024-04-06 03:51:18 0:22:55 0:13:47 0:09:08 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7641970 2024-04-05 21:11:17 2024-04-06 03:28:23 2024-04-06 04:37:16 1:08:53 0:58:13 0:10:40 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-04-06T03:48:48.075007+0000 mon.a (mon.0) 198 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7641971 2024-04-05 21:11:18 2024-04-06 03:30:24 2024-04-06 03:58:06 0:27:42 0:17:10 0:10:32 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=584a67ccb9eb224c5312dccd96a82e67b0645518 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7641972 2024-04-05 21:11:19 2024-04-06 03:30:24 2024-04-06 03:57:03 0:26:39 0:15:22 0:11:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7641973 2024-04-05 21:11:20 2024-04-06 03:31:55 2024-04-06 04:15:20 0:43:25 0:32:48 0:10:37 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1712376028.490313 mon.smithi037 (mon.0) 901 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7641974 2024-04-05 21:11:21 2024-04-06 03:32:25 2024-04-06 03:55:42 0:23:17 0:13:32 0:09:45 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7641975 2024-04-05 21:11:22 2024-04-06 03:32:26 2024-04-06 04:00:54 0:28:28 0:17:10 0:11:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7641976 2024-04-05 21:11:23 2024-04-06 03:33:46 2024-04-06 03:51:44 0:17:58 0:06:36 0:11:22 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7641977 2024-04-05 21:11:24 2024-04-06 03:34:47 2024-04-06 04:00:48 0:26:01 0:15:06 0:10:55 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7641978 2024-04-05 21:11:25 2024-04-06 03:35:17 2024-04-06 04:10:25 0:35:08 0:23:52 0:11:16 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7641979 2024-04-05 21:11:26 2024-04-06 03:36:28 2024-04-06 04:39:46 1:03:18 0:52:49 0:10:29 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-04-06T03:53:34.651904+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7641980 2024-04-05 21:11:27 2024-04-06 03:36:58 2024-04-06 04:02:51 0:25:53 0:13:50 0:12:03 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7641981 2024-04-05 21:11:28 2024-04-06 03:37:29 2024-04-06 04:00:57 0:23:28 0:14:44 0:08:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
fail 7641982 2024-04-05 21:11:29 2024-04-06 03:37:49 2024-04-06 04:02:16 0:24:27 0:12:06 0:12:21 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-04-06T03:56:09.959149+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7641983 2024-04-05 21:11:30 2024-04-06 03:38:40 2024-04-06 04:20:14 0:41:34 0:32:02 0:09:32 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-04-06T04:10:00.005037+0000 mon.a (mon.0) 1531 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log