Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7591899 2024-03-11 21:08:30 2024-03-11 21:10:34 2024-03-11 21:42:10 0:31:36 0:21:46 0:09:50 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-11T21:31:12.265888+0000 mon.smithi144 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591900 2024-03-11 21:08:31 2024-03-11 21:10:34 2024-03-11 21:39:44 0:29:10 0:20:10 0:09:00 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_host_drain} 3
fail 7591901 2024-03-11 21:08:32 2024-03-11 21:10:34 2024-03-11 21:56:34 0:46:00 0:34:51 0:11:09 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710192785.2710476 mon.smithi137 (mon.0) 331 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7591902 2024-03-11 21:08:33 2024-03-11 21:11:15 2024-03-11 21:56:42 0:45:27 0:35:00 0:10:27 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-11T21:31:18.297679+0000 mon.smithi040 (mon.0) 496 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7591903 2024-03-11 21:08:34 2024-03-11 21:11:35 2024-03-11 21:56:31 0:44:56 0:35:09 0:09:47 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7591904 2024-03-11 21:08:35 2024-03-11 21:11:36 2024-03-11 21:36:30 0:24:54 0:12:31 0:12:23 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
fail 7591905 2024-03-11 21:08:36 2024-03-11 21:12:06 2024-03-11 21:37:03 0:24:57 0:12:58 0:11:59 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-03-11T21:30:26.649709+0000 mon.smithi096 (mon.0) 268 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591906 2024-03-11 21:08:37 2024-03-11 21:13:57 2024-03-11 21:52:56 0:38:59 0:24:19 0:14:40 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
dead 7591907 2024-03-11 21:08:38 2024-03-11 21:15:07 2024-03-12 09:23:30 12:08:23 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

hit max job timeout

pass 7591908 2024-03-11 21:08:39 2024-03-11 21:15:08 2024-03-11 21:35:53 0:20:45 0:11:27 0:09:18 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
fail 7591909 2024-03-11 21:08:40 2024-03-11 21:15:08 2024-03-11 21:39:55 0:24:47 0:11:35 0:13:12 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-11T21:34:18.632635+0000 mon.a (mon.0) 190 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7591910 2024-03-11 21:08:41 2024-03-11 21:15:08 2024-03-11 21:32:40 0:17:32 0:07:35 0:09:57 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi008 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7591911 2024-03-11 21:08:42 2024-03-11 21:15:09 2024-03-11 21:58:16 0:43:07 0:32:14 0:10:53 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-03-11T21:33:37.472920+0000 mon.a (mon.0) 362 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7591912 2024-03-11 21:08:43 2024-03-11 21:15:09 2024-03-11 21:39:54 0:24:45 0:13:27 0:11:18 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7591913 2024-03-11 21:08:44 2024-03-11 21:15:10 2024-03-11 21:40:10 0:25:00 0:13:30 0:11:30 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

"2024-03-11T21:34:08.421419+0000 mon.smithi080 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591914 2024-03-11 21:08:45 2024-03-11 21:15:10 2024-03-11 21:51:54 0:36:44 0:22:52 0:13:52 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7591915 2024-03-11 21:08:46 2024-03-11 21:16:40 2024-03-11 21:49:19 0:32:39 0:20:17 0:12:22 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-11T21:39:59.041019+0000 mon.smithi012 (mon.0) 254 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591916 2024-03-11 21:08:47 2024-03-11 21:19:41 2024-03-11 22:05:07 0:45:26 0:33:23 0:12:03 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7591917 2024-03-11 21:08:48 2024-03-11 21:19:42 2024-03-11 21:49:58 0:30:16 0:18:55 0:11:21 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
pass 7591918 2024-03-11 21:08:49 2024-03-11 21:20:52 2024-03-11 21:57:47 0:36:55 0:25:51 0:11:04 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7591919 2024-03-11 21:08:50 2024-03-11 21:20:53 2024-03-11 21:46:34 0:25:41 0:14:38 0:11:03 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-11T21:38:37.747726+0000 mon.smithi042 (mon.0) 263 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591920 2024-03-11 21:08:51 2024-03-11 21:21:43 2024-03-11 21:47:52 0:26:09 0:14:55 0:11:14 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-11T21:41:14.224630+0000 mon.smithi120 (mon.0) 270 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591921 2024-03-11 21:08:52 2024-03-11 21:22:44 2024-03-11 21:48:56 0:26:12 0:15:17 0:10:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

"2024-03-11T21:41:09.423355+0000 mon.smithi090 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591922 2024-03-11 21:08:53 2024-03-11 21:23:14 2024-03-11 21:49:06 0:25:52 0:16:00 0:09:52 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_orch_cli} 1
Failure Reason:

Test failure: test_daemon_restart (tasks.cephadm_cases.test_cli.TestCephadmCLI)

fail 7591923 2024-03-11 21:08:54 2024-03-11 21:24:05 2024-03-11 22:55:59 1:31:54 1:17:44 0:14:10 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi063 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0be6dc02-dff0-11ee-95c8-87774f69a715 -e sha1=94a539707733325322964c6a187c6a1b41be1daf -- bash -c 'ceph orch ps'"

fail 7591924 2024-03-11 21:08:55 2024-03-11 21:24:45 2024-03-11 21:56:25 0:31:40 0:21:34 0:10:06 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-11T21:45:22.026810+0000 mon.smithi052 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591925 2024-03-11 21:08:56 2024-03-11 21:24:45 2024-03-11 22:15:03 0:50:18 0:37:33 0:12:45 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-11T22:09:38.328424+0000 mon.a (mon.0) 1301 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7591926 2024-03-11 21:08:57 2024-03-11 21:27:16 2024-03-11 22:18:37 0:51:21 0:39:58 0:11:23 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-11T22:00:00.000190+0000 mon.a (mon.0) 687 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7591927 2024-03-11 21:08:58 2024-03-11 21:28:47 2024-03-11 21:56:25 0:27:38 0:15:41 0:11:57 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-11T21:48:27.943774+0000 mon.smithi057 (mon.0) 258 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591928 2024-03-11 21:08:59 2024-03-11 21:29:47 2024-03-11 21:53:58 0:24:11 0:12:02 0:12:09 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-11T21:47:43.460833+0000 mon.a (mon.0) 248 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7591929 2024-03-11 21:09:00 2024-03-11 21:30:48 2024-03-11 22:00:28 0:29:40 0:19:48 0:09:52 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-11T21:51:54.495226+0000 mon.smithi119 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591930 2024-03-11 21:09:01 2024-03-11 21:30:48 2024-03-11 22:32:16 1:01:28 0:51:40 0:09:48 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-11T21:52:40.694975+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7591931 2024-03-11 21:09:02 2024-03-11 21:30:49 2024-03-11 22:38:29 1:07:40 0:57:24 0:10:16 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-11T21:51:58.851750+0000 mon.a (mon.0) 481 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7591932 2024-03-11 21:09:03 2024-03-11 21:30:49 2024-03-11 21:56:23 0:25:34 0:15:15 0:10:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-11T21:48:33.146397+0000 mon.smithi023 (mon.0) 258 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591933 2024-03-11 21:09:04 2024-03-11 21:30:49 2024-03-11 21:56:09 0:25:20 0:14:37 0:10:43 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_rgw_multisite} 3
fail 7591934 2024-03-11 21:09:05 2024-03-11 21:30:50 2024-03-11 22:06:32 0:35:42 0:24:48 0:10:54 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-11T21:52:29.261394+0000 mon.smithi082 (mon.0) 252 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591935 2024-03-11 21:09:06 2024-03-11 21:30:50 2024-03-11 22:12:35 0:41:45 0:32:09 0:09:36 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710194126.8933172 mon.smithi088 (mon.0) 683 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log

dead 7591936 2024-03-11 21:09:07 2024-03-11 21:30:51 2024-03-12 09:42:07 12:11:16 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

hit max job timeout

fail 7591937 2024-03-11 21:09:08 2024-03-11 21:34:22 2024-03-11 22:01:25 0:27:03 0:16:54 0:10:09 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-11T21:51:28.491093+0000 mon.smithi078 (mon.0) 258 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591938 2024-03-11 21:09:09 2024-03-11 21:34:22 2024-03-11 22:01:47 0:27:25 0:15:54 0:11:31 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_set_mon_crush_locations} 3
fail 7591939 2024-03-11 21:09:10 2024-03-11 21:34:53 2024-03-11 21:58:15 0:23:22 0:13:07 0:10:15 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-11T21:52:28.481855+0000 mon.smithi033 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591940 2024-03-11 21:09:11 2024-03-11 21:35:13 2024-03-11 22:00:56 0:25:43 0:15:04 0:10:39 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-11T21:53:36.058013+0000 mon.smithi129 (mon.0) 261 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591941 2024-03-11 21:09:12 2024-03-11 21:35:53 2024-03-11 22:21:39 0:45:46 0:35:13 0:10:33 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-11T22:10:00.000111+0000 mon.a (mon.0) 3090 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

fail 7591942 2024-03-11 21:09:13 2024-03-11 21:36:14 2024-03-11 22:49:52 1:13:38 1:01:02 0:12:36 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-11T22:20:00.000232+0000 mon.a (mon.0) 2541 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled" in cluster log

pass 7591943 2024-03-11 21:09:14 2024-03-11 21:36:34 2024-03-11 22:00:47 0:24:13 0:12:33 0:11:40 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_adoption} 1
fail 7591944 2024-03-11 21:09:15 2024-03-11 21:39:15 2024-03-11 22:11:43 0:32:28 0:21:16 0:11:12 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-11T22:00:23.539098+0000 mon.smithi081 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591945 2024-03-11 21:09:17 2024-03-11 21:39:46 2024-03-11 22:04:55 0:25:09 0:14:09 0:11:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-11T21:58:03.620861+0000 mon.smithi046 (mon.0) 263 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591946 2024-03-11 21:09:18 2024-03-11 21:39:46 2024-03-11 22:02:45 0:22:59 0:13:12 0:09:47 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7591947 2024-03-11 21:09:19 2024-03-11 21:39:46 2024-03-11 22:01:45 0:21:59 0:11:45 0:10:14 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-11T21:57:11.739599+0000 mon.a (mon.0) 247 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7591948 2024-03-11 21:09:20 2024-03-11 21:40:27 2024-03-11 22:01:44 0:21:17 0:11:38 0:09:39 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_ca_signed_key} 2
fail 7591949 2024-03-11 21:09:21 2024-03-11 21:40:27 2024-03-11 21:58:25 0:17:58 0:07:19 0:10:39 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

Command failed on smithi086 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7591950 2024-03-11 21:09:22 2024-03-11 21:40:48 2024-03-11 22:11:26 0:30:38 0:14:34 0:16:04 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-11T22:04:28.885444+0000 mon.smithi071 (mon.0) 268 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591951 2024-03-11 21:09:23 2024-03-11 21:45:59 2024-03-11 22:11:04 0:25:05 0:14:25 0:10:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-11T22:03:00.028930+0000 mon.smithi042 (mon.0) 261 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591952 2024-03-11 21:09:24 2024-03-11 21:46:19 2024-03-12 01:37:33 3:51:14 3:39:26 0:11:48 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi173 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7591953 2024-03-11 21:09:25 2024-03-11 21:46:20 2024-03-11 22:45:19 0:58:59 0:48:40 0:10:19 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-11T22:03:46.812437+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7591954 2024-03-11 21:09:26 2024-03-11 21:46:20 2024-03-11 22:11:31 0:25:11 0:15:02 0:10:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_cephadm} 1
fail 7591955 2024-03-11 21:09:28 2024-03-11 21:46:20 2024-03-11 22:22:27 0:36:07 0:25:19 0:10:48 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-11T22:07:39.063860+0000 mon.smithi118 (mon.0) 257 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591956 2024-03-11 21:09:29 2024-03-11 21:46:21 2024-03-11 22:11:20 0:24:59 0:15:32 0:09:27 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7591957 2024-03-11 21:09:30 2024-03-11 21:46:21 2024-03-11 22:53:19 1:06:58 0:58:06 0:08:52 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-11T22:20:00.001083+0000 mon.a (mon.0) 1459 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

fail 7591958 2024-03-11 21:09:31 2024-03-11 21:46:21 2024-03-11 22:11:14 0:24:53 0:15:01 0:09:52 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-11T22:03:07.380721+0000 mon.smithi060 (mon.0) 261 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591959 2024-03-11 21:09:32 2024-03-11 21:46:22 2024-03-11 22:19:09 0:32:47 0:23:20 0:09:27 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
fail 7591960 2024-03-11 21:09:33 2024-03-11 21:46:22 2024-03-11 22:03:57 0:17:35 0:08:34 0:09:01 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7591961 2024-03-11 21:09:34 2024-03-11 21:46:22 2024-03-11 22:19:43 0:33:21 0:19:13 0:14:08 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-03-11T22:11:03.242442+0000 mon.smithi064 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591962 2024-03-11 21:09:35 2024-03-11 21:50:03 2024-03-11 22:14:59 0:24:56 0:13:13 0:11:43 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

"2024-03-11T22:08:06.776185+0000 mon.smithi080 (mon.0) 266 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591963 2024-03-11 21:09:36 2024-03-11 21:50:04 2024-03-11 22:24:02 0:33:58 0:20:27 0:13:31 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

"2024-03-11T22:13:12.551938+0000 mon.smithi084 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591964 2024-03-11 21:09:37 2024-03-11 21:52:04 2024-03-11 22:18:51 0:26:47 0:14:21 0:12:26 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py'

fail 7591965 2024-03-11 21:09:38 2024-03-11 21:53:05 2024-03-11 22:38:15 0:45:10 0:33:56 0:11:14 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710195506.5973608 mon.smithi028 (mon.0) 681 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log

fail 7591966 2024-03-11 21:09:39 2024-03-11 21:53:05 2024-03-11 22:25:34 0:32:29 0:14:26 0:18:03 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-11T22:19:20.395451+0000 mon.smithi003 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591967 2024-03-11 21:09:40 2024-03-11 21:56:16 2024-03-11 22:23:48 0:27:32 0:11:28 0:16:04 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-11T22:17:55.348479+0000 mon.a (mon.0) 193 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7591968 2024-03-11 21:09:41 2024-03-11 21:57:57 2024-03-11 22:25:56 0:27:59 0:14:15 0:13:44 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_extra_daemon_features} 2
fail 7591969 2024-03-11 21:09:42 2024-03-11 22:00:47 2024-03-11 22:28:25 0:27:38 0:15:13 0:12:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-11T22:19:23.519740+0000 mon.smithi007 (mon.0) 269 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591970 2024-03-11 21:09:43 2024-03-11 22:01:28 2024-03-11 22:29:39 0:28:11 0:13:55 0:14:16 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-11T22:22:46.371966+0000 mon.smithi033 (mon.0) 256 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591971 2024-03-11 21:09:44 2024-03-11 22:01:48 2024-03-11 22:57:30 0:55:42 0:44:48 0:10:54 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-11T22:40:00.000209+0000 mon.a (mon.0) 1180 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

fail 7591972 2024-03-11 21:09:45 2024-03-11 22:01:49 2024-03-11 22:34:16 0:32:27 0:22:01 0:10:26 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

"2024-03-11T22:24:48.744308+0000 mon.smithi120 (mon.0) 255 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591973 2024-03-11 21:09:46 2024-03-11 22:01:49 2024-03-11 22:34:50 0:33:01 0:24:23 0:08:38 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7591974 2024-03-11 21:09:47 2024-03-11 22:01:49 2024-03-11 22:38:49 0:37:00 0:25:45 0:11:15 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7591975 2024-03-11 21:09:48 2024-03-11 22:01:50 2024-03-11 22:37:02 0:35:12 0:23:28 0:11:44 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_host_drain} 3
fail 7591976 2024-03-11 21:09:49 2024-03-11 22:01:50 2024-03-11 22:54:43 0:52:53 0:41:50 0:11:03 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-03-11T22:24:11.910737+0000 mon.a (mon.0) 569 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7591977 2024-03-11 21:09:50 2024-03-11 22:01:50 2024-03-11 22:26:35 0:24:45 0:14:27 0:10:18 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-11T22:18:17.305690+0000 mon.smithi026 (mon.0) 258 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

dead 7591978 2024-03-11 21:09:51 2024-03-11 22:01:51 2024-03-12 10:11:11 12:09:20 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

hit max job timeout

fail 7591979 2024-03-11 21:09:52 2024-03-11 22:01:51 2024-03-11 22:28:22 0:26:31 0:15:26 0:11:05 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-11T22:20:53.980225+0000 mon.smithi143 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591980 2024-03-11 21:09:53 2024-03-11 22:01:51 2024-03-11 22:26:17 0:24:26 0:14:04 0:10:22 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7591981 2024-03-11 21:09:54 2024-03-11 22:01:52 2024-03-11 22:26:57 0:25:05 0:13:38 0:11:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-11T22:20:55.316810+0000 mon.smithi090 (mon.0) 266 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591982 2024-03-11 21:09:55 2024-03-11 22:01:52 2024-03-11 22:36:36 0:34:44 0:23:13 0:11:31 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-11T22:24:36.474363+0000 mon.smithi086 (mon.0) 252 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591983 2024-03-11 21:09:56 2024-03-11 22:01:52 2024-03-11 22:50:07 0:48:15 0:37:49 0:10:26 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-11T22:23:06.687016+0000 mon.a (mon.0) 175 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7591984 2024-03-11 21:09:57 2024-03-11 22:01:53 2024-03-11 22:31:40 0:29:47 0:20:03 0:09:44 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_monitoring_stack_basic} 3
fail 7591985 2024-03-11 21:09:58 2024-03-11 22:01:53 2024-03-11 22:47:57 0:46:04 0:35:08 0:10:56 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-11T22:22:07.774761+0000 mon.smithi073 (mon.0) 507 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7591986 2024-03-11 21:09:59 2024-03-11 22:01:54 2024-03-11 22:56:12 0:54:18 0:45:03 0:09:15 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7591987 2024-03-11 21:10:00 2024-03-11 22:01:54 2024-03-11 22:27:01 0:25:07 0:13:51 0:11:16 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7591988 2024-03-11 21:10:01 2024-03-11 22:01:54 2024-03-11 22:37:32 0:35:38 0:24:46 0:10:52 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
fail 7591989 2024-03-11 21:10:02 2024-03-11 22:01:55 2024-03-11 22:21:02 0:19:07 0:07:29 0:11:38 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi057 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7591990 2024-03-11 21:10:03 2024-03-11 22:01:55 2024-03-11 22:30:27 0:28:32 0:17:04 0:11:28 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-11T22:21:11.688696+0000 mon.smithi106 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591991 2024-03-11 21:10:05 2024-03-11 22:01:55 2024-03-11 22:25:12 0:23:17 0:11:57 0:11:20 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
fail 7591992 2024-03-11 21:10:06 2024-03-11 22:01:56 2024-03-11 22:32:30 0:30:34 0:11:06 0:19:28 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-11T22:27:59.619277+0000 mon.a (mon.0) 192 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7591993 2024-03-11 21:10:07 2024-03-11 22:11:27 2024-03-11 23:28:28 1:17:01 1:04:22 0:12:39 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-11T22:36:47.276047+0000 mon.a (mon.0) 180 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7591994 2024-03-11 21:10:08 2024-03-11 22:11:38 2024-03-11 22:45:05 0:33:27 0:17:17 0:16:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-11T22:35:30.110554+0000 mon.smithi042 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7591995 2024-03-11 21:10:09 2024-03-11 22:17:19 2024-03-11 22:46:52 0:29:33 0:20:18 0:09:15 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_orch_cli} 1
fail 7591996 2024-03-11 21:10:10 2024-03-11 22:17:19 2024-03-11 22:49:59 0:32:40 0:20:37 0:12:03 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-11T22:40:14.523630+0000 mon.smithi081 (mon.0) 260 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591997 2024-03-11 21:10:11 2024-03-11 22:17:20 2024-03-11 22:51:52 0:34:32 0:22:54 0:11:38 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-11T22:40:07.573842+0000 mon.smithi130 (mon.0) 261 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7591998 2024-03-11 21:10:12 2024-03-11 22:17:20 2024-03-11 22:58:22 0:41:02 0:32:10 0:08:52 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710196868.5224204 mon.smithi094 (mon.0) 708 : cluster [WRN] Replacing daemon mds.cephfs.smithi094.qrbkag as rank 0 with standby daemon mds.cephfs.smithi189.jcfzkw" in cluster log

pass 7591999 2024-03-11 21:10:13 2024-03-11 22:17:20 2024-03-11 22:42:21 0:25:01 0:15:14 0:09:47 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
dead 7592000 2024-03-11 21:10:14 2024-03-11 22:17:21 2024-03-12 10:26:02 12:08:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

hit max job timeout

pass 7592001 2024-03-11 21:10:15 2024-03-11 22:17:21 2024-03-11 22:52:18 0:34:57 0:25:25 0:09:32 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_orch_cli_mon} 5
fail 7592002 2024-03-11 21:10:16 2024-03-11 22:17:22 2024-03-11 23:18:19 1:00:57 0:51:49 0:09:08 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-03-11T22:33:14.583268+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7592003 2024-03-11 21:10:17 2024-03-11 22:17:22 2024-03-11 23:18:18 1:00:56 0:51:09 0:09:47 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-11T22:40:00.000142+0000 mon.a (mon.0) 662 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7592004 2024-03-11 21:10:18 2024-03-11 22:17:22 2024-03-11 22:43:13 0:25:51 0:14:10 0:11:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-11T22:36:43.596984+0000 mon.smithi046 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592005 2024-03-11 21:10:19 2024-03-11 22:17:23 2024-03-11 22:43:32 0:26:09 0:14:08 0:12:01 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7592006 2024-03-11 21:10:20 2024-03-11 22:17:23 2024-03-11 22:43:18 0:25:55 0:14:47 0:11:08 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-11T22:35:10.540820+0000 mon.smithi080 (mon.0) 260 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592007 2024-03-11 21:10:21 2024-03-11 22:17:23 2024-03-11 22:48:59 0:31:36 0:20:54 0:10:42 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-11T22:40:10.933556+0000 mon.smithi008 (mon.0) 254 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592008 2024-03-11 21:10:22 2024-03-11 22:19:14 2024-03-11 22:57:08 0:37:54 0:21:54 0:16:00 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-03-11T22:50:00.000204+0000 mon.a (mon.0) 849 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

fail 7592009 2024-03-11 21:10:23 2024-03-11 22:26:05 2024-03-11 22:55:43 0:29:38 0:18:22 0:11:16 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-11T22:44:00.622565+0000 mon.smithi164 (mon.0) 268 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592010 2024-03-11 21:10:24 2024-03-11 22:26:26 2024-03-11 22:55:02 0:28:36 0:12:15 0:16:21 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-11T22:48:39.720185+0000 mon.a (mon.0) 247 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7592011 2024-03-11 21:10:25 2024-03-11 22:31:54 2024-03-11 23:06:29 0:34:35 0:22:58 0:11:37 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_set_mon_crush_locations} 3
fail 7592012 2024-03-11 21:10:26 2024-03-11 22:32:44 2024-03-11 23:45:09 1:12:25 0:57:16 0:15:09 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi153 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fa913b96-dff9-11ee-95c8-87774f69a715 -e sha1=94a539707733325322964c6a187c6a1b41be1daf -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

fail 7592013 2024-03-11 21:10:27 2024-03-11 22:32:44 2024-03-11 22:59:04 0:26:20 0:15:22 0:10:58 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-11T22:51:28.688052+0000 mon.smithi019 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592014 2024-03-11 21:10:28 2024-03-11 22:32:45 2024-03-11 23:01:13 0:28:28 0:14:00 0:14:28 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-03-11T22:53:53.211704+0000 mon.smithi066 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592015 2024-03-11 21:10:29 2024-03-11 22:32:45 2024-03-11 22:57:40 0:24:55 0:15:23 0:09:32 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7592016 2024-03-11 21:10:30 2024-03-11 22:32:46 2024-03-11 23:02:20 0:29:34 0:19:18 0:10:16 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

"2024-03-11T22:53:02.783123+0000 mon.smithi026 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592017 2024-03-11 21:10:31 2024-03-11 23:49:46 3876 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-11T23:10:00.000173+0000 mon.a (mon.0) 925 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

pass 7592018 2024-03-11 21:10:32 2024-03-11 22:32:46 2024-03-11 22:51:53 0:19:07 0:09:36 0:09:31 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_adoption} 1
fail 7592019 2024-03-11 21:10:33 2024-03-11 22:32:47 2024-03-11 22:56:34 0:23:47 0:13:07 0:10:40 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

"2024-03-11T22:50:47.910712+0000 mon.smithi183 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592020 2024-03-11 21:10:34 2024-03-11 22:57:13 727 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_ca_signed_key} 2
fail 7592021 2024-03-11 21:10:35 2024-03-11 22:32:47 2024-03-11 22:55:53 0:23:06 0:14:06 0:09:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-11T22:49:55.856765+0000 mon.smithi089 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592022 2024-03-11 21:10:36 2024-03-11 22:32:48 2024-03-11 23:20:33 0:47:45 0:37:45 0:10:00 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-11T22:53:54.892558+0000 mon.a (mon.0) 480 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7592023 2024-03-11 21:10:37 2024-03-11 22:32:48 2024-03-11 23:09:20 0:36:32 0:24:07 0:12:25 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7592024 2024-03-11 21:10:38 2024-03-11 22:32:48 2024-03-11 23:17:00 0:44:12 0:32:42 0:11:30 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7592025 2024-03-11 21:10:39 2024-03-11 22:32:49 2024-03-11 23:04:27 0:31:38 0:21:53 0:09:45 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-11T22:53:06.569916+0000 mon.smithi032 (mon.0) 254 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592026 2024-03-11 21:10:41 2024-03-11 22:32:49 2024-03-11 23:03:30 0:30:41 0:19:49 0:10:52 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-11T22:55:04.503809+0000 mon.smithi162 (mon.0) 252 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592027 2024-03-11 21:10:41 2024-03-11 22:32:50 2024-03-11 23:03:05 0:30:15 0:20:00 0:10:15 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm} 1
pass 7592028 2024-03-11 21:10:43 2024-03-11 22:32:50 2024-03-11 22:57:37 0:24:47 0:14:13 0:10:34 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
fail 7592029 2024-03-11 21:10:44 2024-03-11 22:32:50 2024-03-11 22:52:40 0:19:50 0:07:28 0:12:22 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi062 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7592030 2024-03-11 21:10:45 2024-03-11 22:35:01 2024-03-11 23:02:09 0:27:08 0:14:22 0:12:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

"2024-03-11T22:54:22.528508+0000 mon.smithi069 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592031 2024-03-11 21:10:45 2024-03-11 22:37:12 2024-03-11 23:00:14 0:23:02 0:12:58 0:10:04 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7592032 2024-03-11 21:10:46 2024-03-11 22:37:12 2024-03-11 23:00:48 0:23:36 0:12:31 0:11:05 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-11T22:55:17.718649+0000 mon.a (mon.0) 247 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7592033 2024-03-11 21:10:47 2024-03-11 22:37:42 2024-03-11 23:18:01 0:40:19 0:29:42 0:10:37 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-11T23:10:00.000079+0000 mon.a (mon.0) 1669 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

pass 7592034 2024-03-11 21:10:48 2024-03-11 22:38:53 2024-03-11 22:59:29 0:20:36 0:06:03 0:14:33 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm_repos} 1
dead 7592035 2024-03-11 21:10:50 2024-03-11 22:42:24 2024-03-12 10:51:46 12:09:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

hit max job timeout

pass 7592036 2024-03-11 21:10:51 2024-03-11 22:43:34 2024-03-11 23:17:54 0:34:20 0:24:40 0:09:40 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7592037 2024-03-11 21:10:52 2024-03-11 22:43:35 2024-03-11 23:19:51 0:36:16 0:21:45 0:14:31 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-11T23:08:42.461924+0000 mon.smithi149 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592038 2024-03-11 21:10:53 2024-03-11 22:48:05 2024-03-11 23:10:58 0:22:53 0:13:38 0:09:15 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-11T23:04:38.384674+0000 mon.smithi042 (mon.0) 261 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592039 2024-03-11 21:10:54 2024-03-11 22:48:06 2024-03-11 23:11:08 0:23:02 0:13:47 0:09:15 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm_timeout} 1
fail 7592040 2024-03-11 21:10:55 2024-03-11 22:48:06 2024-03-11 23:14:42 0:26:36 0:16:02 0:10:34 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-11T23:05:08.931896+0000 mon.smithi001 (mon.0) 270 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592041 2024-03-11 21:10:56 2024-03-11 22:48:07 2024-03-11 23:43:49 0:55:42 0:45:02 0:10:40 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-11T23:30:00.000242+0000 mon.a (mon.0) 2821 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7592042 2024-03-11 21:10:57 2024-03-11 22:48:07 2024-03-12 02:39:16 3:51:09 3:37:08 0:14:01 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi123 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fbcdfe674e56d1ea7a0810744e5915bb07961be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7592043 2024-03-11 21:10:58 2024-03-11 22:48:07 2024-03-11 23:15:06 0:26:59 0:16:42 0:10:17 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-11T23:05:25.981458+0000 mon.smithi086 (mon.0) 260 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592044 2024-03-11 21:10:59 2024-03-11 22:48:08 2024-03-11 23:17:39 0:29:31 0:19:18 0:10:13 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_extra_daemon_features} 2
fail 7592045 2024-03-11 21:11:00 2024-03-11 22:48:08 2024-03-11 23:37:11 0:49:03 0:37:40 0:11:23 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-11T23:20:00.000156+0000 mon.a (mon.0) 1540 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

fail 7592046 2024-03-11 21:11:01 2024-03-11 22:48:08 2024-03-11 23:24:13 0:36:05 0:24:23 0:11:42 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-11T23:09:28.285146+0000 mon.smithi099 (mon.0) 252 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592047 2024-03-11 21:11:02 2024-03-11 22:48:09 2024-03-11 23:27:18 0:39:09 0:28:23 0:10:46 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-11T23:05:43.123544+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7592048 2024-03-11 21:11:03 2024-03-11 22:48:09 2024-03-11 23:15:28 0:27:19 0:13:27 0:13:52 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-11T23:09:38.512278+0000 mon.smithi143 (mon.0) 263 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592049 2024-03-11 21:11:04 2024-03-11 22:52:20 2024-03-11 23:17:33 0:25:13 0:15:10 0:10:03 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_host_drain} 3
fail 7592050 2024-03-11 21:11:05 2024-03-11 22:52:20 2024-03-11 23:21:24 0:29:04 0:14:42 0:14:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-11T23:12:59.248884+0000 mon.smithi079 (mon.0) 260 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592051 2024-03-11 21:11:06 2024-03-11 22:56:21 2024-03-11 23:19:01 0:22:40 0:11:08 0:11:32 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7592052 2024-03-11 21:11:07 2024-03-11 22:57:42 2024-03-11 23:22:56 0:25:14 0:15:23 0:09:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-11T23:14:21.153533+0000 mon.smithi057 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592053 2024-03-11 21:11:08 2024-03-11 22:57:42 2024-03-11 23:20:47 0:23:05 0:13:35 0:09:30 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7592054 2024-03-11 21:11:09 2024-03-11 22:57:43 2024-03-11 23:40:54 0:43:11 0:31:22 0:11:49 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710199131.6342838 mon.smithi038 (mon.0) 329 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7592055 2024-03-11 21:11:10 2024-03-11 22:59:53 2024-03-11 23:25:41 0:25:48 0:14:39 0:11:09 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7592056 2024-03-11 21:11:11 2024-03-11 22:59:54 2024-03-11 23:36:26 0:36:32 0:22:02 0:14:30 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

"2024-03-11T23:30:00.000234+0000 mon.a (mon.0) 1103 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

fail 7592057 2024-03-11 21:11:12 2024-03-11 23:03:15 2024-03-11 23:34:56 0:31:41 0:20:27 0:11:14 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-11T23:26:22.177342+0000 mon.smithi044 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592058 2024-03-11 21:11:13 2024-03-11 23:03:35 2024-03-11 23:35:12 0:31:37 0:21:08 0:10:29 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-11T23:23:46.555244+0000 mon.smithi122 (mon.0) 255 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592059 2024-03-11 21:11:14 2024-03-11 23:03:35 2024-03-12 00:07:25 1:03:50 0:51:41 0:12:09 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-11T23:30:00.000119+0000 mon.a (mon.0) 885 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

fail 7592060 2024-03-11 21:11:15 2024-03-11 23:03:36 2024-03-11 23:26:21 0:22:45 0:13:35 0:09:10 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-11T23:20:25.169940+0000 mon.smithi002 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7592061 2024-03-11 21:11:16 2024-03-11 23:03:36 2024-03-11 23:41:03 0:37:27 0:26:12 0:11:15 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
fail 7592062 2024-03-11 21:11:17 2024-03-11 23:03:36 2024-03-11 23:34:39 0:31:03 0:18:40 0:12:23 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-11T23:22:45.392711+0000 mon.smithi069 (mon.0) 272 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7592063 2024-03-11 21:11:18 2024-03-11 23:03:37 2024-03-11 23:30:04 0:26:27 0:15:46 0:10:41 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_orch_cli} 1
Failure Reason:

Test failure: test_daemon_restart (tasks.cephadm_cases.test_cli.TestCephadmCLI)