Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7694254 2024-05-06 20:10:08 2024-05-15 04:42:01 821 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-05-15T04:37:51.101864+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694255 2024-05-06 20:10:09 2024-05-15 04:19:01 2024-05-15 04:44:14 0:25:13 0:14:27 0:10:46 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-05-15T04:39:47.130493+0000 mon.smithi115 (mon.0) 783 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7694256 2024-05-06 20:10:10 2024-05-15 04:19:02 2024-05-15 05:36:30 1:17:28 1:07:52 0:09:36 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7694257 2024-05-06 20:10:11 2024-05-15 04:19:32 2024-05-15 05:12:53 0:53:21 0:41:14 0:12:07 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7694258 2024-05-06 20:10:12 2024-05-15 04:20:43 2024-05-15 04:51:12 0:30:29 0:19:46 0:10:43 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7694259 2024-05-06 20:10:13 2024-05-15 04:55:21 1434 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-05-15T04:53:31.557548+0000 mon.a (mon.0) 715 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

fail 7694260 2024-05-06 20:10:14 2024-05-15 04:21:33 2024-05-15 05:04:26 0:42:53 0:32:00 0:10:53 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7694261 2024-05-06 20:10:15 2024-05-15 04:23:24 2024-05-15 04:41:28 0:18:04 0:07:35 0:10:29 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/flannel rook/1.7.2} 1
Failure Reason:

Command failed on smithi042 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

fail 7694262 2024-05-06 20:10:16 2024-05-15 04:24:05 2024-05-15 04:49:07 0:25:02 0:14:45 0:10:17 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-15T04:44:51.626889+0000 mon.smithi043 (mon.0) 821 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694263 2024-05-06 20:10:17 2024-05-15 04:24:05 2024-05-15 04:48:07 0:24:02 0:13:20 0:10:42 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom} 2
pass 7694264 2024-05-06 20:10:17 2024-05-15 04:24:25 2024-05-15 04:56:25 0:32:00 0:18:10 0:13:50 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7694265 2024-05-06 20:10:19 2024-05-15 04:25:46 2024-05-15 05:01:35 0:35:49 0:25:56 0:09:53 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-05-15T04:48:29.999477+0000 mon.a (mon.0) 434 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694266 2024-05-06 20:10:20 2024-05-15 04:25:46 2024-05-15 04:50:59 0:25:13 0:13:59 0:11:14 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-05-15T04:45:31.606318+0000 mon.a (mon.0) 189 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694267 2024-05-06 20:10:21 2024-05-15 04:28:07 2024-05-15 05:30:15 1:02:08 0:50:37 0:11:31 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7694268 2024-05-06 20:10:22 2024-05-15 04:29:48 2024-05-15 05:02:35 0:32:47 0:21:30 0:11:17 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7694269 2024-05-06 20:10:23 2024-05-15 04:30:48 2024-05-15 05:01:51 0:31:03 0:22:23 0:08:40 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 7694270 2024-05-06 20:10:24 2024-05-15 04:30:48 2024-05-15 05:16:19 0:45:31 0:32:53 0:12:38 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7694271 2024-05-06 20:10:25 2024-05-15 04:33:09 2024-05-15 05:17:00 0:43:51 0:34:31 0:09:20 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7694272 2024-05-06 20:10:26 2024-05-15 04:33:50 2024-05-15 05:43:28 1:09:38 1:00:36 0:09:02 smithi main ubuntu 22.04 orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
Failure Reason:

"2024-05-15T04:59:12.002977+0000 mon.a (mon.0) 335 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

pass 7694273 2024-05-06 20:10:27 2024-05-15 04:33:50 2024-05-15 04:53:37 0:19:47 0:09:22 0:10:25 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_adoption} 1
pass 7694274 2024-05-06 20:10:28 2024-05-15 04:34:31 2024-05-15 05:00:46 0:26:15 0:14:19 0:11:56 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7694275 2024-05-06 20:10:29 2024-05-15 04:35:21 2024-05-15 05:00:20 0:24:59 0:13:20 0:11:39 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7694276 2024-05-06 20:10:30 2024-05-15 04:36:22 2024-05-15 05:12:00 0:35:38 0:25:22 0:10:16 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7694277 2024-05-06 20:10:31 2024-05-15 04:36:52 2024-05-15 05:00:40 0:23:48 0:12:47 0:11:01 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
dead 7694278 2024-05-06 20:10:32 2024-05-15 04:37:33 2024-05-15 16:49:35 12:12:02 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

hit max job timeout

pass 7694279 2024-05-06 20:10:33 2024-05-15 04:41:13 2024-05-15 05:09:01 0:27:48 0:18:38 0:09:10 smithi main ubuntu 22.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7694280 2024-05-06 20:10:34 2024-05-15 04:41:14 2024-05-15 05:02:33 0:21:19 0:11:53 0:09:26 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7694281 2024-05-06 20:10:35 2024-05-15 04:41:24 2024-05-15 05:31:29 0:50:05 0:38:42 0:11:23 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7694282 2024-05-06 20:10:36 2024-05-15 04:41:24 2024-05-15 05:11:52 0:30:28 0:18:48 0:11:40 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7694283 2024-05-06 20:10:37 2024-05-15 04:42:35 2024-05-15 05:08:23 0:25:48 0:14:33 0:11:15 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7694284 2024-05-06 20:10:38 2024-05-15 04:45:06 2024-05-15 05:15:03 0:29:57 0:20:05 0:09:52 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7694285 2024-05-06 20:10:39 2024-05-15 04:45:06 2024-05-15 05:09:26 0:24:20 0:13:22 0:10:58 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7694286 2024-05-06 20:10:40 2024-05-15 04:45:47 2024-05-15 05:07:33 0:21:46 0:11:42 0:10:04 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
dead 7694287 2024-05-06 20:10:41 2024-05-15 04:46:37 2024-05-15 04:47:41 0:01:04 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi137

fail 7694288 2024-05-06 20:10:41 2024-05-15 04:46:38 2024-05-15 05:11:23 0:24:45 0:14:40 0:10:05 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-15T05:07:10.532261+0000 mon.smithi042 (mon.0) 814 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694289 2024-05-06 20:10:42 2024-05-15 04:46:38 2024-05-15 05:44:21 0:57:43 0:48:13 0:09:30 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
fail 7694290 2024-05-06 20:10:43 2024-05-15 04:46:38 2024-05-15 05:36:45 0:50:07 0:39:29 0:10:38 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7694291 2024-05-06 20:10:44 2024-05-15 04:47:49 2024-05-15 05:11:14 0:23:25 0:14:23 0:09:02 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-15T05:09:58.394634+0000 mon.a (mon.0) 210 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7694292 2024-05-06 20:10:45 2024-05-15 04:47:59 2024-05-15 05:13:47 0:25:48 0:14:48 0:11:00 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7694293 2024-05-06 20:10:46 2024-05-15 04:48:10 2024-05-15 05:22:43 0:34:33 0:23:44 0:10:49 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys} 2
pass 7694294 2024-05-06 20:10:47 2024-05-15 04:49:20 2024-05-15 05:15:53 0:26:33 0:15:23 0:11:10 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7694295 2024-05-06 20:10:48 2024-05-15 04:50:51 2024-05-15 05:16:28 0:25:37 0:16:13 0:09:24 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7694296 2024-05-06 20:10:49 2024-05-15 04:51:21 2024-05-15 05:23:06 0:31:45 0:21:46 0:09:59 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7694297 2024-05-06 20:10:50 2024-05-15 04:51:22 2024-05-15 05:20:50 0:29:28 0:20:04 0:09:24 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7694298 2024-05-06 20:10:51 2024-05-15 04:51:22 2024-05-15 05:21:42 0:30:20 0:18:18 0:12:02 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_basic} 2
pass 7694299 2024-05-06 20:10:52 2024-05-15 04:54:13 2024-05-15 05:20:04 0:25:51 0:15:43 0:10:08 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7694300 2024-05-06 20:10:53 2024-05-15 04:54:13 2024-05-15 05:21:01 0:26:48 0:12:11 0:14:37 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-05-15T05:16:11.815076+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694301 2024-05-06 20:10:54 2024-05-15 04:56:34 2024-05-15 05:36:17 0:39:43 0:28:44 0:10:59 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-05-15T05:23:47.921663+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694302 2024-05-06 20:10:54 2024-05-15 04:56:34 2024-05-15 05:17:46 0:21:12 0:11:48 0:09:24 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
Failure Reason:

"2024-05-15T05:15:41.918542+0000 mon.a (mon.0) 361 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694303 2024-05-06 20:10:55 2024-05-15 04:56:45 2024-05-15 05:28:20 0:31:35 0:16:40 0:14:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7694304 2024-05-06 20:10:56 2024-05-15 05:00:25 2024-05-15 06:17:59 1:17:34 1:06:39 0:10:55 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7694305 2024-05-06 20:10:57 2024-05-15 05:00:46 2024-05-15 05:47:51 0:47:05 0:36:54 0:10:11 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7694306 2024-05-06 20:10:58 2024-05-15 05:00:56 2024-05-15 05:36:46 0:35:50 0:25:27 0:10:23 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-05-15T05:32:50.265661+0000 mon.a (mon.0) 563 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7694307 2024-05-06 20:10:59 2024-05-15 05:00:57 2024-05-15 05:25:10 0:24:13 0:13:39 0:10:34 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7694308 2024-05-06 20:11:00 2024-05-15 05:01:57 2024-05-15 05:19:40 0:17:43 0:07:36 0:10:07 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi018 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7694309 2024-05-06 20:11:01 2024-05-15 05:02:18 2024-05-15 05:23:18 0:21:00 0:12:35 0:08:25 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_domain} 2
fail 7694310 2024-05-06 20:11:02 2024-05-15 05:02:18 2024-05-15 05:36:05 0:33:47 0:23:32 0:10:15 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-15T05:28:34.228003+0000 mon.smithi053 (mon.0) 817 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694311 2024-05-06 20:11:03 2024-05-15 05:02:18 2024-05-15 05:56:01 0:53:43 0:44:30 0:09:13 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7694312 2024-05-06 20:11:04 2024-05-15 05:02:19 2024-05-15 05:27:04 0:24:45 0:14:50 0:09:55 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
pass 7694313 2024-05-06 20:11:05 2024-05-15 05:02:19 2024-05-15 05:29:22 0:27:03 0:17:32 0:09:31 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7694314 2024-05-06 20:11:06 2024-05-15 05:02:19 2024-05-15 05:27:53 0:25:34 0:15:08 0:10:26 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-15T05:23:16.155237+0000 mon.smithi174 (mon.0) 852 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7694315 2024-05-06 20:11:07 2024-05-15 05:02:40 2024-05-15 05:27:49 0:25:09 0:15:45 0:09:24 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-05-15T05:21:15.056764+0000 mon.a (mon.0) 642 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694316 2024-05-06 20:11:08 2024-05-15 05:02:40 2024-05-15 05:29:37 0:26:57 0:13:30 0:13:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7694317 2024-05-06 20:11:09 2024-05-15 05:28:44 665 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_basic} 2
fail 7694318 2024-05-06 20:11:10 2024-05-15 05:07:42 2024-05-15 05:27:29 0:19:47 0:09:04 0:10:43 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d815ceabb47f66b7ffcffd2e7bff487b4bab808 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7694319 2024-05-06 20:11:11 2024-05-15 05:07:42 2024-05-15 05:38:21 0:30:39 0:19:19 0:11:20 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-05-15T05:34:02.841169+0000 mon.smithi001 (mon.0) 760 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694320 2024-05-06 20:11:11 2024-05-15 05:13:39 2024-05-15 05:54:59 0:41:20 0:31:18 0:10:02 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
fail 7694321 2024-05-06 20:11:12 2024-05-15 05:13:40 2024-05-15 06:03:19 0:49:39 0:39:49 0:09:50 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7694322 2024-05-06 20:11:13 2024-05-15 05:13:50 2024-05-15 05:49:35 0:35:45 0:25:19 0:10:26 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli_mon} 5
pass 7694323 2024-05-06 20:11:14 2024-05-15 05:13:50 2024-05-15 05:34:40 0:20:50 0:11:36 0:09:14 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
pass 7694324 2024-05-06 20:11:15 2024-05-15 05:13:51 2024-05-15 05:39:26 0:25:35 0:15:06 0:10:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7694325 2024-05-06 20:11:16 2024-05-15 05:20:07 2024-05-15 05:42:44 0:22:37 0:13:15 0:09:22 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
fail 7694326 2024-05-06 20:11:17 2024-05-15 05:20:07 2024-05-15 05:42:54 0:22:47 0:12:08 0:10:39 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-05-15T05:38:48.286246+0000 mon.a (mon.0) 448 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694327 2024-05-06 20:11:18 2024-05-15 05:21:48 2024-05-15 05:46:19 0:24:31 0:13:24 0:11:07 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_extra_daemon_features} 2
fail 7694328 2024-05-06 20:11:19 2024-05-15 05:22:48 2024-05-15 05:48:22 0:25:34 0:14:15 0:11:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-05-15T05:45:36.761652+0000 mon.smithi089 (mon.0) 818 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694329 2024-05-06 20:11:20 2024-05-15 05:23:09 2024-05-15 05:55:13 0:32:04 0:21:12 0:10:52 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-15T05:50:19.191847+0000 mon.smithi186 (mon.0) 810 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694330 2024-05-06 20:11:21 2024-05-15 05:23:19 2024-05-15 05:53:08 0:29:49 0:18:33 0:11:16 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_dom} 2
pass 7694331 2024-05-06 20:11:21 2024-05-15 05:25:20 2024-05-15 06:00:04 0:34:44 0:22:27 0:12:17 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7694332 2024-05-06 20:11:22 2024-05-15 05:27:11 2024-05-15 06:31:03 1:03:52 0:51:38 0:12:14 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e0bf950-127e-11ef-bc98-c7b262605968 -e sha1=bbc3230dd38dbe0ebab62c596365a1a9b048201c -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

pass 7694333 2024-05-06 20:11:23 2024-05-15 05:28:21 2024-05-15 06:04:40 0:36:19 0:26:26 0:09:53 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7694334 2024-05-06 20:11:24 2024-05-15 05:28:52 2024-05-15 05:54:49 0:25:57 0:15:48 0:10:09 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-05-15T05:53:04.635628+0000 mon.a (mon.0) 938 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

pass 7694335 2024-05-06 20:11:25 2024-05-15 05:29:42 2024-05-15 05:55:41 0:25:59 0:15:38 0:10:21 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7694336 2024-05-06 20:11:26 2024-05-15 05:30:23 2024-05-15 06:21:00 0:50:37 0:38:17 0:12:20 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7694337 2024-05-06 20:11:27 2024-05-15 05:31:34 2024-05-15 05:51:24 0:19:50 0:09:46 0:10:04 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_adoption} 1
pass 7694338 2024-05-06 20:11:28 2024-05-15 05:31:34 2024-05-15 06:00:49 0:29:15 0:18:55 0:10:20 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7694339 2024-05-06 20:11:29 2024-05-15 05:33:24 2024-05-15 06:00:55 0:27:31 0:18:56 0:08:35 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
pass 7694340 2024-05-06 20:11:30 2024-05-15 05:33:25 2024-05-15 06:10:36 0:37:11 0:25:20 0:11:51 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7694341 2024-05-06 20:11:31 2024-05-15 05:33:25 2024-05-15 05:56:21 0:22:56 0:13:36 0:09:20 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7694342 2024-05-06 20:11:32 2024-05-15 05:33:26 2024-05-15 06:33:05 0:59:39 0:49:50 0:09:49 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7694343 2024-05-06 20:11:33 2024-05-15 05:33:26 2024-05-15 06:04:35 0:31:09 0:20:05 0:11:04 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7694344 2024-05-06 20:11:33 2024-05-15 05:34:46 2024-05-15 05:57:28 0:22:42 0:13:13 0:09:29 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7694345 2024-05-06 20:11:34 2024-05-15 05:34:47 2024-05-15 06:02:03 0:27:16 0:14:21 0:12:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7694346 2024-05-06 20:11:35 2024-05-15 05:36:37 2024-05-15 06:03:01 0:26:24 0:12:05 0:14:19 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7694347 2024-05-06 20:11:36 2024-05-15 05:39:28 2024-05-15 06:12:39 0:33:11 0:24:17 0:08:54 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7694348 2024-05-06 20:11:37 2024-05-15 05:39:39 2024-05-15 06:03:53 0:24:14 0:13:16 0:10:58 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7694349 2024-05-06 20:11:38 2024-05-15 05:40:49 2024-05-15 06:02:23 0:21:34 0:11:24 0:10:10 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
fail 7694350 2024-05-06 20:11:39 2024-05-15 05:41:20 2024-05-15 06:06:40 0:25:20 0:14:55 0:10:25 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-15T06:02:48.632181+0000 mon.smithi078 (mon.0) 820 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694351 2024-05-06 20:11:40 2024-05-15 05:41:40 2024-05-15 06:13:46 0:32:06 0:18:53 0:13:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-05-15T06:06:42.861185+0000 mon.a (mon.0) 718 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694352 2024-05-06 20:11:41 2024-05-15 05:48:56 2024-05-15 06:34:37 0:45:41 0:35:49 0:09:52 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7694353 2024-05-06 20:11:42 2024-05-15 05:48:56 2024-05-15 06:19:03 0:30:07 0:19:36 0:10:31 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-15T06:16:32.329416+0000 mon.a (mon.0) 213 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7694354 2024-05-06 20:11:43 2024-05-15 05:49:06 2024-05-15 06:19:08 0:30:02 0:20:38 0:09:24 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7694355 2024-05-06 20:11:44 2024-05-15 05:49:07 2024-05-15 06:07:10 0:18:03 0:07:40 0:10:23 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/1.7.2} 3
Failure Reason:

Command failed on smithi042 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7694356 2024-05-06 20:11:44 2024-05-15 05:49:07 2024-05-15 06:36:49 0:47:42 0:38:06 0:09:36 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
fail 7694357 2024-05-06 20:11:45 2024-05-15 05:49:08 2024-05-15 06:33:11 0:44:03 0:32:21 0:11:42 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-05-15T06:06:44.926426+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694358 2024-05-06 20:11:46 2024-05-15 05:49:38 2024-05-15 06:15:04 0:25:26 0:15:02 0:10:24 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7694359 2024-05-06 20:11:47 2024-05-15 05:49:38 2024-05-15 06:16:41 0:27:03 0:15:15 0:11:48 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite} 3
dead 7694360 2024-05-06 20:11:48 2024-05-15 05:50:49 2024-05-15 18:02:10 12:11:21 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

hit max job timeout

pass 7694361 2024-05-06 20:11:49 2024-05-15 05:53:10 2024-05-15 06:15:32 0:22:22 0:11:18 0:11:04 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_basic} 2
pass 7694362 2024-05-06 20:11:50 2024-05-15 05:54:30 2024-05-15 06:20:15 0:25:45 0:14:53 0:10:52 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7694363 2024-05-06 20:11:51 2024-05-15 05:56:02 2024-05-15 06:21:31 0:25:29 0:15:45 0:09:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7694364 2024-05-06 20:11:52 2024-05-15 05:56:22 2024-05-15 06:29:21 0:32:59 0:21:27 0:11:32 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-05-15T06:25:52.233965+0000 mon.smithi087 (mon.0) 942 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694365 2024-05-06 20:11:53 2024-05-15 05:57:33 2024-05-15 06:55:46 0:58:13 0:46:07 0:12:06 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
fail 7694366 2024-05-06 20:11:53 2024-05-15 06:00:14 2024-05-15 06:34:44 0:34:30 0:22:45 0:11:45 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-05-15T06:25:25.298121+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694367 2024-05-06 20:11:54 2024-05-15 06:01:04 2024-05-15 06:51:25 0:50:21 0:38:34 0:11:47 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7694368 2024-05-06 20:11:55 2024-05-15 06:02:05 2024-05-15 06:47:30 0:45:25 0:35:17 0:10:08 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7694369 2024-05-06 20:11:56 2024-05-15 06:02:25 2024-05-15 06:51:42 0:49:17 0:39:47 0:09:30 smithi main centos 9.stream orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-05-15T06:23:23.946702+0000 mon.a (mon.0) 604 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694370 2024-05-06 20:11:57 2024-05-15 06:02:25 2024-05-15 06:27:59 0:25:34 0:14:21 0:11:13 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-05-15T06:24:40.080796+0000 mon.a (mon.0) 551 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7694371 2024-05-06 20:11:58 2024-05-15 06:03:06 2024-05-15 06:26:29 0:23:23 0:12:45 0:10:38 smithi main centos 9.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
pass 7694372 2024-05-06 20:11:59 2024-05-15 06:03:06 2024-05-15 06:33:36 0:30:30 0:20:02 0:10:28 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7694373 2024-05-06 20:12:00 2024-05-15 06:03:57 2024-05-15 06:41:49 0:37:52 0:26:41 0:11:11 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-05-15T06:25:37.762344+0000 mon.a (mon.0) 540 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7694374 2024-05-06 20:12:01 2024-05-15 06:04:27 2024-05-15 06:34:09 0:29:42 0:19:41 0:10:01 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} 2
fail 7694375 2024-05-06 20:12:02 2024-05-15 06:04:28 2024-05-15 06:31:25 0:26:57 0:16:45 0:10:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-15T06:24:44.207159+0000 mon.smithi102 (mon.0) 860 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694376 2024-05-06 20:12:02 2024-05-15 06:04:28 2024-05-15 06:25:24 0:20:56 0:11:36 0:09:20 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
dead 7694377 2024-05-06 20:12:03 2024-05-15 06:04:28 2024-05-15 06:05:32 0:01:04 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi084

pass 7694378 2024-05-06 20:12:04 2024-05-15 06:04:29 2024-05-15 07:08:28 1:03:59 0:54:12 0:09:47 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7694379 2024-05-06 20:12:05 2024-05-15 06:05:39 2024-05-15 06:33:03 0:27:24 0:17:40 0:09:44 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7694380 2024-05-06 20:12:06 2024-05-15 06:06:10 2024-05-15 06:30:07 0:23:57 0:11:28 0:12:29 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi113 with status 5: 'sudo systemctl stop ceph-12ef9cac-1284-11ef-bc98-c7b262605968@mon.a'

fail 7694381 2024-05-06 20:12:07 2024-05-15 06:08:00 2024-05-15 06:41:40 0:33:40 0:21:54 0:11:46 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-15T06:36:30.127094+0000 mon.smithi089 (mon.0) 867 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694382 2024-05-06 20:12:08 2024-05-15 06:10:01 2024-05-15 06:33:03 0:23:02 0:13:31 0:09:31 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7694383 2024-05-06 20:12:09 2024-05-15 06:10:01 2024-05-15 06:33:15 0:23:14 0:11:19 0:11:55 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} 2
fail 7694384 2024-05-06 20:12:10 2024-05-15 06:10:42 2024-05-15 06:34:54 0:24:12 0:13:50 0:10:22 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-05-15T06:31:51.828075+0000 mon.smithi100 (mon.0) 793 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694385 2024-05-06 20:12:11 2024-05-15 06:11:52 2024-05-15 06:34:56 0:23:04 0:14:18 0:08:46 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm} 1
pass 7694386 2024-05-06 20:12:12 2024-05-15 06:12:03 2024-05-15 07:23:21 1:11:18 0:58:58 0:12:20 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 7694387 2024-05-06 20:12:13 2024-05-15 06:12:43 2024-05-15 06:40:47 0:28:04 0:15:35 0:12:29 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-05-15T06:32:27.864502+0000 mon.a (mon.0) 414 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694388 2024-05-06 20:12:13 2024-05-15 06:15:14 2024-05-15 06:48:35 0:33:21 0:22:38 0:10:43 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7694389 2024-05-06 20:12:14 2024-05-15 06:15:34 2024-05-15 06:59:21 0:43:47 0:33:44 0:10:03 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-05-15T06:50:00.000202+0000 mon.smithi060 (mon.0) 407 : cluster [WRN] osd.3 (root=default,host=smithi114) is down" in cluster log

pass 7694390 2024-05-06 20:12:15 2024-05-15 06:15:35 2024-05-15 06:52:25 0:36:50 0:25:58 0:10:52 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli_mon} 5
fail 7694391 2024-05-06 20:12:16 2024-05-15 06:16:45 2024-05-15 06:40:17 0:23:32 0:13:27 0:10:05 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-05-15T06:33:31.725263+0000 mon.smithi116 (mon.0) 160 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694392 2024-05-06 20:12:17 2024-05-15 06:16:56 2024-05-15 07:10:57 0:54:01 0:43:48 0:10:13 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7694393 2024-05-06 20:12:18 2024-05-15 06:17:26 2024-05-15 06:47:26 0:30:00 0:20:45 0:09:15 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7694394 2024-05-06 20:12:19 2024-05-15 06:17:46 2024-05-15 06:35:37 0:17:51 0:06:38 0:11:13 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7694395 2024-05-06 20:12:20 2024-05-15 06:17:47 2024-05-15 06:43:03 0:25:16 0:14:52 0:10:24 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-05-15T06:38:23.811191+0000 mon.smithi133 (mon.0) 817 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694396 2024-05-06 20:12:21 2024-05-15 06:17:57 2024-05-15 06:39:11 0:21:14 0:12:28 0:08:46 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} 2
pass 7694397 2024-05-06 20:12:22 2024-05-15 06:18:08 2024-05-15 06:46:27 0:28:19 0:17:30 0:10:49 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
dead 7694398 2024-05-06 20:12:22 2024-05-15 06:19:18 2024-05-15 06:21:12 0:01:54 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi160

dead 7694399 2024-05-06 20:12:23 2024-05-15 06:20:09 2024-05-15 06:21:13 0:01:04 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi153

fail 7694400 2024-05-06 20:12:24 2024-05-15 06:20:09 2024-05-15 06:49:41 0:29:32 0:19:37 0:09:55 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-05-15T06:43:18.733385+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694401 2024-05-06 20:12:25 2024-05-15 06:20:10 2024-05-15 07:07:16 0:47:06 0:37:56 0:09:10 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7694402 2024-05-06 20:12:26 2024-05-15 06:20:10 2024-05-15 06:37:38 0:17:28 0:07:38 0:09:50 smithi main ubuntu 22.04 orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/master} 1
Failure Reason:

Command failed on smithi042 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"

pass 7694403 2024-05-06 20:12:27 2024-05-15 06:20:10 2024-05-15 06:41:36 0:21:26 0:12:23 0:09:03 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_adoption} 1
pass 7694404 2024-05-06 20:12:28 2024-05-15 06:20:11 2024-05-15 06:43:05 0:22:54 0:13:11 0:09:43 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7694405 2024-05-06 20:12:29 2024-05-15 06:20:11 2024-05-15 06:43:21 0:23:10 0:13:39 0:09:31 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7694406 2024-05-06 20:12:30 2024-05-15 06:20:11 2024-05-15 06:50:06 0:29:55 0:19:37 0:10:18 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7694407 2024-05-06 20:12:31 2024-05-15 06:20:22 2024-05-15 06:55:39 0:35:17 0:24:36 0:10:41 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
dead 7694408 2024-05-06 20:12:32 2024-05-15 06:20:22 2024-05-15 18:30:17 12:09:55 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

hit max job timeout

pass 7694409 2024-05-06 20:12:32 2024-05-15 06:21:23 2024-05-15 07:08:19 0:46:56 0:37:04 0:09:52 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
fail 7694410 2024-05-06 20:12:33 2024-05-15 06:21:23 2024-05-15 06:46:39 0:25:16 0:15:51 0:09:25 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-05-15T06:44:49.119172+0000 mon.a (mon.0) 709 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

pass 7694411 2024-05-06 20:12:34 2024-05-15 06:21:33 2024-05-15 06:58:23 0:36:50 0:25:22 0:11:28 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7694412 2024-05-06 20:12:35 2024-05-15 06:22:14 2024-05-15 06:44:55 0:22:41 0:14:12 0:08:29 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7694413 2024-05-06 20:12:36 2024-05-15 06:22:14 2024-05-15 07:11:52 0:49:38 0:36:02 0:13:36 smithi main centos 9.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi029 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7bcfde2-1285-11ef-bc98-c7b262605968 -e sha1=bbc3230dd38dbe0ebab62c596365a1a9b048201c -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\''

pass 7694414 2024-05-06 20:12:37 2024-05-15 06:48:37 2024-05-15 07:17:57 0:29:20 0:18:43 0:10:37 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7694415 2024-05-06 20:12:38 2024-05-15 06:50:07 2024-05-15 07:09:26 0:19:19 0:07:36 0:11:43 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

Command failed on smithi164 with status 1: 'sudo docker pull quay.io/samba.org/samba-ad-server:latest'

fail 7694416 2024-05-06 20:12:39 2024-05-15 06:51:08 2024-05-15 07:22:42 0:31:34 0:21:04 0:10:30 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-05-15T07:16:33.946821+0000 mon.smithi174 (mon.0) 790 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694417 2024-05-06 20:12:40 2024-05-15 06:51:08 2024-05-15 07:13:44 0:22:36 0:14:03 0:08:33 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-05-15T07:08:44.687075+0000 mon.a (mon.0) 258 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694418 2024-05-06 20:12:40 2024-05-15 06:51:09 2024-05-15 10:40:27 3:49:18 3:37:06 0:12:12 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi189 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d815ceabb47f66b7ffcffd2e7bff487b4bab808 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7694419 2024-05-06 20:12:41 2024-05-15 06:51:09 2024-05-15 07:14:41 0:23:32 0:14:28 0:09:04 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

"2024-05-15T07:13:38.494500+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7694420 2024-05-06 20:12:42 2024-05-15 06:51:09 2024-05-15 07:15:00 0:23:51 0:14:14 0:09:37 smithi main ubuntu 22.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7694421 2024-05-06 20:12:43 2024-05-15 06:51:10 2024-05-15 07:16:16 0:25:06 0:15:04 0:10:02 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7694422 2024-05-06 20:12:44 2024-05-15 06:51:10 2024-05-15 07:14:07 0:22:57 0:12:56 0:10:01 smithi main centos 9.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
fail 7694423 2024-05-06 20:12:45 2024-05-15 06:51:10 2024-05-15 07:14:03 0:22:53 0:12:31 0:10:22 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-05-15T07:10:32.069709+0000 mon.a (mon.0) 789 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7694424 2024-05-06 20:12:46 2024-05-15 06:51:11 2024-05-15 07:16:07 0:24:56 0:15:55 0:09:01 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7694425 2024-05-06 20:12:47 2024-05-15 06:51:11 2024-05-15 07:14:06 0:22:55 0:14:13 0:08:42 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7694426 2024-05-06 20:12:48 2024-05-15 06:51:11 2024-05-15 07:14:18 0:23:07 0:11:31 0:11:36 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_basic} 2
pass 7694427 2024-05-06 20:12:48 2024-05-15 06:52:32 2024-05-15 07:37:37 0:45:05 0:35:37 0:09:28 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7694428 2024-05-06 20:12:49 2024-05-15 06:52:32 2024-05-15 07:39:33 0:47:01 0:35:27 0:11:34 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7694429 2024-05-06 20:12:50 2024-05-15 06:54:23 2024-05-15 07:30:32 0:36:09 0:25:43 0:10:26 smithi main ubuntu 22.04 orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7694430 2024-05-06 20:12:51 2024-05-15 06:54:43 2024-05-15 07:30:24 0:35:41 0:23:35 0:12:06 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-05-15T07:26:37.599691+0000 mon.smithi072 (mon.0) 990 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694431 2024-05-06 20:12:52 2024-05-15 06:55:44 2024-05-15 07:20:46 0:25:02 0:14:56 0:10:06 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7694432 2024-05-06 20:12:53 2024-05-15 06:55:54 2024-05-15 07:20:58 0:25:04 0:15:41 0:09:23 smithi main centos 9.stream orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-05-15T07:12:56.173381+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7694433 2024-05-06 20:12:54 2024-05-15 06:56:05 2024-05-15 07:20:58 0:24:53 0:13:29 0:11:24 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

"2024-05-15T07:17:14.635065+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7694434 2024-05-06 20:12:55 2024-05-15 06:57:55 2024-05-15 07:46:10 0:48:15 0:38:00 0:10:15 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7694435 2024-05-06 20:12:56 2024-05-15 06:58:26 2024-05-15 07:21:23 0:22:57 0:14:34 0:08:23 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

"2024-05-15T07:19:51.229732+0000 mon.a (mon.0) 547 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log

pass 7694436 2024-05-06 20:12:57 2024-05-15 06:58:26 2024-05-15 07:23:37 0:25:11 0:13:44 0:11:27 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7694437 2024-05-06 20:12:57 2024-05-15 06:59:37 2024-05-15 07:22:38 0:23:01 0:11:56 0:11:05 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} 2
fail 7694438 2024-05-06 20:12:58 2024-05-15 07:00:07 2024-05-15 07:27:46 0:27:39 0:17:27 0:10:12 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-05-15T07:21:14.312630+0000 mon.smithi105 (mon.0) 857 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694439 2024-05-06 20:12:59 2024-05-15 07:00:48 2024-05-15 07:35:18 0:34:30 0:23:32 0:10:58 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7694440 2024-05-06 20:13:00 2024-05-15 07:01:18 2024-05-15 07:56:15 0:54:57 0:43:49 0:11:08 smithi main ubuntu 22.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-05-15T07:25:06.992715+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7694441 2024-05-06 20:13:01 2024-05-15 07:02:19 2024-05-15 07:27:36 0:25:17 0:15:47 0:09:30 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7694442 2024-05-06 20:13:02 2024-05-15 07:02:19 2024-05-15 08:16:43 1:14:24 1:03:18 0:11:06 smithi main ubuntu 22.04 orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
fail 7694443 2024-05-06 20:13:03 2024-05-15 07:03:00 2024-05-15 07:28:57 0:25:57 0:14:41 0:11:16 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-05-15T07:24:16.651458+0000 mon.smithi070 (mon.0) 865 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7694444 2024-05-06 20:13:04 2024-05-15 07:03:20 2024-05-15 07:27:41 0:24:21 0:11:36 0:12:45 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7694445 2024-05-06 20:13:05 2024-05-15 07:06:41 2024-05-15 07:48:03 0:41:22 0:32:30 0:08:52 smithi main ubuntu 22.04 orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7694446 2024-05-06 20:13:06 2024-05-15 07:06:41 2024-05-15 07:36:25 0:29:44 0:19:27 0:10:17 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7694447 2024-05-06 20:13:07 2024-05-15 07:06:42 2024-05-15 07:35:58 0:29:16 0:18:15 0:11:01 smithi main ubuntu 22.04 orch/cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} 2