Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7622356 2024-03-26 01:50:59 2024-03-26 01:52:15 2024-03-26 02:24:43 0:32:28 0:21:33 0:10:55 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-26T02:18:47.148265+0000 mon.smithi118 (mon.0) 780 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622357 2024-03-26 01:51:01 2024-03-26 01:52:15 2024-03-26 02:20:25 0:28:10 0:17:55 0:10:15 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-03-26T02:14:48.048351+0000 mon.a (mon.0) 380 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622358 2024-03-26 01:51:03 2024-03-26 01:53:16 2024-03-26 02:37:14 0:43:58 0:32:37 0:11:21 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711419753.0212104 mon.smithi063 (mon.0) 905 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622359 2024-03-26 01:51:04 2024-03-26 01:53:46 2024-03-26 02:41:17 0:47:31 0:34:44 0:12:47 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-26T02:22:21.808791+0000 mon.smithi136 (mon.0) 879 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622360 2024-03-26 01:51:05 2024-03-26 01:55:57 2024-03-26 02:41:25 0:45:28 0:35:09 0:10:19 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-03-26T02:17:06.454878+0000 mon.a (mon.0) 613 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622361 2024-03-26 01:51:07 2024-03-26 01:55:57 2024-03-26 02:19:49 0:23:52 0:13:38 0:10:14 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-26T02:15:53.475511+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7622362 2024-03-26 01:51:08 2024-03-26 01:56:08 2024-03-26 02:16:52 0:20:44 0:12:13 0:08:31 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
fail 7622363 2024-03-26 01:51:09 2024-03-26 01:56:08 2024-03-26 02:33:40 0:37:32 0:26:22 0:11:10 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-03-26T02:12:44.763911+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7622364 2024-03-26 01:51:11 2024-03-26 01:57:49 2024-03-26 02:21:17 0:23:28 0:13:38 0:09:50 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T02:18:31.291118+0000 mon.a (mon.0) 289 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

fail 7622365 2024-03-26 01:51:12 2024-03-26 01:57:59 2024-03-26 02:25:39 0:27:40 0:17:58 0:09:42 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-26T02:17:52.860672+0000 mon.smithi029 (mon.0) 742 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7622366 2024-03-26 01:51:13 2024-03-26 01:58:00 2024-03-26 02:19:08 0:21:08 0:11:23 0:09:45 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
fail 7622367 2024-03-26 01:51:15 2024-03-26 01:58:00 2024-03-26 02:27:32 0:29:32 0:12:15 0:17:17 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-26T02:24:04.465211+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622368 2024-03-26 01:51:16 2024-03-26 02:03:01 2024-03-26 03:02:14 0:59:13 0:48:26 0:10:47 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-26T02:31:54.373419+0000 mon.a (mon.0) 968 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622369 2024-03-26 01:51:17 2024-03-26 02:03:01 2024-03-26 02:49:47 0:46:46 0:36:35 0:10:11 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T02:24:33.640311+0000 mon.a (mon.0) 553 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7622370 2024-03-26 01:51:19 2024-03-26 02:03:02 2024-03-26 02:35:59 0:32:57 0:22:57 0:10:00 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

"2024-03-26T02:30:00.000194+0000 mon.a (mon.0) 1104 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log

fail 7622371 2024-03-26 01:51:20 2024-03-26 02:03:02 2024-03-26 02:27:53 0:24:51 0:15:11 0:09:40 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-26T02:23:44.949061+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7622372 2024-03-26 01:51:21 2024-03-26 02:03:02 2024-03-26 02:28:02 0:25:00 0:16:38 0:08:22 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7622373 2024-03-26 01:51:23 2024-03-26 02:03:03 2024-03-26 02:32:35 0:29:32 0:19:41 0:09:51 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-26T02:28:54.909915+0000 mon.smithi102 (mon.0) 775 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7622374 2024-03-26 01:51:24 2024-03-26 02:03:03 2024-03-26 02:35:50 0:32:47 0:22:21 0:10:26 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-26T02:31:06.239301+0000 mon.smithi055 (mon.0) 783 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622375 2024-03-26 01:51:25 2024-03-26 02:03:04 2024-03-26 02:38:44 0:35:40 0:26:08 0:09:32 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-26T02:25:19.334478+0000 mon.a (mon.0) 458 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622376 2024-03-26 01:51:27 2024-03-26 02:03:04 2024-03-26 02:38:48 0:35:44 0:25:17 0:10:27 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-26T02:26:57.882196+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622377 2024-03-26 01:51:28 2024-03-26 02:03:04 2024-03-26 03:24:56 1:21:52 1:06:34 0:15:18 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7622378 2024-03-26 01:51:29 2024-03-26 02:08:57 2024-03-26 02:37:11 0:28:14 0:15:07 0:13:07 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-26T02:30:15.733313+0000 mon.smithi053 (mon.0) 582 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622379 2024-03-26 01:51:31 2024-03-26 02:12:17 2024-03-26 02:54:16 0:41:59 0:25:04 0:16:55 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-26T02:45:29.777294+0000 mon.a (mon.0) 1024 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log

fail 7622380 2024-03-26 01:51:32 2024-03-26 02:18:29 2024-03-26 02:39:23 0:20:54 0:11:41 0:09:13 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T02:35:55.424235+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622381 2024-03-26 01:51:33 2024-03-26 02:18:29 2024-03-26 02:46:05 0:27:36 0:17:28 0:10:08 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-26T02:38:56.834942+0000 mon.smithi044 (mon.0) 303 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7622382 2024-03-26 01:51:35 2024-03-26 02:18:29 2024-03-26 03:32:24 1:13:55 1:04:15 0:09:40 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-26T02:54:32.881453+0000 mon.a (mon.0) 1156 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL)" in cluster log

fail 7622383 2024-03-26 01:51:36 2024-03-26 02:18:30 2024-03-26 03:08:03 0:49:33 0:39:10 0:10:23 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T02:47:24.336858+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7622384 2024-03-26 01:51:37 2024-03-26 02:18:30 2024-03-26 02:41:27 0:22:57 0:13:59 0:08:58 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
fail 7622385 2024-03-26 01:51:39 2024-03-26 02:18:30 2024-03-26 02:41:36 0:23:06 0:14:24 0:08:42 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-26T02:38:19.705736+0000 mon.smithi150 (mon.0) 781 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7622386 2024-03-26 01:51:40 2024-03-26 02:18:31 2024-03-26 02:48:13 0:29:42 0:20:03 0:09:39 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-26T02:43:48.615395+0000 mon.smithi080 (mon.0) 749 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622387 2024-03-26 01:51:42 2024-03-26 02:18:31 2024-03-26 03:03:43 0:45:12 0:34:51 0:10:21 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711421342.7324953 mon.smithi057 (mon.0) 903 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622388 2024-03-26 01:51:43 2024-03-26 02:18:31 2024-03-26 02:46:17 0:27:46 0:18:02 0:09:44 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-26T02:39:51.686531+0000 mon.smithi016 (mon.0) 807 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7622389 2024-03-26 01:51:44 2024-03-26 02:19:22 2024-03-26 02:58:02 0:38:40 0:24:53 0:13:47 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7622390 2024-03-26 01:51:46 2024-03-26 02:21:53 2024-03-26 03:15:42 0:53:49 0:43:43 0:10:06 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-03-26T02:41:08.515803+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622391 2024-03-26 01:51:47 2024-03-26 02:21:53 2024-03-26 02:53:09 0:31:16 0:16:03 0:15:13 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-03-26T02:47:14.970452+0000 mon.a (mon.0) 374 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622392 2024-03-26 01:51:48 2024-03-26 02:28:04 2024-03-26 02:59:46 0:31:42 0:15:55 0:15:47 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-26T02:55:15.415165+0000 mon.smithi001 (mon.0) 826 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7622393 2024-03-26 01:51:49 2024-03-26 02:33:55 2024-03-26 02:55:26 0:21:31 0:12:49 0:08:42 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7622394 2024-03-26 01:51:51 2024-03-26 02:33:56 2024-03-26 02:58:21 0:24:25 0:13:13 0:11:12 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7622395 2024-03-26 01:51:52 2024-03-26 02:33:56 2024-03-26 03:04:38 0:30:42 0:18:59 0:11:43 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T03:00:13.399789+0000 mon.a (mon.0) 290 : cluster [WRN] Replacing daemon mds.cephfs.smithi031.okjpbc as rank 0 with standby daemon mds.cephfs.smithi031.nifdkr" in cluster log

fail 7622396 2024-03-26 01:51:53 2024-03-26 02:33:56 2024-03-26 03:00:16 0:26:20 0:15:19 0:11:01 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-26T02:53:01.265885+0000 mon.a (mon.0) 588 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7622397 2024-03-26 01:51:55 2024-03-26 02:33:57 2024-03-26 03:04:33 0:30:36 0:19:25 0:11:11 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7622398 2024-03-26 01:51:56 2024-03-26 02:33:57 2024-03-26 03:40:59 1:07:02 0:54:41 0:12:21 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-26T03:04:14.387440+0000 mon.a (mon.0) 1051 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log

fail 7622399 2024-03-26 01:51:57 2024-03-26 02:33:58 2024-03-26 03:49:33 1:15:35 1:03:35 0:12:00 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T03:12:07.519796+0000 mon.a (mon.0) 1184 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7622400 2024-03-26 01:51:59 2024-03-26 02:33:58 2024-03-26 02:56:26 0:22:28 0:12:08 0:10:20 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7622401 2024-03-26 01:52:00 2024-03-26 02:33:58 2024-03-26 03:50:59 1:17:01 1:07:09 0:09:52 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7622402 2024-03-26 01:52:01 2024-03-26 02:33:59 2024-03-26 03:00:20 0:26:21 0:14:01 0:12:20 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

"2024-03-26T02:54:54.200253+0000 mon.smithi113 (mon.0) 571 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622403 2024-03-26 01:52:03 2024-03-26 02:33:59 2024-03-26 03:01:30 0:27:31 0:17:16 0:10:15 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e42b8ea316eec6c6f4fae026f6d6b62fa5fe7003 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7622404 2024-03-26 01:52:04 2024-03-26 02:33:59 2024-03-26 02:59:11 0:25:12 0:15:09 0:10:03 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-26T02:55:03.454796+0000 mon.smithi029 (mon.0) 781 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622405 2024-03-26 01:52:05 2024-03-26 02:34:00 2024-03-26 03:06:32 0:32:32 0:20:57 0:11:35 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-26T03:01:21.795463+0000 mon.smithi102 (mon.0) 809 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622406 2024-03-26 01:52:06 2024-03-26 02:34:00 2024-03-26 03:03:25 0:29:25 0:19:45 0:09:40 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-26T02:56:09.941629+0000 mon.smithi047 (mon.0) 676 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7622407 2024-03-26 01:52:08 2024-03-26 02:34:00 2024-03-26 03:15:47 0:41:47 0:30:39 0:11:08 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T03:05:43.526091+0000 mon.a (mon.0) 1555 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

pass 7622408 2024-03-26 01:52:09 2024-03-26 02:34:01 2024-03-26 03:10:21 0:36:20 0:23:29 0:12:51 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 7622409 2024-03-26 01:52:10 2024-03-26 02:34:01 2024-03-26 02:49:39 0:15:38 0:06:33 0:09:05 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7622410 2024-03-26 01:52:12 2024-03-26 02:34:01 2024-03-26 03:21:50 0:47:49 0:34:04 0:13:45 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711422356.7341175 mon.smithi006 (mon.0) 937 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622411 2024-03-26 01:52:13 2024-03-26 02:34:12 2024-03-26 03:06:45 0:32:33 0:14:33 0:18:00 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-03-26T03:04:16.895658+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7622412 2024-03-26 01:52:14 2024-03-26 02:41:48 2024-03-26 03:14:26 0:32:38 0:14:50 0:17:48 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
fail 7622413 2024-03-26 01:52:16 2024-03-26 02:49:20 2024-03-26 03:10:16 0:20:56 0:11:05 0:09:51 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T03:06:17.494462+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

pass 7622414 2024-03-26 01:52:17 2024-03-26 02:49:20 2024-03-26 03:16:00 0:26:40 0:14:31 0:12:09 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7622415 2024-03-26 01:52:18 2024-03-26 02:49:20 2024-03-26 03:14:06 0:24:46 0:13:01 0:11:45 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

"2024-03-26T03:10:04.433939+0000 mon.smithi016 (mon.0) 444 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622416 2024-03-26 01:52:19 2024-03-26 02:49:21 2024-03-26 03:13:40 0:24:19 0:12:12 0:12:07 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-26T03:08:39.604331+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622417 2024-03-26 01:52:21 2024-03-26 02:49:21 2024-03-26 03:50:16 1:00:55 0:51:06 0:09:49 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-03-26T03:05:28.007053+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622418 2024-03-26 01:52:22 2024-03-26 02:49:21 2024-03-26 03:14:11 0:24:50 0:15:17 0:09:33 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-26T03:07:12.365442+0000 mon.smithi003 (mon.0) 588 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622419 2024-03-26 01:52:23 2024-03-26 02:49:22 2024-03-26 03:18:28 0:29:06 0:18:57 0:10:09 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-26T03:09:03.586293+0000 mon.a (mon.0) 658 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622420 2024-03-26 01:52:25 2024-03-26 02:49:22 2024-03-26 03:17:18 0:27:56 0:18:36 0:09:20 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-03-26T03:15:43.327378+0000 mon.a (mon.0) 52 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622421 2024-03-26 01:52:26 2024-03-26 02:49:22 2024-03-26 03:21:46 0:32:24 0:21:55 0:10:29 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-26T03:16:37.500334+0000 mon.smithi046 (mon.0) 794 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622422 2024-03-26 01:52:27 2024-03-26 02:49:23 2024-03-26 03:15:16 0:25:53 0:13:53 0:12:00 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-26T03:11:07.081175+0000 mon.smithi073 (mon.0) 793 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7622423 2024-03-26 01:52:29 2024-03-26 02:49:23 2024-03-26 03:41:36 0:52:13 0:40:08 0:12:05 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7622424 2024-03-26 01:52:30 2024-03-26 02:49:23 2024-03-26 03:19:19 0:29:56 0:17:51 0:12:05 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-26T03:13:37.937447+0000 mon.smithi088 (mon.0) 794 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622425 2024-03-26 01:52:31 2024-03-26 02:49:24 2024-03-26 03:49:52 1:00:28 0:49:01 0:11:27 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-26T03:29:34.546566+0000 mon.a (mon.0) 1316 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7622426 2024-03-26 01:52:32 2024-03-26 02:49:24 2024-03-26 03:25:21 0:35:57 0:23:37 0:12:20 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys} 2
fail 7622427 2024-03-26 01:52:34 2024-03-26 02:49:35 2024-03-26 03:24:40 0:35:05 0:23:01 0:12:04 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-03-26T03:21:13.143447+0000 mon.a (mon.0) 639 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7622428 2024-03-26 01:52:35 2024-03-26 02:49:35 2024-03-26 03:13:06 0:23:31 0:13:09 0:10:22 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-26T03:10:12.699745+0000 mon.a (mon.0) 464 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7622429 2024-03-26 01:52:36 2024-03-26 02:49:35 2024-03-26 03:15:18 0:25:43 0:15:43 0:10:00 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T03:12:52.018644+0000 mon.a (mon.0) 277 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

fail 7622430 2024-03-26 01:52:38 2024-03-26 02:49:36 2024-03-26 03:23:17 0:33:41 0:22:53 0:10:48 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-26T03:16:52.024935+0000 mon.smithi080 (mon.0) 880 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7622431 2024-03-26 01:52:39 2024-03-26 02:49:36 2024-03-26 14:58:11 12:08:35 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

hit max job timeout

fail 7622432 2024-03-26 01:52:40 2024-03-26 02:49:46 2024-03-26 03:30:55 0:41:09 0:23:15 0:17:54 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-26T03:23:05.433132+0000 mon.smithi043 (mon.0) 820 : cluster [WRN] Replacing daemon mds.foofs.smithi118.vsrsbe as rank 0 with standby daemon mds.foofs.smithi043.oqleun" in cluster log

dead 7622433 2024-03-26 01:52:42 2024-03-26 02:56:28 2024-03-26 15:08:45 12:12:17 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

hit max job timeout

fail 7622434 2024-03-26 01:52:43 2024-03-26 02:58:08 2024-03-26 03:45:28 0:47:20 0:36:42 0:10:38 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711423825.5449877 mon.smithi067 (mon.0) 915 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622435 2024-03-26 01:52:45 2024-03-26 02:58:09 2024-03-26 03:29:38 0:31:29 0:15:48 0:15:41 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-26T03:24:21.003115+0000 mon.smithi119 (mon.0) 791 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622436 2024-03-26 01:52:46 2024-03-26 02:58:29 2024-03-26 03:25:45 0:27:16 0:11:35 0:15:41 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-26T03:22:40.746736+0000 mon.a (mon.0) 429 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622437 2024-03-26 01:52:47 2024-03-26 03:10:29 2024-03-26 04:02:03 0:51:34 0:38:01 0:13:33 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-26T03:46:24.067027+0000 mon.a (mon.0) 1012 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7622438 2024-03-26 01:52:49 2024-03-26 03:13:50 2024-03-26 03:49:53 0:36:03 0:26:21 0:09:42 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-26T03:35:26.332589+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622439 2024-03-26 01:52:50 2024-03-26 03:14:30 2024-03-26 04:32:39 1:18:09 1:06:58 0:11:11 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-26T03:49:54.631194+0000 mon.a (mon.0) 1286 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL)" in cluster log

fail 7622440 2024-03-26 01:52:51 2024-03-26 03:14:51 2024-03-26 04:26:36 1:11:45 1:01:06 0:10:39 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T03:50:00.000143+0000 mon.a (mon.0) 1382 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 5 pool(s) do not have an application enabled" in cluster log

pass 7622441 2024-03-26 01:52:52 2024-03-26 03:15:02 2024-03-26 03:45:40 0:30:38 0:18:51 0:11:47 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7622442 2024-03-26 01:52:54 2024-03-26 03:16:02 2024-03-26 03:41:17 0:25:15 0:14:56 0:10:19 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-26T03:35:57.879535+0000 mon.smithi045 (mon.0) 789 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7622443 2024-03-26 01:52:55 2024-03-26 03:16:23 2024-03-26 04:07:00 0:50:37 0:37:40 0:12:57 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-26T03:51:43.174294+0000 mon.a (mon.0) 833 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7622444 2024-03-26 01:52:56 2024-03-26 03:18:44 2024-03-26 03:47:09 0:28:25 0:18:15 0:10:10 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T03:43:19.175864+0000 mon.a (mon.0) 291 : cluster [WRN] Replacing daemon mds.cephfs.smithi037.blrdoq as rank 0 with standby daemon mds.cephfs.smithi037.abwhjt" in cluster log

pass 7622445 2024-03-26 01:52:58 2024-03-26 03:19:34 2024-03-26 03:50:34 0:31:00 0:20:16 0:10:44 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7622446 2024-03-26 01:52:59 2024-03-26 03:20:15 2024-03-26 03:50:50 0:30:35 0:20:03 0:10:32 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

"2024-03-26T03:45:10.096198+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7622447 2024-03-26 01:53:00 2024-03-26 03:20:15 2024-03-26 03:54:53 0:34:38 0:22:26 0:12:12 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-26T03:45:25.209989+0000 mon.smithi044 (mon.0) 564 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622448 2024-03-26 01:53:01 2024-03-26 03:20:15 2024-03-26 04:08:19 0:48:04 0:38:10 0:09:54 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7622449 2024-03-26 01:53:03 2024-03-26 03:20:16 2024-03-26 03:45:10 0:24:54 0:14:38 0:10:16 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-26T03:40:55.435988+0000 mon.smithi003 (mon.0) 767 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622450 2024-03-26 01:53:04 2024-03-26 03:20:16 2024-03-26 03:48:03 0:27:47 0:18:27 0:09:20 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-26T03:41:42.502440+0000 mon.smithi121 (mon.0) 802 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7622451 2024-03-26 01:53:05 2024-03-26 03:20:16 2024-03-26 04:47:23 1:27:07 1:16:45 0:10:22 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T04:02:29.491553+0000 mon.a (mon.0) 1430 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

fail 7622452 2024-03-26 01:53:06 2024-03-26 03:20:17 2024-03-26 03:52:55 0:32:38 0:23:10 0:09:28 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-03-26T03:50:00.000078+0000 mon.a (mon.0) 1374 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log

pass 7622453 2024-03-26 01:53:08 2024-03-26 03:20:17 2024-03-26 03:48:28 0:28:11 0:17:15 0:10:56 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3