Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7624076 2024-03-26 20:31:48 2024-03-26 20:32:07 2024-03-26 21:05:16 0:33:09 0:22:36 0:10:33 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-03-26T21:00:00.000184+0000 mon.a (mon.0) 1174 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log

fail 7624077 2024-03-26 20:31:49 2024-03-26 20:32:07 2024-03-26 20:58:05 0:25:58 0:16:00 0:09:58 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-03-26T20:52:16.917505+0000 mon.a (mon.0) 394 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624078 2024-03-26 20:31:50 2024-03-26 20:32:47 2024-03-26 21:18:29 0:45:42 0:36:00 0:09:42 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711486800.000299 mon.smithi026 (mon.0) 659 : cluster [ERR] fs cephfs is offline because no MDS is active for it." in cluster log

fail 7624079 2024-03-26 20:31:52 2024-03-26 20:33:58 2024-03-26 21:19:13 0:45:15 0:34:46 0:10:29 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-26T20:53:30.336493+0000 mon.smithi063 (mon.0) 503 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7624080 2024-03-26 20:31:53 2024-03-26 20:33:58 2024-03-26 21:31:38 0:57:40 0:48:31 0:09:09 smithi main ubuntu 22.04 orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
Failure Reason:

"2024-03-26T21:00:13.555405+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

fail 7624081 2024-03-26 20:31:54 2024-03-26 20:33:59 2024-03-26 20:56:37 0:22:38 0:13:20 0:09:18 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-26T20:53:25.605270+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7624082 2024-03-26 20:31:56 2024-03-26 20:34:09 2024-03-26 20:58:04 0:23:55 0:14:11 0:09:44 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} 2
fail 7624083 2024-03-26 20:31:57 2024-03-26 20:34:09 2024-03-26 21:16:45 0:42:36 0:30:35 0:12:01 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-03-26T20:54:57.939426+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7624084 2024-03-26 20:31:58 2024-03-26 20:35:30 2024-03-26 20:58:39 0:23:09 0:13:12 0:09:57 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T20:55:46.538892+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7624085 2024-03-26 20:32:00 2024-03-26 20:35:30 2024-03-27 08:43:57 12:08:27 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7624086 2024-03-26 20:32:01 2024-03-26 20:35:31 2024-03-26 21:03:28 0:27:57 0:18:10 0:09:47 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
fail 7624087 2024-03-26 20:32:02 2024-03-26 20:35:51 2024-03-26 20:57:10 0:21:19 0:11:21 0:09:58 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-26T20:53:48.687519+0000 mon.a (mon.0) 469 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624088 2024-03-26 20:32:04 2024-03-26 20:36:01 2024-03-26 21:48:07 1:12:06 0:58:02 0:14:04 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-26T21:03:24.089547+0000 mon.a (mon.0) 865 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624089 2024-03-26 20:32:05 2024-03-26 20:37:52 2024-03-26 21:35:22 0:57:30 0:47:31 0:09:59 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-26T20:55:56.782307+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7624090 2024-03-26 20:32:07 2024-03-26 20:37:53 2024-03-26 21:11:46 0:33:53 0:23:49 0:10:04 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T21:00:22.540078+0000 mon.a (mon.0) 661 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624091 2024-03-26 20:32:08 2024-03-26 20:38:43 2024-03-26 21:02:09 0:23:26 0:13:47 0:09:39 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-26T20:58:35.663940+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624092 2024-03-26 20:32:09 2024-03-26 20:39:03 2024-03-26 21:09:47 0:30:44 0:17:45 0:12:59 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-26T21:03:12.860147+0000 mon.smithi096 (mon.0) 786 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624093 2024-03-26 20:32:11 2024-03-26 20:40:14 2024-03-26 21:11:24 0:31:10 0:19:37 0:11:33 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-26T21:08:16.700989+0000 mon.smithi042 (mon.0) 770 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624094 2024-03-26 20:32:12 2024-03-26 20:41:25 2024-03-26 21:13:12 0:31:47 0:20:52 0:10:55 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-26T21:07:31.377870+0000 mon.smithi131 (mon.0) 825 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7624095 2024-03-26 20:32:14 2024-03-26 20:41:25 2024-03-26 21:18:27 0:37:02 0:25:59 0:11:03 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-26T21:04:19.886017+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624096 2024-03-26 20:32:15 2024-03-26 20:42:05 2024-03-26 21:25:30 0:43:25 0:32:17 0:11:08 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T21:07:28.348778+0000 mon.a (mon.0) 830 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624097 2024-03-26 20:32:16 2024-03-26 20:42:26 2024-03-26 21:56:28 1:14:02 1:00:30 0:13:32 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T21:20:00.000154+0000 mon.a (mon.0) 1372 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 5 pool(s) do not have an application enabled" in cluster log

fail 7624098 2024-03-26 20:32:18 2024-03-26 20:44:06 2024-03-26 21:21:35 0:37:29 0:25:22 0:12:07 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-26T21:09:31.906419+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624099 2024-03-26 20:32:19 2024-03-26 20:45:07 2024-03-26 22:04:20 1:19:13 1:08:45 0:10:28 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7624100 2024-03-26 20:32:21 2024-03-26 20:45:07 2024-03-26 21:10:55 0:25:48 0:15:31 0:10:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-26T21:06:49.893541+0000 mon.smithi018 (mon.0) 799 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7624101 2024-03-26 20:32:22 2024-03-26 20:45:38 2024-03-26 21:27:20 0:41:42 0:28:59 0:12:43 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-26T21:15:20.119332+0000 mon.a (mon.0) 592 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624102 2024-03-26 20:32:23 2024-03-26 20:48:19 2024-03-26 21:09:36 0:21:17 0:11:08 0:10:09 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T21:05:39.098772+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

fail 7624103 2024-03-26 20:32:25 2024-03-26 20:48:19 2024-03-26 21:14:29 0:26:10 0:14:20 0:11:50 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-26T21:10:10.517137+0000 mon.smithi183 (mon.0) 785 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7624104 2024-03-26 20:32:26 2024-03-26 20:49:29 2024-03-26 21:23:03 0:33:34 0:22:08 0:11:26 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7624105 2024-03-26 20:32:27 2024-03-26 20:49:40 2024-03-26 21:19:51 0:30:11 0:15:45 0:14:26 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-03-26T21:14:45.500780+0000 mon.a (mon.0) 209 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7624106 2024-03-26 20:32:29 2024-03-26 20:51:10 2024-03-26 21:16:39 0:25:29 0:14:43 0:10:46 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-26T21:12:34.337317+0000 mon.smithi089 (mon.0) 784 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624107 2024-03-26 20:32:30 2024-03-26 20:51:31 2024-03-26 21:24:17 0:32:46 0:21:57 0:10:49 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-26T21:20:03.108250+0000 mon.smithi029 (mon.0) 785 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624108 2024-03-26 20:32:31 2024-03-26 20:51:31 2024-03-26 21:52:05 1:00:34 0:50:18 0:10:16 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-26T21:26:47.611422+0000 mon.a (mon.0) 947 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

fail 7624109 2024-03-26 20:32:33 2024-03-26 20:52:22 2024-03-26 21:43:33 0:51:11 0:38:48 0:12:23 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711488570.7345958 mon.smithi103 (mon.0) 955 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624110 2024-03-26 20:32:34 2024-03-26 20:52:22 2024-03-26 21:19:51 0:27:29 0:17:46 0:09:43 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-26T21:13:28.574793+0000 mon.smithi102 (mon.0) 800 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624111 2024-03-26 20:32:35 2024-03-26 20:52:42 2024-03-26 21:15:39 0:22:57 0:11:54 0:11:03 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-26T21:09:15.194789+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7624112 2024-03-26 20:32:37 2024-03-26 20:52:43 2024-03-26 21:45:56 0:53:13 0:41:08 0:12:05 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-03-26T21:14:00.254269+0000 mon.a (mon.0) 432 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624113 2024-03-26 20:32:38 2024-03-26 20:53:33 2024-03-26 21:30:38 0:37:05 0:26:50 0:10:15 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T21:18:23.650191+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624114 2024-03-26 20:32:39 2024-03-26 20:53:34 2024-03-26 21:22:41 0:29:07 0:16:06 0:13:01 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-03-26T21:16:15.230225+0000 mon.a (mon.0) 266 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7624115 2024-03-26 20:32:41 2024-03-26 20:53:44 2024-03-26 21:23:02 0:29:18 0:18:14 0:11:04 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-26T21:17:15.213512+0000 mon.smithi045 (mon.0) 797 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7624116 2024-03-26 20:32:42 2024-03-26 20:54:05 2024-03-26 21:16:33 0:22:28 0:12:35 0:09:53 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7624117 2024-03-26 20:32:43 2024-03-26 20:55:05 2024-03-26 21:21:36 0:26:31 0:13:32 0:12:59 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7624118 2024-03-26 20:32:45 2024-03-26 20:55:05 2024-03-26 21:26:04 0:30:59 0:19:04 0:11:55 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T21:21:06.091537+0000 mon.a (mon.0) 289 : cluster [WRN] Health check failed: Degraded data redundancy: 7/21 objects degraded (33.333%), 3 pgs degraded (PG_DEGRADED)" in cluster log

fail 7624119 2024-03-26 20:32:46 2024-03-26 20:56:16 2024-03-26 21:21:34 0:25:18 0:15:50 0:09:28 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-26T21:14:00.881095+0000 mon.a (mon.0) 414 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7624120 2024-03-26 20:32:48 2024-03-26 20:56:16 2024-03-26 21:27:36 0:31:20 0:19:05 0:12:15 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7624121 2024-03-26 20:32:49 2024-03-26 20:56:37 2024-03-26 22:01:08 1:04:31 0:54:22 0:10:09 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-26T21:33:27.738501+0000 mon.a (mon.0) 928 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624122 2024-03-26 20:32:50 2024-03-26 20:56:37 2024-03-26 22:01:37 1:05:00 0:53:01 0:11:59 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T21:30:00.000178+0000 mon.a (mon.0) 2476 : cluster [WRN] Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled" in cluster log

pass 7624123 2024-03-26 20:32:52 2024-03-26 20:58:08 2024-03-26 21:20:08 0:22:00 0:11:47 0:10:13 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7624124 2024-03-26 20:32:53 2024-03-26 20:58:38 2024-03-26 21:31:37 0:32:59 0:23:05 0:09:54 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7624125 2024-03-26 20:32:54 2024-03-26 20:58:38 2024-03-26 21:21:42 0:23:04 0:13:47 0:09:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7624126 2024-03-26 20:32:56 2024-03-26 20:58:39 2024-03-26 21:40:19 0:41:40 0:32:31 0:09:09 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

"2024-03-26T21:19:41.761510+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7624127 2024-03-26 20:32:57 2024-03-26 20:58:39 2024-03-26 21:28:10 0:29:31 0:17:27 0:12:04 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=42fc52b86b14d4f88c40d75eb7102e0ab3918f55 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7624128 2024-03-26 20:32:58 2024-03-26 21:00:40 2024-03-26 21:29:29 0:28:49 0:14:32 0:14:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-26T21:26:45.936072+0000 mon.smithi145 (mon.0) 784 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624129 2024-03-26 20:33:00 2024-03-26 21:04:21 2024-03-26 22:23:16 1:18:55 1:09:03 0:09:52 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T21:30:30.725236+0000 mon.a (mon.0) 835 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624130 2024-03-26 20:33:01 2024-03-26 21:04:21 2024-03-26 21:36:39 0:32:18 0:21:49 0:10:29 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-26T21:30:43.564924+0000 mon.smithi022 (mon.0) 783 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624131 2024-03-26 20:33:02 2024-03-26 21:05:12 2024-03-26 21:36:54 0:31:42 0:21:54 0:09:48 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-26T21:31:17.563267+0000 mon.smithi136 (mon.0) 768 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624132 2024-03-26 20:33:04 2024-03-26 21:05:12 2024-03-26 21:42:23 0:37:11 0:25:35 0:11:36 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T21:30:05.309045+0000 mon.a (mon.0) 661 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7624133 2024-03-26 20:33:05 2024-03-26 21:05:12 2024-03-26 21:21:53 0:16:41 0:06:37 0:10:04 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7624134 2024-03-26 20:33:06 2024-03-26 21:05:13 2024-03-26 21:46:21 0:41:08 0:32:34 0:08:34 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711488762.4052248 mon.smithi012 (mon.0) 935 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624135 2024-03-26 20:33:08 2024-03-26 21:05:13 2024-03-26 21:28:02 0:22:49 0:14:07 0:08:42 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-03-26T21:26:27.001637+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7624136 2024-03-26 20:33:09 2024-03-26 21:05:14 2024-03-26 21:30:54 0:25:40 0:16:11 0:09:29 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
fail 7624137 2024-03-26 20:33:10 2024-03-26 21:05:14 2024-03-26 21:26:19 0:21:05 0:11:28 0:09:37 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T21:23:09.178042+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

pass 7624138 2024-03-26 20:33:11 2024-03-26 21:05:14 2024-03-26 21:32:15 0:27:01 0:16:57 0:10:04 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7624139 2024-03-26 20:33:13 2024-03-26 21:05:15 2024-03-26 21:31:11 0:25:56 0:13:12 0:12:44 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

"2024-03-26T21:25:21.895727+0000 mon.smithi184 (mon.0) 242 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624140 2024-03-26 20:33:14 2024-03-26 21:08:05 2024-03-26 21:40:13 0:32:08 0:18:34 0:13:34 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-26T21:29:14.824657+0000 mon.a (mon.0) 393 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624141 2024-03-26 20:33:15 2024-03-26 21:10:36 2024-03-26 22:13:33 1:02:57 0:53:10 0:09:47 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-03-26T21:26:13.266415+0000 mon.a (mon.0) 195 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7624142 2024-03-26 20:33:17 2024-03-26 21:10:36 2024-03-26 21:47:33 0:36:57 0:15:35 0:21:22 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-26T21:39:51.144356+0000 mon.smithi031 (mon.0) 572 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624143 2024-03-26 20:33:18 2024-03-26 21:20:18 2024-03-26 21:45:30 0:25:12 0:15:21 0:09:51 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-26T21:40:12.226846+0000 mon.a (mon.0) 664 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624144 2024-03-26 20:33:20 2024-03-26 21:20:38 2024-03-26 22:03:59 0:43:21 0:32:27 0:10:54 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-26T21:44:29.334225+0000 mon.a (mon.0) 645 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7624145 2024-03-26 20:33:21 2024-03-26 21:20:39 2024-03-26 22:25:29 1:04:50 0:53:02 0:11:48 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T21:48:27.232463+0000 mon.a (mon.0) 960 : cluster [WRN] Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624146 2024-03-26 20:33:22 2024-03-26 21:20:39 2024-03-26 21:45:45 0:25:06 0:14:03 0:11:03 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-03-26T21:40:42.930071+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624147 2024-03-26 20:33:24 2024-03-26 21:20:50 2024-03-26 21:54:02 0:33:12 0:22:13 0:10:59 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-26T21:49:04.680646+0000 mon.smithi053 (mon.0) 804 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624148 2024-03-26 20:33:25 2024-03-26 21:20:50 2024-03-26 21:47:12 0:26:22 0:14:17 0:12:05 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-26T21:43:57.795378+0000 mon.smithi111 (mon.0) 798 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624149 2024-03-26 20:33:26 2024-03-26 21:20:51 2024-03-26 22:11:20 0:50:29 0:40:02 0:10:27 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7624150 2024-03-26 20:33:28 2024-03-26 21:20:51 2024-03-26 21:45:28 0:24:37 0:15:29 0:09:08 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-26T21:40:31.128482+0000 mon.smithi007 (mon.0) 794 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624151 2024-03-26 20:33:29 2024-03-26 21:20:51 2024-03-26 22:05:15 0:44:24 0:32:58 0:11:26 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-03-26T21:43:50.572555+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7624152 2024-03-26 20:33:30 2024-03-26 21:20:52 2024-03-26 21:55:25 0:34:33 0:23:33 0:11:00 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-03-26T21:52:23.851939+0000 mon.a (mon.0) 641 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624153 2024-03-26 20:33:31 2024-03-26 21:20:52 2024-03-26 21:47:38 0:26:46 0:17:20 0:09:26 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-26T21:44:29.421261+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624154 2024-03-26 20:33:33 2024-03-26 21:20:52 2024-03-26 21:45:08 0:24:16 0:13:22 0:10:54 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-26T21:42:38.782478+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624155 2024-03-26 20:33:34 2024-03-26 21:20:53 2024-03-26 21:48:58 0:28:05 0:17:28 0:10:37 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-26T21:43:36.041210+0000 mon.smithi089 (mon.0) 835 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7624156 2024-03-26 20:33:35 2024-03-26 21:20:53 2024-03-26 22:19:07 0:58:14 0:48:38 0:09:36 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-26T21:55:05.805962+0000 mon.a (mon.0) 918 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624157 2024-03-26 20:33:37 2024-03-26 21:20:53 2024-03-26 21:57:20 0:36:27 0:26:10 0:10:17 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T21:46:43.154891+0000 mon.a (mon.0) 667 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624158 2024-03-26 20:33:38 2024-03-26 21:20:54 2024-03-26 21:45:19 0:24:25 0:13:53 0:10:32 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-26T21:39:44.645346+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624159 2024-03-26 20:33:39 2024-03-26 21:20:54 2024-03-26 21:57:25 0:36:31 0:25:10 0:11:21 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-26T21:49:10.654887+0000 mon.smithi112 (mon.0) 774 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624160 2024-03-26 20:33:41 2024-03-26 21:20:55 2024-03-26 21:47:32 0:26:37 0:14:12 0:12:25 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-26T21:43:34.380760+0000 mon.smithi131 (mon.0) 799 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624161 2024-03-26 20:33:42 2024-03-26 21:20:55 2024-03-26 22:05:16 0:44:21 0:32:40 0:11:41 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711489825.3655252 mon.smithi148 (mon.0) 913 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7624162 2024-03-26 20:33:43 2024-03-26 21:20:55 2024-03-26 21:49:18 0:28:23 0:15:32 0:12:51 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-26T21:41:57.797436+0000 mon.smithi049 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624163 2024-03-26 20:33:45 2024-03-26 21:20:56 2024-03-26 21:42:36 0:21:40 0:11:57 0:09:43 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-26T21:40:07.266504+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624164 2024-03-26 20:33:46 2024-03-26 21:20:56 2024-03-26 22:10:19 0:49:23 0:37:49 0:11:34 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-26T21:43:34.697192+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7624165 2024-03-26 20:33:47 2024-03-26 21:21:46 2024-03-26 21:59:16 0:37:30 0:25:34 0:11:56 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-26T21:46:46.106281+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624166 2024-03-26 20:33:49 2024-03-26 21:23:07 2024-03-26 22:15:59 0:52:52 0:35:18 0:17:34 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-26T21:54:33.074133+0000 mon.a (mon.0) 833 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624167 2024-03-26 20:33:50 2024-03-26 21:27:38 2024-03-26 22:34:04 1:06:26 0:53:00 0:13:26 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-26T21:56:44.324087+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624168 2024-03-26 20:33:51 2024-03-26 21:30:59 2024-03-26 22:08:37 0:37:38 0:20:33 0:17:05 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-26T21:58:10.528752+0000 mon.a (mon.0) 209 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7624169 2024-03-26 20:33:53 2024-03-26 21:36:10 2024-03-26 22:02:12 0:26:02 0:15:21 0:10:41 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-26T21:57:51.164031+0000 mon.smithi098 (mon.0) 785 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7624170 2024-03-26 20:33:54 2024-03-26 21:36:10 2024-03-26 22:25:20 0:49:10 0:37:38 0:11:32 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-26T22:02:00.555410+0000 mon.a (mon.0) 244 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log

fail 7624171 2024-03-26 20:33:55 2024-03-26 21:36:11 2024-03-26 22:07:22 0:31:11 0:18:28 0:12:43 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-26T22:02:14.228107+0000 mon.a (mon.0) 247 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624172 2024-03-26 20:33:57 2024-03-26 21:36:11 2024-03-26 22:08:53 0:32:42 0:22:14 0:10:28 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-26T22:01:26.885679+0000 mon.smithi121 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624173 2024-03-26 20:33:58 2024-03-26 22:19:45 2043 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

"2024-03-26T21:58:47.110603+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7624174 2024-03-26 20:33:59 2024-03-26 21:36:12 2024-03-26 22:06:32 0:30:20 0:20:16 0:10:04 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

"2024-03-26T22:00:47.484333+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7624175 2024-03-26 20:34:01 2024-03-26 21:36:12 2024-03-26 22:09:08 0:32:56 0:21:40 0:11:16 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-26T22:03:47.403535+0000 mon.smithi082 (mon.0) 765 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7624176 2024-03-26 20:34:02 2024-03-26 21:36:13 2024-03-26 22:12:35 0:36:22 0:24:41 0:11:41 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi196 with status 5: 'sudo systemctl stop ceph-2f9b9224-ebbb-11ee-95d0-87774f69a715@mon.smithi196'

fail 7624177 2024-03-26 20:34:03 2024-03-26 21:36:13 2024-03-26 22:00:37 0:24:24 0:14:16 0:10:08 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-26T21:57:33.078598+0000 mon.smithi045 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624178 2024-03-26 20:34:05 2024-03-26 21:36:13 2024-03-26 22:46:43 1:10:30 0:59:24 0:11:06 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-26T22:02:14.249622+0000 mon.a (mon.0) 882 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7624179 2024-03-26 20:34:06 2024-03-26 21:36:14 2024-03-26 22:05:21 0:29:07 0:18:31 0:10:36 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-26T21:57:21.024273+0000 mon.smithi029 (mon.0) 807 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7624180 2024-03-26 20:34:07 2024-03-26 21:36:14 2024-03-26 22:12:06 0:35:52 0:24:58 0:10:54 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-26T22:00:00.942201+0000 mon.a (mon.0) 580 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7624181 2024-03-26 20:34:09 2024-03-26 21:36:14 2024-03-26 22:04:32 0:28:18 0:17:27 0:10:51 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7624182 2024-03-26 20:34:10 2024-03-26 22:07:42 1304 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2