Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7613410 2024-03-20 19:16:54 2024-03-20 19:18:05 2024-03-20 19:50:57 0:32:52 0:22:51 0:10:01 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7613411 2024-03-20 19:16:55 2024-03-20 19:18:06 2024-03-20 19:45:21 0:27:15 0:16:06 0:11:09 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-03-20T19:39:41.259995+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613412 2024-03-20 19:16:57 2024-03-20 19:18:06 2024-03-20 20:00:59 0:42:53 0:32:55 0:09:58 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710963960.5126908 mon.smithi114 (mon.0) 914 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613413 2024-03-20 19:16:58 2024-03-20 19:18:06 2024-03-20 20:03:51 0:45:45 0:34:41 0:11:04 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-20T19:38:04.849120+0000 mon.smithi086 (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7613414 2024-03-20 19:17:00 2024-03-20 19:18:07 2024-03-20 20:02:45 0:44:38 0:35:42 0:08:56 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-03-20T19:36:53.105480+0000 mon.a (mon.0) 270 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613415 2024-03-20 19:17:01 2024-03-20 19:18:07 2024-03-20 19:42:32 0:24:25 0:13:52 0:10:33 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-20T19:39:55.596274+0000 mon.a (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7613416 2024-03-20 19:17:03 2024-03-20 19:18:07 2024-03-20 19:41:22 0:23:15 0:12:58 0:10:17 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} 2
pass 7613417 2024-03-20 19:17:04 2024-03-20 19:18:08 2024-03-20 19:58:53 0:40:45 0:28:23 0:12:22 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
fail 7613418 2024-03-20 19:17:06 2024-03-20 19:19:48 2024-03-20 19:48:32 0:28:44 0:16:38 0:12:06 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-20T19:41:43.085226+0000 mon.smithi097 (mon.0) 826 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

pass 7613419 2024-03-20 19:17:07 2024-03-20 19:21:19 2024-03-20 19:51:41 0:30:22 0:18:44 0:11:38 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
fail 7613420 2024-03-20 19:17:08 2024-03-20 19:23:30 2024-03-20 19:45:13 0:21:43 0:11:22 0:10:21 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-20T19:42:26.927952+0000 mon.a (mon.0) 446 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613421 2024-03-20 19:17:10 2024-03-20 19:24:10 2024-03-20 20:29:18 1:05:08 0:54:08 0:11:00 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-20T19:49:09.845857+0000 mon.a (mon.0) 824 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7613422 2024-03-20 19:17:11 2024-03-20 19:24:11 2024-03-20 20:23:11 0:59:00 0:47:42 0:11:18 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-20T19:44:22.796730+0000 mon.a (mon.0) 473 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7613423 2024-03-20 19:17:12 2024-03-20 19:25:51 2024-03-20 20:04:14 0:38:23 0:25:58 0:12:25 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-20T19:52:36.503230+0000 mon.a (mon.0) 647 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613424 2024-03-20 19:17:14 2024-03-20 19:26:32 2024-03-20 19:49:21 0:22:49 0:13:18 0:09:31 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-20T19:45:32.413303+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7613425 2024-03-20 19:17:15 2024-03-20 19:26:32 2024-03-20 19:59:37 0:33:05 0:19:43 0:13:22 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
fail 7613426 2024-03-20 19:17:17 2024-03-20 19:28:43 2024-03-20 19:58:47 0:30:04 0:19:37 0:10:27 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-20T19:55:35.236118+0000 mon.smithi107 (mon.0) 756 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613427 2024-03-20 19:17:18 2024-03-20 19:28:43 2024-03-20 20:02:43 0:34:00 0:20:32 0:13:28 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-20T19:56:32.396221+0000 mon.smithi045 (mon.0) 746 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613428 2024-03-20 19:17:19 2024-03-20 19:30:54 2024-03-20 20:06:34 0:35:40 0:25:56 0:09:44 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-20T19:52:01.598098+0000 mon.a (mon.0) 366 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613429 2024-03-20 19:17:21 2024-03-20 19:30:54 2024-03-20 20:15:42 0:44:48 0:33:08 0:11:40 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-20T19:59:31.598300+0000 mon.a (mon.0) 809 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613430 2024-03-20 19:17:22 2024-03-20 19:32:55 2024-03-20 20:44:59 1:12:04 1:02:05 0:09:59 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-20T19:56:00.822081+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613431 2024-03-20 19:17:23 2024-03-20 19:32:55 2024-03-20 20:10:27 0:37:32 0:25:59 0:11:33 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-20T19:57:45.398206+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613432 2024-03-20 19:17:25 2024-03-20 19:32:55 2024-03-20 20:56:25 1:23:30 1:12:27 0:11:03 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7613433 2024-03-20 19:17:26 2024-03-20 19:32:56 2024-03-20 19:55:56 0:23:00 0:14:04 0:08:56 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-20T19:52:44.317110+0000 mon.smithi089 (mon.0) 776 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7613434 2024-03-20 19:17:27 2024-03-20 19:32:56 2024-03-20 20:11:03 0:38:07 0:26:57 0:11:10 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-20T20:05:42.988990+0000 mon.a (mon.0) 1158 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

fail 7613435 2024-03-20 19:17:29 2024-03-20 19:32:56 2024-03-20 19:58:07 0:25:11 0:14:42 0:10:29 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-20T19:53:57.135174+0000 mon.smithi029 (mon.0) 773 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613436 2024-03-20 19:17:30 2024-03-20 19:32:57 2024-03-20 20:08:09 0:35:12 0:24:23 0:10:49 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
Failure Reason:

"2024-03-20T20:00:00.000157+0000 mon.a (mon.0) 888 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log

fail 7613437 2024-03-20 19:17:31 2024-03-20 19:32:57 2024-03-20 19:58:59 0:26:02 0:16:13 0:09:49 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-03-20T19:55:12.712103+0000 mon.a (mon.0) 188 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7613438 2024-03-20 19:17:33 2024-03-20 19:33:08 2024-03-20 20:00:34 0:27:26 0:14:43 0:12:43 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-20T19:54:00.031582+0000 mon.smithi161 (mon.0) 704 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7613439 2024-03-20 19:17:34 2024-03-20 19:33:18 2024-03-20 20:06:04 0:32:46 0:20:14 0:12:32 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-20T20:02:25.412887+0000 mon.smithi001 (mon.0) 751 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613440 2024-03-20 19:17:35 2024-03-20 19:35:09 2024-03-20 20:41:35 1:06:26 0:49:10 0:17:16 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-20T20:03:17.357187+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613441 2024-03-20 19:17:37 2024-03-20 19:41:30 2024-03-20 20:23:30 0:42:00 0:31:19 0:10:41 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710965407.1483743 mon.smithi028 (mon.0) 888 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7613442 2024-03-20 19:17:38 2024-03-20 19:42:20 2024-03-20 20:10:30 0:28:10 0:17:38 0:10:32 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
dead 7613443 2024-03-20 19:17:39 2024-03-20 19:43:21 2024-03-21 07:53:58 12:10:37 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

hit max job timeout

fail 7613444 2024-03-20 19:17:41 2024-03-20 19:44:21 2024-03-20 20:38:42 0:54:21 0:42:40 0:11:41 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-03-20T20:06:34.402470+0000 mon.a (mon.0) 507 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613445 2024-03-20 19:17:42 2024-03-20 19:44:22 2024-03-20 20:21:43 0:37:21 0:23:54 0:13:27 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-20T20:07:20.387443+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613446 2024-03-20 19:17:43 2024-03-20 19:46:43 2024-03-20 20:14:05 0:27:22 0:15:52 0:11:30 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-03-20T20:06:46.815434+0000 mon.a (mon.0) 245 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7613447 2024-03-20 19:17:45 2024-03-20 19:46:43 2024-03-20 20:15:04 0:28:21 0:15:35 0:12:46 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-20T20:09:23.608133+0000 mon.smithi023 (mon.0) 777 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7613448 2024-03-20 19:17:46 2024-03-20 19:46:53 2024-03-20 20:08:45 0:21:52 0:12:33 0:09:19 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
fail 7613449 2024-03-20 19:17:47 2024-03-20 19:46:54 2024-03-20 20:11:10 0:24:16 0:13:20 0:10:56 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-03-20T20:08:14.064447+0000 mon.smithi033 (mon.0) 783 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613450 2024-03-20 19:17:49 2024-03-20 19:48:24 2024-03-20 20:15:39 0:27:15 0:16:09 0:11:06 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-20T20:06:27.821457+0000 mon.a (mon.0) 419 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7613451 2024-03-20 19:17:50 2024-03-20 19:48:24 2024-03-20 20:16:03 0:27:39 0:18:56 0:08:43 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7613452 2024-03-20 19:17:51 2024-03-20 19:48:25 2024-03-20 21:03:54 1:15:29 1:05:41 0:09:48 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-20T20:10:08.133337+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613453 2024-03-20 19:17:52 2024-03-20 19:48:25 2024-03-20 20:51:48 1:03:23 0:51:58 0:11:25 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-20T20:14:37.286053+0000 mon.a (mon.0) 943 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7613454 2024-03-20 19:17:54 2024-03-20 19:48:36 2024-03-20 20:15:30 0:26:54 0:12:14 0:14:40 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7613455 2024-03-20 19:17:55 2024-03-20 19:48:36 2024-03-20 20:53:30 1:04:54 0:56:38 0:08:16 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7613456 2024-03-20 19:17:56 2024-03-20 19:48:36 2024-03-20 20:14:13 0:25:37 0:13:40 0:11:57 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7613457 2024-03-20 19:17:58 2024-03-20 19:51:07 2024-03-20 20:38:45 0:47:38 0:32:44 0:14:54 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

"2024-03-20T20:17:34.173801+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613458 2024-03-20 19:17:59 2024-03-20 19:53:28 2024-03-20 20:21:09 0:27:41 0:17:30 0:10:11 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4181a8dbc90192a00ad0f45f1edafe51d2b53f07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7613459 2024-03-20 19:18:00 2024-03-20 19:53:28 2024-03-20 20:19:42 0:26:14 0:14:22 0:11:52 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-20T20:16:44.748756+0000 mon.smithi017 (mon.0) 767 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613460 2024-03-20 19:18:01 2024-03-20 19:56:39 2024-03-20 21:07:37 1:10:58 1:00:58 0:10:00 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-20T20:20:30.803334+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7613461 2024-03-20 19:18:03 2024-03-20 19:56:39 2024-03-20 20:30:46 0:34:07 0:21:29 0:12:38 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-20T20:25:26.747269+0000 mon.smithi046 (mon.0) 803 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613462 2024-03-20 19:18:04 2024-03-20 19:59:00 2024-03-20 20:29:05 0:30:05 0:20:04 0:10:01 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-20T20:25:15.406051+0000 mon.smithi037 (mon.0) 757 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613463 2024-03-20 19:18:05 2024-03-20 20:34:30 1408 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
Failure Reason:

"2024-03-20T20:22:45.629764+0000 mon.a (mon.0) 639 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7613464 2024-03-20 19:18:07 2024-03-20 20:01:31 2024-03-20 20:16:23 0:14:52 0:06:20 0:08:32 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7613465 2024-03-20 19:18:08 2024-03-20 20:01:31 2024-03-20 20:46:39 0:45:08 0:31:23 0:13:45 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710966688.846076 mon.smithi039 (mon.0) 896 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613466 2024-03-20 19:18:09 2024-03-20 20:02:32 2024-03-20 20:27:49 0:25:17 0:14:03 0:11:14 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-03-20T20:25:13.009058+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7613467 2024-03-20 19:18:11 2024-03-20 20:02:32 2024-03-20 20:28:37 0:26:05 0:14:45 0:11:20 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7613468 2024-03-20 19:18:12 2024-03-20 20:03:53 2024-03-20 20:26:39 0:22:46 0:14:05 0:08:41 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7613469 2024-03-20 19:18:13 2024-03-20 20:03:53 2024-03-20 20:33:33 0:29:40 0:19:29 0:10:11 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
Failure Reason:

"2024-03-20T20:29:16.134156+0000 mon.smithi173 (mon.0) 488 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613470 2024-03-20 19:18:15 2024-03-20 20:03:53 2024-03-20 20:25:04 0:21:11 0:12:03 0:09:08 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-20T20:20:29.186409+0000 mon.a (mon.0) 384 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613471 2024-03-20 19:18:16 2024-03-20 20:03:54 2024-03-20 20:57:44 0:53:50 0:43:01 0:10:49 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi069 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9231578-e6f6-11ee-95c9-87774f69a715 -e sha1=4181a8dbc90192a00ad0f45f1edafe51d2b53f07 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

fail 7613472 2024-03-20 19:18:17 2024-03-20 20:03:54 2024-03-20 20:28:50 0:24:56 0:15:29 0:09:27 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-20T20:24:04.411342+0000 mon.smithi007 (mon.0) 779 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613473 2024-03-20 19:18:19 2024-03-20 20:03:54 2024-03-20 20:28:40 0:24:46 0:14:59 0:09:47 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-20T20:24:21.219157+0000 mon.a (mon.0) 657 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613474 2024-03-20 19:18:20 2024-03-20 20:03:55 2024-03-20 20:44:54 0:40:59 0:30:34 0:10:25 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-20T20:27:24.698651+0000 mon.a (mon.0) 829 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7613475 2024-03-20 19:18:21 2024-03-20 20:03:55 2024-03-20 21:08:11 1:04:16 0:52:54 0:11:22 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-20T20:31:05.764088+0000 mon.a (mon.0) 1041 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613476 2024-03-20 19:18:22 2024-03-20 20:03:56 2024-03-20 20:26:37 0:22:41 0:13:44 0:08:57 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-03-20T20:22:13.334010+0000 mon.a (mon.0) 284 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613477 2024-03-20 19:18:24 2024-03-20 20:03:56 2024-03-20 20:36:03 0:32:07 0:21:36 0:10:31 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-20T20:30:26.126286+0000 mon.smithi045 (mon.0) 863 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7613478 2024-03-20 19:18:25 2024-03-20 20:04:06 2024-03-21 08:12:45 12:08:39 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

hit max job timeout

fail 7613479 2024-03-20 19:18:26 2024-03-20 20:04:07 2024-03-20 20:53:36 0:49:29 0:37:58 0:11:31 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7613480 2024-03-20 19:18:28 2024-03-20 20:04:07 2024-03-20 20:29:48 0:25:41 0:15:59 0:09:42 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-20T20:25:37.660937+0000 mon.smithi099 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613481 2024-03-20 19:18:29 2024-03-20 20:04:07 2024-03-20 20:48:29 0:44:22 0:33:08 0:11:14 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-03-20T20:26:25.638779+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613482 2024-03-20 19:18:30 2024-03-20 20:04:08 2024-03-20 20:36:48 0:32:40 0:22:45 0:09:55 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-03-20T20:27:15.124460+0000 mon.a (mon.0) 193 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7613483 2024-03-20 19:18:32 2024-03-20 20:05:08 2024-03-20 20:28:14 0:23:06 0:13:10 0:09:56 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-20T20:25:45.494322+0000 mon.a (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613484 2024-03-20 19:18:33 2024-03-20 20:05:09 2024-03-20 20:33:19 0:28:10 0:17:18 0:10:52 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-20T20:24:44.939852+0000 mon.smithi040 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613485 2024-03-20 19:18:34 2024-03-20 20:06:19 2024-03-20 21:04:13 0:57:54 0:48:08 0:09:46 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-20T20:27:58.009259+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7613486 2024-03-20 19:18:35 2024-03-20 20:06:20 2024-03-20 20:47:40 0:41:20 0:27:05 0:14:15 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-20T20:35:52.888177+0000 mon.a (mon.0) 651 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613487 2024-03-20 19:18:37 2024-03-20 20:10:31 2024-03-20 20:35:15 0:24:44 0:14:03 0:10:41 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-20T20:28:29.085709+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613488 2024-03-20 19:18:38 2024-03-20 20:10:31 2024-03-20 20:47:57 0:37:26 0:23:31 0:13:55 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-20T20:39:44.691356+0000 mon.smithi019 (mon.0) 774 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613489 2024-03-20 19:18:40 2024-03-20 20:14:22 2024-03-20 20:38:41 0:24:19 0:13:26 0:10:53 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-20T20:35:33.828592+0000 mon.smithi150 (mon.0) 782 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613490 2024-03-20 19:18:41 2024-03-20 20:15:32 2024-03-20 20:57:26 0:41:54 0:31:35 0:10:19 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1710967389.6528833 mon.smithi071 (mon.0) 925 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7613491 2024-03-20 19:18:42 2024-03-20 20:16:13 2024-03-20 20:41:52 0:25:39 0:14:37 0:11:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-20T20:38:45.267041+0000 mon.smithi053 (mon.0) 845 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7613492 2024-03-20 19:18:44 2024-03-20 20:18:54 2024-03-20 20:45:32 0:26:38 0:11:20 0:15:18 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-20T20:40:42.663012+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7613493 2024-03-20 19:18:45 2024-03-20 20:19:24 2024-03-20 21:10:39 0:51:15 0:39:02 0:12:13 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-20T20:42:58.072907+0000 mon.a (mon.0) 481 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7613494 2024-03-20 19:18:46 2024-03-20 20:19:25 2024-03-20 20:54:56 0:35:31 0:25:43 0:09:48 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-20T20:40:18.065949+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613495 2024-03-20 19:18:48 2024-03-20 20:19:25 2024-03-20 21:08:13 0:48:48 0:38:35 0:10:13 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-20T20:43:26.123696+0000 mon.a (mon.0) 828 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7613496 2024-03-20 19:18:49 2024-03-20 20:19:25 2024-03-20 21:05:22 0:45:57 0:35:17 0:10:40 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-20T20:45:43.091344+0000 mon.a (mon.0) 1046 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613497 2024-03-20 19:18:50 2024-03-20 20:19:26 2024-03-20 20:48:17 0:28:51 0:18:54 0:09:57 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-20T20:37:54.079711+0000 mon.a (mon.0) 189 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7613498 2024-03-20 19:18:52 2024-03-20 20:19:26 2024-03-20 20:45:15 0:25:49 0:14:12 0:11:37 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-20T20:39:01.589880+0000 mon.smithi118 (mon.0) 652 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7613499 2024-03-20 19:18:53 2024-03-20 20:19:26 2024-03-20 21:07:50 0:48:24 0:38:01 0:10:23 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-20T20:44:51.885223+0000 mon.a (mon.0) 224 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log

pass 7613500 2024-03-20 19:18:54 2024-03-20 20:19:27 2024-03-20 20:49:44 0:30:17 0:20:11 0:10:06 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7613501 2024-03-20 19:18:56 2024-03-20 20:19:27 2024-03-20 21:00:59 0:41:32 0:32:36 0:08:56 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 7613502 2024-03-20 19:18:57 2024-03-20 20:19:27 2024-03-20 20:49:54 0:30:27 0:19:33 0:10:54 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

"2024-03-20T20:44:04.794950+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7613503 2024-03-20 19:18:58 2024-03-20 20:19:28 2024-03-20 20:57:45 0:38:17 0:20:24 0:17:53 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-20T20:52:06.672818+0000 mon.smithi106 (mon.0) 754 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7613504 2024-03-20 19:19:00 2024-03-20 20:25:19 2024-03-20 21:15:54 0:50:35 0:38:42 0:11:53 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7613505 2024-03-20 19:19:01 2024-03-20 20:26:49 2024-03-20 20:54:26 0:27:37 0:14:02 0:13:35 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-20T20:49:41.546272+0000 mon.smithi113 (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7613506 2024-03-20 19:19:02 2024-03-20 20:28:40 2024-03-20 21:30:04 1:01:24 0:47:33 0:13:51 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-20T20:57:07.561003+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

pass 7613507 2024-03-20 19:19:04 2024-03-20 20:32:41 2024-03-20 21:01:46 0:29:05 0:17:40 0:11:25 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7613508 2024-03-20 19:19:05 2024-03-20 20:34:52 2024-03-20 21:09:53 0:35:01 0:24:48 0:10:13 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-20T20:55:39.752003+0000 mon.a (mon.0) 367 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7613509 2024-03-20 19:19:06 2024-03-20 20:34:52 2024-03-20 21:02:03 0:27:11 0:16:37 0:10:34 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7613510 2024-03-20 19:19:08 2024-03-20 20:34:52 2024-03-20 21:06:15 0:31:23 0:21:41 0:09:42 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2