Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7616040 2024-03-22 03:02:29 2024-03-22 04:46:19 2024-03-22 08:35:23 3:49:04 3:36:47 0:12:17 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi153 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7616041 2024-03-22 03:02:31 2024-03-22 04:46:19 2024-03-22 05:17:40 0:31:21 0:21:23 0:09:58 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-22T05:08:00.429594+0000 mon.smithi062 (mon.0) 663 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7616042 2024-03-22 03:02:33 2024-03-22 04:46:20 2024-03-22 05:21:57 0:35:37 0:22:54 0:12:43 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-03-22T05:16:26.183698+0000 mon.a (mon.0) 596 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7616043 2024-03-22 03:02:34 2024-03-22 04:46:20 2024-03-22 05:31:29 0:45:09 0:34:13 0:10:56 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-03-22T05:12:21.535632+0000 mon.smithi092 (mon.0) 863 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7616044 2024-03-22 03:02:36 2024-03-22 04:46:20 2024-03-22 05:31:25 0:45:05 0:35:01 0:10:04 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} 1
Failure Reason:

"2024-03-22T05:06:23.353732+0000 mon.a (mon.0) 480 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616045 2024-03-22 03:02:37 2024-03-22 04:46:21 2024-03-22 05:15:15 0:28:54 0:20:27 0:08:27 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-22T05:13:17.314698+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7616046 2024-03-22 03:02:39 2024-03-22 04:46:21 2024-03-22 05:22:21 0:36:00 0:21:19 0:14:41 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
fail 7616047 2024-03-22 03:02:41 2024-03-22 04:51:12 2024-03-22 05:38:42 0:47:30 0:26:27 0:21:03 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-03-22T05:18:33.199577+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616048 2024-03-22 03:02:42 2024-03-22 04:51:22 2024-03-22 05:19:46 0:28:24 0:17:43 0:10:41 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-22T05:16:39.591587+0000 mon.a (mon.0) 240 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616049 2024-03-22 03:02:44 2024-03-22 04:52:53 2024-03-22 05:25:47 0:32:54 0:15:03 0:17:51 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-22T05:16:39.009082+0000 mon.a (mon.0) 172 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log

fail 7616050 2024-03-22 03:02:45 2024-03-22 04:53:44 2024-03-22 05:20:46 0:27:02 0:16:26 0:10:36 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-22T05:13:42.098376+0000 mon.smithi086 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616051 2024-03-22 03:02:47 2024-03-22 04:53:44 2024-03-22 05:14:51 0:21:07 0:11:34 0:09:33 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
Failure Reason:

"2024-03-22T05:10:32.879883+0000 mon.smithi057 (mon.0) 230 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616052 2024-03-22 03:02:49 2024-03-22 04:53:44 2024-03-22 05:22:34 0:28:50 0:11:36 0:17:14 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-22T05:16:28.569524+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616053 2024-03-22 03:02:50 2024-03-22 04:59:25 2024-03-22 05:45:52 0:46:27 0:35:10 0:11:17 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-22T05:22:45.599028+0000 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7616054 2024-03-22 03:02:52 2024-03-22 05:00:46 2024-03-22 05:58:07 0:57:21 0:47:50 0:09:31 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-03-22T05:15:55.622597+0000 mon.a (mon.0) 166 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616055 2024-03-22 03:02:53 2024-03-22 05:00:46 2024-03-22 05:31:05 0:30:19 0:18:12 0:12:07 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-22T05:27:12.337430+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7616056 2024-03-22 03:02:55 2024-03-22 05:01:47 2024-03-22 17:09:59 12:08:12 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

hit max job timeout

fail 7616057 2024-03-22 03:02:56 2024-03-22 05:01:47 2024-03-22 05:31:18 0:29:31 0:19:11 0:10:20 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-22T05:26:56.274938+0000 mon.smithi079 (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616058 2024-03-22 03:02:58 2024-03-22 05:01:48 2024-03-22 05:33:28 0:31:40 0:21:39 0:10:01 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-22T05:28:09.197299+0000 mon.smithi107 (mon.0) 756 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616059 2024-03-22 03:03:00 2024-03-22 05:01:48 2024-03-22 05:52:48 0:51:00 0:38:52 0:12:08 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-22T05:24:36.605895+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7616060 2024-03-22 03:03:01 2024-03-22 05:02:39 2024-03-22 05:42:10 0:39:31 0:25:12 0:14:19 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-22T05:28:48.642356+0000 mon.a (mon.0) 276 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7616061 2024-03-22 03:03:03 2024-03-22 05:06:29 2024-03-22 05:56:22 0:49:53 0:37:05 0:12:48 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7616062 2024-03-22 03:03:04 2024-03-22 05:09:10 2024-03-22 05:34:17 0:25:07 0:14:22 0:10:45 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-22T05:29:51.651755+0000 mon.smithi073 (mon.0) 779 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7616063 2024-03-22 03:03:06 2024-03-22 05:09:11 2024-03-22 05:45:06 0:35:55 0:24:42 0:11:13 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-22T05:30:44.612208+0000 mon.a (mon.0) 266 : cluster [WRN] Health detail: HEALTH_WARN 1/5 mons down, quorum a,e,c,d" in cluster log

fail 7616064 2024-03-22 03:03:08 2024-03-22 05:10:01 2024-03-22 05:31:10 0:21:09 0:10:58 0:10:11 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-22T05:27:33.936616+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616065 2024-03-22 03:03:09 2024-03-22 05:10:01 2024-03-22 05:35:58 0:25:57 0:13:55 0:12:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-22T05:30:33.882451+0000 mon.smithi007 (mon.0) 556 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616066 2024-03-22 03:03:11 2024-03-22 05:10:52 2024-03-22 05:57:52 0:47:00 0:36:19 0:10:41 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-22T05:48:22.350102+0000 mon.a (mon.0) 2055 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log

fail 7616067 2024-03-22 03:03:12 2024-03-22 05:10:52 2024-03-22 05:40:52 0:30:00 0:14:12 0:15:48 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-03-22T05:36:46.617465+0000 mon.a (mon.0) 187 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7616068 2024-03-22 03:03:13 2024-03-22 05:11:53 2024-03-22 05:37:42 0:25:49 0:14:27 0:11:22 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-22T05:33:07.149835+0000 mon.smithi037 (mon.0) 774 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616069 2024-03-22 03:03:15 2024-03-22 05:12:33 2024-03-22 05:43:53 0:31:20 0:19:56 0:11:24 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-22T05:39:25.255427+0000 mon.smithi175 (mon.0) 738 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616070 2024-03-22 03:03:16 2024-03-22 05:14:14 2024-03-22 05:49:58 0:35:44 0:26:14 0:09:30 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-22T05:35:58.735607+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7616071 2024-03-22 03:03:18 2024-03-22 05:14:24 2024-03-22 05:45:53 0:31:29 0:17:53 0:13:36 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-03-22T05:39:32.321360+0000 mon.smithi001 (mon.0) 793 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616072 2024-03-22 03:03:19 2024-03-22 05:16:35 2024-03-22 05:41:31 0:24:56 0:12:20 0:12:36 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-22T05:37:09.247613+0000 mon.a (mon.0) 561 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616073 2024-03-22 03:03:21 2024-03-22 05:17:06 2024-03-22 06:07:17 0:50:11 0:39:15 0:10:56 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-03-22T05:35:17.643564+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616074 2024-03-22 03:03:22 2024-03-22 05:17:06 2024-03-22 05:44:47 0:27:41 0:16:32 0:11:09 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-03-22T05:37:12.777017+0000 mon.a (mon.0) 240 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7616075 2024-03-22 03:03:24 2024-03-22 05:17:06 2024-03-22 05:44:20 0:27:14 0:15:46 0:11:28 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-03-22T05:38:39.756788+0000 mon.smithi115 (mon.0) 766 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616076 2024-03-22 03:03:25 2024-03-22 05:17:07 2024-03-22 09:07:40 3:50:33 3:37:03 0:13:30 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi080 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7616077 2024-03-22 03:03:27 2024-03-22 05:17:07 2024-03-22 05:38:37 0:21:30 0:12:29 0:09:01 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
fail 7616078 2024-03-22 03:03:28 2024-03-22 05:17:17 2024-03-22 05:40:11 0:22:54 0:13:14 0:09:40 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-03-22T05:37:51.411536+0000 mon.smithi062 (mon.0) 790 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616079 2024-03-22 03:03:30 2024-03-22 05:17:18 2024-03-22 05:47:07 0:29:49 0:19:15 0:10:34 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-22T05:42:35.906848+0000 mon.a (mon.0) 281 : cluster [WRN] Replacing daemon mds.cephfs.smithi057.abystw as rank 0 with standby daemon mds.cephfs.smithi057.calrzj" in cluster log

pass 7616080 2024-03-22 03:03:31 2024-03-22 05:17:18 2024-03-22 05:47:37 0:30:19 0:19:05 0:11:14 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7616081 2024-03-22 03:03:33 2024-03-22 05:19:59 2024-03-22 06:33:52 1:13:53 1:04:21 0:09:32 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi055 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7616082 2024-03-22 03:03:34 2024-03-22 05:20:09 2024-03-22 06:24:34 1:04:25 0:52:16 0:12:09 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-03-22T05:47:00.795045+0000 mon.a (mon.0) 1168 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7616083 2024-03-22 03:03:36 2024-03-22 05:20:40 2024-03-22 05:41:42 0:21:02 0:12:16 0:08:46 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
dead 7616084 2024-03-22 03:03:38 2024-03-22 05:20:40 2024-03-22 17:30:08 12:09:28 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

hit max job timeout

fail 7616085 2024-03-22 03:03:39 2024-03-22 05:21:51 2024-03-22 05:50:18 0:28:27 0:17:34 0:10:53 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7616086 2024-03-22 03:03:41 2024-03-22 05:22:31 2024-03-22 05:49:10 0:26:39 0:14:30 0:12:09 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-03-22T05:45:13.303394+0000 mon.smithi019 (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616087 2024-03-22 03:03:42 2024-03-22 05:24:22 2024-03-22 06:02:49 0:38:27 0:21:12 0:17:15 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-03-22T05:57:20.056522+0000 mon.smithi067 (mon.0) 774 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7616088 2024-03-22 03:03:44 2024-03-22 05:43:31 2024-03-22 06:14:05 0:30:34 0:20:11 0:10:23 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-03-22T06:10:23.100981+0000 mon.smithi143 (mon.0) 764 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7616089 2024-03-22 03:03:45 2024-03-22 05:44:32 2024-03-22 05:59:24 0:14:52 0:06:17 0:08:35 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
fail 7616090 2024-03-22 03:03:47 2024-03-22 05:44:32 2024-03-22 06:32:45 0:48:13 0:33:21 0:14:52 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711088189.6958392 mon.smithi006 (mon.0) 890 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7616091 2024-03-22 03:03:48 2024-03-22 05:47:43 2024-03-22 06:12:55 0:25:12 0:14:51 0:10:21 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

"2024-03-22T06:11:11.792133+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7616092 2024-03-22 03:03:50 2024-03-22 05:48:04 2024-03-22 06:13:00 0:24:56 0:14:16 0:10:40 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
fail 7616093 2024-03-22 03:03:51 2024-03-22 05:48:14 2024-03-22 06:12:57 0:24:43 0:11:55 0:12:48 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-22T06:09:30.155781+0000 mon.a (mon.0) 271 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log

fail 7616094 2024-03-22 03:03:53 2024-03-22 05:48:15 2024-03-22 06:12:58 0:24:43 0:15:50 0:08:53 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"2024-03-22T06:06:46.870710+0000 mon.a (mon.0) 569 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7616095 2024-03-22 03:03:54 2024-03-22 05:48:15 2024-03-22 06:14:06 0:25:51 0:14:39 0:11:12 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7616096 2024-03-22 03:03:56 2024-03-22 05:48:15 2024-03-22 06:10:36 0:22:21 0:13:14 0:09:07 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

"2024-03-22T06:03:39.764038+0000 mon.smithi037 (mon.0) 237 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616097 2024-03-22 03:03:58 2024-03-22 05:48:16 2024-03-22 06:12:02 0:23:46 0:12:36 0:11:10 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-03-22T06:05:44.037251+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616098 2024-03-22 03:03:59 2024-03-22 05:48:16 2024-03-22 06:55:07 1:06:51 0:56:37 0:10:14 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-03-22T06:12:34.525502+0000 mon.a (mon.0) 816 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 7616099 2024-03-22 03:04:01 2024-03-22 05:48:16 2024-03-22 06:41:16 0:53:00 0:43:24 0:09:36 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 972e12d4-e811-11ee-95cd-87774f69a715 -e sha1=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''

fail 7616100 2024-03-22 03:04:02 2024-03-22 05:48:17 2024-03-22 06:15:57 0:27:40 0:15:57 0:11:43 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-03-22T06:10:00.000156+0000 mon.smithi077 (mon.0) 777 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log

pass 7616101 2024-03-22 03:04:04 2024-03-22 05:48:17 2024-03-22 06:21:58 0:33:41 0:23:41 0:10:00 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7616102 2024-03-22 03:04:05 2024-03-22 05:48:18 2024-03-22 06:13:54 0:25:36 0:14:22 0:11:14 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
fail 7616103 2024-03-22 03:04:07 2024-03-22 05:48:18 2024-03-22 06:23:22 0:35:04 0:23:08 0:11:56 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-03-22T06:16:59.294856+0000 mon.smithi090 (mon.0) 808 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616104 2024-03-22 03:04:08 2024-03-22 05:48:18 2024-03-22 06:11:35 0:23:17 0:13:49 0:09:28 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-03-22T06:09:04.686150+0000 mon.smithi045 (mon.0) 763 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616105 2024-03-22 03:04:10 2024-03-22 05:48:19 2024-03-22 06:15:56 0:27:37 0:15:53 0:11:44 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-03-22T06:10:04.559915+0000 mon.smithi097 (mon.0) 787 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616106 2024-03-22 03:04:11 2024-03-22 05:48:19 2024-03-22 06:22:22 0:34:03 0:23:52 0:10:11 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-03-22T06:14:10.273291+0000 mon.a (mon.0) 393 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616107 2024-03-22 03:04:13 2024-03-22 05:48:19 2024-03-22 06:13:44 0:25:25 0:14:20 0:11:05 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
Failure Reason:

"2024-03-22T06:10:24.313046+0000 mon.a (mon.0) 458 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616108 2024-03-22 03:04:15 2024-03-22 05:48:20 2024-03-22 06:14:12 0:25:52 0:13:56 0:11:56 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
Failure Reason:

"2024-03-22T06:10:33.489061+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: Degraded data redundancy: 14/42 objects degraded (33.333%), 7 pgs degraded (PG_DEGRADED)" in cluster log

fail 7616109 2024-03-22 03:04:16 2024-03-22 05:48:20 2024-03-22 06:15:58 0:27:38 0:17:11 0:10:27 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-03-22T06:09:00.217518+0000 mon.smithi107 (mon.0) 770 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616110 2024-03-22 03:04:18 2024-03-22 05:48:20 2024-03-22 06:32:44 0:44:24 0:32:26 0:11:58 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-03-22T06:13:08.426499+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7616111 2024-03-22 03:04:19 2024-03-22 05:48:21 2024-03-22 07:01:40 1:13:19 0:53:06 0:20:13 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7616112 2024-03-22 03:04:21 2024-03-22 05:58:43 2024-03-22 06:23:39 0:24:56 0:14:25 0:10:31 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

"2024-03-22T06:17:18.442853+0000 mon.a (mon.0) 181 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7616113 2024-03-22 03:04:22 2024-03-22 05:58:43 2024-03-22 06:33:04 0:34:21 0:23:36 0:10:45 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-03-22T06:21:12.377513+0000 mon.smithi087 (mon.0) 552 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616114 2024-03-22 03:04:24 2024-03-22 05:59:33 2024-03-22 06:22:42 0:23:09 0:14:00 0:09:09 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-03-22T06:18:28.744440+0000 mon.smithi018 (mon.0) 580 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616115 2024-03-22 03:04:25 2024-03-22 05:59:54 2024-03-22 06:27:40 0:27:46 0:14:54 0:12:52 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

"2024-03-22T06:21:53.740826+0000 mon.a (mon.0) 626 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7616116 2024-03-22 03:04:27 2024-03-22 06:00:04 2024-03-22 06:23:07 0:23:03 0:14:38 0:08:25 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-03-22T06:19:55.376605+0000 mon.smithi119 (mon.0) 840 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7616117 2024-03-22 03:04:28 2024-03-22 06:00:05 2024-03-22 06:24:46 0:24:41 0:11:20 0:13:21 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-03-22T06:19:45.144399+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616118 2024-03-22 03:04:30 2024-03-22 06:00:45 2024-03-22 06:51:44 0:50:59 0:37:27 0:13:32 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-03-22T06:21:28.691281+0000 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7616119 2024-03-22 03:04:31 2024-03-22 06:03:06 2024-03-22 06:53:27 0:50:21 0:39:21 0:11:00 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

"2024-03-22T06:26:01.354586+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7616120 2024-03-22 03:04:33 2024-03-22 06:03:36 2024-03-22 06:33:03 0:29:27 0:18:54 0:10:33 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-03-22T06:30:12.349624+0000 mon.a (mon.0) 578 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log

fail 7616121 2024-03-22 03:04:34 2024-03-22 06:03:47 2024-03-22 06:28:23 0:24:36 0:14:36 0:10:00 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-03-22T06:24:25.922783+0000 mon.smithi017 (mon.0) 784 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7616122 2024-03-22 03:04:36 2024-03-22 06:03:47 2024-03-22 06:52:33 0:48:46 0:37:46 0:11:00 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-03-22T06:29:10.645287+0000 mon.a (mon.0) 227 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log

fail 7616123 2024-03-22 03:04:37 2024-03-22 06:03:47 2024-03-22 06:32:11 0:28:24 0:18:14 0:10:10 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
Failure Reason:

"2024-03-22T06:29:00.776282+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: Degraded data redundancy: 14/42 objects degraded (33.333%), 7 pgs degraded (PG_DEGRADED)" in cluster log

fail 7616124 2024-03-22 03:04:39 2024-03-22 06:03:48 2024-03-22 06:33:37 0:29:49 0:19:27 0:10:22 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-03-22T06:28:51.162348+0000 mon.smithi100 (mon.0) 732 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7616125 2024-03-22 03:04:41 2024-03-22 06:03:48 2024-03-22 07:03:31 0:59:43 0:50:07 0:09:36 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-03-22T06:26:12.459202+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7616126 2024-03-22 03:04:42 2024-03-22 06:03:49 2024-03-22 06:37:44 0:33:55 0:20:04 0:13:51 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

"2024-03-22T06:31:35.329548+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7616127 2024-03-22 03:04:44 2024-03-22 06:07:49 2024-03-22 06:41:34 0:33:45 0:21:02 0:12:43 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-03-22T06:35:50.613238+0000 mon.smithi063 (mon.0) 764 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 7616128 2024-03-22 03:04:45 2024-03-22 06:09:50 2024-03-22 06:53:00 0:43:10 0:32:11 0:10:59 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1711089469.3948402 mon.smithi005 (mon.0) 955 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7616129 2024-03-22 03:04:47 2024-03-22 06:09:50 2024-03-22 06:34:53 0:25:03 0:13:45 0:11:18 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-03-22T06:31:53.886119+0000 mon.smithi104 (mon.0) 762 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7616130 2024-03-22 03:04:49 2024-03-22 06:11:51 2024-03-22 06:42:13 0:30:22 0:17:37 0:12:45 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2