User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
phlogistonjohn | 2024-03-22 03:02:08 | 2024-03-22 04:46:21 | 2024-03-22 17:30:08 | 12:43:47 | orch:cephadm | wip-phlogistonjohn-testing-2024-03-21-1835 | smithi | ea01217 | 10 | 79 | 2 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 7616040 | 2024-03-22 03:02:29 | 2024-03-22 04:46:19 | 2024-03-22 08:35:23 | 3:49:04 | 3:36:47 | 0:12:17 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi153 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
fail | 7616041 | 2024-03-22 03:02:31 | 2024-03-22 04:46:19 | 2024-03-22 05:17:40 | 0:31:21 | 0:21:23 | 0:09:58 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:08:00.429594+0000 mon.smithi062 (mon.0) 663 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616042 | 2024-03-22 03:02:33 | 2024-03-22 04:46:20 | 2024-03-22 05:21:57 | 0:35:37 | 0:22:54 | 0:12:43 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-22T05:16:26.183698+0000 mon.a (mon.0) 596 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7616043 | 2024-03-22 03:02:34 | 2024-03-22 04:46:20 | 2024-03-22 05:31:29 | 0:45:09 | 0:34:13 | 0:10:56 | smithi | main | centos | 9.stream | orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 | |
Failure Reason:
"2024-03-22T05:12:21.535632+0000 mon.smithi092 (mon.0) 863 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7616044 | 2024-03-22 03:02:36 | 2024-03-22 04:46:20 | 2024-03-22 05:31:25 | 0:45:05 | 0:35:01 | 0:10:04 | smithi | main | centos | 9.stream | orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} | 1 | |
Failure Reason:
"2024-03-22T05:06:23.353732+0000 mon.a (mon.0) 480 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616045 | 2024-03-22 03:02:37 | 2024-03-22 04:46:21 | 2024-03-22 05:15:15 | 0:28:54 | 0:20:27 | 0:08:27 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-22T05:13:17.314698+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7616046 | 2024-03-22 03:02:39 | 2024-03-22 04:46:21 | 2024-03-22 05:22:21 | 0:36:00 | 0:21:19 | 0:14:41 | smithi | main | centos | 9.stream | orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} | 2 | |
fail | 7616047 | 2024-03-22 03:02:41 | 2024-03-22 04:51:12 | 2024-03-22 05:38:42 | 0:47:30 | 0:26:27 | 0:21:03 | smithi | main | centos | 9.stream | orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} | 3 | |
Failure Reason:
"2024-03-22T05:18:33.199577+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616048 | 2024-03-22 03:02:42 | 2024-03-22 04:51:22 | 2024-03-22 05:19:46 | 0:28:24 | 0:17:43 | 0:10:41 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-22T05:16:39.591587+0000 mon.a (mon.0) 240 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616049 | 2024-03-22 03:02:44 | 2024-03-22 04:52:53 | 2024-03-22 05:25:47 | 0:32:54 | 0:15:03 | 0:17:51 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-22T05:16:39.009082+0000 mon.a (mon.0) 172 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7616050 | 2024-03-22 03:02:45 | 2024-03-22 04:53:44 | 2024-03-22 05:20:46 | 0:27:02 | 0:16:26 | 0:10:36 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:13:42.098376+0000 mon.smithi086 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616051 | 2024-03-22 03:02:47 | 2024-03-22 04:53:44 | 2024-03-22 05:14:51 | 0:21:07 | 0:11:34 | 0:09:33 | smithi | main | centos | 9.stream | orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} | 1 | |
Failure Reason:
"2024-03-22T05:10:32.879883+0000 mon.smithi057 (mon.0) 230 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616052 | 2024-03-22 03:02:49 | 2024-03-22 04:53:44 | 2024-03-22 05:22:34 | 0:28:50 | 0:11:36 | 0:17:14 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-22T05:16:28.569524+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616053 | 2024-03-22 03:02:50 | 2024-03-22 04:59:25 | 2024-03-22 05:45:52 | 0:46:27 | 0:35:10 | 0:11:17 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-22T05:22:45.599028+0000 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616054 | 2024-03-22 03:02:52 | 2024-03-22 05:00:46 | 2024-03-22 05:58:07 | 0:57:21 | 0:47:50 | 0:09:31 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 | |
Failure Reason:
"2024-03-22T05:15:55.622597+0000 mon.a (mon.0) 166 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616055 | 2024-03-22 03:02:53 | 2024-03-22 05:00:46 | 2024-03-22 05:31:05 | 0:30:19 | 0:18:12 | 0:12:07 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-22T05:27:12.337430+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
dead | 7616056 | 2024-03-22 03:02:55 | 2024-03-22 05:01:47 | 2024-03-22 17:09:59 | 12:08:12 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7616057 | 2024-03-22 03:02:56 | 2024-03-22 05:01:47 | 2024-03-22 05:31:18 | 0:29:31 | 0:19:11 | 0:10:20 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-22T05:26:56.274938+0000 mon.smithi079 (mon.0) 751 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616058 | 2024-03-22 03:02:58 | 2024-03-22 05:01:48 | 2024-03-22 05:33:28 | 0:31:40 | 0:21:39 | 0:10:01 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:28:09.197299+0000 mon.smithi107 (mon.0) 756 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616059 | 2024-03-22 03:03:00 | 2024-03-22 05:01:48 | 2024-03-22 05:52:48 | 0:51:00 | 0:38:52 | 0:12:08 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-22T05:24:36.605895+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616060 | 2024-03-22 03:03:01 | 2024-03-22 05:02:39 | 2024-03-22 05:42:10 | 0:39:31 | 0:25:12 | 0:14:19 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-22T05:28:48.642356+0000 mon.a (mon.0) 276 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7616061 | 2024-03-22 03:03:03 | 2024-03-22 05:06:29 | 2024-03-22 05:56:22 | 0:49:53 | 0:37:05 | 0:12:48 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7616062 | 2024-03-22 03:03:04 | 2024-03-22 05:09:10 | 2024-03-22 05:34:17 | 0:25:07 | 0:14:22 | 0:10:45 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:29:51.651755+0000 mon.smithi073 (mon.0) 779 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7616063 | 2024-03-22 03:03:06 | 2024-03-22 05:09:11 | 2024-03-22 05:45:06 | 0:35:55 | 0:24:42 | 0:11:13 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-22T05:30:44.612208+0000 mon.a (mon.0) 266 : cluster [WRN] Health detail: HEALTH_WARN 1/5 mons down, quorum a,e,c,d" in cluster log |
||||||||||||||
fail | 7616064 | 2024-03-22 03:03:08 | 2024-03-22 05:10:01 | 2024-03-22 05:31:10 | 0:21:09 | 0:10:58 | 0:10:11 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-22T05:27:33.936616+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616065 | 2024-03-22 03:03:09 | 2024-03-22 05:10:01 | 2024-03-22 05:35:58 | 0:25:57 | 0:13:55 | 0:12:02 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:30:33.882451+0000 mon.smithi007 (mon.0) 556 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616066 | 2024-03-22 03:03:11 | 2024-03-22 05:10:52 | 2024-03-22 05:57:52 | 0:47:00 | 0:36:19 | 0:10:41 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-22T05:48:22.350102+0000 mon.a (mon.0) 2055 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log |
||||||||||||||
fail | 7616067 | 2024-03-22 03:03:12 | 2024-03-22 05:10:52 | 2024-03-22 05:40:52 | 0:30:00 | 0:14:12 | 0:15:48 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-22T05:36:46.617465+0000 mon.a (mon.0) 187 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7616068 | 2024-03-22 03:03:13 | 2024-03-22 05:11:53 | 2024-03-22 05:37:42 | 0:25:49 | 0:14:27 | 0:11:22 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-22T05:33:07.149835+0000 mon.smithi037 (mon.0) 774 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616069 | 2024-03-22 03:03:15 | 2024-03-22 05:12:33 | 2024-03-22 05:43:53 | 0:31:20 | 0:19:56 | 0:11:24 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:39:25.255427+0000 mon.smithi175 (mon.0) 738 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616070 | 2024-03-22 03:03:16 | 2024-03-22 05:14:14 | 2024-03-22 05:49:58 | 0:35:44 | 0:26:14 | 0:09:30 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-22T05:35:58.735607+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7616071 | 2024-03-22 03:03:18 | 2024-03-22 05:14:24 | 2024-03-22 05:45:53 | 0:31:29 | 0:17:53 | 0:13:36 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:39:32.321360+0000 mon.smithi001 (mon.0) 793 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616072 | 2024-03-22 03:03:19 | 2024-03-22 05:16:35 | 2024-03-22 05:41:31 | 0:24:56 | 0:12:20 | 0:12:36 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-22T05:37:09.247613+0000 mon.a (mon.0) 561 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616073 | 2024-03-22 03:03:21 | 2024-03-22 05:17:06 | 2024-03-22 06:07:17 | 0:50:11 | 0:39:15 | 0:10:56 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-22T05:35:17.643564+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616074 | 2024-03-22 03:03:22 | 2024-03-22 05:17:06 | 2024-03-22 05:44:47 | 0:27:41 | 0:16:32 | 0:11:09 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} | 3 | |
Failure Reason:
"2024-03-22T05:37:12.777017+0000 mon.a (mon.0) 240 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7616075 | 2024-03-22 03:03:24 | 2024-03-22 05:17:06 | 2024-03-22 05:44:20 | 0:27:14 | 0:15:46 | 0:11:28 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:38:39.756788+0000 mon.smithi115 (mon.0) 766 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616076 | 2024-03-22 03:03:25 | 2024-03-22 05:17:07 | 2024-03-22 09:07:40 | 3:50:33 | 3:37:03 | 0:13:30 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi080 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
pass | 7616077 | 2024-03-22 03:03:27 | 2024-03-22 05:17:07 | 2024-03-22 05:38:37 | 0:21:30 | 0:12:29 | 0:09:01 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} | 1 | |
fail | 7616078 | 2024-03-22 03:03:28 | 2024-03-22 05:17:17 | 2024-03-22 05:40:11 | 0:22:54 | 0:13:14 | 0:09:40 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} | 2 | |
Failure Reason:
"2024-03-22T05:37:51.411536+0000 mon.smithi062 (mon.0) 790 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616079 | 2024-03-22 03:03:30 | 2024-03-22 05:17:18 | 2024-03-22 05:47:07 | 0:29:49 | 0:19:15 | 0:10:34 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-22T05:42:35.906848+0000 mon.a (mon.0) 281 : cluster [WRN] Replacing daemon mds.cephfs.smithi057.abystw as rank 0 with standby daemon mds.cephfs.smithi057.calrzj" in cluster log |
||||||||||||||
pass | 7616080 | 2024-03-22 03:03:31 | 2024-03-22 05:17:18 | 2024-03-22 05:47:37 | 0:30:19 | 0:19:05 | 0:11:14 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} | 2 | |
fail | 7616081 | 2024-03-22 03:03:33 | 2024-03-22 05:19:59 | 2024-03-22 06:33:52 | 1:13:53 | 1:04:21 | 0:09:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi055 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
fail | 7616082 | 2024-03-22 03:03:34 | 2024-03-22 05:20:09 | 2024-03-22 06:24:34 | 1:04:25 | 0:52:16 | 0:12:09 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-22T05:47:00.795045+0000 mon.a (mon.0) 1168 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
pass | 7616083 | 2024-03-22 03:03:36 | 2024-03-22 05:20:40 | 2024-03-22 05:41:42 | 0:21:02 | 0:12:16 | 0:08:46 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} | 2 | |
dead | 7616084 | 2024-03-22 03:03:38 | 2024-03-22 05:20:40 | 2024-03-22 17:30:08 | 12:09:28 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7616085 | 2024-03-22 03:03:39 | 2024-03-22 05:21:51 | 2024-03-22 05:50:18 | 0:28:27 | 0:17:34 | 0:10:53 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} | 1 | |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
fail | 7616086 | 2024-03-22 03:03:41 | 2024-03-22 05:22:31 | 2024-03-22 05:49:10 | 0:26:39 | 0:14:30 | 0:12:09 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:45:13.303394+0000 mon.smithi019 (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616087 | 2024-03-22 03:03:42 | 2024-03-22 05:24:22 | 2024-03-22 06:02:49 | 0:38:27 | 0:21:12 | 0:17:15 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} | 2 | |
Failure Reason:
"2024-03-22T05:57:20.056522+0000 mon.smithi067 (mon.0) 774 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7616088 | 2024-03-22 03:03:44 | 2024-03-22 05:43:31 | 2024-03-22 06:14:05 | 0:30:34 | 0:20:11 | 0:10:23 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-22T06:10:23.100981+0000 mon.smithi143 (mon.0) 764 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7616089 | 2024-03-22 03:03:45 | 2024-03-22 05:44:32 | 2024-03-22 05:59:24 | 0:14:52 | 0:06:17 | 0:08:35 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} | 1 | |
fail | 7616090 | 2024-03-22 03:03:47 | 2024-03-22 05:44:32 | 2024-03-22 06:32:45 | 0:48:13 | 0:33:21 | 0:14:52 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711088189.6958392 mon.smithi006 (mon.0) 890 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7616091 | 2024-03-22 03:03:48 | 2024-03-22 05:47:43 | 2024-03-22 06:12:55 | 0:25:12 | 0:14:51 | 0:10:21 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} | 1 | |
Failure Reason:
"2024-03-22T06:11:11.792133+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
pass | 7616092 | 2024-03-22 03:03:50 | 2024-03-22 05:48:04 | 2024-03-22 06:13:00 | 0:24:56 | 0:14:16 | 0:10:40 | smithi | main | ubuntu | 22.04 | orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} | 2 | |
fail | 7616093 | 2024-03-22 03:03:51 | 2024-03-22 05:48:14 | 2024-03-22 06:12:57 | 0:24:43 | 0:11:55 | 0:12:48 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-22T06:09:30.155781+0000 mon.a (mon.0) 271 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616094 | 2024-03-22 03:03:53 | 2024-03-22 05:48:15 | 2024-03-22 06:12:58 | 0:24:43 | 0:15:50 | 0:08:53 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-22T06:06:46.870710+0000 mon.a (mon.0) 569 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7616095 | 2024-03-22 03:03:54 | 2024-03-22 05:48:15 | 2024-03-22 06:14:06 | 0:25:51 | 0:14:39 | 0:11:12 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 | |
fail | 7616096 | 2024-03-22 03:03:56 | 2024-03-22 05:48:15 | 2024-03-22 06:10:36 | 0:22:21 | 0:13:14 | 0:09:07 | smithi | main | centos | 9.stream | orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} | 1 | |
Failure Reason:
"2024-03-22T06:03:39.764038+0000 mon.smithi037 (mon.0) 237 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616097 | 2024-03-22 03:03:58 | 2024-03-22 05:48:16 | 2024-03-22 06:12:02 | 0:23:46 | 0:12:36 | 0:11:10 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-22T06:05:44.037251+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616098 | 2024-03-22 03:03:59 | 2024-03-22 05:48:16 | 2024-03-22 06:55:07 | 1:06:51 | 0:56:37 | 0:10:14 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-22T06:12:34.525502+0000 mon.a (mon.0) 816 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7616099 | 2024-03-22 03:04:01 | 2024-03-22 05:48:16 | 2024-03-22 06:41:16 | 0:53:00 | 0:43:24 | 0:09:36 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 | |
Failure Reason:
Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 972e12d4-e811-11ee-95cd-87774f69a715 -e sha1=ea01217f8a79678e64ef6a5d68a043a4ef21ca37 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' |
||||||||||||||
fail | 7616100 | 2024-03-22 03:04:02 | 2024-03-22 05:48:17 | 2024-03-22 06:15:57 | 0:27:40 | 0:15:57 | 0:11:43 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:10:00.000156+0000 mon.smithi077 (mon.0) 777 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
pass | 7616101 | 2024-03-22 03:04:04 | 2024-03-22 05:48:17 | 2024-03-22 06:21:58 | 0:33:41 | 0:23:41 | 0:10:00 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 | |
pass | 7616102 | 2024-03-22 03:04:05 | 2024-03-22 05:48:18 | 2024-03-22 06:13:54 | 0:25:36 | 0:14:22 | 0:11:14 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} | 2 | |
fail | 7616103 | 2024-03-22 03:04:07 | 2024-03-22 05:48:18 | 2024-03-22 06:23:22 | 0:35:04 | 0:23:08 | 0:11:56 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:16:59.294856+0000 mon.smithi090 (mon.0) 808 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616104 | 2024-03-22 03:04:08 | 2024-03-22 05:48:18 | 2024-03-22 06:11:35 | 0:23:17 | 0:13:49 | 0:09:28 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |
Failure Reason:
"2024-03-22T06:09:04.686150+0000 mon.smithi045 (mon.0) 763 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616105 | 2024-03-22 03:04:10 | 2024-03-22 05:48:19 | 2024-03-22 06:15:56 | 0:27:37 | 0:15:53 | 0:11:44 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:10:04.559915+0000 mon.smithi097 (mon.0) 787 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616106 | 2024-03-22 03:04:11 | 2024-03-22 05:48:19 | 2024-03-22 06:22:22 | 0:34:03 | 0:23:52 | 0:10:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-22T06:14:10.273291+0000 mon.a (mon.0) 393 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616107 | 2024-03-22 03:04:13 | 2024-03-22 05:48:19 | 2024-03-22 06:13:44 | 0:25:25 | 0:14:20 | 0:11:05 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-22T06:10:24.313046+0000 mon.a (mon.0) 458 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616108 | 2024-03-22 03:04:15 | 2024-03-22 05:48:20 | 2024-03-22 06:14:12 | 0:25:52 | 0:13:56 | 0:11:56 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-22T06:10:33.489061+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: Degraded data redundancy: 14/42 objects degraded (33.333%), 7 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616109 | 2024-03-22 03:04:16 | 2024-03-22 05:48:20 | 2024-03-22 06:15:58 | 0:27:38 | 0:17:11 | 0:10:27 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:09:00.217518+0000 mon.smithi107 (mon.0) 770 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616110 | 2024-03-22 03:04:18 | 2024-03-22 05:48:20 | 2024-03-22 06:32:44 | 0:44:24 | 0:32:26 | 0:11:58 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-22T06:13:08.426499+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616111 | 2024-03-22 03:04:19 | 2024-03-22 05:48:21 | 2024-03-22 07:01:40 | 1:13:19 | 0:53:06 | 0:20:13 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7616112 | 2024-03-22 03:04:21 | 2024-03-22 05:58:43 | 2024-03-22 06:23:39 | 0:24:56 | 0:14:25 | 0:10:31 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-22T06:17:18.442853+0000 mon.a (mon.0) 181 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7616113 | 2024-03-22 03:04:22 | 2024-03-22 05:58:43 | 2024-03-22 06:33:04 | 0:34:21 | 0:23:36 | 0:10:45 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:21:12.377513+0000 mon.smithi087 (mon.0) 552 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616114 | 2024-03-22 03:04:24 | 2024-03-22 05:59:33 | 2024-03-22 06:22:42 | 0:23:09 | 0:14:00 | 0:09:09 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-22T06:18:28.744440+0000 mon.smithi018 (mon.0) 580 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616115 | 2024-03-22 03:04:25 | 2024-03-22 05:59:54 | 2024-03-22 06:27:40 | 0:27:46 | 0:14:54 | 0:12:52 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-22T06:21:53.740826+0000 mon.a (mon.0) 626 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616116 | 2024-03-22 03:04:27 | 2024-03-22 06:00:04 | 2024-03-22 06:23:07 | 0:23:03 | 0:14:38 | 0:08:25 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:19:55.376605+0000 mon.smithi119 (mon.0) 840 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7616117 | 2024-03-22 03:04:28 | 2024-03-22 06:00:05 | 2024-03-22 06:24:46 | 0:24:41 | 0:11:20 | 0:13:21 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-22T06:19:45.144399+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616118 | 2024-03-22 03:04:30 | 2024-03-22 06:00:45 | 2024-03-22 06:51:44 | 0:50:59 | 0:37:27 | 0:13:32 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-22T06:21:28.691281+0000 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616119 | 2024-03-22 03:04:31 | 2024-03-22 06:03:06 | 2024-03-22 06:53:27 | 0:50:21 | 0:39:21 | 0:11:00 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-22T06:26:01.354586+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616120 | 2024-03-22 03:04:33 | 2024-03-22 06:03:36 | 2024-03-22 06:33:03 | 0:29:27 | 0:18:54 | 0:10:33 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-22T06:30:12.349624+0000 mon.a (mon.0) 578 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7616121 | 2024-03-22 03:04:34 | 2024-03-22 06:03:47 | 2024-03-22 06:28:23 | 0:24:36 | 0:14:36 | 0:10:00 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:24:25.922783+0000 mon.smithi017 (mon.0) 784 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7616122 | 2024-03-22 03:04:36 | 2024-03-22 06:03:47 | 2024-03-22 06:52:33 | 0:48:46 | 0:37:46 | 0:11:00 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-22T06:29:10.645287+0000 mon.a (mon.0) 227 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log |
||||||||||||||
fail | 7616123 | 2024-03-22 03:04:37 | 2024-03-22 06:03:47 | 2024-03-22 06:32:11 | 0:28:24 | 0:18:14 | 0:10:10 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-22T06:29:00.776282+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: Degraded data redundancy: 14/42 objects degraded (33.333%), 7 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7616124 | 2024-03-22 03:04:39 | 2024-03-22 06:03:48 | 2024-03-22 06:33:37 | 0:29:49 | 0:19:27 | 0:10:22 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:28:51.162348+0000 mon.smithi100 (mon.0) 732 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7616125 | 2024-03-22 03:04:41 | 2024-03-22 06:03:48 | 2024-03-22 07:03:31 | 0:59:43 | 0:50:07 | 0:09:36 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-22T06:26:12.459202+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7616126 | 2024-03-22 03:04:42 | 2024-03-22 06:03:49 | 2024-03-22 06:37:44 | 0:33:55 | 0:20:04 | 0:13:51 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-22T06:31:35.329548+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7616127 | 2024-03-22 03:04:44 | 2024-03-22 06:07:49 | 2024-03-22 06:41:34 | 0:33:45 | 0:21:02 | 0:12:43 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-22T06:35:50.613238+0000 mon.smithi063 (mon.0) 764 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7616128 | 2024-03-22 03:04:45 | 2024-03-22 06:09:50 | 2024-03-22 06:53:00 | 0:43:10 | 0:32:11 | 0:10:59 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711089469.3948402 mon.smithi005 (mon.0) 955 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7616129 | 2024-03-22 03:04:47 | 2024-03-22 06:09:50 | 2024-03-22 06:34:53 | 0:25:03 | 0:13:45 | 0:11:18 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-22T06:31:53.886119+0000 mon.smithi104 (mon.0) 762 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7616130 | 2024-03-22 03:04:49 | 2024-03-22 06:11:51 | 2024-03-22 06:42:13 | 0:30:22 | 0:17:37 | 0:12:45 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 |