User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
gabrioux | 2024-03-26 20:31:35 | 2024-03-26 20:32:07 | 2024-03-27 08:43:57 | 12:11:50 | orch:cephadm | wip-guits-testing-2024-03-26-0925 | smithi | 42fc52b | 13 | 93 | 1 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 7624076 | 2024-03-26 20:31:48 | 2024-03-26 20:32:07 | 2024-03-26 21:05:16 | 0:33:09 | 0:22:36 | 0:10:33 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-26T21:00:00.000184+0000 mon.a (mon.0) 1174 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
fail | 7624077 | 2024-03-26 20:31:49 | 2024-03-26 20:32:07 | 2024-03-26 20:58:05 | 0:25:58 | 0:16:00 | 0:09:58 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-26T20:52:16.917505+0000 mon.a (mon.0) 394 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624078 | 2024-03-26 20:31:50 | 2024-03-26 20:32:47 | 2024-03-26 21:18:29 | 0:45:42 | 0:36:00 | 0:09:42 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711486800.000299 mon.smithi026 (mon.0) 659 : cluster [ERR] fs cephfs is offline because no MDS is active for it." in cluster log |
||||||||||||||
fail | 7624079 | 2024-03-26 20:31:52 | 2024-03-26 20:33:58 | 2024-03-26 21:19:13 | 0:45:15 | 0:34:46 | 0:10:29 | smithi | main | centos | 9.stream | orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 | |
Failure Reason:
"2024-03-26T20:53:30.336493+0000 mon.smithi063 (mon.0) 503 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7624080 | 2024-03-26 20:31:53 | 2024-03-26 20:33:58 | 2024-03-26 21:31:38 | 0:57:40 | 0:48:31 | 0:09:09 | smithi | main | ubuntu | 22.04 | orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} | 1 | |
Failure Reason:
"2024-03-26T21:00:13.555405+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log |
||||||||||||||
fail | 7624081 | 2024-03-26 20:31:54 | 2024-03-26 20:33:59 | 2024-03-26 20:56:37 | 0:22:38 | 0:13:20 | 0:09:18 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-26T20:53:25.605270+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7624082 | 2024-03-26 20:31:56 | 2024-03-26 20:34:09 | 2024-03-26 20:58:04 | 0:23:55 | 0:14:11 | 0:09:44 | smithi | main | ubuntu | 22.04 | orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli} | 2 | |
fail | 7624083 | 2024-03-26 20:31:57 | 2024-03-26 20:34:09 | 2024-03-26 21:16:45 | 0:42:36 | 0:30:35 | 0:12:01 | smithi | main | centos | 9.stream | orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} | 3 | |
Failure Reason:
"2024-03-26T20:54:57.939426+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624084 | 2024-03-26 20:31:58 | 2024-03-26 20:35:30 | 2024-03-26 20:58:39 | 0:23:09 | 0:13:12 | 0:09:57 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T20:55:46.538892+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
dead | 7624085 | 2024-03-26 20:32:00 | 2024-03-26 20:35:30 | 2024-03-27 08:43:57 | 12:08:27 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7624086 | 2024-03-26 20:32:01 | 2024-03-26 20:35:31 | 2024-03-26 21:03:28 | 0:27:57 | 0:18:10 | 0:09:47 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} | 1 | |
fail | 7624087 | 2024-03-26 20:32:02 | 2024-03-26 20:35:51 | 2024-03-26 20:57:10 | 0:21:19 | 0:11:21 | 0:09:58 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-26T20:53:48.687519+0000 mon.a (mon.0) 469 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624088 | 2024-03-26 20:32:04 | 2024-03-26 20:36:01 | 2024-03-26 21:48:07 | 1:12:06 | 0:58:02 | 0:14:04 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-26T21:03:24.089547+0000 mon.a (mon.0) 865 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624089 | 2024-03-26 20:32:05 | 2024-03-26 20:37:52 | 2024-03-26 21:35:22 | 0:57:30 | 0:47:31 | 0:09:59 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 | |
Failure Reason:
"2024-03-26T20:55:56.782307+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7624090 | 2024-03-26 20:32:07 | 2024-03-26 20:37:53 | 2024-03-26 21:11:46 | 0:33:53 | 0:23:49 | 0:10:04 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T21:00:22.540078+0000 mon.a (mon.0) 661 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624091 | 2024-03-26 20:32:08 | 2024-03-26 20:38:43 | 2024-03-26 21:02:09 | 0:23:26 | 0:13:47 | 0:09:39 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-26T20:58:35.663940+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624092 | 2024-03-26 20:32:09 | 2024-03-26 20:39:03 | 2024-03-26 21:09:47 | 0:30:44 | 0:17:45 | 0:12:59 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:03:12.860147+0000 mon.smithi096 (mon.0) 786 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624093 | 2024-03-26 20:32:11 | 2024-03-26 20:40:14 | 2024-03-26 21:11:24 | 0:31:10 | 0:19:37 | 0:11:33 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-26T21:08:16.700989+0000 mon.smithi042 (mon.0) 770 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624094 | 2024-03-26 20:32:12 | 2024-03-26 20:41:25 | 2024-03-26 21:13:12 | 0:31:47 | 0:20:52 | 0:10:55 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:07:31.377870+0000 mon.smithi131 (mon.0) 825 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7624095 | 2024-03-26 20:32:14 | 2024-03-26 20:41:25 | 2024-03-26 21:18:27 | 0:37:02 | 0:25:59 | 0:11:03 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-26T21:04:19.886017+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624096 | 2024-03-26 20:32:15 | 2024-03-26 20:42:05 | 2024-03-26 21:25:30 | 0:43:25 | 0:32:17 | 0:11:08 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T21:07:28.348778+0000 mon.a (mon.0) 830 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624097 | 2024-03-26 20:32:16 | 2024-03-26 20:42:26 | 2024-03-26 21:56:28 | 1:14:02 | 1:00:30 | 0:13:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T21:20:00.000154+0000 mon.a (mon.0) 1372 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 5 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
fail | 7624098 | 2024-03-26 20:32:18 | 2024-03-26 20:44:06 | 2024-03-26 21:21:35 | 0:37:29 | 0:25:22 | 0:12:07 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-26T21:09:31.906419+0000 mon.a (mon.0) 439 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624099 | 2024-03-26 20:32:19 | 2024-03-26 20:45:07 | 2024-03-26 22:04:20 | 1:19:13 | 1:08:45 | 0:10:28 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7624100 | 2024-03-26 20:32:21 | 2024-03-26 20:45:07 | 2024-03-26 21:10:55 | 0:25:48 | 0:15:31 | 0:10:17 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:06:49.893541+0000 mon.smithi018 (mon.0) 799 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7624101 | 2024-03-26 20:32:22 | 2024-03-26 20:45:38 | 2024-03-26 21:27:20 | 0:41:42 | 0:28:59 | 0:12:43 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-26T21:15:20.119332+0000 mon.a (mon.0) 592 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624102 | 2024-03-26 20:32:23 | 2024-03-26 20:48:19 | 2024-03-26 21:09:36 | 0:21:17 | 0:11:08 | 0:10:09 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T21:05:39.098772+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7624103 | 2024-03-26 20:32:25 | 2024-03-26 20:48:19 | 2024-03-26 21:14:29 | 0:26:10 | 0:14:20 | 0:11:50 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:10:10.517137+0000 mon.smithi183 (mon.0) 785 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7624104 | 2024-03-26 20:32:26 | 2024-03-26 20:49:29 | 2024-03-26 21:23:03 | 0:33:34 | 0:22:08 | 0:11:26 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} | 2 | |
fail | 7624105 | 2024-03-26 20:32:27 | 2024-03-26 20:49:40 | 2024-03-26 21:19:51 | 0:30:11 | 0:15:45 | 0:14:26 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-26T21:14:45.500780+0000 mon.a (mon.0) 209 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7624106 | 2024-03-26 20:32:29 | 2024-03-26 20:51:10 | 2024-03-26 21:16:39 | 0:25:29 | 0:14:43 | 0:10:46 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-26T21:12:34.337317+0000 mon.smithi089 (mon.0) 784 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624107 | 2024-03-26 20:32:30 | 2024-03-26 20:51:31 | 2024-03-26 21:24:17 | 0:32:46 | 0:21:57 | 0:10:49 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:20:03.108250+0000 mon.smithi029 (mon.0) 785 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624108 | 2024-03-26 20:32:31 | 2024-03-26 20:51:31 | 2024-03-26 21:52:05 | 1:00:34 | 0:50:18 | 0:10:16 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-26T21:26:47.611422+0000 mon.a (mon.0) 947 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log |
||||||||||||||
fail | 7624109 | 2024-03-26 20:32:33 | 2024-03-26 20:52:22 | 2024-03-26 21:43:33 | 0:51:11 | 0:38:48 | 0:12:23 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711488570.7345958 mon.smithi103 (mon.0) 955 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624110 | 2024-03-26 20:32:34 | 2024-03-26 20:52:22 | 2024-03-26 21:19:51 | 0:27:29 | 0:17:46 | 0:09:43 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:13:28.574793+0000 mon.smithi102 (mon.0) 800 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624111 | 2024-03-26 20:32:35 | 2024-03-26 20:52:42 | 2024-03-26 21:15:39 | 0:22:57 | 0:11:54 | 0:11:03 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-26T21:09:15.194789+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624112 | 2024-03-26 20:32:37 | 2024-03-26 20:52:43 | 2024-03-26 21:45:56 | 0:53:13 | 0:41:08 | 0:12:05 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-26T21:14:00.254269+0000 mon.a (mon.0) 432 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624113 | 2024-03-26 20:32:38 | 2024-03-26 20:53:33 | 2024-03-26 21:30:38 | 0:37:05 | 0:26:50 | 0:10:15 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T21:18:23.650191+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624114 | 2024-03-26 20:32:39 | 2024-03-26 20:53:34 | 2024-03-26 21:22:41 | 0:29:07 | 0:16:06 | 0:13:01 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} | 3 | |
Failure Reason:
"2024-03-26T21:16:15.230225+0000 mon.a (mon.0) 266 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7624115 | 2024-03-26 20:32:41 | 2024-03-26 20:53:44 | 2024-03-26 21:23:02 | 0:29:18 | 0:18:14 | 0:11:04 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:17:15.213512+0000 mon.smithi045 (mon.0) 797 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7624116 | 2024-03-26 20:32:42 | 2024-03-26 20:54:05 | 2024-03-26 21:16:33 | 0:22:28 | 0:12:35 | 0:09:53 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} | 1 | |
pass | 7624117 | 2024-03-26 20:32:43 | 2024-03-26 20:55:05 | 2024-03-26 21:21:36 | 0:26:31 | 0:13:32 | 0:12:59 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} | 2 | |
fail | 7624118 | 2024-03-26 20:32:45 | 2024-03-26 20:55:05 | 2024-03-26 21:26:04 | 0:30:59 | 0:19:04 | 0:11:55 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T21:21:06.091537+0000 mon.a (mon.0) 289 : cluster [WRN] Health check failed: Degraded data redundancy: 7/21 objects degraded (33.333%), 3 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7624119 | 2024-03-26 20:32:46 | 2024-03-26 20:56:16 | 2024-03-26 21:21:34 | 0:25:18 | 0:15:50 | 0:09:28 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-26T21:14:00.881095+0000 mon.a (mon.0) 414 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
pass | 7624120 | 2024-03-26 20:32:48 | 2024-03-26 20:56:16 | 2024-03-26 21:27:36 | 0:31:20 | 0:19:05 | 0:12:15 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} | 2 | |
fail | 7624121 | 2024-03-26 20:32:49 | 2024-03-26 20:56:37 | 2024-03-26 22:01:08 | 1:04:31 | 0:54:22 | 0:10:09 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-26T21:33:27.738501+0000 mon.a (mon.0) 928 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624122 | 2024-03-26 20:32:50 | 2024-03-26 20:56:37 | 2024-03-26 22:01:37 | 1:05:00 | 0:53:01 | 0:11:59 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T21:30:00.000178+0000 mon.a (mon.0) 2476 : cluster [WRN] Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
pass | 7624123 | 2024-03-26 20:32:52 | 2024-03-26 20:58:08 | 2024-03-26 21:20:08 | 0:22:00 | 0:11:47 | 0:10:13 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} | 2 | |
fail | 7624124 | 2024-03-26 20:32:53 | 2024-03-26 20:58:38 | 2024-03-26 21:31:37 | 0:32:59 | 0:23:05 | 0:09:54 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7624125 | 2024-03-26 20:32:54 | 2024-03-26 20:58:38 | 2024-03-26 21:21:42 | 0:23:04 | 0:13:47 | 0:09:17 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 | |
fail | 7624126 | 2024-03-26 20:32:56 | 2024-03-26 20:58:39 | 2024-03-26 21:40:19 | 0:41:40 | 0:32:31 | 0:09:09 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-26T21:19:41.761510+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624127 | 2024-03-26 20:32:57 | 2024-03-26 20:58:39 | 2024-03-26 21:28:10 | 0:29:31 | 0:17:27 | 0:12:04 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} | 1 | |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=42fc52b86b14d4f88c40d75eb7102e0ab3918f55 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
fail | 7624128 | 2024-03-26 20:32:58 | 2024-03-26 21:00:40 | 2024-03-26 21:29:29 | 0:28:49 | 0:14:32 | 0:14:17 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:26:45.936072+0000 mon.smithi145 (mon.0) 784 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624129 | 2024-03-26 20:33:00 | 2024-03-26 21:04:21 | 2024-03-26 22:23:16 | 1:18:55 | 1:09:03 | 0:09:52 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T21:30:30.725236+0000 mon.a (mon.0) 835 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624130 | 2024-03-26 20:33:01 | 2024-03-26 21:04:21 | 2024-03-26 21:36:39 | 0:32:18 | 0:21:49 | 0:10:29 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:30:43.564924+0000 mon.smithi022 (mon.0) 783 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624131 | 2024-03-26 20:33:02 | 2024-03-26 21:05:12 | 2024-03-26 21:36:54 | 0:31:42 | 0:21:54 | 0:09:48 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-26T21:31:17.563267+0000 mon.smithi136 (mon.0) 768 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624132 | 2024-03-26 20:33:04 | 2024-03-26 21:05:12 | 2024-03-26 21:42:23 | 0:37:11 | 0:25:35 | 0:11:36 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T21:30:05.309045+0000 mon.a (mon.0) 661 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7624133 | 2024-03-26 20:33:05 | 2024-03-26 21:05:12 | 2024-03-26 21:21:53 | 0:16:41 | 0:06:37 | 0:10:04 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} | 1 | |
fail | 7624134 | 2024-03-26 20:33:06 | 2024-03-26 21:05:13 | 2024-03-26 21:46:21 | 0:41:08 | 0:32:34 | 0:08:34 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711488762.4052248 mon.smithi012 (mon.0) 935 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624135 | 2024-03-26 20:33:08 | 2024-03-26 21:05:13 | 2024-03-26 21:28:02 | 0:22:49 | 0:14:07 | 0:08:42 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} | 1 | |
Failure Reason:
"2024-03-26T21:26:27.001637+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
pass | 7624136 | 2024-03-26 20:33:09 | 2024-03-26 21:05:14 | 2024-03-26 21:30:54 | 0:25:40 | 0:16:11 | 0:09:29 | smithi | main | ubuntu | 22.04 | orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} | 2 | |
fail | 7624137 | 2024-03-26 20:33:10 | 2024-03-26 21:05:14 | 2024-03-26 21:26:19 | 0:21:05 | 0:11:28 | 0:09:37 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T21:23:09.178042+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
pass | 7624138 | 2024-03-26 20:33:11 | 2024-03-26 21:05:14 | 2024-03-26 21:32:15 | 0:27:01 | 0:16:57 | 0:10:04 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 | |
fail | 7624139 | 2024-03-26 20:33:13 | 2024-03-26 21:05:15 | 2024-03-26 21:31:11 | 0:25:56 | 0:13:12 | 0:12:44 | smithi | main | centos | 9.stream | orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} | 1 | |
Failure Reason:
"2024-03-26T21:25:21.895727+0000 mon.smithi184 (mon.0) 242 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624140 | 2024-03-26 20:33:14 | 2024-03-26 21:08:05 | 2024-03-26 21:40:13 | 0:32:08 | 0:18:34 | 0:13:34 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-26T21:29:14.824657+0000 mon.a (mon.0) 393 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624141 | 2024-03-26 20:33:15 | 2024-03-26 21:10:36 | 2024-03-26 22:13:33 | 1:02:57 | 0:53:10 | 0:09:47 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 | |
Failure Reason:
"2024-03-26T21:26:13.266415+0000 mon.a (mon.0) 195 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624142 | 2024-03-26 20:33:17 | 2024-03-26 21:10:36 | 2024-03-26 21:47:33 | 0:36:57 | 0:15:35 | 0:21:22 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:39:51.144356+0000 mon.smithi031 (mon.0) 572 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624143 | 2024-03-26 20:33:18 | 2024-03-26 21:20:18 | 2024-03-26 21:45:30 | 0:25:12 | 0:15:21 | 0:09:51 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-26T21:40:12.226846+0000 mon.a (mon.0) 664 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624144 | 2024-03-26 20:33:20 | 2024-03-26 21:20:38 | 2024-03-26 22:03:59 | 0:43:21 | 0:32:27 | 0:10:54 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-26T21:44:29.334225+0000 mon.a (mon.0) 645 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7624145 | 2024-03-26 20:33:21 | 2024-03-26 21:20:39 | 2024-03-26 22:25:29 | 1:04:50 | 0:53:02 | 0:11:48 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T21:48:27.232463+0000 mon.a (mon.0) 960 : cluster [WRN] Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624146 | 2024-03-26 20:33:22 | 2024-03-26 21:20:39 | 2024-03-26 21:45:45 | 0:25:06 | 0:14:03 | 0:11:03 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} | 2 | |
Failure Reason:
"2024-03-26T21:40:42.930071+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624147 | 2024-03-26 20:33:24 | 2024-03-26 21:20:50 | 2024-03-26 21:54:02 | 0:33:12 | 0:22:13 | 0:10:59 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:49:04.680646+0000 mon.smithi053 (mon.0) 804 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624148 | 2024-03-26 20:33:25 | 2024-03-26 21:20:50 | 2024-03-26 21:47:12 | 0:26:22 | 0:14:17 | 0:12:05 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |
Failure Reason:
"2024-03-26T21:43:57.795378+0000 mon.smithi111 (mon.0) 798 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624149 | 2024-03-26 20:33:26 | 2024-03-26 21:20:51 | 2024-03-26 22:11:20 | 0:50:29 | 0:40:02 | 0:10:27 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7624150 | 2024-03-26 20:33:28 | 2024-03-26 21:20:51 | 2024-03-26 21:45:28 | 0:24:37 | 0:15:29 | 0:09:08 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:40:31.128482+0000 mon.smithi007 (mon.0) 794 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624151 | 2024-03-26 20:33:29 | 2024-03-26 21:20:51 | 2024-03-26 22:05:15 | 0:44:24 | 0:32:58 | 0:11:26 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-26T21:43:50.572555+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624152 | 2024-03-26 20:33:30 | 2024-03-26 21:20:52 | 2024-03-26 21:55:25 | 0:34:33 | 0:23:33 | 0:11:00 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-26T21:52:23.851939+0000 mon.a (mon.0) 641 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624153 | 2024-03-26 20:33:31 | 2024-03-26 21:20:52 | 2024-03-26 21:47:38 | 0:26:46 | 0:17:20 | 0:09:26 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-26T21:44:29.421261+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624154 | 2024-03-26 20:33:33 | 2024-03-26 21:20:52 | 2024-03-26 21:45:08 | 0:24:16 | 0:13:22 | 0:10:54 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T21:42:38.782478+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624155 | 2024-03-26 20:33:34 | 2024-03-26 21:20:53 | 2024-03-26 21:48:58 | 0:28:05 | 0:17:28 | 0:10:37 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:43:36.041210+0000 mon.smithi089 (mon.0) 835 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7624156 | 2024-03-26 20:33:35 | 2024-03-26 21:20:53 | 2024-03-26 22:19:07 | 0:58:14 | 0:48:38 | 0:09:36 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-26T21:55:05.805962+0000 mon.a (mon.0) 918 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624157 | 2024-03-26 20:33:37 | 2024-03-26 21:20:53 | 2024-03-26 21:57:20 | 0:36:27 | 0:26:10 | 0:10:17 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T21:46:43.154891+0000 mon.a (mon.0) 667 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624158 | 2024-03-26 20:33:38 | 2024-03-26 21:20:54 | 2024-03-26 21:45:19 | 0:24:25 | 0:13:53 | 0:10:32 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-26T21:39:44.645346+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624159 | 2024-03-26 20:33:39 | 2024-03-26 21:20:54 | 2024-03-26 21:57:25 | 0:36:31 | 0:25:10 | 0:11:21 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:49:10.654887+0000 mon.smithi112 (mon.0) 774 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624160 | 2024-03-26 20:33:41 | 2024-03-26 21:20:55 | 2024-03-26 21:47:32 | 0:26:37 | 0:14:12 | 0:12:25 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-26T21:43:34.380760+0000 mon.smithi131 (mon.0) 799 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624161 | 2024-03-26 20:33:42 | 2024-03-26 21:20:55 | 2024-03-26 22:05:16 | 0:44:21 | 0:32:40 | 0:11:41 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711489825.3655252 mon.smithi148 (mon.0) 913 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7624162 | 2024-03-26 20:33:43 | 2024-03-26 21:20:55 | 2024-03-26 21:49:18 | 0:28:23 | 0:15:32 | 0:12:51 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:41:57.797436+0000 mon.smithi049 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624163 | 2024-03-26 20:33:45 | 2024-03-26 21:20:56 | 2024-03-26 21:42:36 | 0:21:40 | 0:11:57 | 0:09:43 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-26T21:40:07.266504+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624164 | 2024-03-26 20:33:46 | 2024-03-26 21:20:56 | 2024-03-26 22:10:19 | 0:49:23 | 0:37:49 | 0:11:34 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-26T21:43:34.697192+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7624165 | 2024-03-26 20:33:47 | 2024-03-26 21:21:46 | 2024-03-26 21:59:16 | 0:37:30 | 0:25:34 | 0:11:56 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-26T21:46:46.106281+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624166 | 2024-03-26 20:33:49 | 2024-03-26 21:23:07 | 2024-03-26 22:15:59 | 0:52:52 | 0:35:18 | 0:17:34 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T21:54:33.074133+0000 mon.a (mon.0) 833 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624167 | 2024-03-26 20:33:50 | 2024-03-26 21:27:38 | 2024-03-26 22:34:04 | 1:06:26 | 0:53:00 | 0:13:26 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T21:56:44.324087+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624168 | 2024-03-26 20:33:51 | 2024-03-26 21:30:59 | 2024-03-26 22:08:37 | 0:37:38 | 0:20:33 | 0:17:05 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-26T21:58:10.528752+0000 mon.a (mon.0) 209 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7624169 | 2024-03-26 20:33:53 | 2024-03-26 21:36:10 | 2024-03-26 22:02:12 | 0:26:02 | 0:15:21 | 0:10:41 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:57:51.164031+0000 mon.smithi098 (mon.0) 785 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7624170 | 2024-03-26 20:33:54 | 2024-03-26 21:36:10 | 2024-03-26 22:25:20 | 0:49:10 | 0:37:38 | 0:11:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-26T22:02:00.555410+0000 mon.a (mon.0) 244 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log |
||||||||||||||
fail | 7624171 | 2024-03-26 20:33:55 | 2024-03-26 21:36:11 | 2024-03-26 22:07:22 | 0:31:11 | 0:18:28 | 0:12:43 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T22:02:14.228107+0000 mon.a (mon.0) 247 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624172 | 2024-03-26 20:33:57 | 2024-03-26 21:36:11 | 2024-03-26 22:08:53 | 0:32:42 | 0:22:14 | 0:10:28 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-26T22:01:26.885679+0000 mon.smithi121 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624173 | 2024-03-26 20:33:58 | 2024-03-26 22:19:45 | 2043 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 | ||||
Failure Reason:
"2024-03-26T21:58:47.110603+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7624174 | 2024-03-26 20:33:59 | 2024-03-26 21:36:12 | 2024-03-26 22:06:32 | 0:30:20 | 0:20:16 | 0:10:04 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-26T22:00:47.484333+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7624175 | 2024-03-26 20:34:01 | 2024-03-26 21:36:12 | 2024-03-26 22:09:08 | 0:32:56 | 0:21:40 | 0:11:16 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-26T22:03:47.403535+0000 mon.smithi082 (mon.0) 765 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7624176 | 2024-03-26 20:34:02 | 2024-03-26 21:36:13 | 2024-03-26 22:12:35 | 0:36:22 | 0:24:41 | 0:11:41 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed on smithi196 with status 5: 'sudo systemctl stop ceph-2f9b9224-ebbb-11ee-95d0-87774f69a715@mon.smithi196' |
||||||||||||||
fail | 7624177 | 2024-03-26 20:34:03 | 2024-03-26 21:36:13 | 2024-03-26 22:00:37 | 0:24:24 | 0:14:16 | 0:10:08 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:57:33.078598+0000 mon.smithi045 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624178 | 2024-03-26 20:34:05 | 2024-03-26 21:36:13 | 2024-03-26 22:46:43 | 1:10:30 | 0:59:24 | 0:11:06 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-26T22:02:14.249622+0000 mon.a (mon.0) 882 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7624179 | 2024-03-26 20:34:06 | 2024-03-26 21:36:14 | 2024-03-26 22:05:21 | 0:29:07 | 0:18:31 | 0:10:36 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T21:57:21.024273+0000 mon.smithi029 (mon.0) 807 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7624180 | 2024-03-26 20:34:07 | 2024-03-26 21:36:14 | 2024-03-26 22:12:06 | 0:35:52 | 0:24:58 | 0:10:54 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T22:00:00.942201+0000 mon.a (mon.0) 580 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
pass | 7624181 | 2024-03-26 20:34:09 | 2024-03-26 21:36:14 | 2024-03-26 22:04:32 | 0:28:18 | 0:17:27 | 0:10:51 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} | 3 | |
pass | 7624182 | 2024-03-26 20:34:10 | 2024-03-26 22:07:42 | 1304 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 |