User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
adking | 2024-03-26 01:50:53 | 2024-03-26 01:52:15 | 2024-03-26 15:08:45 | 13:16:30 | orch:cephadm | wip-adk-testing-2024-03-25-1628 | smithi | e42b8ea | 17 | 79 | 2 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 7622356 | 2024-03-26 01:50:59 | 2024-03-26 01:52:15 | 2024-03-26 02:24:43 | 0:32:28 | 0:21:33 | 0:10:55 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:18:47.148265+0000 mon.smithi118 (mon.0) 780 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622357 | 2024-03-26 01:51:01 | 2024-03-26 01:52:15 | 2024-03-26 02:20:25 | 0:28:10 | 0:17:55 | 0:10:15 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-26T02:14:48.048351+0000 mon.a (mon.0) 380 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622358 | 2024-03-26 01:51:03 | 2024-03-26 01:53:16 | 2024-03-26 02:37:14 | 0:43:58 | 0:32:37 | 0:11:21 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711419753.0212104 mon.smithi063 (mon.0) 905 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622359 | 2024-03-26 01:51:04 | 2024-03-26 01:53:46 | 2024-03-26 02:41:17 | 0:47:31 | 0:34:44 | 0:12:47 | smithi | main | centos | 9.stream | orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 | |
Failure Reason:
"2024-03-26T02:22:21.808791+0000 mon.smithi136 (mon.0) 879 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622360 | 2024-03-26 01:51:05 | 2024-03-26 01:55:57 | 2024-03-26 02:41:25 | 0:45:28 | 0:35:09 | 0:10:19 | smithi | main | centos | 9.stream | orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} | 1 | |
Failure Reason:
"2024-03-26T02:17:06.454878+0000 mon.a (mon.0) 613 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622361 | 2024-03-26 01:51:07 | 2024-03-26 01:55:57 | 2024-03-26 02:19:49 | 0:23:52 | 0:13:38 | 0:10:14 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-26T02:15:53.475511+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7622362 | 2024-03-26 01:51:08 | 2024-03-26 01:56:08 | 2024-03-26 02:16:52 | 0:20:44 | 0:12:13 | 0:08:31 | smithi | main | centos | 9.stream | orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} | 2 | |
fail | 7622363 | 2024-03-26 01:51:09 | 2024-03-26 01:56:08 | 2024-03-26 02:33:40 | 0:37:32 | 0:26:22 | 0:11:10 | smithi | main | centos | 9.stream | orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} | 3 | |
Failure Reason:
"2024-03-26T02:12:44.763911+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7622364 | 2024-03-26 01:51:11 | 2024-03-26 01:57:49 | 2024-03-26 02:21:17 | 0:23:28 | 0:13:38 | 0:09:50 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T02:18:31.291118+0000 mon.a (mon.0) 289 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7622365 | 2024-03-26 01:51:12 | 2024-03-26 01:57:59 | 2024-03-26 02:25:39 | 0:27:40 | 0:17:58 | 0:09:42 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:17:52.860672+0000 mon.smithi029 (mon.0) 742 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
pass | 7622366 | 2024-03-26 01:51:13 | 2024-03-26 01:58:00 | 2024-03-26 02:19:08 | 0:21:08 | 0:11:23 | 0:09:45 | smithi | main | centos | 9.stream | orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} | 1 | |
fail | 7622367 | 2024-03-26 01:51:15 | 2024-03-26 01:58:00 | 2024-03-26 02:27:32 | 0:29:32 | 0:12:15 | 0:17:17 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-26T02:24:04.465211+0000 mon.a (mon.0) 443 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622368 | 2024-03-26 01:51:16 | 2024-03-26 02:03:01 | 2024-03-26 03:02:14 | 0:59:13 | 0:48:26 | 0:10:47 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 | |
Failure Reason:
"2024-03-26T02:31:54.373419+0000 mon.a (mon.0) 968 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622369 | 2024-03-26 01:51:17 | 2024-03-26 02:03:01 | 2024-03-26 02:49:47 | 0:46:46 | 0:36:35 | 0:10:11 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T02:24:33.640311+0000 mon.a (mon.0) 553 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7622370 | 2024-03-26 01:51:19 | 2024-03-26 02:03:02 | 2024-03-26 02:35:59 | 0:32:57 | 0:22:57 | 0:10:00 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-26T02:30:00.000194+0000 mon.a (mon.0) 1104 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
fail | 7622371 | 2024-03-26 01:51:20 | 2024-03-26 02:03:02 | 2024-03-26 02:27:53 | 0:24:51 | 0:15:11 | 0:09:40 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-26T02:23:44.949061+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7622372 | 2024-03-26 01:51:21 | 2024-03-26 02:03:02 | 2024-03-26 02:28:02 | 0:25:00 | 0:16:38 | 0:08:22 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
fail | 7622373 | 2024-03-26 01:51:23 | 2024-03-26 02:03:03 | 2024-03-26 02:32:35 | 0:29:32 | 0:19:41 | 0:09:51 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-26T02:28:54.909915+0000 mon.smithi102 (mon.0) 775 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7622374 | 2024-03-26 01:51:24 | 2024-03-26 02:03:03 | 2024-03-26 02:35:50 | 0:32:47 | 0:22:21 | 0:10:26 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:31:06.239301+0000 mon.smithi055 (mon.0) 783 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622375 | 2024-03-26 01:51:25 | 2024-03-26 02:03:04 | 2024-03-26 02:38:44 | 0:35:40 | 0:26:08 | 0:09:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-26T02:25:19.334478+0000 mon.a (mon.0) 458 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622376 | 2024-03-26 01:51:27 | 2024-03-26 02:03:04 | 2024-03-26 02:38:48 | 0:35:44 | 0:25:17 | 0:10:27 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-26T02:26:57.882196+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622377 | 2024-03-26 01:51:28 | 2024-03-26 02:03:04 | 2024-03-26 03:24:56 | 1:21:52 | 1:06:34 | 0:15:18 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7622378 | 2024-03-26 01:51:29 | 2024-03-26 02:08:57 | 2024-03-26 02:37:11 | 0:28:14 | 0:15:07 | 0:13:07 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:30:15.733313+0000 mon.smithi053 (mon.0) 582 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622379 | 2024-03-26 01:51:31 | 2024-03-26 02:12:17 | 2024-03-26 02:54:16 | 0:41:59 | 0:25:04 | 0:16:55 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-26T02:45:29.777294+0000 mon.a (mon.0) 1024 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7622380 | 2024-03-26 01:51:32 | 2024-03-26 02:18:29 | 2024-03-26 02:39:23 | 0:20:54 | 0:11:41 | 0:09:13 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T02:35:55.424235+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622381 | 2024-03-26 01:51:33 | 2024-03-26 02:18:29 | 2024-03-26 02:46:05 | 0:27:36 | 0:17:28 | 0:10:08 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:38:56.834942+0000 mon.smithi044 (mon.0) 303 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7622382 | 2024-03-26 01:51:35 | 2024-03-26 02:18:29 | 2024-03-26 03:32:24 | 1:13:55 | 1:04:15 | 0:09:40 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-26T02:54:32.881453+0000 mon.a (mon.0) 1156 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL)" in cluster log |
||||||||||||||
fail | 7622383 | 2024-03-26 01:51:36 | 2024-03-26 02:18:30 | 2024-03-26 03:08:03 | 0:49:33 | 0:39:10 | 0:10:23 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-26T02:47:24.336858+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
pass | 7622384 | 2024-03-26 01:51:37 | 2024-03-26 02:18:30 | 2024-03-26 02:41:27 | 0:22:57 | 0:13:59 | 0:08:58 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} | 3 | |
fail | 7622385 | 2024-03-26 01:51:39 | 2024-03-26 02:18:30 | 2024-03-26 02:41:36 | 0:23:06 | 0:14:24 | 0:08:42 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-26T02:38:19.705736+0000 mon.smithi150 (mon.0) 781 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7622386 | 2024-03-26 01:51:40 | 2024-03-26 02:18:31 | 2024-03-26 02:48:13 | 0:29:42 | 0:20:03 | 0:09:39 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:43:48.615395+0000 mon.smithi080 (mon.0) 749 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622387 | 2024-03-26 01:51:42 | 2024-03-26 02:18:31 | 2024-03-26 03:03:43 | 0:45:12 | 0:34:51 | 0:10:21 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711421342.7324953 mon.smithi057 (mon.0) 903 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622388 | 2024-03-26 01:51:43 | 2024-03-26 02:18:31 | 2024-03-26 02:46:17 | 0:27:46 | 0:18:02 | 0:09:44 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:39:51.686531+0000 mon.smithi016 (mon.0) 807 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7622389 | 2024-03-26 01:51:44 | 2024-03-26 02:19:22 | 2024-03-26 02:58:02 | 0:38:40 | 0:24:53 | 0:13:47 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 3 | |
fail | 7622390 | 2024-03-26 01:51:46 | 2024-03-26 02:21:53 | 2024-03-26 03:15:42 | 0:53:49 | 0:43:43 | 0:10:06 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-26T02:41:08.515803+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622391 | 2024-03-26 01:51:47 | 2024-03-26 02:21:53 | 2024-03-26 02:53:09 | 0:31:16 | 0:16:03 | 0:15:13 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} | 3 | |
Failure Reason:
"2024-03-26T02:47:14.970452+0000 mon.a (mon.0) 374 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622392 | 2024-03-26 01:51:48 | 2024-03-26 02:28:04 | 2024-03-26 02:59:46 | 0:31:42 | 0:15:55 | 0:15:47 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:55:15.415165+0000 mon.smithi001 (mon.0) 826 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7622393 | 2024-03-26 01:51:49 | 2024-03-26 02:33:55 | 2024-03-26 02:55:26 | 0:21:31 | 0:12:49 | 0:08:42 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} | 1 | |
pass | 7622394 | 2024-03-26 01:51:51 | 2024-03-26 02:33:56 | 2024-03-26 02:58:21 | 0:24:25 | 0:13:13 | 0:11:12 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} | 2 | |
fail | 7622395 | 2024-03-26 01:51:52 | 2024-03-26 02:33:56 | 2024-03-26 03:04:38 | 0:30:42 | 0:18:59 | 0:11:43 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T03:00:13.399789+0000 mon.a (mon.0) 290 : cluster [WRN] Replacing daemon mds.cephfs.smithi031.okjpbc as rank 0 with standby daemon mds.cephfs.smithi031.nifdkr" in cluster log |
||||||||||||||
fail | 7622396 | 2024-03-26 01:51:53 | 2024-03-26 02:33:56 | 2024-03-26 03:00:16 | 0:26:20 | 0:15:19 | 0:11:01 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-26T02:53:01.265885+0000 mon.a (mon.0) 588 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7622397 | 2024-03-26 01:51:55 | 2024-03-26 02:33:57 | 2024-03-26 03:04:33 | 0:30:36 | 0:19:25 | 0:11:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} | 2 | |
fail | 7622398 | 2024-03-26 01:51:56 | 2024-03-26 02:33:57 | 2024-03-26 03:40:59 | 1:07:02 | 0:54:41 | 0:12:21 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-26T03:04:14.387440+0000 mon.a (mon.0) 1051 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7622399 | 2024-03-26 01:51:57 | 2024-03-26 02:33:58 | 2024-03-26 03:49:33 | 1:15:35 | 1:03:35 | 0:12:00 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T03:12:07.519796+0000 mon.a (mon.0) 1184 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
pass | 7622400 | 2024-03-26 01:51:59 | 2024-03-26 02:33:58 | 2024-03-26 02:56:26 | 0:22:28 | 0:12:08 | 0:10:20 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} | 2 | |
fail | 7622401 | 2024-03-26 01:52:00 | 2024-03-26 02:33:58 | 2024-03-26 03:50:59 | 1:17:01 | 1:07:09 | 0:09:52 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7622402 | 2024-03-26 01:52:01 | 2024-03-26 02:33:59 | 2024-03-26 03:00:20 | 0:26:21 | 0:14:01 | 0:12:20 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:54:54.200253+0000 mon.smithi113 (mon.0) 571 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622403 | 2024-03-26 01:52:03 | 2024-03-26 02:33:59 | 2024-03-26 03:01:30 | 0:27:31 | 0:17:16 | 0:10:15 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} | 1 | |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e42b8ea316eec6c6f4fae026f6d6b62fa5fe7003 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
fail | 7622404 | 2024-03-26 01:52:04 | 2024-03-26 02:33:59 | 2024-03-26 02:59:11 | 0:25:12 | 0:15:09 | 0:10:03 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 | |
Failure Reason:
"2024-03-26T02:55:03.454796+0000 mon.smithi029 (mon.0) 781 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622405 | 2024-03-26 01:52:05 | 2024-03-26 02:34:00 | 2024-03-26 03:06:32 | 0:32:32 | 0:20:57 | 0:11:35 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:01:21.795463+0000 mon.smithi102 (mon.0) 809 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622406 | 2024-03-26 01:52:06 | 2024-03-26 02:34:00 | 2024-03-26 03:03:25 | 0:29:25 | 0:19:45 | 0:09:40 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-26T02:56:09.941629+0000 mon.smithi047 (mon.0) 676 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7622407 | 2024-03-26 01:52:08 | 2024-03-26 02:34:00 | 2024-03-26 03:15:47 | 0:41:47 | 0:30:39 | 0:11:08 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T03:05:43.526091+0000 mon.a (mon.0) 1555 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log |
||||||||||||||
pass | 7622408 | 2024-03-26 01:52:09 | 2024-03-26 02:34:01 | 2024-03-26 03:10:21 | 0:36:20 | 0:23:29 | 0:12:51 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} | 2 | |
pass | 7622409 | 2024-03-26 01:52:10 | 2024-03-26 02:34:01 | 2024-03-26 02:49:39 | 0:15:38 | 0:06:33 | 0:09:05 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} | 1 | |
fail | 7622410 | 2024-03-26 01:52:12 | 2024-03-26 02:34:01 | 2024-03-26 03:21:50 | 0:47:49 | 0:34:04 | 0:13:45 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711422356.7341175 mon.smithi006 (mon.0) 937 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622411 | 2024-03-26 01:52:13 | 2024-03-26 02:34:12 | 2024-03-26 03:06:45 | 0:32:33 | 0:14:33 | 0:18:00 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} | 1 | |
Failure Reason:
"2024-03-26T03:04:16.895658+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
pass | 7622412 | 2024-03-26 01:52:14 | 2024-03-26 02:41:48 | 2024-03-26 03:14:26 | 0:32:38 | 0:14:50 | 0:17:48 | smithi | main | ubuntu | 22.04 | orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} | 2 | |
fail | 7622413 | 2024-03-26 01:52:16 | 2024-03-26 02:49:20 | 2024-03-26 03:10:16 | 0:20:56 | 0:11:05 | 0:09:51 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T03:06:17.494462+0000 mon.a (mon.0) 280 : cluster [WRN] Health check failed: Degraded data redundancy: 21/63 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
pass | 7622414 | 2024-03-26 01:52:17 | 2024-03-26 02:49:20 | 2024-03-26 03:16:00 | 0:26:40 | 0:14:31 | 0:12:09 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 | |
fail | 7622415 | 2024-03-26 01:52:18 | 2024-03-26 02:49:20 | 2024-03-26 03:14:06 | 0:24:46 | 0:13:01 | 0:11:45 | smithi | main | centos | 9.stream | orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} | 1 | |
Failure Reason:
"2024-03-26T03:10:04.433939+0000 mon.smithi016 (mon.0) 444 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622416 | 2024-03-26 01:52:19 | 2024-03-26 02:49:21 | 2024-03-26 03:13:40 | 0:24:19 | 0:12:12 | 0:12:07 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-26T03:08:39.604331+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622417 | 2024-03-26 01:52:21 | 2024-03-26 02:49:21 | 2024-03-26 03:50:16 | 1:00:55 | 0:51:06 | 0:09:49 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 | |
Failure Reason:
"2024-03-26T03:05:28.007053+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622418 | 2024-03-26 01:52:22 | 2024-03-26 02:49:21 | 2024-03-26 03:14:11 | 0:24:50 | 0:15:17 | 0:09:33 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:07:12.365442+0000 mon.smithi003 (mon.0) 588 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622419 | 2024-03-26 01:52:23 | 2024-03-26 02:49:22 | 2024-03-26 03:18:28 | 0:29:06 | 0:18:57 | 0:10:09 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-26T03:09:03.586293+0000 mon.a (mon.0) 658 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622420 | 2024-03-26 01:52:25 | 2024-03-26 02:49:22 | 2024-03-26 03:17:18 | 0:27:56 | 0:18:36 | 0:09:20 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} | 2 | |
Failure Reason:
"2024-03-26T03:15:43.327378+0000 mon.a (mon.0) 52 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622421 | 2024-03-26 01:52:26 | 2024-03-26 02:49:22 | 2024-03-26 03:21:46 | 0:32:24 | 0:21:55 | 0:10:29 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:16:37.500334+0000 mon.smithi046 (mon.0) 794 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622422 | 2024-03-26 01:52:27 | 2024-03-26 02:49:23 | 2024-03-26 03:15:16 | 0:25:53 | 0:13:53 | 0:12:00 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |
Failure Reason:
"2024-03-26T03:11:07.081175+0000 mon.smithi073 (mon.0) 793 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7622423 | 2024-03-26 01:52:29 | 2024-03-26 02:49:23 | 2024-03-26 03:41:36 | 0:52:13 | 0:40:08 | 0:12:05 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7622424 | 2024-03-26 01:52:30 | 2024-03-26 02:49:23 | 2024-03-26 03:19:19 | 0:29:56 | 0:17:51 | 0:12:05 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:13:37.937447+0000 mon.smithi088 (mon.0) 794 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622425 | 2024-03-26 01:52:31 | 2024-03-26 02:49:24 | 2024-03-26 03:49:52 | 1:00:28 | 0:49:01 | 0:11:27 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-26T03:29:34.546566+0000 mon.a (mon.0) 1316 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
pass | 7622426 | 2024-03-26 01:52:32 | 2024-03-26 02:49:24 | 2024-03-26 03:25:21 | 0:35:57 | 0:23:37 | 0:12:20 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys} | 2 | |
fail | 7622427 | 2024-03-26 01:52:34 | 2024-03-26 02:49:35 | 2024-03-26 03:24:40 | 0:35:05 | 0:23:01 | 0:12:04 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-26T03:21:13.143447+0000 mon.a (mon.0) 639 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7622428 | 2024-03-26 01:52:35 | 2024-03-26 02:49:35 | 2024-03-26 03:13:06 | 0:23:31 | 0:13:09 | 0:10:22 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-26T03:10:12.699745+0000 mon.a (mon.0) 464 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7622429 | 2024-03-26 01:52:36 | 2024-03-26 02:49:35 | 2024-03-26 03:15:18 | 0:25:43 | 0:15:43 | 0:10:00 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} | 2 | |
Failure Reason:
"2024-03-26T03:12:52.018644+0000 mon.a (mon.0) 277 : cluster [WRN] Health check failed: Degraded data redundancy: 22/66 objects degraded (33.333%), 10 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7622430 | 2024-03-26 01:52:38 | 2024-03-26 02:49:36 | 2024-03-26 03:23:17 | 0:33:41 | 0:22:53 | 0:10:48 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:16:52.024935+0000 mon.smithi080 (mon.0) 880 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
dead | 7622431 | 2024-03-26 01:52:39 | 2024-03-26 02:49:36 | 2024-03-26 14:58:11 | 12:08:35 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7622432 | 2024-03-26 01:52:40 | 2024-03-26 02:49:46 | 2024-03-26 03:30:55 | 0:41:09 | 0:23:15 | 0:17:54 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:23:05.433132+0000 mon.smithi043 (mon.0) 820 : cluster [WRN] Replacing daemon mds.foofs.smithi118.vsrsbe as rank 0 with standby daemon mds.foofs.smithi043.oqleun" in cluster log |
||||||||||||||
dead | 7622433 | 2024-03-26 01:52:42 | 2024-03-26 02:56:28 | 2024-03-26 15:08:45 | 12:12:17 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7622434 | 2024-03-26 01:52:43 | 2024-03-26 02:58:08 | 2024-03-26 03:45:28 | 0:47:20 | 0:36:42 | 0:10:38 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1711423825.5449877 mon.smithi067 (mon.0) 915 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622435 | 2024-03-26 01:52:45 | 2024-03-26 02:58:09 | 2024-03-26 03:29:38 | 0:31:29 | 0:15:48 | 0:15:41 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:24:21.003115+0000 mon.smithi119 (mon.0) 791 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622436 | 2024-03-26 01:52:46 | 2024-03-26 02:58:29 | 2024-03-26 03:25:45 | 0:27:16 | 0:11:35 | 0:15:41 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-26T03:22:40.746736+0000 mon.a (mon.0) 429 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622437 | 2024-03-26 01:52:47 | 2024-03-26 03:10:29 | 2024-03-26 04:02:03 | 0:51:34 | 0:38:01 | 0:13:33 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-26T03:46:24.067027+0000 mon.a (mon.0) 1012 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7622438 | 2024-03-26 01:52:49 | 2024-03-26 03:13:50 | 2024-03-26 03:49:53 | 0:36:03 | 0:26:21 | 0:09:42 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-26T03:35:26.332589+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622439 | 2024-03-26 01:52:50 | 2024-03-26 03:14:30 | 2024-03-26 04:32:39 | 1:18:09 | 1:06:58 | 0:11:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-26T03:49:54.631194+0000 mon.a (mon.0) 1286 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL)" in cluster log |
||||||||||||||
fail | 7622440 | 2024-03-26 01:52:51 | 2024-03-26 03:14:51 | 2024-03-26 04:26:36 | 1:11:45 | 1:01:06 | 0:10:39 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-26T03:50:00.000143+0000 mon.a (mon.0) 1382 : cluster [WRN] Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 5 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
pass | 7622441 | 2024-03-26 01:52:52 | 2024-03-26 03:15:02 | 2024-03-26 03:45:40 | 0:30:38 | 0:18:51 | 0:11:47 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} | 3 | |
fail | 7622442 | 2024-03-26 01:52:54 | 2024-03-26 03:16:02 | 2024-03-26 03:41:17 | 0:25:15 | 0:14:56 | 0:10:19 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:35:57.879535+0000 mon.smithi045 (mon.0) 789 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7622443 | 2024-03-26 01:52:55 | 2024-03-26 03:16:23 | 2024-03-26 04:07:00 | 0:50:37 | 0:37:40 | 0:12:57 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-26T03:51:43.174294+0000 mon.a (mon.0) 833 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7622444 | 2024-03-26 01:52:56 | 2024-03-26 03:18:44 | 2024-03-26 03:47:09 | 0:28:25 | 0:18:15 | 0:10:10 | smithi | main | ubuntu | 22.04 | orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} | 2 | |
Failure Reason:
"2024-03-26T03:43:19.175864+0000 mon.a (mon.0) 291 : cluster [WRN] Replacing daemon mds.cephfs.smithi037.blrdoq as rank 0 with standby daemon mds.cephfs.smithi037.abwhjt" in cluster log |
||||||||||||||
pass | 7622445 | 2024-03-26 01:52:58 | 2024-03-26 03:19:34 | 2024-03-26 03:50:34 | 0:31:00 | 0:20:16 | 0:10:44 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
fail | 7622446 | 2024-03-26 01:52:59 | 2024-03-26 03:20:15 | 2024-03-26 03:50:50 | 0:30:35 | 0:20:03 | 0:10:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-26T03:45:10.096198+0000 mon.a (mon.0) 451 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7622447 | 2024-03-26 01:53:00 | 2024-03-26 03:20:15 | 2024-03-26 03:54:53 | 0:34:38 | 0:22:26 | 0:12:12 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-26T03:45:25.209989+0000 mon.smithi044 (mon.0) 564 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622448 | 2024-03-26 01:53:01 | 2024-03-26 03:20:15 | 2024-03-26 04:08:19 | 0:48:04 | 0:38:10 | 0:09:54 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7622449 | 2024-03-26 01:53:03 | 2024-03-26 03:20:16 | 2024-03-26 03:45:10 | 0:24:54 | 0:14:38 | 0:10:16 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:40:55.435988+0000 mon.smithi003 (mon.0) 767 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622450 | 2024-03-26 01:53:04 | 2024-03-26 03:20:16 | 2024-03-26 03:48:03 | 0:27:47 | 0:18:27 | 0:09:20 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-26T03:41:42.502440+0000 mon.smithi121 (mon.0) 802 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7622451 | 2024-03-26 01:53:05 | 2024-03-26 03:20:16 | 2024-03-26 04:47:23 | 1:27:07 | 1:16:45 | 0:10:22 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-26T04:02:29.491553+0000 mon.a (mon.0) 1430 : cluster [ERR] Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL)" in cluster log |
||||||||||||||
fail | 7622452 | 2024-03-26 01:53:06 | 2024-03-26 03:20:17 | 2024-03-26 03:52:55 | 0:32:38 | 0:23:10 | 0:09:28 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-26T03:50:00.000078+0000 mon.a (mon.0) 1374 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
pass | 7622453 | 2024-03-26 01:53:08 | 2024-03-26 03:20:17 | 2024-03-26 03:48:28 | 0:28:11 | 0:17:15 | 0:10:56 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} | 3 |