User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
gabrioux | 2024-03-20 19:16:31 | 2024-03-20 19:18:07 | 2024-03-21 08:12:45 | 12:54:38 | orch:cephadm | wip-guits-testing-2024-03-20-1259 | smithi | 4181a8d | 18 | 81 | 2 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 7613410 | 2024-03-20 19:16:54 | 2024-03-20 19:18:05 | 2024-03-20 19:50:57 | 0:32:52 | 0:22:51 | 0:10:01 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 | |
fail | 7613411 | 2024-03-20 19:16:55 | 2024-03-20 19:18:06 | 2024-03-20 19:45:21 | 0:27:15 | 0:16:06 | 0:11:09 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-20T19:39:41.259995+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613412 | 2024-03-20 19:16:57 | 2024-03-20 19:18:06 | 2024-03-20 20:00:59 | 0:42:53 | 0:32:55 | 0:09:58 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1710963960.5126908 mon.smithi114 (mon.0) 914 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613413 | 2024-03-20 19:16:58 | 2024-03-20 19:18:06 | 2024-03-20 20:03:51 | 0:45:45 | 0:34:41 | 0:11:04 | smithi | main | centos | 9.stream | orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 | |
Failure Reason:
"2024-03-20T19:38:04.849120+0000 mon.smithi086 (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7613414 | 2024-03-20 19:17:00 | 2024-03-20 19:18:07 | 2024-03-20 20:02:45 | 0:44:38 | 0:35:42 | 0:08:56 | smithi | main | centos | 9.stream | orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} | 1 | |
Failure Reason:
"2024-03-20T19:36:53.105480+0000 mon.a (mon.0) 270 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613415 | 2024-03-20 19:17:01 | 2024-03-20 19:18:07 | 2024-03-20 19:42:32 | 0:24:25 | 0:13:52 | 0:10:33 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-20T19:39:55.596274+0000 mon.a (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7613416 | 2024-03-20 19:17:03 | 2024-03-20 19:18:07 | 2024-03-20 19:41:22 | 0:23:15 | 0:12:58 | 0:10:17 | smithi | main | centos | 9.stream | orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} | 2 | |
pass | 7613417 | 2024-03-20 19:17:04 | 2024-03-20 19:18:08 | 2024-03-20 19:58:53 | 0:40:45 | 0:28:23 | 0:12:22 | smithi | main | centos | 9.stream | orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} | 3 | |
fail | 7613418 | 2024-03-20 19:17:06 | 2024-03-20 19:19:48 | 2024-03-20 19:48:32 | 0:28:44 | 0:16:38 | 0:12:06 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-20T19:41:43.085226+0000 mon.smithi097 (mon.0) 826 : cluster [WRN] Health check failed: Failed to place 2 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
pass | 7613419 | 2024-03-20 19:17:07 | 2024-03-20 19:21:19 | 2024-03-20 19:51:41 | 0:30:22 | 0:18:44 | 0:11:38 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} | 1 | |
fail | 7613420 | 2024-03-20 19:17:08 | 2024-03-20 19:23:30 | 2024-03-20 19:45:13 | 0:21:43 | 0:11:22 | 0:10:21 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-20T19:42:26.927952+0000 mon.a (mon.0) 446 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613421 | 2024-03-20 19:17:10 | 2024-03-20 19:24:10 | 2024-03-20 20:29:18 | 1:05:08 | 0:54:08 | 0:11:00 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-20T19:49:09.845857+0000 mon.a (mon.0) 824 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7613422 | 2024-03-20 19:17:11 | 2024-03-20 19:24:11 | 2024-03-20 20:23:11 | 0:59:00 | 0:47:42 | 0:11:18 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 | |
Failure Reason:
"2024-03-20T19:44:22.796730+0000 mon.a (mon.0) 473 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7613423 | 2024-03-20 19:17:12 | 2024-03-20 19:25:51 | 2024-03-20 20:04:14 | 0:38:23 | 0:25:58 | 0:12:25 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-20T19:52:36.503230+0000 mon.a (mon.0) 647 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613424 | 2024-03-20 19:17:14 | 2024-03-20 19:26:32 | 2024-03-20 19:49:21 | 0:22:49 | 0:13:18 | 0:09:31 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-20T19:45:32.413303+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7613425 | 2024-03-20 19:17:15 | 2024-03-20 19:26:32 | 2024-03-20 19:59:37 | 0:33:05 | 0:19:43 | 0:13:22 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
fail | 7613426 | 2024-03-20 19:17:17 | 2024-03-20 19:28:43 | 2024-03-20 19:58:47 | 0:30:04 | 0:19:37 | 0:10:27 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-20T19:55:35.236118+0000 mon.smithi107 (mon.0) 756 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613427 | 2024-03-20 19:17:18 | 2024-03-20 19:28:43 | 2024-03-20 20:02:43 | 0:34:00 | 0:20:32 | 0:13:28 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-20T19:56:32.396221+0000 mon.smithi045 (mon.0) 746 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613428 | 2024-03-20 19:17:19 | 2024-03-20 19:30:54 | 2024-03-20 20:06:34 | 0:35:40 | 0:25:56 | 0:09:44 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-20T19:52:01.598098+0000 mon.a (mon.0) 366 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613429 | 2024-03-20 19:17:21 | 2024-03-20 19:30:54 | 2024-03-20 20:15:42 | 0:44:48 | 0:33:08 | 0:11:40 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-20T19:59:31.598300+0000 mon.a (mon.0) 809 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613430 | 2024-03-20 19:17:22 | 2024-03-20 19:32:55 | 2024-03-20 20:44:59 | 1:12:04 | 1:02:05 | 0:09:59 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-20T19:56:00.822081+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613431 | 2024-03-20 19:17:23 | 2024-03-20 19:32:55 | 2024-03-20 20:10:27 | 0:37:32 | 0:25:59 | 0:11:33 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-20T19:57:45.398206+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613432 | 2024-03-20 19:17:25 | 2024-03-20 19:32:55 | 2024-03-20 20:56:25 | 1:23:30 | 1:12:27 | 0:11:03 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7613433 | 2024-03-20 19:17:26 | 2024-03-20 19:32:56 | 2024-03-20 19:55:56 | 0:23:00 | 0:14:04 | 0:08:56 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-20T19:52:44.317110+0000 mon.smithi089 (mon.0) 776 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7613434 | 2024-03-20 19:17:27 | 2024-03-20 19:32:56 | 2024-03-20 20:11:03 | 0:38:07 | 0:26:57 | 0:11:10 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-20T20:05:42.988990+0000 mon.a (mon.0) 1158 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log |
||||||||||||||
fail | 7613435 | 2024-03-20 19:17:29 | 2024-03-20 19:32:56 | 2024-03-20 19:58:07 | 0:25:11 | 0:14:42 | 0:10:29 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
Failure Reason:
"2024-03-20T19:53:57.135174+0000 mon.smithi029 (mon.0) 773 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613436 | 2024-03-20 19:17:30 | 2024-03-20 19:32:57 | 2024-03-20 20:08:09 | 0:35:12 | 0:24:23 | 0:10:49 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-20T20:00:00.000157+0000 mon.a (mon.0) 888 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
fail | 7613437 | 2024-03-20 19:17:31 | 2024-03-20 19:32:57 | 2024-03-20 19:58:59 | 0:26:02 | 0:16:13 | 0:09:49 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-20T19:55:12.712103+0000 mon.a (mon.0) 188 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7613438 | 2024-03-20 19:17:33 | 2024-03-20 19:33:08 | 2024-03-20 20:00:34 | 0:27:26 | 0:14:43 | 0:12:43 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-20T19:54:00.031582+0000 mon.smithi161 (mon.0) 704 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7613439 | 2024-03-20 19:17:34 | 2024-03-20 19:33:18 | 2024-03-20 20:06:04 | 0:32:46 | 0:20:14 | 0:12:32 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:02:25.412887+0000 mon.smithi001 (mon.0) 751 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613440 | 2024-03-20 19:17:35 | 2024-03-20 19:35:09 | 2024-03-20 20:41:35 | 1:06:26 | 0:49:10 | 0:17:16 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-20T20:03:17.357187+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613441 | 2024-03-20 19:17:37 | 2024-03-20 19:41:30 | 2024-03-20 20:23:30 | 0:42:00 | 0:31:19 | 0:10:41 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1710965407.1483743 mon.smithi028 (mon.0) 888 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7613442 | 2024-03-20 19:17:38 | 2024-03-20 19:42:20 | 2024-03-20 20:10:30 | 0:28:10 | 0:17:38 | 0:10:32 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
dead | 7613443 | 2024-03-20 19:17:39 | 2024-03-20 19:43:21 | 2024-03-21 07:53:58 | 12:10:37 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 3 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7613444 | 2024-03-20 19:17:41 | 2024-03-20 19:44:21 | 2024-03-20 20:38:42 | 0:54:21 | 0:42:40 | 0:11:41 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-20T20:06:34.402470+0000 mon.a (mon.0) 507 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613445 | 2024-03-20 19:17:42 | 2024-03-20 19:44:22 | 2024-03-20 20:21:43 | 0:37:21 | 0:23:54 | 0:13:27 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-20T20:07:20.387443+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613446 | 2024-03-20 19:17:43 | 2024-03-20 19:46:43 | 2024-03-20 20:14:05 | 0:27:22 | 0:15:52 | 0:11:30 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} | 3 | |
Failure Reason:
"2024-03-20T20:06:46.815434+0000 mon.a (mon.0) 245 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7613447 | 2024-03-20 19:17:45 | 2024-03-20 19:46:43 | 2024-03-20 20:15:04 | 0:28:21 | 0:15:35 | 0:12:46 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:09:23.608133+0000 mon.smithi023 (mon.0) 777 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7613448 | 2024-03-20 19:17:46 | 2024-03-20 19:46:53 | 2024-03-20 20:08:45 | 0:21:52 | 0:12:33 | 0:09:19 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} | 1 | |
fail | 7613449 | 2024-03-20 19:17:47 | 2024-03-20 19:46:54 | 2024-03-20 20:11:10 | 0:24:16 | 0:13:20 | 0:10:56 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} | 2 | |
Failure Reason:
"2024-03-20T20:08:14.064447+0000 mon.smithi033 (mon.0) 783 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613450 | 2024-03-20 19:17:49 | 2024-03-20 19:48:24 | 2024-03-20 20:15:39 | 0:27:15 | 0:16:09 | 0:11:06 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-20T20:06:27.821457+0000 mon.a (mon.0) 419 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7613451 | 2024-03-20 19:17:50 | 2024-03-20 19:48:24 | 2024-03-20 20:16:03 | 0:27:39 | 0:18:56 | 0:08:43 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} | 2 | |
fail | 7613452 | 2024-03-20 19:17:51 | 2024-03-20 19:48:25 | 2024-03-20 21:03:54 | 1:15:29 | 1:05:41 | 0:09:48 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-20T20:10:08.133337+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613453 | 2024-03-20 19:17:52 | 2024-03-20 19:48:25 | 2024-03-20 20:51:48 | 1:03:23 | 0:51:58 | 0:11:25 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-20T20:14:37.286053+0000 mon.a (mon.0) 943 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
pass | 7613454 | 2024-03-20 19:17:54 | 2024-03-20 19:48:36 | 2024-03-20 20:15:30 | 0:26:54 | 0:12:14 | 0:14:40 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} | 2 | |
fail | 7613455 | 2024-03-20 19:17:55 | 2024-03-20 19:48:36 | 2024-03-20 20:53:30 | 1:04:54 | 0:56:38 | 0:08:16 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
pass | 7613456 | 2024-03-20 19:17:56 | 2024-03-20 19:48:36 | 2024-03-20 20:14:13 | 0:25:37 | 0:13:40 | 0:11:57 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 | |
fail | 7613457 | 2024-03-20 19:17:58 | 2024-03-20 19:51:07 | 2024-03-20 20:38:45 | 0:47:38 | 0:32:44 | 0:14:54 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-20T20:17:34.173801+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613458 | 2024-03-20 19:17:59 | 2024-03-20 19:53:28 | 2024-03-20 20:21:09 | 0:27:41 | 0:17:30 | 0:10:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} | 1 | |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4181a8dbc90192a00ad0f45f1edafe51d2b53f07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
fail | 7613459 | 2024-03-20 19:18:00 | 2024-03-20 19:53:28 | 2024-03-20 20:19:42 | 0:26:14 | 0:14:22 | 0:11:52 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:16:44.748756+0000 mon.smithi017 (mon.0) 767 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613460 | 2024-03-20 19:18:01 | 2024-03-20 19:56:39 | 2024-03-20 21:07:37 | 1:10:58 | 1:00:58 | 0:10:00 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-20T20:20:30.803334+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7613461 | 2024-03-20 19:18:03 | 2024-03-20 19:56:39 | 2024-03-20 20:30:46 | 0:34:07 | 0:21:29 | 0:12:38 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:25:26.747269+0000 mon.smithi046 (mon.0) 803 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613462 | 2024-03-20 19:18:04 | 2024-03-20 19:59:00 | 2024-03-20 20:29:05 | 0:30:05 | 0:20:04 | 0:10:01 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-20T20:25:15.406051+0000 mon.smithi037 (mon.0) 757 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613463 | 2024-03-20 19:18:05 | 2024-03-20 20:34:30 | 1408 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} | 2 | ||||
Failure Reason:
"2024-03-20T20:22:45.629764+0000 mon.a (mon.0) 639 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7613464 | 2024-03-20 19:18:07 | 2024-03-20 20:01:31 | 2024-03-20 20:16:23 | 0:14:52 | 0:06:20 | 0:08:32 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} | 1 | |
fail | 7613465 | 2024-03-20 19:18:08 | 2024-03-20 20:01:31 | 2024-03-20 20:46:39 | 0:45:08 | 0:31:23 | 0:13:45 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1710966688.846076 mon.smithi039 (mon.0) 896 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613466 | 2024-03-20 19:18:09 | 2024-03-20 20:02:32 | 2024-03-20 20:27:49 | 0:25:17 | 0:14:03 | 0:11:14 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} | 1 | |
Failure Reason:
"2024-03-20T20:25:13.009058+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
pass | 7613467 | 2024-03-20 19:18:11 | 2024-03-20 20:02:32 | 2024-03-20 20:28:37 | 0:26:05 | 0:14:45 | 0:11:20 | smithi | main | ubuntu | 22.04 | orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} | 2 | |
pass | 7613468 | 2024-03-20 19:18:12 | 2024-03-20 20:03:53 | 2024-03-20 20:26:39 | 0:22:46 | 0:14:05 | 0:08:41 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 | |
fail | 7613469 | 2024-03-20 19:18:13 | 2024-03-20 20:03:53 | 2024-03-20 20:33:33 | 0:29:40 | 0:19:29 | 0:10:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} | 1 | |
Failure Reason:
"2024-03-20T20:29:16.134156+0000 mon.smithi173 (mon.0) 488 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613470 | 2024-03-20 19:18:15 | 2024-03-20 20:03:53 | 2024-03-20 20:25:04 | 0:21:11 | 0:12:03 | 0:09:08 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 3 | |
Failure Reason:
"2024-03-20T20:20:29.186409+0000 mon.a (mon.0) 384 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613471 | 2024-03-20 19:18:16 | 2024-03-20 20:03:54 | 2024-03-20 20:57:44 | 0:53:50 | 0:43:01 | 0:10:49 | smithi | main | centos | 9.stream | orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 | |
Failure Reason:
Command failed on smithi069 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9231578-e6f6-11ee-95c9-87774f69a715 -e sha1=4181a8dbc90192a00ad0f45f1edafe51d2b53f07 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' |
||||||||||||||
fail | 7613472 | 2024-03-20 19:18:17 | 2024-03-20 20:03:54 | 2024-03-20 20:28:50 | 0:24:56 | 0:15:29 | 0:09:27 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:24:04.411342+0000 mon.smithi007 (mon.0) 779 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613473 | 2024-03-20 19:18:19 | 2024-03-20 20:03:54 | 2024-03-20 20:28:40 | 0:24:46 | 0:14:59 | 0:09:47 | smithi | main | centos | 9.stream | orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-20T20:24:21.219157+0000 mon.a (mon.0) 657 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613474 | 2024-03-20 19:18:20 | 2024-03-20 20:03:55 | 2024-03-20 20:44:54 | 0:40:59 | 0:30:34 | 0:10:25 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-20T20:27:24.698651+0000 mon.a (mon.0) 829 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7613475 | 2024-03-20 19:18:21 | 2024-03-20 20:03:55 | 2024-03-20 21:08:11 | 1:04:16 | 0:52:54 | 0:11:22 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-20T20:31:05.764088+0000 mon.a (mon.0) 1041 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613476 | 2024-03-20 19:18:22 | 2024-03-20 20:03:56 | 2024-03-20 20:26:37 | 0:22:41 | 0:13:44 | 0:08:57 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} | 2 | |
Failure Reason:
"2024-03-20T20:22:13.334010+0000 mon.a (mon.0) 284 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613477 | 2024-03-20 19:18:24 | 2024-03-20 20:03:56 | 2024-03-20 20:36:03 | 0:32:07 | 0:21:36 | 0:10:31 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:30:26.126286+0000 mon.smithi045 (mon.0) 863 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
dead | 7613478 | 2024-03-20 19:18:25 | 2024-03-20 20:04:06 | 2024-03-21 08:12:45 | 12:08:39 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7613479 | 2024-03-20 19:18:26 | 2024-03-20 20:04:07 | 2024-03-20 20:53:36 | 0:49:29 | 0:37:58 | 0:11:31 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7613480 | 2024-03-20 19:18:28 | 2024-03-20 20:04:07 | 2024-03-20 20:29:48 | 0:25:41 | 0:15:59 | 0:09:42 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:25:37.660937+0000 mon.smithi099 (mon.0) 782 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613481 | 2024-03-20 19:18:29 | 2024-03-20 20:04:07 | 2024-03-20 20:48:29 | 0:44:22 | 0:33:08 | 0:11:14 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} | 2 | |
Failure Reason:
"2024-03-20T20:26:25.638779+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613482 | 2024-03-20 19:18:30 | 2024-03-20 20:04:08 | 2024-03-20 20:36:48 | 0:32:40 | 0:22:45 | 0:09:55 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-20T20:27:15.124460+0000 mon.a (mon.0) 193 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7613483 | 2024-03-20 19:18:32 | 2024-03-20 20:05:08 | 2024-03-20 20:28:14 | 0:23:06 | 0:13:10 | 0:09:56 | smithi | main | centos | 9.stream | orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} | 1 | |
Failure Reason:
"2024-03-20T20:25:45.494322+0000 mon.a (mon.0) 455 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613484 | 2024-03-20 19:18:33 | 2024-03-20 20:05:09 | 2024-03-20 20:33:19 | 0:28:10 | 0:17:18 | 0:10:52 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:24:44.939852+0000 mon.smithi040 (mon.0) 576 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613485 | 2024-03-20 19:18:34 | 2024-03-20 20:06:19 | 2024-03-20 21:04:13 | 0:57:54 | 0:48:08 | 0:09:46 | smithi | main | ubuntu | 22.04 | orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} | 2 | |
Failure Reason:
"2024-03-20T20:27:58.009259+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613486 | 2024-03-20 19:18:35 | 2024-03-20 20:06:20 | 2024-03-20 20:47:40 | 0:41:20 | 0:27:05 | 0:14:15 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-20T20:35:52.888177+0000 mon.a (mon.0) 651 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613487 | 2024-03-20 19:18:37 | 2024-03-20 20:10:31 | 2024-03-20 20:35:15 | 0:24:44 | 0:14:03 | 0:10:41 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |
Failure Reason:
"2024-03-20T20:28:29.085709+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613488 | 2024-03-20 19:18:38 | 2024-03-20 20:10:31 | 2024-03-20 20:47:57 | 0:37:26 | 0:23:31 | 0:13:55 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:39:44.691356+0000 mon.smithi019 (mon.0) 774 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613489 | 2024-03-20 19:18:40 | 2024-03-20 20:14:22 | 2024-03-20 20:38:41 | 0:24:19 | 0:13:26 | 0:10:53 | smithi | main | centos | 9.stream | orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-20T20:35:33.828592+0000 mon.smithi150 (mon.0) 782 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613490 | 2024-03-20 19:18:41 | 2024-03-20 20:15:32 | 2024-03-20 20:57:26 | 0:41:54 | 0:31:35 | 0:10:19 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"1710967389.6528833 mon.smithi071 (mon.0) 925 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
fail | 7613491 | 2024-03-20 19:18:42 | 2024-03-20 20:16:13 | 2024-03-20 20:41:52 | 0:25:39 | 0:14:37 | 0:11:02 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:38:45.267041+0000 mon.smithi053 (mon.0) 845 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log |
||||||||||||||
fail | 7613492 | 2024-03-20 19:18:44 | 2024-03-20 20:18:54 | 2024-03-20 20:45:32 | 0:26:38 | 0:11:20 | 0:15:18 | smithi | main | centos | 9.stream | orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 3 | |
Failure Reason:
"2024-03-20T20:40:42.663012+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 7613493 | 2024-03-20 19:18:45 | 2024-03-20 20:19:24 | 2024-03-20 21:10:39 | 0:51:15 | 0:39:02 | 0:12:13 | smithi | main | ubuntu | 20.04 | orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 | |
Failure Reason:
"2024-03-20T20:42:58.072907+0000 mon.a (mon.0) 481 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7613494 | 2024-03-20 19:18:46 | 2024-03-20 20:19:25 | 2024-03-20 20:54:56 | 0:35:31 | 0:25:43 | 0:09:48 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-20T20:40:18.065949+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613495 | 2024-03-20 19:18:48 | 2024-03-20 20:19:25 | 2024-03-20 21:08:13 | 0:48:48 | 0:38:35 | 0:10:13 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} | 2 | |
Failure Reason:
"2024-03-20T20:43:26.123696+0000 mon.a (mon.0) 828 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
fail | 7613496 | 2024-03-20 19:18:49 | 2024-03-20 20:19:25 | 2024-03-20 21:05:22 | 0:45:57 | 0:35:17 | 0:10:40 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-20T20:45:43.091344+0000 mon.a (mon.0) 1046 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613497 | 2024-03-20 19:18:50 | 2024-03-20 20:19:26 | 2024-03-20 20:48:17 | 0:28:51 | 0:18:54 | 0:09:57 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-20T20:37:54.079711+0000 mon.a (mon.0) 189 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7613498 | 2024-03-20 19:18:52 | 2024-03-20 20:19:26 | 2024-03-20 20:45:15 | 0:25:49 | 0:14:12 | 0:11:37 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:39:01.589880+0000 mon.smithi118 (mon.0) 652 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7613499 | 2024-03-20 19:18:53 | 2024-03-20 20:19:26 | 2024-03-20 21:07:50 | 0:48:24 | 0:38:01 | 0:10:23 | smithi | main | ubuntu | 22.04 | orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} | 5 | |
Failure Reason:
"2024-03-20T20:44:51.885223+0000 mon.a (mon.0) 224 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,e" in cluster log |
||||||||||||||
pass | 7613500 | 2024-03-20 19:18:54 | 2024-03-20 20:19:27 | 2024-03-20 20:49:44 | 0:30:17 | 0:20:11 | 0:10:06 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 | |
pass | 7613501 | 2024-03-20 19:18:56 | 2024-03-20 20:19:27 | 2024-03-20 21:00:59 | 0:41:32 | 0:32:36 | 0:08:56 | smithi | main | ubuntu | 22.04 | orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 | |
fail | 7613502 | 2024-03-20 19:18:57 | 2024-03-20 20:19:27 | 2024-03-20 20:49:54 | 0:30:27 | 0:19:33 | 0:10:54 | smithi | main | ubuntu | 22.04 | orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-20T20:44:04.794950+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
fail | 7613503 | 2024-03-20 19:18:58 | 2024-03-20 20:19:28 | 2024-03-20 20:57:45 | 0:38:17 | 0:20:24 | 0:17:53 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |
Failure Reason:
"2024-03-20T20:52:06.672818+0000 mon.smithi106 (mon.0) 754 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7613504 | 2024-03-20 19:19:00 | 2024-03-20 20:25:19 | 2024-03-20 21:15:54 | 0:50:35 | 0:38:42 | 0:11:53 | smithi | main | centos | 9.stream | orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7613505 | 2024-03-20 19:19:01 | 2024-03-20 20:26:49 | 2024-03-20 20:54:26 | 0:27:37 | 0:14:02 | 0:13:35 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 | |
Failure Reason:
"2024-03-20T20:49:41.546272+0000 mon.smithi113 (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7613506 | 2024-03-20 19:19:02 | 2024-03-20 20:28:40 | 2024-03-20 21:30:04 | 1:01:24 | 0:47:33 | 0:13:51 | smithi | main | centos | 9.stream | orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} | 2 | |
Failure Reason:
"2024-03-20T20:57:07.561003+0000 mon.a (mon.0) 817 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log |
||||||||||||||
pass | 7613507 | 2024-03-20 19:19:04 | 2024-03-20 20:32:41 | 2024-03-20 21:01:46 | 0:29:05 | 0:17:40 | 0:11:25 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 | |
fail | 7613508 | 2024-03-20 19:19:05 | 2024-03-20 20:34:52 | 2024-03-20 21:09:53 | 0:35:01 | 0:24:48 | 0:10:13 | smithi | main | centos | 9.stream | orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} | 2 | |
Failure Reason:
"2024-03-20T20:55:39.752003+0000 mon.a (mon.0) 367 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7613509 | 2024-03-20 19:19:06 | 2024-03-20 20:34:52 | 2024-03-20 21:02:03 | 0:27:11 | 0:16:37 | 0:10:34 | smithi | main | centos | 9.stream | orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} | 3 | |
pass | 7613510 | 2024-03-20 19:19:08 | 2024-03-20 20:34:52 | 2024-03-20 21:06:15 | 0:31:23 | 0:21:41 | 0:09:42 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 |