| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2024-05-04 03:08:13 | 2024-05-11 03:39:19 | 2024-05-11 15:48:28 | 12:09:09 | upgrade | main | smithi | 04416f4 | 7 | 29 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7690374 |
|
2024-05-04 03:09:24 | 2024-05-11 03:35:37 | 2024-05-11 04:15:58 | 0:40:21 | 0:25:25 | 0:14:56 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7690375 |
|
2024-05-04 03:09:25 | 2024-05-11 03:39:18 | 2024-05-11 03:58:50 | 0:19:32 | 0:10:01 | 0:09:31 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
Failure Reason:
"1715399826.0456908 mon.a (mon.0) 60 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7690376 |
|
2024-05-04 03:09:26 | 2024-05-11 03:39:18 | 2024-05-11 05:57:27 | 2:18:09 | 2:08:07 | 0:10:02 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-05-11T04:22:03.348840+0000 mon.a (mon.0) 395 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| dead | 7690377 |
|
2024-05-04 03:09:27 | 2024-05-11 03:39:19 | 2024-05-11 15:48:28 | 12:09:09 | smithi | main | centos | 8.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| pass | 7690378 |
|
2024-05-04 03:09:28 | 2024-05-11 03:39:19 | 2024-05-11 04:24:27 | 0:45:08 | 0:33:51 | 0:11:17 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7690379 |
|
2024-05-04 03:09:29 | 2024-05-11 03:39:19 | 2024-05-11 05:20:35 | 1:41:16 | 1:30:10 | 0:11:06 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1715399943.7089148 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7690380 |
|
2024-05-04 03:09:30 | 2024-05-11 03:39:20 | 2024-05-11 06:59:03 | 3:19:43 | 3:05:18 | 0:14:25 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-05-11T04:12:15.751018+0000 mon.a (mon.0) 54 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7690381 |
|
2024-05-04 03:09:31 | 2024-05-11 03:43:31 | 2024-05-11 04:04:38 | 0:21:07 | 0:12:29 | 0:08:38 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-pacific 1-upgrade}} | 1 |
| pass | 7690382 |
|
2024-05-04 03:09:32 | 2024-05-11 03:43:42 | 2024-05-11 04:08:15 | 0:24:33 | 0:12:34 | 0:11:59 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/new_ops/{newops}}} | 2 |
| fail | 7690383 |
|
2024-05-04 03:09:33 | 2024-05-11 03:44:42 | 2024-05-11 06:32:31 | 2:47:49 | 2:36:33 | 0:11:16 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1715400342.5355108 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7690384 |
|
2024-05-04 03:09:34 | 2024-05-11 03:45:13 | 2024-05-11 06:58:49 | 3:13:36 | 3:02:22 | 0:11:14 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-11T04:16:48.294075+0000 mon.a (mon.0) 213 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7690385 |
|
2024-05-04 03:09:35 | 2024-05-11 03:45:13 | 2024-05-11 06:34:29 | 2:49:16 | 2:40:12 | 0:09:04 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1715400278.2523398 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7690386 |
|
2024-05-04 03:09:36 | 2024-05-11 03:45:13 | 2024-05-11 04:32:29 | 0:47:16 | 0:38:00 | 0:09:16 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7690387 |
|
2024-05-04 03:09:37 | 2024-05-11 03:45:34 | 2024-05-11 04:45:48 | 1:00:14 | 0:44:07 | 0:16:07 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7690388 |
|
2024-05-04 03:09:38 | 2024-05-11 03:51:25 | 2024-05-11 06:39:17 | 2:47:52 | 2:37:46 | 0:10:06 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1715400911.5082839 mon.a (mon.0) 365 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7690389 |
|
2024-05-04 03:09:39 | 2024-05-11 03:51:26 | 2024-05-11 07:36:07 | 3:44:41 | 3:32:35 | 0:12:06 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-11T04:20:00.000139+0000 mon.a (mon.0) 893 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| pass | 7690390 |
|
2024-05-04 03:09:40 | 2024-05-11 03:54:56 | 2024-05-11 04:23:48 | 0:28:52 | 0:20:20 | 0:08:32 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7690391 |
|
2024-05-04 03:09:41 | 2024-05-11 03:54:57 | 2024-05-11 06:55:43 | 3:00:46 | 2:49:27 | 0:11:19 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1715401079.0519469 mon.a (mon.0) 653 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7690392 |
|
2024-05-04 03:09:42 | 2024-05-11 03:56:28 | 2024-05-11 04:40:02 | 0:43:34 | 0:33:41 | 0:09:53 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-05-11T04:30:00.000225+0000 mon.smithi052 (mon.0) 519 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded" in cluster log |
||||||||||||||
| fail | 7690393 |
|
2024-05-04 03:09:43 | 2024-05-11 03:56:58 | 2024-05-11 06:40:47 | 2:43:49 | 2:33:41 | 0:10:08 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-05-11T04:20:00.000097+0000 mon.a (mon.0) 730 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| fail | 7690394 |
|
2024-05-04 03:09:44 | 2024-05-11 03:57:39 | 2024-05-11 06:25:22 | 2:27:43 | 2:11:05 | 0:16:38 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1715401462.956952 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7690395 |
|
2024-05-04 03:09:45 | 2024-05-11 04:04:10 | 2024-05-11 04:58:19 | 0:54:09 | 0:44:17 | 0:09:52 | smithi | main | ubuntu | 22.04 | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks} | 2 |
Failure Reason:
"1715402032.370691 mon.a (mon.0) 661 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7690396 |
|
2024-05-04 03:09:46 | 2024-05-11 04:04:41 | 2024-05-11 06:22:50 | 2:18:09 | 2:07:10 | 0:10:59 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-05-11T04:46:58.698929+0000 mon.a (mon.0) 298 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7690397 |
|
2024-05-04 03:09:47 | 2024-05-11 04:05:01 | 2024-05-11 04:53:01 | 0:48:00 | 0:37:24 | 0:10:36 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7690398 |
|
2024-05-04 03:09:48 | 2024-05-11 04:05:42 | 2024-05-11 05:46:05 | 1:40:23 | 1:29:00 | 0:11:23 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1715401695.9918315 mon.a (mon.0) 658 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7690399 |
|
2024-05-04 03:09:49 | 2024-05-11 04:06:02 | 2024-05-11 04:57:13 | 0:51:11 | 0:41:07 | 0:10:04 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/kernel_untar_build}} | 2 |
| fail | 7690400 |
|
2024-05-04 03:09:50 | 2024-05-11 04:06:13 | 2024-05-11 08:02:04 | 3:55:51 | 3:43:27 | 0:12:24 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-11T04:30:57.821617+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7690401 |
|
2024-05-04 03:09:51 | 2024-05-11 04:07:03 | 2024-05-11 05:10:32 | 1:03:29 | 0:50:49 | 0:12:40 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7690402 |
|
2024-05-04 03:09:52 | 2024-05-11 04:08:24 | 2024-05-11 04:39:34 | 0:31:10 | 0:22:30 | 0:08:40 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7690403 |
|
2024-05-04 03:09:53 | 2024-05-11 04:08:24 | 2024-05-11 05:20:39 | 1:12:15 | 1:00:07 | 0:12:08 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7690404 |
|
2024-05-04 03:09:53 | 2024-05-06 13:40:58 | 2024-05-06 14:06:24 | 0:25:26 | 0:17:40 | 0:07:46 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04416f48efe02891b265c07b4f38b46e422bbef9' |
||||||||||||||
| fail | 7690405 |
|
2024-05-04 03:09:54 | 2024-05-11 04:09:25 | 2024-05-11 07:20:38 | 3:11:13 | 2:59:27 | 0:11:46 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1715401954.8279164 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7690406 |
|
2024-05-04 03:09:55 | 2024-05-11 04:10:35 | 2024-05-11 07:23:35 | 3:13:00 | 3:04:25 | 0:08:35 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-11T04:27:40.869839+0000 mon.a (mon.0) 175 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7690407 |
|
2024-05-04 03:09:56 | 2024-05-11 04:10:36 | 2024-05-11 06:57:43 | 2:47:07 | 2:37:59 | 0:09:08 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1715401774.456793 mon.a (mon.0) 355 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7690408 |
|
2024-05-04 03:09:57 | 2024-05-11 04:10:36 | 2024-05-11 05:00:36 | 0:50:00 | 0:39:13 | 0:10:47 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7690409 |
|
2024-05-04 03:09:58 | 2024-05-11 04:11:17 | 2024-05-11 06:50:19 | 2:39:02 | 2:27:22 | 0:11:40 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-05-11T04:44:57.037752+0000 mon.a (mon.0) 304 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7690410 |
|
2024-05-04 03:09:59 | 2024-05-11 04:12:17 | 2024-05-11 06:41:11 | 2:28:54 | 2:15:02 | 0:13:52 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1715402400.0001087 mon.a (mon.0) 729 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
Pulpito