| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2024-03-07 02:25:02 | 2024-03-07 02:26:04 | 2024-03-07 20:05:34 | 17:39:30 | upgrade:reef-x | main | smithi | ea9a568 | 71 | 3 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7583715 |
|
2024-03-07 02:25:15 | 2024-03-07 02:26:01 | 2024-03-07 03:26:29 | 1:00:28 | 0:45:25 | 0:15:03 | smithi | main | centos | 9.stream | upgrade:reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583716 |
|
2024-03-07 02:25:16 | 2024-03-07 02:26:02 | 2024-03-07 05:57:58 | 3:31:56 | 3:22:14 | 0:09:42 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T04:30:00.000199+0000 mon.a (mon.0) 6131 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7583717 |
|
2024-03-07 02:25:17 | 2024-03-07 02:26:02 | 2024-03-07 05:24:13 | 2:58:11 | 2:43:20 | 0:14:51 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000137+0000 mon.a (mon.0) 624 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583718 |
|
2024-03-07 02:25:18 | 2024-03-07 02:26:03 | 2024-03-07 03:33:43 | 1:07:40 | 0:52:19 | 0:15:21 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583719 |
|
2024-03-07 02:25:19 | 2024-03-07 02:26:03 | 2024-03-07 05:55:20 | 3:29:17 | 3:14:22 | 0:14:55 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T05:10:00.000140+0000 mon.a (mon.0) 8890 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 1 scrub errors" in cluster log |
||||||||||||||
| fail | 7583720 |
|
2024-03-07 02:25:20 | 2024-03-07 02:26:04 | 2024-03-07 05:49:08 | 3:23:04 | 3:14:23 | 0:08:41 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T02:50:00.000131+0000 mon.a (mon.0) 765 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| fail | 7583721 |
|
2024-03-07 02:25:21 | 2024-03-07 02:26:04 | 2024-03-07 03:37:44 | 1:11:40 | 0:58:35 | 0:13:05 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583722 |
|
2024-03-07 02:25:22 | 2024-03-07 02:26:04 | 2024-03-07 06:24:12 | 3:58:08 | 3:42:57 | 0:15:11 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000151+0000 mon.a (mon.0) 356 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 3754/39795 objects degraded (9.433%), 3 pgs degraded, 3 pgs undersized" in cluster log |
||||||||||||||
| fail | 7583723 |
|
2024-03-07 02:25:23 | 2024-03-07 02:26:05 | 2024-03-07 05:24:30 | 2:58:25 | 2:43:32 | 0:14:53 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:00:00.000213+0000 mon.a (mon.0) 773 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| fail | 7583724 |
|
2024-03-07 02:25:24 | 2024-03-07 02:26:05 | 2024-03-07 05:39:17 | 3:13:12 | 3:02:42 | 0:10:30 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:10:00.000167+0000 mon.a (mon.0) 536 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583725 |
|
2024-03-07 02:25:25 | 2024-03-07 02:26:06 | 2024-03-07 03:58:38 | 1:32:32 | 1:17:55 | 0:14:37 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583726 |
|
2024-03-07 02:25:26 | 2024-03-07 02:26:06 | 2024-03-07 06:13:26 | 3:47:20 | 3:37:43 | 0:09:37 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T02:50:00.000161+0000 mon.a (mon.0) 759 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| fail | 7583727 |
|
2024-03-07 02:25:27 | 2024-03-07 02:26:07 | 2024-03-07 03:26:47 | 1:00:40 | 0:47:50 | 0:12:50 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583728 |
|
2024-03-07 02:25:28 | 2024-03-07 02:26:07 | 2024-03-07 06:23:52 | 3:57:45 | 3:43:10 | 0:14:35 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T04:50:00.000119+0000 mon.a (mon.0) 6339 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 4 scrub errors" in cluster log |
||||||||||||||
| fail | 7583729 |
|
2024-03-07 02:25:29 | 2024-03-07 02:26:07 | 2024-03-07 03:28:06 | 1:01:59 | 0:48:25 | 0:13:34 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583730 |
|
2024-03-07 02:25:30 | 2024-03-07 02:26:08 | 2024-03-07 05:46:05 | 3:19:57 | 3:08:44 | 0:11:13 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:30:00.000151+0000 mon.a (mon.0) 1649 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 5832/206439 objects degraded (2.825%), 2 pgs degraded" in cluster log |
||||||||||||||
| dead | 7583731 |
|
2024-03-07 02:25:31 | 2024-03-07 02:26:08 | 2024-03-07 02:31:18 | 0:05:10 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | ||
Failure Reason:
Error reimaging machines: Expected smithi028's OS to be centos 9 but found ubuntu 22.04 |
||||||||||||||
| dead | 7583732 |
|
2024-03-07 02:25:32 | 2024-03-07 02:26:08 | 2024-03-07 02:31:40 | 0:05:32 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | ||
Failure Reason:
Error reimaging machines: list index out of range |
||||||||||||||
| fail | 7583733 |
|
2024-03-07 02:25:33 | 2024-03-07 02:26:09 | 2024-03-07 03:28:54 | 1:02:45 | 0:48:30 | 0:14:15 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583734 |
|
2024-03-07 02:25:34 | 2024-03-07 02:26:09 | 2024-03-07 06:07:54 | 3:41:45 | 3:26:02 | 0:15:43 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000542+0000 mon.a (mon.0) 511 : cluster 3 [WRN] OSD_DOWN: 1 osds down" in cluster log |
||||||||||||||
| fail | 7583735 |
|
2024-03-07 02:25:35 | 2024-03-07 02:26:10 | 2024-03-07 05:40:40 | 3:14:30 | 2:59:42 | 0:14:48 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000150+0000 mon.a (mon.0) 742 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583736 |
|
2024-03-07 02:25:36 | 2024-03-07 02:26:10 | 2024-03-07 05:47:44 | 3:21:34 | 3:07:34 | 0:14:00 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T02:53:44.660041+0000 mon.a (mon.0) 181 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583737 |
|
2024-03-07 02:25:37 | 2024-03-07 02:26:10 | 2024-03-07 02:47:39 | 0:21:29 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | ||
Failure Reason:
Failed to reconnect to smithi158 |
||||||||||||||
| fail | 7583738 |
|
2024-03-07 02:25:38 | 2024-03-07 02:26:11 | 2024-03-07 06:00:36 | 3:34:25 | 3:17:56 | 0:16:29 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000148+0000 mon.a (mon.0) 602 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583739 |
|
2024-03-07 02:25:39 | 2024-03-07 02:26:11 | 2024-03-07 03:41:58 | 1:15:47 | 0:59:22 | 0:16:25 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583740 |
|
2024-03-07 02:25:40 | 2024-03-07 02:26:12 | 2024-03-07 03:33:39 | 1:07:27 | 0:56:32 | 0:10:55 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583741 |
|
2024-03-07 02:25:41 | 2024-03-07 02:26:12 | 2024-03-07 05:20:44 | 2:54:32 | 2:39:03 | 0:15:29 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000158+0000 mon.a (mon.0) 1143 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583742 |
|
2024-03-07 02:25:42 | 2024-03-07 02:26:12 | 2024-03-07 05:48:26 | 3:22:14 | 3:07:18 | 0:14:56 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T04:40:00.000173+0000 mon.a (mon.0) 7009 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 1 scrub errors" in cluster log |
||||||||||||||
| fail | 7583743 |
|
2024-03-07 02:25:43 | 2024-03-07 02:26:13 | 2024-03-07 06:26:09 | 3:59:56 | 3:44:14 | 0:15:42 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:01:03.591192+0000 mon.a (mon.0) 180 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583744 |
|
2024-03-07 02:25:43 | 2024-03-07 02:26:13 | 2024-03-07 06:13:52 | 3:47:39 | 3:29:58 | 0:17:41 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T04:50:00.000247+0000 mon.a (mon.0) 7678 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 11 scrub errors" in cluster log |
||||||||||||||
| fail | 7583745 |
|
2024-03-07 02:25:44 | 2024-03-07 02:26:14 | 2024-03-07 03:37:54 | 1:11:40 | 0:56:55 | 0:14:45 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583746 |
|
2024-03-07 02:25:45 | 2024-03-07 02:26:14 | 2024-03-07 06:06:53 | 3:40:39 | 3:27:35 | 0:13:04 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:05:44.828634+0000 mon.a (mon.0) 71 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583747 |
|
2024-03-07 02:25:46 | 2024-03-07 02:26:14 | 2024-03-07 05:30:36 | 3:04:22 | 2:51:03 | 0:13:19 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T04:50:00.000187+0000 mon.a (mon.0) 5785 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 6 scrub errors" in cluster log |
||||||||||||||
| fail | 7583748 |
|
2024-03-07 02:25:47 | 2024-03-07 02:26:15 | 2024-03-07 05:40:18 | 3:14:03 | 2:58:07 | 0:15:56 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:07:33.791248+0000 mon.a (mon.0) 105 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583749 |
|
2024-03-07 02:25:48 | 2024-03-07 02:26:15 | 2024-03-07 05:55:26 | 3:29:11 | 3:12:58 | 0:16:13 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T05:00:00.000188+0000 mon.a (mon.0) 7905 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7583750 |
|
2024-03-07 02:25:49 | 2024-03-07 02:26:16 | 2024-03-07 05:40:44 | 3:14:28 | 3:02:32 | 0:11:56 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:09:02.971037+0000 mon.a (mon.0) 106 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583751 |
|
2024-03-07 02:25:50 | 2024-03-07 02:26:16 | 2024-03-07 03:25:36 | 0:59:20 | 0:47:08 | 0:12:12 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583752 |
|
2024-03-07 02:25:51 | 2024-03-07 02:26:16 | 2024-03-07 03:24:21 | 0:58:05 | 0:44:13 | 0:13:52 | smithi | main | centos | 9.stream | upgrade:reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583753 |
|
2024-03-07 02:25:53 | 2024-03-07 02:26:17 | 2024-03-07 06:06:36 | 3:40:19 | 3:24:27 | 0:15:52 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T05:00:00.000139+0000 mon.a (mon.0) 7835 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7583754 |
|
2024-03-07 02:25:54 | 2024-03-07 02:26:17 | 2024-03-07 05:44:19 | 3:18:02 | 3:04:07 | 0:13:55 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T04:40:00.000236+0000 mon.a (mon.0) 6551 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 10 scrub errors" in cluster log |
||||||||||||||
| fail | 7583755 |
|
2024-03-07 02:25:55 | 2024-03-07 02:26:18 | 2024-03-07 03:25:21 | 0:59:03 | 0:46:16 | 0:12:47 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583756 |
|
2024-03-07 02:25:56 | 2024-03-07 02:26:18 | 2024-03-07 06:09:36 | 3:43:18 | 3:28:47 | 0:14:31 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:03:13.842004+0000 mon.a (mon.0) 8 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7583757 |
|
2024-03-07 02:25:56 | 2024-03-07 02:26:18 | 2024-03-07 05:19:20 | 2:53:02 | 2:37:58 | 0:15:04 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T04:40:00.000238+0000 mon.a (mon.0) 7134 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7583758 |
|
2024-03-07 02:25:57 | 2024-03-07 02:26:19 | 2024-03-07 03:42:01 | 1:15:42 | 0:59:58 | 0:15:44 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| dead | 7583759 |
|
2024-03-07 02:25:58 | 2024-03-07 02:26:19 | 2024-03-07 20:05:34 | 17:39:15 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7583760 |
|
2024-03-07 02:25:59 | 2024-03-07 02:26:19 | 2024-03-07 06:01:51 | 3:35:32 | 3:21:58 | 0:13:34 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:10:00.000160+0000 mon.a (mon.0) 564 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583761 |
|
2024-03-07 02:26:00 | 2024-03-07 02:26:20 | 2024-03-07 05:26:46 | 3:00:26 | 2:44:10 | 0:16:16 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:12:18.729143+0000 mon.a (mon.0) 58 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583762 |
|
2024-03-07 02:26:01 | 2024-03-07 02:26:20 | 2024-03-07 06:43:33 | 4:17:13 | 4:01:44 | 0:15:29 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T05:20:00.000222+0000 mon.a (mon.0) 6938 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 14 scrub errors" in cluster log |
||||||||||||||
| fail | 7583763 |
|
2024-03-07 02:26:02 | 2024-03-07 02:26:21 | 2024-03-07 05:17:42 | 2:51:21 | 2:37:13 | 0:14:08 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:00:00.000157+0000 mon.a (mon.0) 743 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| fail | 7583764 |
|
2024-03-07 02:26:03 | 2024-03-07 02:26:21 | 2024-03-07 03:25:05 | 0:58:44 | 0:47:01 | 0:11:43 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583765 |
|
2024-03-07 02:26:04 | 2024-03-07 02:26:21 | 2024-03-07 05:44:47 | 3:18:26 | 3:08:35 | 0:09:51 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T02:46:44.846961+0000 mon.a (mon.0) 176 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583766 |
|
2024-03-07 02:26:05 | 2024-03-07 02:26:22 | 2024-03-07 05:54:06 | 3:27:44 | 3:15:55 | 0:11:49 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T02:51:00.797509+0000 mon.a (mon.0) 184 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583767 |
|
2024-03-07 02:26:06 | 2024-03-07 02:26:22 | 2024-03-07 05:26:33 | 3:00:11 | 2:45:38 | 0:14:33 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:06:54.175260+0000 mon.a (mon.0) 65 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583768 |
|
2024-03-07 02:26:07 | 2024-03-07 02:26:23 | 2024-03-07 06:28:57 | 4:02:34 | 3:47:40 | 0:14:54 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:06:06.703832+0000 mon.a (mon.0) 8 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7583769 |
|
2024-03-07 02:26:08 | 2024-03-07 02:26:23 | 2024-03-07 05:48:42 | 3:22:19 | 3:07:26 | 0:14:53 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:18:49.408154+0000 mon.a (mon.0) 108 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583770 |
|
2024-03-07 02:26:09 | 2024-03-07 02:26:23 | 2024-03-07 03:32:46 | 1:06:23 | 0:50:58 | 0:15:25 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583771 |
|
2024-03-07 02:26:10 | 2024-03-07 05:57:05 | 11650 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |||
Failure Reason:
"2024-03-07T03:12:44.377903+0000 mon.a (mon.0) 151 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583772 |
|
2024-03-07 02:26:11 | 2024-03-07 05:56:27 | 11748 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |||
Failure Reason:
"2024-03-07T03:10:00.000676+0000 mon.a (mon.0) 640 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 9644/220002 objects degraded (4.384%), 5 pgs degraded, 1 pg undersized" in cluster log |
||||||||||||||
| fail | 7583773 |
|
2024-03-07 02:26:12 | 2024-03-07 02:26:25 | 2024-03-07 05:36:08 | 3:09:43 | 2:53:33 | 0:16:10 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:02:16.523829+0000 mon.a (mon.0) 181 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583774 |
|
2024-03-07 02:26:13 | 2024-03-07 02:26:25 | 2024-03-07 06:04:34 | 3:38:09 | 3:23:11 | 0:14:58 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T03:05:37.507386+0000 mon.a (mon.0) 8 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7583775 |
|
2024-03-07 02:26:14 | 2024-03-07 02:26:25 | 2024-03-07 05:39:40 | 3:13:15 | 2:57:02 | 0:16:13 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:13:12.448574+0000 mon.a (mon.0) 64 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583776 |
|
2024-03-07 02:26:15 | 2024-03-07 03:44:18 | 3763 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |||
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583777 |
|
2024-03-07 02:26:16 | 2024-03-07 02:26:26 | 2024-03-07 03:36:05 | 1:09:39 | 0:57:32 | 0:12:07 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583778 |
|
2024-03-07 02:26:17 | 2024-03-07 02:26:27 | 2024-03-07 05:55:36 | 3:29:09 | 3:13:00 | 0:16:09 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T04:30:00.000175+0000 mon.a (mon.0) 6300 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 11 scrub errors" in cluster log |
||||||||||||||
| fail | 7583779 |
|
2024-03-07 02:26:18 | 2024-03-07 05:20:46 | 9627 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |||
Failure Reason:
"2024-03-07T03:10:00.000147+0000 mon.a (mon.0) 538 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7583780 |
|
2024-03-07 02:26:19 | 2024-03-07 02:26:27 | 2024-03-07 04:00:01 | 1:33:34 | 1:18:43 | 0:14:51 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583781 |
|
2024-03-07 02:26:20 | 2024-03-07 02:26:28 | 2024-03-07 05:30:07 | 3:03:39 | 2:48:30 | 0:15:09 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:06:05.990363+0000 mon.a (mon.0) 106 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583782 |
|
2024-03-07 02:26:21 | 2024-03-07 03:36:32 | 3294 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |||
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
| fail | 7583783 |
|
2024-03-07 02:26:22 | 2024-03-07 02:26:29 | 2024-03-07 05:43:24 | 3:16:55 | 3:04:39 | 0:12:16 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T02:50:13.142951+0000 mon.a (mon.0) 176 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583784 |
|
2024-03-07 02:26:23 | 2024-03-07 02:26:29 | 2024-03-07 03:25:37 | 0:59:08 | 0:46:45 | 0:12:23 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7583785 |
|
2024-03-07 02:26:25 | 2024-03-07 02:26:29 | 2024-03-07 05:41:32 | 3:15:03 | 2:59:22 | 0:15:41 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:20:00.000118+0000 mon.a (mon.0) 608 : cluster 3 [WRN] OSD_DOWN: 1 osds down" in cluster log |
||||||||||||||
| fail | 7583786 |
|
2024-03-07 02:26:26 | 2024-03-07 02:26:30 | 2024-03-07 06:13:35 | 3:47:05 | 3:29:48 | 0:17:17 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-03-07T05:00:00.000167+0000 mon.a (mon.0) 8325 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 2 scrub errors" in cluster log |
||||||||||||||
| fail | 7583787 |
|
2024-03-07 02:26:27 | 2024-03-07 02:31:41 | 2024-03-07 05:53:18 | 3:21:37 | 2:53:07 | 0:28:30 | smithi | main | ubuntu | 22.04 | upgrade:reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-07T03:11:33.307657+0000 mon.a (mon.0) 184 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7583788 |
|
2024-03-07 02:26:28 | 2024-03-07 02:48:24 | 2024-03-07 04:31:27 | 1:43:03 | 0:45:52 | 0:57:11 | smithi | main | centos | 9.stream | upgrade:reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
failed to complete snap trimming before timeout |
||||||||||||||
Pulpito