| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| bhubbard | 2024-06-27 23:56:24 | 2024-06-27 23:57:08 | 2024-06-28 07:04:53 | 7:07:45 | upgrade:reef-x:stress-split | main | smithi | dbc9816 | 71 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7777579 |
|
2024-06-27 23:56:30 | 2024-06-27 23:57:08 | 2024-06-28 03:37:36 | 3:40:28 | 3:30:14 | 0:10:14 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000162+0000 mon.a (mon.0) 2378 : cluster [WRN] pg 14.0 is stuck undersized for 64s, current state active+recovering+undersized+degraded+remapped, last acting [0,5]" in cluster log |
||||||||||||||
| fail | 7777580 |
|
2024-06-27 23:56:31 | 2024-06-27 23:58:18 | 2024-06-28 02:42:33 | 2:44:15 | 2:34:09 | 0:10:06 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:40:00.000184+0000 mon.a (mon.0) 968 : cluster [WRN] pg 7.13 is stuck undersized for 63s, current state active+recovering+undersized+remapped, last acting [2,0]" in cluster log |
||||||||||||||
| fail | 7777581 |
|
2024-06-27 23:56:32 | 2024-06-27 23:59:19 | 2024-06-28 03:26:16 | 3:26:57 | 3:16:08 | 0:10:49 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:32:18.431568+0000 mon.a (mon.0) 798 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777582 |
|
2024-06-27 23:56:34 | 2024-06-28 00:00:30 | 2024-06-28 03:15:48 | 3:15:18 | 3:05:00 | 0:10:18 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:27:12.688682+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777583 |
|
2024-06-27 23:56:35 | 2024-06-28 00:00:30 | 2024-06-28 03:08:23 | 3:07:53 | 2:57:52 | 0:10:01 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:40:00.000151+0000 mon.a (mon.0) 829 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777584 |
|
2024-06-27 23:56:36 | 2024-06-28 00:01:01 | 2024-06-28 03:19:11 | 3:18:10 | 3:05:29 | 0:12:41 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:35:59.861195+0000 mon.a (mon.0) 804 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777585 |
|
2024-06-27 23:56:37 | 2024-06-28 00:04:48 | 2024-06-28 03:46:33 | 3:41:45 | 3:31:11 | 0:10:34 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:37:03.403754+0000 mon.a (mon.0) 846 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777586 |
|
2024-06-27 23:56:38 | 2024-06-28 00:04:49 | 2024-06-28 02:52:36 | 2:47:47 | 2:37:05 | 0:10:42 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:50:00.000158+0000 mon.a (mon.0) 1037 : cluster [WRN] pg 8.0 is active+recovery_wait+undersized+degraded+remapped, acting [1,3]" in cluster log |
||||||||||||||
| fail | 7777587 |
|
2024-06-27 23:56:39 | 2024-06-28 00:04:49 | 2024-06-28 03:11:12 | 3:06:23 | 2:55:47 | 0:10:36 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:50:00.000162+0000 mon.a (mon.0) 985 : cluster [WRN] pg 6.e is stuck undersized for 77s, current state active+recovering+undersized+remapped, last acting [2,1]" in cluster log |
||||||||||||||
| fail | 7777588 |
|
2024-06-27 23:56:40 | 2024-06-28 00:05:40 | 2024-06-28 03:38:09 | 3:32:29 | 3:21:49 | 0:10:40 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:38:56.625849+0000 mon.a (mon.0) 790 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777589 |
|
2024-06-27 23:56:42 | 2024-06-28 00:06:00 | 2024-06-28 03:13:05 | 3:07:05 | 2:57:55 | 0:09:10 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000215+0000 mon.a (mon.0) 2421 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777590 |
|
2024-06-27 23:56:43 | 2024-06-28 00:06:01 | 2024-06-28 03:09:00 | 3:02:59 | 2:49:06 | 0:13:53 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:00:00.000179+0000 mon.a (mon.0) 1761 : cluster [WRN] pg 7.4 is active+recovery_wait+undersized+degraded+remapped, acting [1,4]" in cluster log |
||||||||||||||
| fail | 7777591 |
|
2024-06-27 23:56:44 | 2024-06-28 00:09:31 | 2024-06-28 03:27:24 | 3:17:53 | 3:05:38 | 0:12:15 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000127+0000 mon.a (mon.0) 1633 : cluster [WRN] pg 12.c is active+recovery_wait+undersized+degraded+remapped, acting [0,2]" in cluster log |
||||||||||||||
| dead | 7777592 |
|
2024-06-27 23:56:45 | 2024-06-28 00:11:02 | 2024-06-28 00:18:37 | 0:07:35 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | ||
Failure Reason:
Error reimaging machines: This operation would block forever Hub: <Hub '' at 0x7f63080bd5d0 epoll default pending=0 ref=0 fileno=4 thread_ident=0x7f630a861740> Handles: [] |
||||||||||||||
| fail | 7777593 |
|
2024-06-27 23:56:46 | 2024-06-28 00:13:03 | 2024-06-28 03:26:35 | 3:13:32 | 3:00:59 | 0:12:33 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:55:00.635152+0000 mon.a (mon.0) 971 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7777594 |
|
2024-06-27 23:56:47 | 2024-06-28 00:16:31 | 2024-06-28 03:36:07 | 3:19:36 | 3:04:57 | 0:14:39 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T00:47:45.544501+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777595 |
|
2024-06-27 23:56:49 | 2024-06-28 00:21:42 | 2024-06-28 03:58:55 | 3:37:13 | 3:26:32 | 0:10:41 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:55:24.821798+0000 mon.a (mon.0) 806 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777596 |
|
2024-06-27 23:56:50 | 2024-06-28 00:23:02 | 2024-06-28 03:16:36 | 2:53:34 | 2:43:08 | 0:10:26 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000132+0000 mon.a (mon.0) 1490 : cluster [WRN] pg 6.17 is active+recovering+undersized+degraded+remapped, acting [4,5]" in cluster log |
||||||||||||||
| fail | 7777597 |
|
2024-06-27 23:56:51 | 2024-06-28 00:23:13 | 2024-06-28 04:05:00 | 3:41:47 | 3:30:34 | 0:11:13 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:00:00.000164+0000 mon.a (mon.0) 495 : cluster [WRN] pg 7.4 is stuck undersized for 3m, current state active+recovering+undersized+degraded+remapped, last acting [1,4]" in cluster log |
||||||||||||||
| fail | 7777598 |
|
2024-06-27 23:56:52 | 2024-06-28 00:23:23 | 2024-06-28 03:21:21 | 2:57:58 | 2:43:08 | 0:14:50 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:20:00.000181+0000 mon.a (mon.0) 1427 : cluster [WRN] pg 1.1 is stuck peering for 14m, current state remapped+peering, last acting [0,2]" in cluster log |
||||||||||||||
| fail | 7777599 |
|
2024-06-27 23:56:53 | 2024-06-28 00:29:16 | 2024-06-28 03:59:04 | 3:29:48 | 3:20:21 | 0:09:27 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:01:21.064572+0000 mon.a (mon.0) 801 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777600 |
|
2024-06-27 23:56:54 | 2024-06-28 00:29:17 | 2024-06-28 03:36:17 | 3:07:00 | 2:58:21 | 0:08:39 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T00:55:52.918617+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777601 |
|
2024-06-27 23:56:55 | 2024-06-28 00:29:17 | 2024-06-28 03:36:46 | 3:07:29 | 2:55:33 | 0:11:56 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000178+0000 mon.a (mon.0) 752 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777602 |
|
2024-06-27 23:56:56 | 2024-06-28 00:29:27 | 2024-06-28 03:47:11 | 3:17:44 | 3:05:31 | 0:12:13 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:04:30.048885+0000 mon.a (mon.0) 805 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777603 |
|
2024-06-27 23:56:58 | 2024-06-28 00:30:48 | 2024-06-28 04:14:46 | 3:43:58 | 3:33:53 | 0:10:05 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:03:28.022527+0000 mon.a (mon.0) 863 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777604 |
|
2024-06-27 23:56:59 | 2024-06-28 00:30:48 | 2024-06-28 03:24:08 | 2:53:20 | 2:43:19 | 0:10:01 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000160+0000 mon.a (mon.0) 565 : cluster [WRN] pg 3.6 is active+undersized+degraded, acting [0,7]" in cluster log |
||||||||||||||
| fail | 7777605 |
|
2024-06-27 23:57:00 | 2024-06-28 00:30:49 | 2024-06-28 03:37:02 | 3:06:13 | 2:56:20 | 0:09:53 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000274+0000 mon.a (mon.0) 707 : cluster [WRN] Health detail: HEALTH_WARN Reduced data availability: 2 pgs inactive" in cluster log |
||||||||||||||
| fail | 7777606 |
|
2024-06-27 23:57:01 | 2024-06-28 00:31:19 | 2024-06-28 04:15:07 | 3:43:48 | 3:33:03 | 0:10:45 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:05:37.350355+0000 mon.a (mon.0) 863 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777607 |
|
2024-06-27 23:57:02 | 2024-06-28 00:32:40 | 2024-06-28 03:45:29 | 3:12:49 | 3:01:24 | 0:11:25 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000186+0000 mon.a (mon.0) 585 : cluster [WRN] pg 6.0 is active+recovery_wait+undersized+degraded+remapped, acting [0,5]" in cluster log |
||||||||||||||
| fail | 7777608 |
|
2024-06-27 23:57:03 | 2024-06-28 00:33:30 | 2024-06-28 03:40:42 | 3:07:12 | 2:53:04 | 0:14:08 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:00:00.000128+0000 mon.a (mon.0) 734 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
| fail | 7777609 |
|
2024-06-27 23:57:04 | 2024-06-28 00:37:32 | 2024-06-28 04:18:41 | 3:41:09 | 3:28:44 | 0:12:25 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:20:00.000154+0000 mon.a (mon.0) 517 : cluster [WRN] pg 8.1 is stuck undersized for 2m, current state active+recovery_wait+undersized+degraded+remapped, last acting [0,2]" in cluster log |
||||||||||||||
| fail | 7777610 |
|
2024-06-27 23:57:05 | 2024-06-28 00:39:32 | 2024-06-28 03:39:43 | 3:00:11 | 2:50:58 | 0:09:13 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:10:00.000240+0000 mon.a (mon.0) 722 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777611 |
|
2024-06-27 23:57:07 | 2024-06-28 00:39:33 | 2024-06-28 04:03:52 | 3:24:19 | 3:06:57 | 0:17:22 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:20:00.000164+0000 mon.a (mon.0) 365 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down" in cluster log |
||||||||||||||
| fail | 7777612 |
|
2024-06-27 23:57:08 | 2024-06-28 00:45:34 | 2024-06-28 04:22:56 | 3:37:22 | 3:21:06 | 0:16:16 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:18:41.439017+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777613 |
|
2024-06-27 23:57:09 | 2024-06-28 00:51:55 | 2024-06-28 04:20:13 | 3:28:18 | 3:19:05 | 0:09:13 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:24:28.632998+0000 mon.a (mon.0) 806 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777614 |
|
2024-06-27 23:57:10 | 2024-06-28 00:52:05 | 2024-06-28 03:53:09 | 3:01:04 | 2:48:27 | 0:12:37 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:40:00.000201+0000 mon.a (mon.0) 1598 : cluster [WRN] pg 2.0 is stuck undersized for 105s, current state active+undersized, last acting [7,0]" in cluster log |
||||||||||||||
| fail | 7777615 |
|
2024-06-27 23:57:11 | 2024-06-28 00:54:06 | 2024-06-28 04:12:02 | 3:17:56 | 2:59:12 | 0:18:44 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:50:00.000158+0000 mon.a (mon.0) 1007 : cluster [WRN] pg 9.4 is stuck undersized for 3m, current state active+recovery_wait+undersized+degraded+remapped, last acting [1,3]" in cluster log |
||||||||||||||
| fail | 7777616 |
|
2024-06-27 23:57:12 | 2024-06-28 01:00:07 | 2024-06-28 04:28:20 | 3:28:13 | 3:17:49 | 0:10:24 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:40:00.000206+0000 mon.a (mon.0) 836 : cluster [WRN] pg 3.0 is stuck peering for 7m, current state peering, last acting [2,6,5]" in cluster log |
||||||||||||||
| fail | 7777617 |
|
2024-06-27 23:57:13 | 2024-06-28 01:01:08 | 2024-06-28 04:09:44 | 3:08:36 | 2:58:38 | 0:09:58 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:33:56.635441+0000 mon.a (mon.0) 808 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777618 |
|
2024-06-27 23:57:14 | 2024-06-28 01:01:48 | 2024-06-28 04:29:08 | 3:27:20 | 3:17:57 | 0:09:23 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:28:19.368289+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777619 |
|
2024-06-27 23:57:16 | 2024-06-28 01:01:49 | 2024-06-28 03:48:39 | 2:46:50 | 2:36:16 | 0:10:34 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T01:50:00.000156+0000 mon.a (mon.0) 1205 : cluster [WRN] pg 1.3 is stuck peering for 81s, current state remapped+peering, last acting [3,6,4]" in cluster log |
||||||||||||||
| fail | 7777620 |
|
2024-06-27 23:57:17 | 2024-06-28 01:03:09 | 2024-06-28 04:48:01 | 3:44:52 | 3:17:22 | 0:27:30 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T01:52:21.834798+0000 mon.a (mon.0) 851 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777621 |
|
2024-06-27 23:57:18 | 2024-06-28 01:23:54 | 2024-06-28 04:50:37 | 3:26:43 | 3:11:27 | 0:15:16 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T02:01:32.671379+0000 mon.a (mon.0) 813 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777622 |
|
2024-06-27 23:57:20 | 2024-06-28 01:28:25 | 2024-06-28 05:08:12 | 3:39:47 | 3:08:41 | 0:31:06 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T02:50:00.000146+0000 mon.a (mon.0) 1714 : cluster [WRN] pg 1.18 is active+recovery_wait+degraded, acting [2,5,3]" in cluster log |
||||||||||||||
| fail | 7777623 |
|
2024-06-27 23:57:21 | 2024-06-28 01:48:58 | 2024-06-28 04:38:56 | 2:49:58 | 2:39:30 | 0:10:28 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T02:30:00.000268+0000 mon.a (mon.0) 858 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777624 |
|
2024-06-27 23:57:22 | 2024-06-28 01:48:58 | 2024-06-28 05:56:53 | 4:07:55 | 3:40:32 | 0:27:23 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T02:38:43.645737+0000 mon.a (mon.0) 798 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777625 |
|
2024-06-27 23:57:23 | 2024-06-28 02:07:11 | 2024-06-28 04:59:14 | 2:52:03 | 2:33:50 | 0:18:13 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:00:00.000166+0000 mon.a (mon.0) 1028 : cluster [WRN] pg 7.1 is active+recovery_wait+degraded, acting [4,3,6]" in cluster log |
||||||||||||||
| fail | 7777626 |
|
2024-06-27 23:57:24 | 2024-06-28 02:13:42 | 2024-06-28 05:41:12 | 3:27:30 | 3:18:02 | 0:09:28 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:00:00.000156+0000 mon.a (mon.0) 1686 : cluster [WRN] pg 6.8 is stuck undersized for 2m, current state active+recovering+undersized+degraded+remapped, last acting [7,2]" in cluster log |
||||||||||||||
| fail | 7777627 |
|
2024-06-27 23:57:25 | 2024-06-28 02:13:43 | 2024-06-28 05:26:42 | 3:12:59 | 2:56:11 | 0:16:48 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:00:00.000166+0000 mon.a (mon.0) 482 : cluster [WRN] pg 8.1 is stuck undersized for 2m, current state active+recovery_wait+undersized+degraded+remapped, last acting [0,2]" in cluster log |
||||||||||||||
| fail | 7777628 |
|
2024-06-27 23:57:26 | 2024-06-28 02:19:24 | 2024-06-28 05:51:24 | 3:32:00 | 3:11:45 | 0:20:15 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:01:50.378102+0000 mon.a (mon.0) 858 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777629 |
|
2024-06-27 23:57:27 | 2024-06-28 02:29:36 | 2024-06-28 05:26:40 | 2:57:04 | 2:47:35 | 0:09:29 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:10:00.000164+0000 mon.a (mon.0) 971 : cluster [WRN] pg 1.4 is active+recovery_wait+undersized+degraded+remapped, acting [7,6]" in cluster log |
||||||||||||||
| fail | 7777630 |
|
2024-06-27 23:57:29 | 2024-06-28 02:29:36 | 2024-06-28 06:17:50 | 3:48:14 | 3:25:38 | 0:22:36 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:09:04.825386+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777631 |
|
2024-06-27 23:57:30 | 2024-06-28 02:42:39 | 2024-06-28 06:04:09 | 3:21:30 | 3:02:08 | 0:19:22 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:24:32.907594+0000 mon.a (mon.0) 785 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777632 |
|
2024-06-27 23:57:31 | 2024-06-28 02:51:50 | 2024-06-28 06:12:35 | 3:20:45 | 3:09:40 | 0:11:05 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:50:00.000294+0000 mon.a (mon.0) 2090 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777633 |
|
2024-06-27 23:57:32 | 2024-06-28 02:52:41 | 2024-06-28 06:05:42 | 3:13:01 | 2:58:41 | 0:14:20 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:30:00.000170+0000 mon.a (mon.0) 426 : cluster [WRN] pg 3.6 is active+undersized+degraded, acting [0,4]" in cluster log |
||||||||||||||
| fail | 7777634 |
|
2024-06-27 23:57:33 | 2024-06-28 02:56:31 | 2024-06-28 06:24:31 | 3:28:00 | 3:04:29 | 0:23:31 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:50:00.000210+0000 mon.a (mon.0) 844 : cluster [WRN] pg 6.0 is stuck undersized for 3m, current state active+recovering+undersized+degraded+remapped, last acting [0,3]" in cluster log |
||||||||||||||
| fail | 7777635 |
|
2024-06-27 23:57:34 | 2024-06-28 03:09:03 | 2024-06-28 06:05:19 | 2:56:16 | 2:45:53 | 0:10:23 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:30:00.000229+0000 mon.a (mon.0) 1481 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777636 |
|
2024-06-27 23:57:35 | 2024-06-28 03:09:34 | 2024-06-28 06:44:51 | 3:35:17 | 3:23:18 | 0:11:59 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:37:38.426556+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777637 |
|
2024-06-27 23:57:36 | 2024-06-28 03:11:15 | 2024-06-28 06:03:09 | 2:51:54 | 2:42:00 | 0:09:54 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:20:00.000148+0000 mon.a (mon.0) 2463 : cluster [WRN] pg 1.0 is stuck undersized for 91s, current state active+undersized, last acting [7,0]" in cluster log |
||||||||||||||
| fail | 7777638 |
|
2024-06-27 23:57:37 | 2024-06-28 03:11:15 | 2024-06-28 06:41:05 | 3:29:50 | 3:20:55 | 0:08:55 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:43:44.306688+0000 mon.a (mon.0) 859 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777639 |
|
2024-06-27 23:57:38 | 2024-06-28 03:11:15 | 2024-06-28 06:43:14 | 3:31:59 | 3:21:24 | 0:10:35 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:43:31.291900+0000 mon.a (mon.0) 804 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777640 |
|
2024-06-27 23:57:39 | 2024-06-28 03:11:26 | 2024-06-28 06:32:22 | 3:20:56 | 3:06:55 | 0:14:01 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T04:00:00.000161+0000 mon.a (mon.0) 885 : cluster [WRN] pg 8.4 is active+recovery_wait+undersized+degraded+remapped, acting [5,4]" in cluster log |
||||||||||||||
| fail | 7777641 |
|
2024-06-27 23:57:40 | 2024-06-28 03:13:06 | 2024-06-28 06:13:05 | 2:59:59 | 2:48:41 | 0:11:18 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:11:11.643788+0000 osd.5 (osd.5) 13 : cluster [WRN] 8 slow requests (by type [ 'delayed' : 8 ] most affected pool [ 'unique_pool_4' : 8 ])" in cluster log |
||||||||||||||
| fail | 7777642 |
|
2024-06-27 23:57:41 | 2024-06-28 03:15:57 | 2024-06-28 07:04:53 | 3:48:56 | 3:37:54 | 0:11:02 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:50:10.341839+0000 mon.a (mon.0) 869 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777643 |
|
2024-06-27 23:57:43 | 2024-06-28 03:16:38 | 2024-06-28 06:09:25 | 2:52:47 | 2:40:30 | 0:12:17 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:20:00.000156+0000 mon.a (mon.0) 1870 : cluster [WRN] pg 11.15 is stuck undersized for 71s, current state active+recovery_wait+undersized+degraded+remapped, last acting [5,1]" in cluster log |
||||||||||||||
| fail | 7777644 |
|
2024-06-27 23:57:44 | 2024-06-28 03:17:48 | 2024-06-28 06:47:16 | 3:29:28 | 3:19:39 | 0:09:49 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:50:00.000248+0000 mon.a (mon.0) 557 : cluster [WRN] pg 5.c is active+undersized+degraded, acting [4,0]" in cluster log |
||||||||||||||
| fail | 7777645 |
|
2024-06-27 23:57:45 | 2024-06-28 03:17:59 | 2024-06-28 06:30:26 | 3:12:27 | 3:01:16 | 0:11:11 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:00:00.000175+0000 mon.a (mon.0) 777 : cluster [WRN] pg 8.4 is stuck undersized for 3m, current state active+recovery_wait+undersized+degraded+remapped, last acting [5,4]" in cluster log |
||||||||||||||
| fail | 7777646 |
|
2024-06-27 23:57:46 | 2024-06-28 03:19:19 | 2024-06-28 06:53:20 | 3:34:01 | 3:21:54 | 0:12:07 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:54:01.169664+0000 mon.a (mon.0) 800 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777647 |
|
2024-06-27 23:57:47 | 2024-06-28 03:21:30 | 2024-06-28 06:07:01 | 2:45:31 | 2:35:01 | 0:10:30 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T04:00:00.000170+0000 mon.a (mon.0) 772 : cluster [WRN] pg 5.7 is stuck undersized for 2m, current state active+recovering+undersized+degraded+remapped, last acting [5,1]" in cluster log |
||||||||||||||
| fail | 7777648 |
|
2024-06-27 23:57:48 | 2024-06-28 03:21:50 | 2024-06-28 06:58:58 | 3:37:08 | 3:28:50 | 0:08:18 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T03:48:41.949719+0000 mon.a (mon.0) 18 : cluster [WRN] use 'ceph osd pool application enable <pool-name> <app-name>', where <app-name> is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." in cluster log |
||||||||||||||
| fail | 7777649 |
|
2024-06-27 23:57:49 | 2024-06-28 03:21:51 | 2024-06-28 06:35:27 | 3:13:36 | 3:02:33 | 0:11:03 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-28T03:55:38.269825+0000 mon.a (mon.0) 802 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7777650 |
|
2024-06-27 23:57:50 | 2024-06-28 03:23:21 | 2024-06-28 06:41:25 | 3:18:04 | 3:07:51 | 0:10:13 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-28T04:10:00.002369+0000 mon.a (mon.0) 1702 : cluster [WRN] pg 6.5 is stuck undersized for 64s, current state active+recovery_wait+undersized+degraded+remapped, last acting [6,3]" in cluster log |
||||||||||||||
Pulpito