| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail |
|---|---|---|---|---|---|---|---|---|---|
| bhubbard | 2024-06-29 23:46:23 | 2024-06-29 23:47:42 | 2024-06-30 09:02:37 | 9:14:55 | upgrade:reef-x:stress-split | main | smithi | 81225aa | 72 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7779674 |
|
2024-06-29 23:46:29 | 2024-06-29 23:47:42 | 2024-06-30 03:34:13 | 3:46:31 | 3:33:36 | 0:12:55 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:40:00.000173+0000 mon.a (mon.0) 836 : cluster [WRN] pg 10.7 is active+recovery_wait+undersized+degraded+remapped, acting [6,3]" in cluster log |
||||||||||||||
| fail | 7779675 |
|
2024-06-29 23:46:30 | 2024-06-29 23:50:43 | 2024-06-30 02:43:21 | 2:52:38 | 2:40:57 | 0:11:41 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:30:00.000179+0000 mon.a (mon.0) 702 : cluster [WRN] pg 6.2 is stuck undersized for 2m, current state active+recovery_wait+undersized+degraded+remapped, last acting [3,2]" in cluster log |
||||||||||||||
| fail | 7779676 |
|
2024-06-29 23:46:31 | 2024-06-29 23:52:13 | 2024-06-30 03:18:43 | 3:26:30 | 3:15:55 | 0:10:35 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:25:06.240156+0000 mon.a (mon.0) 806 : cluster [WRN] Replacing daemon mds.foo.smithi017.bnbbbs as rank 0 with standby daemon mds.foo.smithi115.zkbgpb" in cluster log |
||||||||||||||
| fail | 7779677 |
|
2024-06-29 23:46:32 | 2024-06-29 23:52:44 | 2024-06-30 03:01:58 | 3:09:14 | 2:57:37 | 0:11:37 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:20:00.000087+0000 mon.a (mon.0) 1176 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779678 |
|
2024-06-29 23:46:33 | 2024-06-29 23:54:45 | 2024-06-30 03:02:15 | 3:07:30 | 2:56:45 | 0:10:45 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:30:00.000117+0000 mon.a (mon.0) 423 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779679 |
|
2024-06-29 23:46:34 | 2024-06-29 23:55:25 | 2024-06-30 03:12:04 | 3:16:39 | 3:04:28 | 0:12:11 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:30:19.872821+0000 mon.a (mon.0) 862 : cluster [WRN] Replacing daemon mds.foo.smithi008.oqzukb as rank 0 with standby daemon mds.foo.smithi083.bfvejd" in cluster log |
||||||||||||||
| fail | 7779680 |
|
2024-06-29 23:46:35 | 2024-06-29 23:57:46 | 2024-06-30 03:48:33 | 3:50:47 | 3:40:12 | 0:10:35 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:31:30.429823+0000 mon.a (mon.0) 804 : cluster [WRN] Replacing daemon mds.foo.smithi094.xowhlq as rank 0 with standby daemon mds.foo.smithi151.yyeize" in cluster log |
||||||||||||||
| fail | 7779681 |
|
2024-06-29 23:46:36 | 2024-06-29 23:58:26 | 2024-06-30 03:02:50 | 3:04:24 | 2:52:20 | 0:12:04 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:35:26.351500+0000 mon.a (mon.0) 575 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7779682 |
|
2024-06-29 23:46:37 | 2024-06-30 00:02:43 | 2024-06-30 03:18:12 | 3:15:29 | 3:06:15 | 0:09:14 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:40:00.000187+0000 mon.a (mon.0) 720 : cluster [WRN] pg 5.0 is active+recovery_wait+undersized+degraded+remapped, acting [1,4]" in cluster log |
||||||||||||||
| fail | 7779683 |
|
2024-06-29 23:46:38 | 2024-06-30 00:02:44 | 2024-06-30 03:48:13 | 3:45:29 | 3:34:39 | 0:10:50 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:36:37.269539+0000 mon.a (mon.0) 802 : cluster [WRN] Replacing daemon mds.foo.smithi037.assjey as rank 0 with standby daemon mds.foo.smithi156.aswuuo" in cluster log |
||||||||||||||
| fail | 7779684 |
|
2024-06-29 23:46:39 | 2024-06-30 00:04:14 | 2024-06-30 03:20:03 | 3:15:49 | 3:05:16 | 0:10:33 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:40:00.003058+0000 mon.a (mon.0) 634 : cluster [WRN] pg 6.3 is active+recovery_wait+undersized+degraded+remapped, acting [7,2]" in cluster log |
||||||||||||||
| fail | 7779685 |
|
2024-06-29 23:46:40 | 2024-06-30 00:04:55 | 2024-06-30 03:00:56 | 2:56:01 | 2:44:31 | 0:11:30 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:50:00.000106+0000 mon.a (mon.0) 1511 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779686 |
|
2024-06-29 23:46:41 | 2024-06-30 00:05:45 | 2024-06-30 03:39:24 | 3:33:39 | 3:22:47 | 0:10:52 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:40:00.000144+0000 mon.a (mon.0) 310 : cluster [WRN] osd.0 (root=default,host=smithi057) is down" in cluster log |
||||||||||||||
| fail | 7779687 |
|
2024-06-29 23:46:42 | 2024-06-30 00:05:45 | 2024-06-30 03:12:17 | 3:06:32 | 2:53:47 | 0:12:45 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:41:39.345499+0000 mon.a (mon.0) 860 : cluster [WRN] Replacing daemon mds.foo.smithi022.boxgrl as rank 0 with standby daemon mds.foo.smithi149.stocpp" in cluster log |
||||||||||||||
| fail | 7779688 |
|
2024-06-29 23:46:43 | 2024-06-30 00:08:26 | 2024-06-30 03:26:40 | 3:18:14 | 2:59:44 | 0:18:30 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:57:01.832110+0000 mon.a (mon.0) 855 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7779689 |
|
2024-06-29 23:46:44 | 2024-06-30 00:17:28 | 2024-06-30 03:41:21 | 3:23:53 | 3:13:18 | 0:10:35 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:44:28.908764+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779690 |
|
2024-06-29 23:46:45 | 2024-06-30 00:17:38 | 2024-06-30 03:51:18 | 3:33:40 | 3:22:27 | 0:11:13 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T00:51:35.084800+0000 mon.a (mon.0) 845 : cluster [WRN] Replacing daemon mds.foo.smithi135.covybw as rank 0 with standby daemon mds.foo.smithi137.zeuhfe" in cluster log |
||||||||||||||
| fail | 7779691 |
|
2024-06-29 23:46:46 | 2024-06-30 00:19:19 | 2024-06-30 03:14:22 | 2:55:03 | 2:44:25 | 0:10:38 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T00:50:00.000145+0000 mon.a (mon.0) 414 : cluster [WRN] osd.0 (root=default,host=smithi154) is down" in cluster log |
||||||||||||||
| fail | 7779692 |
|
2024-06-29 23:46:47 | 2024-06-30 00:19:19 | 2024-06-30 04:02:07 | 3:42:48 | 3:28:22 | 0:14:26 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T01:00:00.000149+0000 mon.a (mon.0) 528 : cluster [WRN] pg 7.4 is stuck undersized for 3m, current state active+recovery_wait+undersized+degraded+remapped, last acting [1,4]" in cluster log |
||||||||||||||
| fail | 7779693 |
|
2024-06-29 23:46:48 | 2024-06-30 00:25:00 | 2024-06-30 03:18:23 | 2:53:23 | 2:39:01 | 0:14:22 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T01:10:00.000177+0000 mon.a (mon.0) 923 : cluster [WRN] pg 7.0 is active+recovery_wait+undersized+degraded+remapped, acting [5,1]" in cluster log |
||||||||||||||
| fail | 7779694 |
|
2024-06-29 23:46:49 | 2024-06-30 00:29:01 | 2024-06-30 04:06:56 | 3:37:55 | 3:28:27 | 0:09:28 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T01:01:15.417523+0000 mon.a (mon.0) 815 : cluster [WRN] Replacing daemon mds.foo.smithi064.zfzmvy as rank 0 with standby daemon mds.foo.smithi191.ihhhhb" in cluster log |
||||||||||||||
| fail | 7779695 |
|
2024-06-29 23:46:51 | 2024-06-30 00:29:02 | 2024-06-30 03:46:08 | 3:17:06 | 2:56:55 | 0:20:11 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T01:05:02.610193+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779696 |
|
2024-06-29 23:46:52 | 2024-06-30 00:38:53 | 2024-06-30 03:40:51 | 3:01:58 | 2:52:35 | 0:09:23 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T01:20:00.000175+0000 mon.a (mon.0) 787 : cluster [WRN] pg 7.0 is stuck undersized for 87s, current state active+recovery_wait+undersized+degraded+remapped, last acting [5,3]" in cluster log |
||||||||||||||
| fail | 7779697 |
|
2024-06-29 23:46:53 | 2024-06-30 00:39:44 | 2024-06-30 03:57:59 | 3:18:15 | 3:05:38 | 0:12:37 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T01:13:52.572013+0000 mon.a (mon.0) 842 : cluster [WRN] Replacing daemon mds.foo.smithi110.xdpvfg as rank 0 with standby daemon mds.foo.smithi120.wontnk" in cluster log |
||||||||||||||
| fail | 7779698 |
|
2024-06-29 23:46:54 | 2024-06-30 00:42:14 | 2024-06-30 04:28:32 | 3:46:18 | 3:35:54 | 0:10:24 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T01:15:08.538380+0000 mon.a (mon.0) 810 : cluster [WRN] Replacing daemon mds.foo.smithi002.zpwzzb as rank 0 with standby daemon mds.foo.smithi170.jldcvm" in cluster log |
||||||||||||||
| fail | 7779699 |
|
2024-06-29 23:46:55 | 2024-06-30 00:42:45 | 2024-06-30 03:49:23 | 3:06:38 | 2:34:53 | 0:31:45 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T01:40:00.000111+0000 mon.a (mon.0) 607 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779700 |
|
2024-06-29 23:46:56 | 2024-06-30 01:04:18 | 2024-06-30 04:30:00 | 3:25:42 | 3:02:43 | 0:22:59 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T02:00:00.000141+0000 mon.a (mon.0) 1085 : cluster [WRN] pg 1.4 is active+recovery_wait+degraded, acting [7,0,6]" in cluster log |
||||||||||||||
| fail | 7779701 |
|
2024-06-29 23:46:57 | 2024-06-30 01:16:30 | 2024-06-30 04:52:44 | 3:36:14 | 3:25:14 | 0:11:00 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T01:49:41.663775+0000 mon.a (mon.0) 810 : cluster [WRN] Replacing daemon mds.foo.smithi047.xjmljw as rank 0 with standby daemon mds.foo.smithi116.gxvpty" in cluster log |
||||||||||||||
| fail | 7779702 |
|
2024-06-29 23:46:58 | 2024-06-30 01:16:31 | 2024-06-30 04:38:16 | 3:21:45 | 3:02:17 | 0:19:28 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T02:10:00.000154+0000 mon.a (mon.0) 1042 : cluster [WRN] osd.5 (root=default,host=smithi132) is down" in cluster log |
||||||||||||||
| fail | 7779703 |
|
2024-06-29 23:46:59 | 2024-06-30 01:26:42 | 2024-06-30 04:28:09 | 3:01:27 | 2:48:32 | 0:12:55 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T02:20:00.000160+0000 mon.a (mon.0) 1811 : cluster [WRN] pg 7.5 is active+recovering+undersized+degraded+remapped, acting [2,0]" in cluster log |
||||||||||||||
| fail | 7779704 |
|
2024-06-29 23:47:00 | 2024-06-30 01:30:33 | 2024-06-30 05:03:54 | 3:33:21 | 3:20:46 | 0:12:35 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T02:10:00.000133+0000 mon.a (mon.0) 464 : cluster [WRN] pg 8.0 is active+recovery_wait+undersized+degraded+remapped, acting [3,5]" in cluster log |
||||||||||||||
| fail | 7779705 |
|
2024-06-29 23:47:01 | 2024-06-30 01:30:34 | 2024-06-30 04:38:27 | 3:07:53 | 2:49:02 | 0:18:51 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T02:13:37.886288+0000 mon.a (mon.0) 801 : cluster [WRN] Replacing daemon mds.foo.smithi119.jaemke as rank 0 with standby daemon mds.foo.smithi183.wtuouv" in cluster log |
||||||||||||||
| fail | 7779706 |
|
2024-06-29 23:47:02 | 2024-06-30 01:40:25 | 2024-06-30 04:50:07 | 3:09:42 | 2:59:36 | 0:10:06 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T02:20:00.000171+0000 mon.a (mon.0) 648 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779707 |
|
2024-06-29 23:47:03 | 2024-06-30 01:40:26 | 2024-06-30 05:10:18 | 3:29:52 | 3:05:25 | 0:24:27 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T02:20:00.000106+0000 mon.a (mon.0) 880 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779708 |
|
2024-06-29 23:47:04 | 2024-06-30 01:54:48 | 2024-06-30 05:05:53 | 3:11:05 | 2:30:39 | 0:40:26 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
Command failed (workunit test rbd/test_librbd.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' |
||||||||||||||
| fail | 7779709 |
|
2024-06-29 23:47:05 | 2024-06-30 02:26:32 | 2024-06-30 05:40:36 | 3:14:04 | 2:48:24 | 0:25:40 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T03:30:00.000899+0000 mon.a (mon.0) 1772 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779710 |
|
2024-06-29 23:47:06 | 2024-06-30 02:43:25 | 2024-06-30 06:04:34 | 3:21:09 | 2:52:59 | 0:28:10 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T03:40:00.000156+0000 mon.a (mon.0) 696 : cluster [WRN] pg 8.0 is active+recovery_wait+undersized+degraded+remapped, acting [1,5]" in cluster log |
||||||||||||||
| fail | 7779711 |
|
2024-06-29 23:47:07 | 2024-06-30 03:00:58 | 2024-06-30 06:35:28 | 3:34:30 | 3:23:12 | 0:11:18 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T03:40:00.000180+0000 mon.a (mon.0) 734 : cluster [WRN] pg 6.2 is stuck undersized for 73s, current state active+recovery_wait+undersized+degraded+remapped, last acting [3,2]" in cluster log |
||||||||||||||
| fail | 7779712 |
|
2024-06-29 23:47:08 | 2024-06-30 03:02:08 | 2024-06-30 06:03:57 | 3:01:49 | 2:52:33 | 0:09:16 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T03:34:57.367339+0000 mon.a (mon.0) 777 : cluster [WRN] Replacing daemon mds.foo.smithi032.avvfhc as rank 0 with standby daemon mds.foo.smithi045.gslayf" in cluster log |
||||||||||||||
| fail | 7779713 |
|
2024-06-29 23:47:10 | 2024-06-30 03:02:18 | 2024-06-30 06:33:56 | 3:31:38 | 3:21:49 | 0:09:49 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T03:29:06.622595+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779714 |
|
2024-06-29 23:47:11 | 2024-06-30 03:02:59 | 2024-06-30 05:59:23 | 2:56:24 | 2:37:33 | 0:18:51 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T03:50:00.005111+0000 mon.a (mon.0) 582 : cluster [WRN] pg 6.9 is stuck undersized for 3m, current state active+recovering+undersized+degraded+remapped, last acting [7,2]" in cluster log |
||||||||||||||
| fail | 7779715 |
|
2024-06-29 23:47:12 | 2024-06-30 03:12:10 | 2024-06-30 06:42:11 | 3:30:01 | 3:19:15 | 0:10:46 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T03:45:11.631598+0000 mon.a (mon.0) 855 : cluster [WRN] Replacing daemon mds.foo.smithi022.lazzql as rank 0 with standby daemon mds.foo.smithi149.ldaipt" in cluster log |
||||||||||||||
| fail | 7779716 |
|
2024-06-29 23:47:13 | 2024-06-30 03:12:21 | 2024-06-30 06:40:26 | 3:28:05 | 3:16:32 | 0:11:33 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T03:46:56.743237+0000 mon.a (mon.0) 797 : cluster [WRN] Replacing daemon mds.foo.smithi154.zynzck as rank 0 with standby daemon mds.foo.smithi181.rwhtcg" in cluster log |
||||||||||||||
| fail | 7779717 |
|
2024-06-29 23:47:14 | 2024-06-30 03:14:32 | 2024-06-30 06:33:35 | 3:19:03 | 3:06:02 | 0:13:01 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:00:00.002384+0000 mon.a (mon.0) 1001 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779718 |
|
2024-06-29 23:47:15 | 2024-06-30 03:18:03 | 2024-06-30 06:14:23 | 2:56:20 | 2:45:32 | 0:10:48 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:00:00.000152+0000 mon.a (mon.0) 814 : cluster [WRN] pg 2.3 is stuck undersized for 3m, current state active+recovery_wait+undersized+degraded+remapped, last acting [2,7]" in cluster log |
||||||||||||||
| fail | 7779719 |
|
2024-06-29 23:47:16 | 2024-06-30 03:18:03 | 2024-06-30 07:26:23 | 4:08:20 | 3:56:01 | 0:12:19 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T03:52:52.403385+0000 mon.a (mon.0) 865 : cluster [WRN] Replacing daemon mds.foo.smithi006.keqrvr as rank 0 with standby daemon mds.foo.smithi152.xmqvis" in cluster log |
||||||||||||||
| fail | 7779720 |
|
2024-06-29 23:47:17 | 2024-06-30 03:18:13 | 2024-06-30 06:03:19 | 2:45:06 | 2:32:43 | 0:12:23 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:10:00.000140+0000 mon.a (mon.0) 1536 : cluster [WRN] pg 1.8 is active+recovery_wait+undersized+degraded+remapped, acting [2,6]" in cluster log |
||||||||||||||
| fail | 7779721 |
|
2024-06-29 23:47:18 | 2024-06-30 03:20:04 | 2024-06-30 06:52:10 | 3:32:06 | 3:15:55 | 0:16:11 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:10:00.000109+0000 mon.a (mon.0) 1496 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779722 |
|
2024-06-29 23:47:19 | 2024-06-30 03:26:45 | 2024-06-30 06:35:57 | 3:09:12 | 2:52:46 | 0:16:26 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:10:00.000156+0000 mon.a (mon.0) 508 : cluster [WRN] pg 7.4 is stuck undersized for 2m, current state active+recovering+undersized+degraded+remapped, last acting [1,4]" in cluster log |
||||||||||||||
| fail | 7779723 |
|
2024-06-29 23:47:20 | 2024-06-30 03:34:17 | 2024-06-30 07:14:58 | 3:40:41 | 3:26:21 | 0:14:20 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:11:18.514554+0000 mon.a (mon.0) 809 : cluster [WRN] Replacing daemon mds.foo.smithi087.gudabx as rank 0 with standby daemon mds.foo.smithi088.uiiscv" in cluster log |
||||||||||||||
| fail | 7779724 |
|
2024-06-29 23:47:21 | 2024-06-30 03:38:48 | 2024-06-30 06:30:27 | 2:51:39 | 2:39:49 | 0:11:50 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:20:00.000170+0000 mon.a (mon.0) 569 : cluster [WRN] pg 5.a is stuck undersized for 3m, current state active+recovery_wait+undersized+degraded+remapped, last acting [2,3]" in cluster log |
||||||||||||||
| fail | 7779725 |
|
2024-06-29 23:47:22 | 2024-06-30 03:40:58 | 2024-06-30 07:19:25 | 3:38:27 | 3:27:51 | 0:10:36 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:09:51.565609+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779726 |
|
2024-06-29 23:47:23 | 2024-06-30 03:41:29 | 2024-06-30 06:48:07 | 3:06:38 | 2:52:46 | 0:13:52 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:18:54.834547+0000 mon.a (mon.0) 856 : cluster [WRN] Replacing daemon mds.foo.smithi122.bwghew as rank 0 with standby daemon mds.foo.smithi130.tnlbwp" in cluster log |
||||||||||||||
| fail | 7779727 |
|
2024-06-29 23:47:24 | 2024-06-30 03:46:10 | 2024-06-30 07:17:09 | 3:30:59 | 3:17:34 | 0:13:25 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:40:00.001951+0000 mon.a (mon.0) 1866 : cluster [WRN] pg 7.5 is active+recovery_wait+degraded, acting [7,2,1]" in cluster log |
||||||||||||||
| fail | 7779728 |
|
2024-06-29 23:47:25 | 2024-06-30 03:48:20 | 2024-06-30 06:53:54 | 3:05:34 | 2:54:57 | 0:10:37 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:40:00.000097+0000 mon.a (mon.0) 1300 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779729 |
|
2024-06-29 23:47:26 | 2024-06-30 03:48:41 | 2024-06-30 07:10:34 | 3:21:53 | 3:11:12 | 0:10:41 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:30:00.000179+0000 mon.a (mon.0) 924 : cluster [WRN] pg 7.15 is active+recovery_wait+undersized+degraded+remapped, acting [7,2]" in cluster log |
||||||||||||||
| fail | 7779730 |
|
2024-06-29 23:47:27 | 2024-06-30 03:49:11 | 2024-06-30 06:47:18 | 2:58:07 | 2:45:45 | 0:12:22 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:23:18.415186+0000 mon.a (mon.0) 802 : cluster [WRN] Replacing daemon mds.foo.smithi135.iwpbap as rank 0 with standby daemon mds.foo.smithi137.orfecl" in cluster log |
||||||||||||||
| fail | 7779731 |
|
2024-06-29 23:47:28 | 2024-06-30 03:51:22 | 2024-06-30 07:29:10 | 3:37:48 | 3:22:12 | 0:15:36 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:24:18.539804+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779732 |
|
2024-06-29 23:47:29 | 2024-06-30 03:58:03 | 2024-06-30 07:17:22 | 3:19:19 | 3:06:04 | 0:13:15 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:40:00.000194+0000 mon.a (mon.0) 770 : cluster [WRN] pg 6.1 is stuck undersized for 2m, current state active+recovery_wait+undersized+degraded+remapped, last acting [2,6]" in cluster log |
||||||||||||||
| fail | 7779733 |
|
2024-06-29 23:47:30 | 2024-06-30 04:02:14 | 2024-06-30 07:34:56 | 3:32:42 | 3:17:26 | 0:15:16 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T04:39:52.243616+0000 mon.a (mon.0) 799 : cluster [WRN] Replacing daemon mds.foo.smithi064.abksnp as rank 0 with standby daemon mds.foo.smithi191.vpfzcz" in cluster log |
||||||||||||||
| fail | 7779734 |
|
2024-06-29 23:47:31 | 2024-06-30 04:07:05 | 2024-06-30 07:42:58 | 3:35:53 | 3:13:25 | 0:22:28 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T04:52:29.145597+0000 mon.a (mon.0) 854 : cluster [WRN] Replacing daemon mds.foo.smithi057.maclpa as rank 0 with standby daemon mds.foo.smithi173.lfjwel" in cluster log |
||||||||||||||
| fail | 7779735 |
|
2024-06-29 23:47:32 | 2024-06-30 04:18:57 | 2024-06-30 07:37:51 | 3:18:54 | 2:59:14 | 0:19:40 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T05:10:00.000167+0000 mon.a (mon.0) 883 : cluster [WRN] pg 3.9 is stuck peering for 8m, current state peering, last acting [4,2,7]" in cluster log |
||||||||||||||
| fail | 7779736 |
|
2024-06-29 23:47:33 | 2024-06-30 04:28:19 | 2024-06-30 07:25:46 | 2:57:27 | 2:47:58 | 0:09:29 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T05:00:00.000092+0000 mon.a (mon.0) 368 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down" in cluster log |
||||||||||||||
| fail | 7779737 |
|
2024-06-29 23:47:34 | 2024-06-30 04:28:39 | 2024-06-30 08:24:17 | 3:55:38 | 3:44:08 | 0:11:30 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T05:03:42.702988+0000 mon.a (mon.0) 798 : cluster [WRN] Replacing daemon mds.foo.smithi105.vkfkfp as rank 0 with standby daemon mds.foo.smithi167.fwoepf" in cluster log |
||||||||||||||
| fail | 7779738 |
|
2024-06-29 23:47:35 | 2024-06-30 04:30:10 | 2024-06-30 07:33:58 | 3:03:48 | 2:44:28 | 0:19:20 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T05:13:57.442612+0000 mon.a (mon.0) 597 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7779739 |
|
2024-06-29 23:47:36 | 2024-06-30 04:38:21 | 2024-06-30 07:47:36 | 3:09:15 | 2:59:31 | 0:09:44 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T05:00:00.000107+0000 mon.a (mon.0) 679 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779740 |
|
2024-06-29 23:47:37 | 2024-06-30 04:38:32 | 2024-06-30 07:59:46 | 3:21:14 | 2:58:52 | 0:22:22 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T05:40:00.000265+0000 mon.a (mon.0) 1167 : cluster [WRN] pg 1.0 is active+recovery_wait+undersized+degraded+remapped, acting [6,1]" in cluster log |
||||||||||||||
| fail | 7779741 |
|
2024-06-29 23:47:38 | 2024-06-30 04:50:14 | 2024-06-30 08:26:40 | 3:36:26 | 3:23:08 | 0:13:18 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T05:25:21.598991+0000 mon.a (mon.0) 856 : cluster [WRN] Replacing daemon mds.foo.smithi047.yidxyq as rank 0 with standby daemon mds.foo.smithi116.wzvraq" in cluster log |
||||||||||||||
| fail | 7779742 |
|
2024-06-29 23:47:39 | 2024-06-30 04:52:54 | 2024-06-30 08:01:11 | 3:08:17 | 2:47:40 | 0:20:37 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T05:40:00.002824+0000 mon.a (mon.0) 470 : cluster [WRN] Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7779743 |
|
2024-06-29 23:47:41 | 2024-06-30 05:03:56 | 2024-06-30 08:41:09 | 3:37:13 | 3:25:30 | 0:11:43 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T05:32:06.148381+0000 mon.a (mon.0) 15 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7779744 |
|
2024-06-29 23:47:41 | 2024-06-30 05:05:57 | 2024-06-30 08:24:12 | 3:18:15 | 3:05:17 | 0:12:58 | smithi | main | ubuntu | 22.04 | upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-06-30T05:42:08.734025+0000 mon.a (mon.0) 855 : cluster [WRN] Replacing daemon mds.foo.smithi081.cmziax as rank 0 with standby daemon mds.foo.smithi195.eywxbx" in cluster log |
||||||||||||||
| fail | 7779745 |
|
2024-06-29 23:47:42 | 2024-06-30 05:10:28 | 2024-06-30 09:02:37 | 3:52:09 | 3:15:03 | 0:37:06 | smithi | main | centos | 9.stream | upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-06-30T06:00:00.000108+0000 mon.a (mon.0) 760 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
Pulpito