Pulpito

rfriedma-2024-04-12_09:02:49-upgrade-wip-rf-comb1-distro-default-smithi

ID
Status
Ceph Branch
Suite Branch
Teuthology Branch
Machine
OS
Nodes
Description
Failure Reason
7653757
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi099 smithi181
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T10:57:38.744468+0000 osd.1 (osd.1) 20 : cluster [ERR] 61.9 soid 61:90b0d9bc:::smithi099682301-188:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653758
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi022 smithi023
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T10:43:18.596483+0000 osd.0 (osd.0) 54 : cluster [ERR] 53.9 soid 53:903de697:::smithi022476537-192:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653759
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi005 smithi006
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T09:41:48.969920+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
7653760
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi050 smithi114
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T10:37:43.859767+0000 osd.2 (osd.2) 38 : cluster [ERR] 50.3 soid 50:c02b9653:::smithi050520407-490:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653761
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi086 smithi090
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
timeout expired in wait_until_healthy
7653762
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi135 smithi196
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"1712915092.5455034 mon.a (mon.0) 717 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
7653763
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi097 smithi110
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T11:39:13.798963+0000 osd.1 (osd.1) 24 : cluster [ERR] 103.17 soid 103:ec67da42:::smithi097814103-1:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653764
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi055 smithi112
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T10:43:53.122838+0000 osd.7 (osd.7) 59 : cluster [ERR] 86.13 soid 86:c9994e48:::smithi055460797-292:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653765
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi078 smithi175
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T09:40:00.000178+0000 mon.a (mon.0) 723 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log
7653766
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi080 smithi115
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T10:57:08.710365+0000 osd.1 (osd.1) 37 : cluster [ERR] 51.11 soid 51:8df32ee7:::smithi080567816-13:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653767
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi049 smithi133
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T09:50:05.444897+0000 mon.a (mon.0) 181 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log
7653768
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi134 smithi194
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
timeout expired in wait_until_healthy
7653769
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi039 smithi047
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:46:36.888853+0000 osd.0 (osd.0) 6 : cluster [ERR] 62.14 soid 62:28a6ac6e:::smithi039490289-4:9f : object info inconsistent , attr value mismatch '__header'" in cluster log
7653770
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi007 smithi151
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:39:36.711988+0000 osd.4 (osd.4) 28 : cluster [ERR] 53.0 soid 53:031633ee:::smithi007362933-43:15e : object info inconsistent , attr value mismatch '__header'" in cluster log
7653771
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi146 smithi152
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T10:01:19.914593+0000 mon.a (mon.0) 148 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log
7653772
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi119 smithi204
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"1712915542.7617176 mon.a (mon.0) 511 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
7653773
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi037 smithi081
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:18:06.298376+0000 osd.4 (osd.4) 49 : cluster [ERR] 58.14 soid 58:2a7c52b6:::smithi037788976-44:2d : object info inconsistent , attr value mismatch '__header'" in cluster log
7653774
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi062 smithi064
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:05:53.478509+0000 osd.7 (osd.7) 108 : cluster [ERR] 50.9 soid 50:9324e055:::smithi062585668-43:c2 : object info inconsistent , attr value mismatch '__header'" in cluster log
7653775
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi003 smithi017
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T09:57:39.521432+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log
7653776
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi083 smithi165
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
timeout expired in wait_until_healthy
7653777
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi172 smithi173
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T10:19:26.311038+0000 mon.a (mon.0) 317 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
7653778
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi117 smithi203
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:20:46.240179+0000 osd.4 (osd.4) 65 : cluster [ERR] 51.12 soid 51:4adf0e44:::smithi117523023-26:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653779
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi018 smithi155
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T11:57:27.813171+0000 osd.0 (osd.0) 6 : cluster [ERR] 59.b soid 59:d3b885bf:::smithi018849635-16:150 : object info inconsistent , attr value mismatch '__header'" in cluster log
7653780
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi060 smithi105
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"1712916600.000141 mon.a (mon.0) 768 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log
7653781
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi170 smithi186
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:41:51.548880+0000 osd.7 (osd.7) 40 : cluster [ERR] 61.8 soid 61:1044ab3d:::smithi170741632-377:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653782
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi026 smithi130
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"1712916762.9854252 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
7653783
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi038 smithi121
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T10:22:48.950764+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log
7653784
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi086 smithi090
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
timeout expired in wait_until_healthy
7653785
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi077 smithi149
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T11:57:50.026935+0000 osd.3 (osd.3) 92 : cluster [ERR] 57.14 soid 57:281270da:::smithi077659812-352:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653786
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi120 smithi188
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"1712918376.9749582 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
7653787
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi043 smithi116
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
No module named 'tasks.rados'
7653788
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi084 smithi179
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
"2024-04-12T12:08:53.595141+0000 osd.5 (osd.5) 54 : cluster [ERR] 87.10 soid 87:08951484:::smithi084622990-2:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653789
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi134 smithi194
upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
timeout expired in wait_until_healthy
7653790
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
ubuntu 22.04
smithi088 smithi132
upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
"2024-04-12T12:26:12.226104+0000 osd.7 (osd.7) 42 : cluster [ERR] 50.7 soid 50:e0498baa:::smithi088392994-48:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log
7653791
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi029 smithi087
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
No module named 'tasks.workunit'
7653792
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi150 smithi162
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
No module named 'tasks.workunit'
7653793
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi083 smithi165
upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity}
No module named 'tasks.workunit'
7653794
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi090 smithi092
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity}
No module named 'tasks.thrashosds'
7653795
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi086 smithi159
upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
No module named 'tasks.rados'
7653796
FAIL
wip-rf-comb1
wip-rf-comb1
main
smithi
centos 9.stream
smithi066 smithi164
upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic}
No module named 'tasks.rados'