User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
teuthology | 2024-04-20 03:08:03 | 2024-04-20 03:08:59 | 2024-04-20 15:18:13 | 12:09:14 | upgrade | main | smithi | d5c8530 | 6 | 29 | 1 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 7664343 | 2024-04-20 03:08:57 | 2024-04-20 03:08:58 | 2024-04-20 03:42:15 | 0:33:17 | 0:24:40 | 0:08:37 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
fail | 7664344 | 2024-04-20 03:08:58 | 2024-04-20 03:08:58 | 2024-04-20 03:30:01 | 0:21:03 | 0:09:55 | 0:11:08 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 | |
Failure Reason:
"2024-04-20T03:28:59.806928+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7664345 | 2024-04-20 03:08:59 | 2024-04-20 03:08:59 | 2024-04-20 05:00:10 | 1:51:11 | 1:44:59 | 0:06:12 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-20T03:31:40.162408+0000 mon.a (mon.0) 340 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
dead | 7664346 | 2024-04-20 03:09:00 | 2024-04-20 03:09:00 | 2024-04-20 15:18:13 | 12:09:13 | smithi | main | centos | 8.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7664347 | 2024-04-20 03:09:01 | 2024-04-20 03:09:01 | 2024-04-20 03:46:18 | 0:37:17 | 0:30:33 | 0:06:44 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
fail | 7664348 | 2024-04-20 03:09:02 | 2024-04-20 03:09:02 | 2024-04-20 04:42:09 | 1:33:07 | 1:26:18 | 0:06:49 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1713583494.4790878 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7664349 | 2024-04-20 03:09:03 | 2024-04-20 03:09:03 | 2024-04-20 06:14:28 | 3:05:25 | 2:58:02 | 0:07:23 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"2024-04-20T05:00:36.339129+0000 osd.2 (osd.2) 15 : cluster [ERR] 61.d soid 61:b00ffb1d:::smithi083727623-11:31 : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
pass | 7664350 | 2024-04-20 03:09:04 | 2024-04-20 03:09:04 | 2024-04-20 03:30:04 | 0:21:00 | 0:11:41 | 0:09:19 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-pacific 1-upgrade}} | 1 | |
pass | 7664351 | 2024-04-20 03:09:05 | 2024-04-20 03:09:05 | 2024-04-20 03:31:35 | 0:22:30 | 0:12:05 | 0:10:25 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/new_ops/{newops}}} | 2 | |
fail | 7664352 | 2024-04-20 03:09:06 | 2024-04-20 03:09:06 | 2024-04-20 05:52:05 | 2:42:59 | 2:33:39 | 0:09:20 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"1713583616.5198622 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7664353 | 2024-04-20 03:09:07 | 2024-04-20 03:09:07 | 2024-04-20 06:26:33 | 3:17:26 | 3:08:14 | 0:09:12 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-20T04:53:09.136603+0000 osd.5 (osd.5) 47 : cluster [ERR] 57.18 soid 57:187f1590:::smithi044765640-456:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
fail | 7664354 | 2024-04-20 03:09:08 | 2024-04-20 03:09:08 | 2024-04-20 06:04:37 | 2:55:29 | 2:45:31 | 0:09:58 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"1713583782.4881973 mon.a (mon.0) 691 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7664355 | 2024-04-20 03:09:09 | 2024-04-20 03:09:09 | 2024-04-20 03:54:46 | 0:45:37 | 0:35:57 | 0:09:40 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7664356 | 2024-04-20 03:09:10 | 2024-04-20 03:09:10 | 2024-04-20 06:22:48 | 3:13:38 | 3:01:09 | 0:12:29 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"2024-04-20T03:37:21.617551+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7664357 | 2024-04-20 03:09:11 | 2024-04-20 03:09:11 | 2024-04-20 06:05:21 | 2:56:10 | 2:44:06 | 0:12:04 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"1713584490.044151 mon.a (mon.0) 510 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7664358 | 2024-04-20 03:09:12 | 2024-04-20 03:09:13 | 2024-04-20 06:38:50 | 3:29:37 | 3:19:24 | 0:10:13 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-20T03:36:08.633170+0000 mon.a (mon.0) 99 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7664359 | 2024-04-20 03:09:13 | 2024-04-20 03:09:14 | 2024-04-20 03:40:56 | 0:31:42 | 0:20:04 | 0:11:38 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
fail | 7664360 | 2024-04-20 03:09:14 | 2024-04-20 03:09:15 | 2024-04-20 06:42:52 | 3:33:37 | 3:27:02 | 0:06:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-20T04:50:20.471100+0000 osd.4 (osd.4) 24 : cluster [ERR] 86.11 soid 86:88bbfd32:::smithi029516431-175:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
pass | 7664361 | 2024-04-20 03:09:15 | 2024-04-20 03:09:16 | 2024-04-20 03:49:10 | 0:39:54 | 0:32:52 | 0:07:02 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
fail | 7664362 | 2024-04-20 03:09:16 | 2024-04-20 03:09:17 | 2024-04-20 05:48:30 | 2:39:13 | 2:30:25 | 0:08:48 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"2024-04-20T05:03:39.104847+0000 osd.6 (osd.6) 4 : cluster [ERR] 58.1 soid 58:834e2f93:::smithi047793217-17:16c : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
fail | 7664363 | 2024-04-20 03:09:17 | 2024-04-20 03:09:18 | 2024-04-20 05:25:03 | 2:15:45 | 2:06:11 | 0:09:34 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"1713583663.593385 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7664364 | 2024-04-20 03:09:18 | 2024-04-20 03:09:18 | 2024-04-20 03:45:15 | 0:35:57 | 0:27:13 | 0:08:44 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream} 0-start 1-tasks} | 2 | |
Failure Reason:
"1713583567.2865825 mon.a (mon.0) 659 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7664365 | 2024-04-20 03:09:19 | 2024-04-20 03:09:19 | 2024-04-20 05:01:30 | 1:52:11 | 1:43:56 | 0:08:15 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-20T03:34:30.689782+0000 mon.a (mon.0) 351 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 7664366 | 2024-04-20 03:09:20 | 2024-04-20 03:09:21 | 2024-04-20 03:54:24 | 0:45:03 | 0:36:10 | 0:08:53 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7664367 | 2024-04-20 03:09:21 | 2024-04-20 03:09:22 | 2024-04-20 04:42:02 | 1:32:40 | 1:25:10 | 0:07:30 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1713583567.672139 mon.a (mon.0) 655 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7664368 | 2024-04-20 03:09:22 | 2024-04-20 03:09:23 | 2024-04-20 04:14:47 | 1:05:24 | 0:53:38 | 0:11:46 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7664369 | 2024-04-20 03:09:23 | 2024-04-20 03:09:24 | 2024-04-20 04:14:47 | 1:05:23 | 0:53:51 | 0:11:32 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7664370 | 2024-04-20 03:09:25 | 2024-04-20 03:09:25 | 2024-04-20 03:41:24 | 0:31:59 | 0:21:19 | 0:10:40 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 | |
Failure Reason:
Command failed on smithi078 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.8 deep-scrub' |
||||||||||||||
fail | 7664371 | 2024-04-20 03:09:26 | 2024-04-20 03:09:26 | 2024-04-20 04:20:41 | 1:11:15 | 1:00:31 | 0:10:44 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7664372 | 2024-04-20 03:09:27 | 2024-04-20 03:09:27 | 2024-04-20 03:49:51 | 0:40:24 | 0:32:11 | 0:08:13 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
"2024-04-20T03:40:00.000107+0000 mon.smithi080 (mon.0) 345 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded" in cluster log |
||||||||||||||
fail | 7664373 | 2024-04-20 03:09:28 | 2024-04-20 03:09:28 | 2024-04-20 06:10:51 | 3:01:23 | 2:49:54 | 0:11:29 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"1713584648.4088316 mon.a (mon.0) 691 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
fail | 7664374 | 2024-04-20 03:09:29 | 2024-04-20 03:09:29 | 2024-04-20 06:03:35 | 2:54:06 | 2:45:51 | 0:08:15 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-20T04:57:37.264515+0000 osd.6 (osd.6) 18 : cluster [ERR] 58.19 soid 58:9b72e28a:::smithi012690778-32:f7 : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
fail | 7664375 | 2024-04-20 03:09:30 | 2024-04-20 03:09:49 | 2024-04-20 05:48:50 | 2:39:01 | 2:31:01 | 0:08:00 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-20T04:39:08.276800+0000 osd.4 (osd.4) 36 : cluster [ERR] 51.4 soid 51:20cfca17:::smithi046513570-47:57 : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
fail | 7664376 | 2024-04-20 03:09:31 | 2024-04-20 03:09:59 | 2024-04-20 03:54:50 | 0:44:51 | 0:36:24 | 0:08:27 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7664377 | 2024-04-20 03:09:32 | 2024-04-20 03:11:20 | 2024-04-20 05:59:22 | 2:48:02 | 2:39:06 | 0:08:56 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"2024-04-20T04:53:23.371287+0000 osd.6 (osd.6) 6 : cluster [ERR] 56.13 soid 56:c8784bfa:::smithi007738136-105:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
fail | 7664378 | 2024-04-20 03:09:33 | 2024-04-20 03:11:30 | 2024-04-20 05:40:07 | 2:28:37 | 2:18:56 | 0:09:41 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 | |
Failure Reason:
"1713583689.531084 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |