| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2024-04-13 03:08:05 | 2024-04-13 06:43:53 | 2024-04-13 11:21:07 | 4:37:14 | upgrade | main | smithi | 5f22a49 | 5 | 32 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7654929 |
|
2024-04-13 03:08:38 | 2024-04-13 06:43:53 | 2024-04-13 07:20:54 | 0:37:01 | 0:24:13 | 0:12:48 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7654930 |
|
2024-04-13 03:08:40 | 2024-04-13 06:47:44 | 2024-04-13 07:07:10 | 0:19:26 | 0:09:51 | 0:09:35 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
Failure Reason:
"2024-04-13T07:05:44.150383+0000 mon.a (mon.0) 38 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7654931 |
|
2024-04-13 03:08:41 | 2024-04-13 06:47:45 | 2024-04-13 08:48:47 | 2:01:02 | 1:49:34 | 0:11:28 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-04-13T07:18:14.755811+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7654932 |
|
2024-04-13 03:08:42 | 2024-04-13 06:49:05 | 2024-04-13 07:04:54 | 0:15:49 | 0:04:43 | 0:11:06 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_9.stream} 0-start 1-tasks} | 2 |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific |
||||||||||||||
| fail | 7654933 |
|
2024-04-13 03:08:43 | 2024-04-13 06:49:06 | 2024-04-13 07:52:18 | 1:03:12 | 0:52:50 | 0:10:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7654934 |
|
2024-04-13 03:08:44 | 2024-04-13 06:49:06 | 2024-04-13 08:43:34 | 1:54:28 | 1:43:30 | 0:10:58 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-04-13T07:26:53.856639+0000 mon.a (mon.0) 18 : cluster [ERR] Health check failed: 8 osds(s) are not reachable (OSD_UNREACHABLE)" in cluster log |
||||||||||||||
| fail | 7654935 |
|
2024-04-13 03:08:45 | 2024-04-13 06:49:47 | 2024-04-13 09:55:59 | 3:06:12 | 2:54:43 | 0:11:29 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T08:58:31.109022+0000 osd.6 (osd.6) 4 : cluster [ERR] 62.2 soid 62:431a08bb:::smithi162701712-19:18b : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| pass | 7654936 |
|
2024-04-13 03:08:46 | 2024-04-13 06:50:28 | 2024-04-13 07:12:00 | 0:21:32 | 0:11:49 | 0:09:43 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7654937 |
|
2024-04-13 03:08:47 | 2024-04-13 06:50:28 | 2024-04-13 09:49:14 | 2:58:46 | 2:47:57 | 0:10:49 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1712992412.8671365 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7654938 |
|
2024-04-13 03:08:48 | 2024-04-13 06:51:59 | 2024-04-13 10:04:28 | 3:12:29 | 3:01:25 | 0:11:04 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T08:38:45.109328+0000 osd.3 (osd.3) 72 : cluster [ERR] 58.3 soid 58:c1a65454:::smithi161761142-153:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| fail | 7654939 |
|
2024-04-13 03:08:49 | 2024-04-13 06:53:10 | 2024-04-13 09:52:02 | 2:58:52 | 2:42:50 | 0:16:02 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T08:23:17.160968+0000 osd.5 (osd.5) 33 : cluster [ERR] 50.17 soid 50:e9195193:::smithi044512902-359:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| fail | 7654940 |
|
2024-04-13 03:08:50 | 2024-04-13 06:58:41 | 2024-04-13 10:49:08 | 3:50:27 | 3:35:59 | 0:14:28 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi130 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2d8c3155d854ee204cb7c7261232571229d1d54 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7654941 |
|
2024-04-13 03:08:51 | 2024-04-13 07:00:02 | 2024-04-13 07:53:48 | 0:53:46 | 0:44:31 | 0:09:15 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7654942 |
|
2024-04-13 03:08:52 | 2024-04-13 07:00:03 | 2024-04-13 07:55:36 | 0:55:33 | 0:45:23 | 0:10:10 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7654943 |
|
2024-04-13 03:08:53 | 2024-04-13 07:00:03 | 2024-04-13 10:48:54 | 3:48:51 | 3:38:31 | 0:10:20 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T09:28:17.435283+0000 osd.5 (osd.5) 50 : cluster [ERR] 103.0 soid 103:002a3059:::smithi053842980-10:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| pass | 7654944 |
|
2024-04-13 03:08:54 | 2024-04-13 07:01:34 | 2024-04-13 07:39:32 | 0:37:58 | 0:20:28 | 0:17:30 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7654945 |
|
2024-04-13 03:08:55 | 2024-04-13 07:10:36 | 2024-04-13 10:03:36 | 2:53:00 | 2:40:59 | 0:12:01 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1712993619.5137918 mon.a (mon.0) 503 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7654946 |
|
2024-04-13 03:08:56 | 2024-04-13 07:12:07 | 2024-04-13 08:32:56 | 1:20:49 | 1:07:26 | 0:13:23 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7654947 |
|
2024-04-13 03:08:57 | 2024-04-13 07:15:37 | 2024-04-13 09:55:32 | 2:39:55 | 2:29:22 | 0:10:33 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T09:00:15.366179+0000 osd.4 (osd.4) 72 : cluster [ERR] 58.6 soid 58:604823a0:::smithi090704779-483:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| pass | 7654948 |
|
2024-04-13 03:08:58 | 2024-04-13 07:15:38 | 2024-04-13 07:42:34 | 0:26:56 | 0:18:43 | 0:08:13 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/fsstress}} | 2 |
| fail | 7654949 |
|
2024-04-13 03:08:59 | 2024-04-13 07:15:39 | 2024-04-13 09:46:48 | 2:31:09 | 2:20:23 | 0:10:46 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1712993807.007602 mon.a (mon.0) 508 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7654950 |
|
2024-04-13 03:09:00 | 2024-04-13 07:15:39 | 2024-04-13 08:00:54 | 0:45:15 | 0:30:12 | 0:15:03 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream} 0-start 1-tasks} | 2 |
Failure Reason:
"1712994145.6915643 mon.a (mon.0) 660 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7654951 |
|
2024-04-13 03:09:01 | 2024-04-13 07:18:10 | 2024-04-13 09:18:12 | 2:00:02 | 1:47:28 | 0:12:34 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-04-13T07:50:01.317903+0000 mon.a (mon.0) 264 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7654952 |
|
2024-04-13 03:09:02 | 2024-04-13 07:21:01 | 2024-04-13 11:14:14 | 3:53:13 | 3:36:38 | 0:16:35 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi077 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2d8c3155d854ee204cb7c7261232571229d1d54 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7654953 |
|
2024-04-13 03:09:03 | 2024-04-13 07:24:42 | 2024-04-13 09:04:00 | 1:39:18 | 1:28:46 | 0:10:32 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1712994291.1762464 mon.a (mon.0) 525 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7654954 |
|
2024-04-13 03:09:04 | 2024-04-13 07:24:43 | 2024-04-13 11:13:55 | 3:49:12 | 3:25:37 | 0:23:35 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T08:18:01.228290+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7654955 |
|
2024-04-13 03:09:05 | 2024-04-13 07:38:25 | 2024-04-13 08:39:17 | 1:00:52 | 0:50:38 | 0:10:14 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7654956 |
|
2024-04-13 03:09:06 | 2024-04-13 07:39:36 | 2024-04-13 08:11:24 | 0:31:48 | 0:21:56 | 0:09:52 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
Failure Reason:
Command failed on smithi017 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.30 deep-scrub' |
||||||||||||||
| fail | 7654957 |
|
2024-04-13 03:09:07 | 2024-04-13 07:40:17 | 2024-04-13 11:08:32 | 3:28:15 | 3:16:30 | 0:11:45 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T08:04:05.829364+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7654958 |
|
2024-04-13 03:09:08 | 2024-04-13 07:42:38 | 2024-04-13 08:29:54 | 0:47:16 | 0:34:01 | 0:13:15 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1712995535.7198308 mon.smithi042 (mon.0) 341 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7654959 |
|
2024-04-13 03:09:09 | 2024-04-13 07:45:09 | 2024-04-13 11:06:05 | 3:20:56 | 2:58:39 | 0:22:17 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T10:05:53.274209+0000 osd.1 (osd.1) 86 : cluster [ERR] 53.1 soid 53:810a7c1d:::smithi098379425-22:19f : object info inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| fail | 7654960 |
|
2024-04-13 03:09:10 | 2024-04-13 07:58:21 | 2024-04-13 11:21:07 | 3:22:46 | 3:08:57 | 0:13:49 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T09:47:53.272579+0000 osd.4 (osd.4) 47 : cluster [ERR] 58.13 soid 58:c93822fb:::smithi005677167-404:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| fail | 7654961 |
|
2024-04-13 03:09:11 | 2024-04-13 08:02:02 | 2024-04-13 10:53:11 | 2:51:09 | 2:42:32 | 0:08:37 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-13T09:33:49.264953+0000 osd.6 (osd.6) 153 : cluster [ERR] 50.19 soid 50:9882d297:::smithi089529128-37:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
| pass | 7654962 |
|
2024-04-13 03:09:12 | 2024-04-13 08:02:02 | 2024-04-13 08:33:04 | 0:31:02 | 0:23:02 | 0:08:00 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7654963 |
|
2024-04-13 03:09:13 | 2024-04-13 08:02:03 | 2024-04-13 08:49:02 | 0:46:59 | 0:36:39 | 0:10:20 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7654964 |
|
2024-04-13 03:09:14 | 2024-04-13 08:02:03 | 2024-04-13 10:58:35 | 2:56:32 | 2:31:30 | 0:25:02 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T08:48:43.355620+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7654965 |
|
2024-04-13 03:09:15 | 2024-04-13 08:17:26 | 2024-04-13 10:50:10 | 2:32:44 | 2:19:42 | 0:13:02 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-13T09:47:42.801519+0000 osd.6 (osd.6) 34 : cluster [ERR] 50.10 soid 50:096cad85:::smithi049548649-6:head : object info inconsistent , snapset inconsistent , attr value mismatch '__header'" in cluster log |
||||||||||||||
Pulpito