Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7674554 2024-04-26 02:08:51 2024-04-26 04:18:24 2024-04-26 04:48:46 0:30:22 0:18:42 0:11:40 smithi main centos 8.stream upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

pass 7674555 2024-04-26 02:08:52 2024-04-26 04:18:54 2024-04-26 04:38:54 0:20:00 0:09:54 0:10:06 smithi main ubuntu 22.04 upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} 1
fail 7674556 2024-04-26 02:08:53 2024-04-26 04:19:24 2024-04-26 06:13:20 1:53:56 1:45:32 0:08:24 smithi main centos 9.stream upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"2024-04-26T05:40:00.000232+0000 mon.a (mon.0) 2836 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log

fail 7674557 2024-04-26 02:08:54 2024-04-26 04:19:55 2024-04-26 04:31:25 0:11:30 0:03:36 0:07:54 smithi main centos 9.stream upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

pass 7674558 2024-04-26 02:08:55 2024-04-26 04:19:55 2024-04-26 04:57:58 0:38:03 0:31:11 0:06:52 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7674559 2024-04-26 02:08:56 2024-04-26 04:20:16 2024-04-26 06:15:58 1:55:42 1:44:30 0:11:12 smithi main ubuntu 22.04 upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"1714106895.171712 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

dead 7674560 2024-04-26 02:08:57 2024-04-26 04:20:16 2024-04-26 04:21:20 0:01:04 smithi main centos 8.stream upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi156

fail 7674561 2024-04-26 02:08:58 2024-04-26 04:20:16 2024-04-26 07:45:39 3:25:23 3:19:27 0:05:56 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-26T06:20:00.000174+0000 mon.a (mon.0) 6980 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 5 scrub errors" in cluster log

fail 7674562 2024-04-26 02:08:59 2024-04-26 04:20:17 2024-04-26 05:11:11 0:50:54 0:44:51 0:06:03 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674563 2024-04-26 02:09:00 2024-04-26 04:20:17 2024-04-26 07:07:16 2:46:59 2:40:04 0:06:55 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"2024-04-26T06:20:00.000143+0000 mon.a (mon.0) 7339 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 5 scrub errors" in cluster log

fail 7674564 2024-04-26 02:09:01 2024-04-26 04:20:17 2024-04-26 04:41:19 0:21:02 0:12:22 0:08:40 smithi main centos 8.stream upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

fail 7674565 2024-04-26 02:09:02 2024-04-26 04:20:18 2024-04-26 05:00:38 0:40:20 0:32:16 0:08:04 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674566 2024-04-26 02:09:03 2024-04-26 04:21:29 2024-04-26 05:06:31 0:45:02 0:36:48 0:08:14 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7674567 2024-04-26 02:09:04 2024-04-26 04:21:49 2024-04-26 07:57:15 3:35:26 3:23:22 0:12:04 smithi main ubuntu 22.04 upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-26T04:46:17.648865+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7674568 2024-04-26 02:09:05 2024-04-26 04:23:20 2024-04-26 05:27:12 1:03:52 0:51:54 0:11:58 smithi main centos 8.stream upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/dbench}} 2
fail 7674569 2024-04-26 02:09:06 2024-04-26 04:24:00 2024-04-26 05:19:48 0:55:48 0:46:09 0:09:39 smithi main ubuntu 22.04 upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674570 2024-04-26 02:09:07 2024-04-26 04:24:11 2024-04-26 04:51:39 0:27:28 0:18:05 0:09:23 smithi main centos 8.stream upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

fail 7674571 2024-04-26 02:09:08 2024-04-26 04:24:21 2024-04-26 07:30:19 3:05:58 2:58:43 0:07:15 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"2024-04-26T04:48:18.845649+0000 mon.a (mon.0) 16 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

pass 7674572 2024-04-26 02:09:09 2024-04-26 04:25:02 2024-04-26 05:04:31 0:39:29 0:31:28 0:08:01 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7674573 2024-04-26 02:09:10 2024-04-26 04:25:12 2024-04-26 05:13:17 0:48:05 0:39:12 0:08:53 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7674574 2024-04-26 02:09:11 2024-04-26 04:25:42 2024-04-26 04:51:42 0:26:00 0:16:37 0:09:23 smithi main centos 8.stream upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/fsstress}} 2
fail 7674575 2024-04-26 02:09:12 2024-04-26 04:26:33 2024-04-26 07:34:55 3:08:22 3:00:43 0:07:39 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-26T05:00:00.000164+0000 mon.a (mon.0) 649 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

fail 7674576 2024-04-26 02:09:13 2024-04-26 04:27:23 2024-04-26 05:06:49 0:39:26 0:31:56 0:07:30 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674577 2024-04-26 02:09:14 2024-04-26 04:28:04 2024-04-26 05:06:03 0:37:59 0:29:28 0:08:31 smithi main centos 9.stream upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream} 0-start 1-tasks} 2
Failure Reason:

"1714106705.1339636 mon.a (mon.0) 505 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7674578 2024-04-26 02:09:15 2024-04-26 04:28:44 2024-04-26 04:56:55 0:28:11 0:17:24 0:10:47 smithi main centos 8.stream upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

fail 7674579 2024-04-26 02:09:16 2024-04-26 04:29:05 2024-04-26 06:47:23 2:18:18 2:06:54 0:11:24 smithi main ubuntu 22.04 upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"2024-04-26T04:52:58.685584+0000 mon.a (mon.0) 177 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7674580 2024-04-26 02:09:17 2024-04-26 04:29:25 2024-04-26 06:04:41 1:35:16 1:28:24 0:06:52 smithi main centos 9.stream upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"1714106593.3830478 mon.a (mon.0) 173 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7674581 2024-04-26 02:09:18 2024-04-26 04:29:46 2024-04-26 05:13:21 0:43:35 0:37:16 0:06:19 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7674582 2024-04-26 02:09:19 2024-04-26 04:30:16 2024-04-26 07:45:40 3:15:24 3:02:55 0:12:29 smithi main ubuntu 22.04 upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"2024-04-26T04:53:37.839564+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7674583 2024-04-26 02:09:20 2024-04-26 04:31:47 2024-04-26 05:33:34 1:01:47 0:52:11 0:09:36 smithi main ubuntu 22.04 upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674584 2024-04-26 02:09:21 2024-04-26 04:31:47 2024-04-26 04:55:06 0:23:19 0:12:33 0:10:46 smithi main centos 8.stream upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

fail 7674585 2024-04-26 02:09:22 2024-04-26 04:32:28 2024-04-26 05:15:54 0:43:26 0:37:04 0:06:22 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7674586 2024-04-26 02:09:23 2024-04-26 04:32:48 2024-04-26 08:20:01 3:47:13 3:34:47 0:12:26 smithi main ubuntu 22.04 upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-26T04:56:04.855567+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7674587 2024-04-26 02:09:24 2024-04-26 04:33:59 2024-04-26 05:40:51 1:06:52 0:56:07 0:10:45 smithi main ubuntu 22.04 upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7674588 2024-04-26 02:09:25 2024-04-26 04:35:09 2024-04-26 04:58:19 0:23:10 0:11:45 0:11:25 smithi main centos 8.stream upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} 2
pass 7674589 2024-04-26 02:09:26 2024-04-26 04:35:20 2024-04-26 05:07:33 0:32:13 0:22:41 0:09:32 smithi main centos 8.stream upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} 2
fail 7674590 2024-04-26 02:09:27 2024-04-26 04:35:50 2024-04-26 07:30:31 2:54:41 2:46:57 0:07:44 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"2024-04-26T06:30:00.000169+0000 mon.a (mon.0) 6820 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 2 scrub errors" in cluster log

fail 7674591 2024-04-26 02:09:28 2024-04-26 04:35:51 2024-04-26 05:12:47 0:36:56 0:30:54 0:06:02 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7674592 2024-04-26 02:09:29 2024-04-26 04:35:51 2024-04-26 05:03:07 0:27:16 0:17:51 0:09:25 smithi main centos 8.stream upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

ceph version 17.2.7-904.gd8c6b0a3 was not installed, found 15.2.17-0.el8.

fail 7674593 2024-04-26 02:09:30 2024-04-26 04:36:01 2024-04-26 08:23:15 3:47:14 3:37:04 0:10:10 smithi main centos 9.stream upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi130 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7674594 2024-04-26 02:09:31 2024-04-26 04:36:02 2024-04-26 07:39:22 3:03:20 2:56:18 0:07:02 smithi main centos 9.stream upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-26T05:02:23.391092+0000 mon.a (mon.0) 156 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7674595 2024-04-26 02:09:32 2024-04-26 04:36:02 2024-04-26 05:15:19 0:39:17 0:32:08 0:07:09 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy