Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7765700 2024-06-20 15:28:48 2024-06-20 18:38:36 2024-06-20 18:58:14 0:19:38 0:09:50 0:09:48 smithi main ubuntu 22.04 upgrade:quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} 1
Failure Reason:

Command failed on smithi107 with status 1: "sudo egrep 'FileStore has been deprecated and is no longer supported' /var/log/ceph/ceph-osd.1.log"

dead 7765701 2024-06-20 15:28:49 2024-06-20 18:38:36 2024-06-20 18:53:52 0:15:16 smithi main centos 9.stream upgrade:quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

SSH connection to smithi179 was lost: 'sudo yum install -y kernel'

fail 7765702 2024-06-20 15:28:50 2024-06-20 18:46:43 2024-06-20 21:52:04 3:05:21 2:54:05 0:11:16 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718910662.8839328 mon.a (mon.0) 689 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7765703 2024-06-20 15:28:51 2024-06-20 18:47:54 2024-06-20 19:01:30 0:13:36 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

SSH connection to smithi179 was lost: 'sudo yum install -y kernel'

dead 7765704 2024-06-20 15:28:52 2024-06-20 18:53:58 2024-06-20 19:21:09 0:27:11 0:06:58 0:20:13 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

['ubuntu@smithi179.front.sepia.ceph.com: Permission denied (publickey).']

fail 7765705 2024-06-20 15:28:53 2024-06-20 19:01:31 2024-06-20 21:40:42 2:39:11 2:27:05 0:12:06 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718911378.738354 mon.a (mon.0) 368 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765706 2024-06-20 15:28:53 2024-06-20 19:03:43 2024-06-20 22:05:25 3:01:42 2:52:45 0:08:57 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718911463.259273 mon.a (mon.0) 503 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765707 2024-06-20 15:28:54 2024-06-20 19:04:24 2024-06-20 21:51:46 2:47:22 2:31:47 0:15:35 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718912185.3683996 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 7765708 2024-06-20 15:28:55 2024-06-20 19:10:17 2024-06-20 19:38:43 0:28:26 0:06:50 0:21:36 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

['ubuntu@smithi179.front.sepia.ceph.com: Permission denied (publickey).']

fail 7765709 2024-06-20 15:28:56 2024-06-20 19:21:13 2024-06-20 21:42:40 2:21:27 2:09:09 0:12:18 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718912720.0941339 mon.a (mon.0) 683 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765710 2024-06-20 15:28:57 2024-06-20 19:22:44 2024-06-20 22:13:31 2:50:47 2:38:17 0:12:30 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718912858.9308484 mon.a (mon.0) 609 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7765711 2024-06-20 15:28:57 2024-06-20 19:26:06 2024-06-20 22:22:41 2:56:35 2:45:04 0:11:31 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718913499.0576375 mon.a (mon.0) 689 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765712 2024-06-20 15:28:58 2024-06-20 19:28:58 2024-06-20 22:15:28 2:46:30 2:36:11 0:10:19 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718913137.4399018 mon.a (mon.0) 688 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765713 2024-06-20 15:28:59 2024-06-20 19:29:39 2024-06-20 22:18:46 2:49:07 2:32:27 0:16:40 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718913467.3497128 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

dead 7765714 2024-06-20 15:29:00 2024-06-20 19:37:03 2024-06-20 19:47:16 0:10:13 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

SSH connection to smithi179 was lost: 'sudo yum install -y kernel'

fail 7765715 2024-06-20 15:29:01 2024-06-20 19:38:44 2024-06-20 20:36:52 0:58:08 0:45:44 0:12:24 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765716 2024-06-20 15:29:02 2024-06-20 19:40:56 2024-06-20 22:42:14 3:01:18 2:48:43 0:12:35 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718913994.1521902 mon.a (mon.0) 670 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

dead 7765717 2024-06-20 15:29:02 2024-06-20 19:44:48 2024-06-20 19:57:08 0:12:20 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

SSH connection to smithi179 was lost: 'sudo yum install -y kernel'

fail 7765718 2024-06-20 15:29:03 2024-06-20 19:47:20 2024-06-20 20:43:40 0:56:20 0:44:54 0:11:26 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765719 2024-06-20 15:29:04 2024-06-20 19:47:31 2024-06-20 22:37:11 2:49:40 2:30:51 0:18:49 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718914614.227936 mon.a (mon.0) 510 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765720 2024-06-20 15:29:05 2024-06-20 21:26:55 2024-06-21 00:34:39 3:07:44 2:56:57 0:10:47 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718920224.828655 mon.a (mon.0) 679 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765721 2024-06-20 15:29:06 2024-06-20 21:29:37 2024-06-20 23:55:47 2:26:10 2:15:24 0:10:46 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718920323.1481228 mon.a (mon.0) 689 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765722 2024-06-20 15:29:07 2024-06-20 21:30:38 2024-06-20 22:28:19 0:57:41 0:45:17 0:12:24 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765723 2024-06-20 15:29:07 2024-06-20 21:32:29 2024-06-21 00:11:26 2:38:57 2:30:16 0:08:41 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718920380.6060193 mon.a (mon.0) 684 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765724 2024-06-20 15:29:08 2024-06-20 21:32:30 2024-06-21 00:17:58 2:45:28 2:28:39 0:16:49 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718920782.4383907 mon.a (mon.0) 505 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

dead 7765725 2024-06-20 15:29:09 2024-06-20 21:38:24 2024-06-20 21:55:50 0:17:26 0:06:57 0:10:29 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

['ubuntu@smithi179.front.sepia.ceph.com: Permission denied (publickey).']

fail 7765726 2024-06-20 15:29:10 2024-06-20 21:38:24 2024-06-21 01:08:32 3:30:08 3:18:20 0:11:48 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718921244.2984622 mon.a (mon.0) 511 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765727 2024-06-20 15:29:11 2024-06-20 21:40:46 2024-06-21 00:12:44 2:31:58 2:18:40 0:13:18 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718921053.358626 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765728 2024-06-20 15:29:12 2024-06-20 21:42:48 2024-06-21 00:38:32 2:55:44 2:43:21 0:12:23 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718921136.0083394 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7765729 2024-06-20 15:29:12 2024-06-20 21:45:30 2024-06-20 22:50:53 1:05:23 0:53:04 0:12:19 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765730 2024-06-20 15:29:13 2024-06-20 21:46:51 2024-06-21 00:35:07 2:48:16 2:38:18 0:09:58 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718921122.2474597 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7765731 2024-06-20 15:29:14 2024-06-20 21:48:02 2024-06-21 00:41:14 2:53:12 2:42:27 0:10:45 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718921616.0662327 mon.a (mon.0) 505 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765732 2024-06-20 15:29:15 2024-06-20 21:48:03 2024-06-21 01:02:51 3:14:48 3:02:16 0:12:32 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718921606.4310138 mon.a (mon.0) 375 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765733 2024-06-20 15:29:16 2024-06-20 21:51:55 2024-06-21 00:37:32 2:45:37 2:33:15 0:12:22 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922254.4394782 mon.a (mon.0) 701 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765734 2024-06-20 15:29:16 2024-06-20 21:52:06 2024-06-21 00:53:44 3:01:38 2:51:06 0:10:32 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718921523.5841577 mon.a (mon.0) 375 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765735 2024-06-20 15:29:17 2024-06-20 21:52:37 2024-06-21 00:37:40 2:45:03 2:27:55 0:17:08 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922164.3282714 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765736 2024-06-20 15:29:18 2024-06-20 21:55:59 2024-06-21 01:00:17 3:04:18 2:54:06 0:10:12 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922195.5455532 mon.a (mon.0) 513 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765737 2024-06-20 15:29:19 2024-06-20 21:56:30 2024-06-21 00:47:32 2:51:02 2:36:09 0:14:53 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922188.7216878 mon.a (mon.0) 693 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765738 2024-06-20 15:29:20 2024-06-20 21:59:42 2024-06-20 23:37:02 1:37:20 1:26:38 0:10:42 smithi main centos 9.stream upgrade:quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"1718922140.7193758 mon.a (mon.0) 660 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765739 2024-06-20 15:29:21 2024-06-20 21:59:43 2024-06-21 00:55:42 2:55:59 2:45:15 0:10:44 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922183.77066 mon.a (mon.0) 694 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765740 2024-06-20 15:29:21 2024-06-20 22:00:04 2024-06-21 00:43:26 2:43:22 2:32:16 0:11:06 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922244.6310418 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765741 2024-06-20 15:29:22 2024-06-20 22:02:06 2024-06-20 22:59:47 0:57:41 0:45:01 0:12:40 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765742 2024-06-20 15:29:23 2024-06-20 22:03:37 2024-06-21 01:03:25 2:59:48 2:49:48 0:10:00 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922290.1997721 mon.a (mon.0) 520 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765743 2024-06-20 15:29:24 2024-06-20 22:03:38 2024-06-21 00:34:48 2:31:10 2:22:38 0:08:32 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922257.37815 mon.a (mon.0) 507 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765744 2024-06-20 15:29:25 2024-06-20 22:03:39 2024-06-20 23:06:55 1:03:16 0:51:16 0:12:00 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765745 2024-06-20 15:29:26 2024-06-20 22:04:40 2024-06-20 23:12:54 1:08:14 0:58:12 0:10:02 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765746 2024-06-20 15:29:26 2024-06-20 22:05:01 2024-06-21 00:56:19 2:51:18 2:40:43 0:10:35 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922185.113651 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 7765747 2024-06-20 15:29:27 2024-06-20 22:05:02 2024-06-21 00:48:43 2:43:41 2:33:13 0:10:28 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922315.2484884 mon.a (mon.0) 374 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765748 2024-06-20 15:29:28 2024-06-20 22:05:13 2024-06-21 01:13:09 3:07:56 2:57:36 0:10:20 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922933.7146766 mon.a (mon.0) 692 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765749 2024-06-20 15:29:29 2024-06-20 22:05:34 2024-06-21 00:37:12 2:31:38 2:19:08 0:12:30 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922517.174403 mon.a (mon.0) 507 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765750 2024-06-20 15:29:30 2024-06-20 22:07:15 2024-06-21 01:10:44 3:03:29 2:53:21 0:10:08 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922549.2656887 mon.a (mon.0) 681 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765751 2024-06-20 15:29:31 2024-06-20 22:07:16 2024-06-21 01:01:22 2:54:06 2:43:03 0:11:03 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922555.0854127 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765752 2024-06-20 15:29:31 2024-06-20 22:07:47 2024-06-20 23:01:25 0:53:38 0:44:58 0:08:40 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765753 2024-06-20 15:29:32 2024-06-20 22:07:48 2024-06-21 00:29:49 2:22:01 2:10:28 0:11:33 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718922606.490044 mon.a (mon.0) 509 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765754 2024-06-20 15:29:33 2024-06-20 22:08:39 2024-06-21 01:03:52 2:55:13 2:44:22 0:10:51 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922643.931557 mon.a (mon.0) 667 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765755 2024-06-20 15:29:34 2024-06-20 22:08:40 2024-06-21 01:17:44 3:09:04 2:53:57 0:15:07 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
Failure Reason:

"1718923459.8561745 mon.a (mon.0) 696 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765756 2024-06-20 15:29:35 2024-06-20 22:13:33 2024-06-21 01:10:21 2:56:48 2:45:39 0:11:09 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"1718922973.6275778 mon.a (mon.0) 650 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765757 2024-06-20 15:29:36 2024-06-20 22:15:04 2024-06-21 01:06:15 2:51:11 2:41:43 0:09:28 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718922898.9125803 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765758 2024-06-20 15:29:36 2024-06-20 22:15:05 2024-06-21 00:55:19 2:40:14 2:27:42 0:12:32 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

timeout expired in wait_for_all_osds_up

fail 7765759 2024-06-20 15:29:37 2024-06-20 22:15:36 2024-06-21 01:05:08 2:49:32 2:35:40 0:13:52 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718923541.4811077 mon.a (mon.0) 513 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765760 2024-06-20 15:29:38 2024-06-20 22:18:49 2024-06-21 01:16:06 2:57:17 2:43:04 0:14:13 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718923390.4522948 mon.a (mon.0) 507 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765761 2024-06-20 15:29:39 2024-06-20 22:22:51 2024-06-21 00:57:50 2:34:59 2:17:04 0:17:55 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718923910.9403734 mon.a (mon.0) 517 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765762 2024-06-20 15:29:40 2024-06-20 22:25:43 2024-06-20 23:30:07 1:04:24 0:52:06 0:12:18 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7765763 2024-06-20 15:29:40 2024-06-20 22:28:25 2024-06-21 01:40:50 3:12:25 3:01:53 0:10:32 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718924331.3108075 mon.a (mon.0) 697 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765764 2024-06-20 15:29:41 2024-06-20 22:28:56 2024-06-21 01:03:06 2:34:10 2:24:42 0:09:28 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718923851.9108121 mon.a (mon.0) 692 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765765 2024-06-20 15:29:42 2024-06-20 22:29:57 2024-06-21 00:56:44 2:26:47 2:15:07 0:11:40 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718923953.6924872 mon.a (mon.0) 510 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765766 2024-06-20 15:29:43 2024-06-20 22:29:58 2024-06-21 01:47:15 3:17:17 2:59:14 0:18:03 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718924654.0564988 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765767 2024-06-20 15:29:44 2024-06-20 22:37:12 2024-06-21 01:08:42 2:31:30 2:21:02 0:10:28 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718924400.0001435 mon.a (mon.0) 770 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log

fail 7765768 2024-06-20 15:29:45 2024-06-20 22:37:33 2024-06-21 01:39:28 3:01:55 2:48:24 0:13:31 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718924448.0617378 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765769 2024-06-20 15:29:45 2024-06-20 22:40:15 2024-06-21 01:30:36 2:50:21 2:40:09 0:10:12 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718924512.6618974 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765770 2024-06-20 15:29:46 2024-06-20 22:41:26 2024-06-21 01:56:20 3:14:54 3:04:20 0:10:34 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718925184.9200985 mon.a (mon.0) 724 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7765771 2024-06-20 15:29:47 2024-06-20 22:42:18 2024-06-21 01:08:21 2:26:03 2:14:07 0:11:56 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718924686.1007247 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 7765772 2024-06-20 15:29:48 2024-06-20 22:45:09 2024-06-21 01:42:13 2:57:04 2:47:05 0:09:59 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718924772.6650527 mon.a (mon.0) 504 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765773 2024-06-20 15:29:49 2024-06-20 22:45:10 2024-06-21 01:23:58 2:38:48 2:29:06 0:09:42 smithi main ubuntu 22.04 upgrade:quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"1718925176.9200735 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 7765774 2024-06-20 15:29:50 2024-06-20 22:46:01 2024-06-21 01:37:13 2:51:12 2:37:12 0:14:00 smithi main centos 9.stream upgrade:quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} 2
Failure Reason:

"1718925003.412534 mon.a (mon.0) 509 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log