| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| skanta | 2024-09-08 12:47:32 | 2024-09-08 12:48:26 | 2024-09-09 03:52:44 | 15:04:18 | upgrade | squid-release | smithi | f03a108 | 49 | 190 | 2 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7894300 |
|
2024-09-08 12:47:40 | 2024-09-08 12:48:24 | 2024-09-08 13:14:21 | 0:25:57 | 0:19:20 | 0:06:37 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/quincy 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7894301 |
|
2024-09-08 12:47:41 | 2024-09-08 12:48:24 | 2024-09-08 13:07:57 | 0:19:33 | 0:10:36 | 0:08:57 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
Failure Reason:
"1725800784.2538586 mon.a (mon.0) 62 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894302 |
|
2024-09-08 12:47:42 | 2024-09-08 12:48:24 | 2024-09-08 14:49:18 | 2:00:54 | 1:53:59 | 0:06:55 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-09-08T13:04:59.136483+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894303 |
|
2024-09-08 12:47:44 | 2024-09-08 12:48:25 | 2024-09-08 13:46:05 | 0:57:40 | 0:47:26 | 0:10:14 | smithi | main | ubuntu | 22.04 | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks} | 2 |
| fail | 7894304 |
|
2024-09-08 12:47:45 | 2024-09-08 12:48:25 | 2024-09-08 13:31:26 | 0:43:01 | 0:36:15 | 0:06:46 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894305 |
|
2024-09-08 12:47:46 | 2024-09-08 12:48:26 | 2024-09-08 14:29:48 | 1:41:22 | 1:33:57 | 0:07:25 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1725800663.0248816 mon.a (mon.0) 511 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894306 |
|
2024-09-08 12:47:48 | 2024-09-08 12:48:26 | 2024-09-08 16:24:22 | 3:35:56 | 3:28:32 | 0:07:24 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:07:46.030969+0000 mon.a (mon.0) 696 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894307 |
|
2024-09-08 12:47:49 | 2024-09-08 12:48:26 | 2024-09-08 13:03:02 | 0:14:36 | 0:08:10 | 0:06:26 | smithi | main | centos | 9.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} | 1 |
| pass | 7894308 |
|
2024-09-08 12:47:50 | 2024-09-08 12:48:27 | 2024-09-08 13:04:28 | 0:16:01 | 0:08:57 | 0:07:04 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/new_ops/{newops}}} | 2 |
| fail | 7894309 |
|
2024-09-08 12:47:51 | 2024-09-08 12:48:27 | 2024-09-08 16:09:36 | 3:21:09 | 3:13:43 | 0:07:26 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725800549.4474733 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894310 |
|
2024-09-08 12:47:53 | 2024-09-08 12:48:28 | 2024-09-08 15:35:41 | 2:47:13 | 2:39:38 | 0:07:35 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:06:36.190655+0000 mon.a (mon.0) 672 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894311 |
|
2024-09-08 12:47:54 | 2024-09-08 12:48:28 | 2024-09-08 13:28:22 | 0:39:54 | 0:32:27 | 0:07:27 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T13:20:00.000222+0000 mon.smithi043 (mon.0) 678 : cluster [ERR] fs cephfs is degraded" in cluster log |
||||||||||||||
| fail | 7894312 |
|
2024-09-08 12:47:55 | 2024-09-08 12:48:39 | 2024-09-08 15:19:13 | 2:30:34 | 2:22:05 | 0:08:29 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725800667.5994043 mon.a (mon.0) 168 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894313 |
|
2024-09-08 12:47:57 | 2024-09-08 12:48:39 | 2024-09-08 16:18:01 | 3:29:22 | 3:17:59 | 0:11:23 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:11:18.695500+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894314 |
|
2024-09-08 12:47:58 | 2024-09-08 12:48:40 | 2024-09-08 13:33:23 | 0:44:43 | 0:36:42 | 0:08:01 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| dead | 7894315 |
|
2024-09-08 12:48:00 | 2024-09-08 12:48:40 | 2024-09-08 13:06:58 | 0:18:18 | 0:07:30 | 0:10:48 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6887 (apt-get)'] |
||||||||||||||
| fail | 7894316 |
|
2024-09-08 12:48:01 | 2024-09-08 12:48:40 | 2024-09-08 16:16:53 | 3:28:13 | 3:21:21 | 0:06:52 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:06:50.083403+0000 mon.a (mon.0) 562 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894317 |
|
2024-09-08 12:48:02 | 2024-09-08 12:48:41 | 2024-09-08 13:29:14 | 0:40:33 | 0:32:11 | 0:08:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T13:20:00.000275+0000 mon.smithi078 (mon.0) 470 : cluster [WRN] osd.4 (root=default,host=smithi150) is down" in cluster log |
||||||||||||||
| fail | 7894318 |
|
2024-09-08 12:48:04 | 2024-09-08 12:48:41 | 2024-09-08 15:43:00 | 2:54:19 | 2:47:21 | 0:06:58 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725800630.7149892 mon.a (mon.0) 167 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894319 |
|
2024-09-08 12:48:05 | 2024-09-08 12:48:42 | 2024-09-08 16:09:13 | 3:20:31 | 3:11:56 | 0:08:35 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:08:31.494220+0000 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894320 |
|
2024-09-08 12:48:06 | 2024-09-08 12:48:42 | 2024-09-08 13:08:17 | 0:19:35 | 0:07:09 | 0:12:26 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
SSH connection to smithi107 was lost: 'sudo yum -y install python3-rgw' |
||||||||||||||
| dead | 7894321 |
|
2024-09-08 12:48:08 | 2024-09-08 12:48:43 | 2024-09-08 13:00:14 | 0:11:31 | 0:03:53 | 0:07:38 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
['useradd: Not copying any file from skel directory into it.', "useradd: user 'sajibreadd' already exists", 'useradd: warning: the home directory /home/avan already exists.'] |
||||||||||||||
| fail | 7894322 |
|
2024-09-08 12:48:09 | 2024-09-08 12:48:43 | 2024-09-08 16:05:51 | 3:17:08 | 3:05:31 | 0:11:37 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:11:32.032388+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894323 |
|
2024-09-08 12:48:10 | 2024-09-08 12:48:44 | 2024-09-08 13:29:12 | 0:40:28 | 0:32:05 | 0:08:23 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894324 |
|
2024-09-08 12:48:11 | 2024-09-08 12:48:44 | 2024-09-08 15:53:29 | 3:04:45 | 2:50:31 | 0:14:14 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725801875.697384 mon.a (mon.0) 713 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894325 |
|
2024-09-08 12:48:13 | 2024-09-08 12:53:36 | 2024-09-08 16:51:31 | 3:57:55 | 3:48:20 | 0:09:35 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:24:00.838058+0000 mon.a (mon.0) 725 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894326 |
|
2024-09-08 12:48:14 | 2024-09-08 12:53:37 | 2024-09-08 13:37:01 | 0:43:24 | 0:35:50 | 0:07:34 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894327 |
|
2024-09-08 12:48:16 | 2024-09-08 12:53:58 | 2024-09-08 16:13:54 | 3:19:56 | 3:10:35 | 0:09:21 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725801347.2528794 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894328 |
|
2024-09-08 12:48:17 | 2024-09-08 12:53:58 | 2024-09-08 15:46:35 | 2:52:37 | 2:45:09 | 0:07:28 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:12:58.462682+0000 mon.a (mon.0) 673 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894329 |
|
2024-09-08 12:48:18 | 2024-09-08 12:54:59 | 2024-09-08 13:34:11 | 0:39:12 | 0:31:42 | 0:07:30 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894330 |
|
2024-09-08 12:48:19 | 2024-09-08 12:55:10 | 2024-09-08 15:39:35 | 2:44:25 | 2:36:47 | 0:07:38 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725801026.8329265 mon.a (mon.0) 169 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894331 |
|
2024-09-08 12:48:21 | 2024-09-08 12:56:31 | 2024-09-08 16:22:18 | 3:25:47 | 3:17:57 | 0:07:50 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:15:10.217245+0000 mon.a (mon.0) 680 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894332 |
|
2024-09-08 12:48:22 | 2024-09-08 12:56:41 | 2024-09-08 13:37:48 | 0:41:07 | 0:31:44 | 0:09:23 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894333 |
|
2024-09-08 12:48:23 | 2024-09-08 12:58:42 | 2024-09-08 16:08:09 | 3:09:27 | 3:03:17 | 0:06:10 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725801348.0021343 mon.a (mon.0) 499 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894334 |
|
2024-09-08 12:48:25 | 2024-09-08 12:58:53 | 2024-09-08 16:52:12 | 3:53:19 | 3:41:21 | 0:11:58 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:22:44.595638+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894335 |
|
2024-09-08 12:48:26 | 2024-09-08 13:19:38 | 733 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} | 2 | |||
| fail | 7894336 |
|
2024-09-08 12:48:28 | 2024-09-08 13:00:34 | 2024-09-08 15:56:35 | 2:56:01 | 2:46:19 | 0:09:42 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725802122.7334278 mon.a (mon.0) 550 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894337 |
|
2024-09-08 12:48:29 | 2024-09-08 13:00:34 | 2024-09-08 16:14:22 | 3:13:48 | 3:07:35 | 0:06:13 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:18:48.475476+0000 mon.a (mon.0) 702 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894338 |
|
2024-09-08 12:48:30 | 2024-09-08 13:01:05 | 2024-09-08 14:00:00 | 0:58:55 | 0:51:45 | 0:07:10 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894339 |
|
2024-09-08 12:48:31 | 2024-09-08 13:01:05 | 2024-09-08 15:44:48 | 2:43:43 | 2:36:58 | 0:06:45 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725801562.9542089 mon.a (mon.0) 679 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894340 |
|
2024-09-08 12:48:33 | 2024-09-08 13:01:16 | 2024-09-08 16:00:54 | 2:59:38 | 2:52:20 | 0:07:18 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:18:16.621122+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894341 |
|
2024-09-08 12:48:34 | 2024-09-08 13:01:16 | 2024-09-08 13:38:59 | 0:37:43 | 0:31:04 | 0:06:39 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894342 |
|
2024-09-08 12:48:35 | 2024-09-08 13:01:57 | 2024-09-08 16:00:52 | 2:58:55 | 2:53:05 | 0:05:50 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725801509.900734 mon.a (mon.0) 544 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894343 |
|
2024-09-08 12:48:37 | 2024-09-08 13:01:57 | 2024-09-08 13:26:18 | 0:24:21 | 0:17:24 | 0:06:57 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/quincy 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7894344 |
|
2024-09-08 12:48:38 | 2024-09-08 13:03:18 | 2024-09-08 16:34:18 | 3:31:00 | 3:24:15 | 0:06:45 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:20:49.992908+0000 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894345 |
|
2024-09-08 12:48:39 | 2024-09-08 13:03:19 | 2024-09-08 16:08:09 | 3:04:50 | 2:56:29 | 0:08:21 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725801664.2176197 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894346 |
|
2024-09-08 12:48:41 | 2024-09-08 13:04:49 | 2024-09-08 14:02:52 | 0:58:03 | 0:51:26 | 0:06:37 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894347 |
|
2024-09-08 12:48:42 | 2024-09-08 16:14:00 | 10664 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |||
Failure Reason:
"2024-09-08T13:27:22.173095+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894348 |
|
2024-09-08 12:48:44 | 2024-09-08 13:06:01 | 2024-09-08 13:37:24 | 0:31:23 | 0:21:28 | 0:09:55 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7894349 |
|
2024-09-08 12:48:45 | 2024-09-08 13:06:31 | 2024-09-08 16:00:21 | 2:53:50 | 2:45:15 | 0:08:35 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725802456.4056952 mon.a (mon.0) 549 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894350 |
|
2024-09-08 12:48:46 | 2024-09-08 13:06:42 | 2024-09-08 13:44:13 | 0:37:31 | 0:30:00 | 0:07:31 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894351 |
|
2024-09-08 12:48:47 | 2024-09-08 13:07:12 | 2024-09-08 16:25:39 | 3:18:27 | 3:10:44 | 0:07:43 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:25:49.932200+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894352 |
|
2024-09-08 12:48:49 | 2024-09-08 13:08:23 | 2024-09-08 14:05:28 | 0:57:05 | 0:51:03 | 0:06:02 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/dbench}} | 2 |
| fail | 7894353 |
|
2024-09-08 12:48:50 | 2024-09-08 13:08:23 | 2024-09-08 15:51:52 | 2:43:29 | 2:36:41 | 0:06:48 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725801753.5673244 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894354 |
|
2024-09-08 12:48:51 | 2024-09-08 13:08:34 | 2024-09-08 13:54:02 | 0:45:28 | 0:37:51 | 0:07:37 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894355 |
|
2024-09-08 12:48:53 | 2024-09-08 13:09:15 | 2024-09-08 16:30:18 | 3:21:03 | 3:14:41 | 0:06:22 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:26:47.750897+0000 mon.a (mon.0) 681 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894356 |
|
2024-09-08 12:48:54 | 2024-09-08 13:09:15 | 2024-09-08 16:04:20 | 2:55:05 | 2:45:47 | 0:09:18 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725801914.969601 mon.a (mon.0) 169 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894357 |
|
2024-09-08 12:48:55 | 2024-09-08 13:10:56 | 2024-09-08 13:51:37 | 0:40:41 | 0:30:52 | 0:09:49 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894358 |
|
2024-09-08 12:48:57 | 2024-09-08 13:14:37 | 2024-09-08 16:53:54 | 3:39:17 | 3:23:25 | 0:15:52 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:42:04.340536+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894359 |
|
2024-09-08 12:48:58 | 2024-09-08 13:19:19 | 2024-09-08 16:13:24 | 2:54:05 | 2:43:49 | 0:10:16 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725803309.501587 mon.a (mon.0) 590 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894360 |
|
2024-09-08 12:48:59 | 2024-09-08 13:19:19 | 2024-09-08 14:03:06 | 0:43:47 | 0:36:52 | 0:06:55 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894361 |
|
2024-09-08 12:49:00 | 2024-09-08 13:19:50 | 2024-09-08 16:28:19 | 3:08:29 | 3:00:36 | 0:07:53 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:40:00.000189+0000 mon.a (mon.0) 780 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
| fail | 7894362 |
|
2024-09-08 12:49:01 | 2024-09-08 13:20:50 | 2024-09-08 16:03:43 | 2:42:53 | 2:30:38 | 0:12:15 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725802991.1905634 mon.a (mon.0) 545 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894363 |
|
2024-09-08 12:49:03 | 2024-09-08 13:26:32 | 2024-09-08 16:53:48 | 3:27:16 | 3:20:46 | 0:06:30 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T13:43:01.075802+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894364 |
|
2024-09-08 12:49:04 | 2024-09-08 13:26:32 | 2024-09-08 14:11:30 | 0:44:58 | 0:35:43 | 0:09:15 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894365 |
|
2024-09-08 12:49:05 | 2024-09-08 13:28:33 | 2024-09-08 16:42:56 | 3:14:23 | 3:06:32 | 0:07:51 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725803151.2734587 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894366 |
|
2024-09-08 12:49:06 | 2024-09-08 13:29:24 | 2024-09-08 16:24:52 | 2:55:28 | 2:47:44 | 0:07:44 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:47:19.998379+0000 mon.a (mon.0) 664 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894367 |
|
2024-09-08 12:49:08 | 2024-09-08 13:29:24 | 2024-09-08 14:08:35 | 0:39:11 | 0:30:42 | 0:08:29 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T14:00:00.000163+0000 mon.smithi018 (mon.0) 443 : cluster [WRN] osd.4 (root=default,host=smithi137) is down" in cluster log |
||||||||||||||
| fail | 7894368 |
|
2024-09-08 12:49:09 | 2024-09-08 13:31:35 | 2024-09-08 16:03:26 | 2:31:51 | 2:21:57 | 0:09:54 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725803281.6260562 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894369 |
|
2024-09-08 12:49:10 | 2024-09-08 13:33:36 | 2024-09-08 17:04:19 | 3:30:43 | 3:19:50 | 0:10:53 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T14:04:47.965293+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894370 |
|
2024-09-08 12:49:12 | 2024-09-08 13:34:27 | 2024-09-08 14:34:21 | 0:59:54 | 0:48:14 | 0:11:40 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/dbench}} | 2 |
| fail | 7894371 |
|
2024-09-08 12:49:13 | 2024-09-08 13:37:18 | 2024-09-08 14:20:39 | 0:43:21 | 0:36:02 | 0:07:19 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894372 |
|
2024-09-08 12:49:15 | 2024-09-08 13:37:38 | 2024-09-08 16:48:08 | 3:10:30 | 3:00:21 | 0:10:09 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725804001.097189 mon.a (mon.0) 180 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894373 |
|
2024-09-08 12:49:16 | 2024-09-08 13:38:09 | 2024-09-08 17:12:36 | 3:34:27 | 3:26:01 | 0:08:26 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T13:57:02.706983+0000 mon.a (mon.0) 692 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894374 |
|
2024-09-08 12:49:17 | 2024-09-08 13:39:20 | 2024-09-08 14:03:20 | 0:24:00 | 0:12:17 | 0:11:43 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/fsstress}} | 2 |
| pass | 7894375 |
|
2024-09-08 12:49:19 | 2024-09-08 13:44:31 | 2024-09-08 14:23:24 | 0:38:53 | 0:29:54 | 0:08:59 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894376 |
|
2024-09-08 12:49:20 | 2024-09-08 13:46:22 | 2024-09-08 16:38:54 | 2:52:32 | 2:44:57 | 0:07:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725804240.2180474 mon.a (mon.0) 515 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894377 |
|
2024-09-08 12:49:21 | 2024-09-08 13:47:53 | 2024-09-08 16:51:36 | 3:03:43 | 2:57:13 | 0:06:30 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T14:05:09.226277+0000 mon.a (mon.0) 567 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894378 |
|
2024-09-08 12:49:23 | 2024-09-08 13:47:53 | 2024-09-08 14:34:55 | 0:47:02 | 0:36:16 | 0:10:46 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894379 |
|
2024-09-08 12:49:24 | 2024-09-08 13:51:54 | 2024-09-08 16:51:25 | 2:59:31 | 2:50:30 | 0:09:01 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725804474.5449991 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894380 |
|
2024-09-08 12:49:25 | 2024-09-08 13:54:15 | 2024-09-08 17:20:08 | 3:25:53 | 3:10:30 | 0:15:23 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T14:22:18.023758+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894381 |
|
2024-09-08 12:49:27 | 2024-09-08 14:00:17 | 2024-09-08 14:42:10 | 0:41:53 | 0:31:45 | 0:10:08 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T14:30:00.000315+0000 mon.smithi003 (mon.0) 258 : cluster [WRN] osd.0 (root=default,host=smithi003) is down" in cluster log |
||||||||||||||
| fail | 7894382 |
|
2024-09-08 12:49:28 | 2024-09-08 14:03:08 | 2024-09-08 16:51:22 | 2:48:14 | 2:37:42 | 0:10:32 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725805517.5254128 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894383 |
|
2024-09-08 12:49:29 | 2024-09-08 14:03:19 | 2024-09-08 18:03:30 | 4:00:11 | 3:49:08 | 0:11:03 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T14:25:20.475597+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894384 |
|
2024-09-08 12:49:30 | 2024-09-08 14:03:39 | 2024-09-08 14:26:57 | 0:23:18 | 0:14:33 | 0:08:45 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/yes}} | 3 |
| fail | 7894385 |
|
2024-09-08 12:49:32 | 2024-09-08 14:05:50 | 2024-09-08 17:40:43 | 3:34:53 | 3:22:28 | 0:12:25 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725805819.8466084 mon.a (mon.0) 180 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894386 |
|
2024-09-08 12:49:33 | 2024-09-08 14:08:51 | 2024-09-08 16:58:41 | 2:49:50 | 2:40:19 | 0:09:31 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T14:29:10.528557+0000 mon.a (mon.0) 672 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894387 |
|
2024-09-08 12:49:34 | 2024-09-08 14:11:42 | 2024-09-08 15:03:55 | 0:52:13 | 0:35:58 | 0:16:15 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894388 |
|
2024-09-08 12:49:36 | 2024-09-08 14:20:54 | 2024-09-08 16:46:45 | 2:25:51 | 2:15:52 | 0:09:59 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725806465.809988 mon.a (mon.0) 669 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894389 |
|
2024-09-08 12:49:37 | 2024-09-08 14:23:35 | 2024-09-08 14:52:26 | 0:28:51 | 0:19:10 | 0:09:41 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7894390 |
|
2024-09-08 12:49:38 | 2024-09-08 14:27:16 | 2024-09-08 17:47:33 | 3:20:17 | 3:10:12 | 0:10:05 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T14:48:17.113001+0000 mon.a (mon.0) 669 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894391 |
|
2024-09-08 12:49:40 | 2024-09-08 14:30:07 | 2024-09-08 15:11:38 | 0:41:31 | 0:31:04 | 0:10:27 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894392 |
|
2024-09-08 12:49:41 | 2024-09-08 14:34:39 | 2024-09-08 17:24:13 | 2:49:34 | 2:41:51 | 0:07:43 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725807103.341974 mon.a (mon.0) 547 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894393 |
|
2024-09-08 12:49:42 | 2024-09-08 14:35:09 | 2024-09-08 18:25:59 | 3:50:50 | 3:33:41 | 0:17:09 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T15:12:19.311222+0000 mon.a (mon.0) 698 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894394 |
|
2024-09-08 12:49:44 | 2024-09-08 14:42:21 | 2024-09-08 15:26:22 | 0:44:01 | 0:30:55 | 0:13:06 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894395 |
|
2024-09-08 12:49:45 | 2024-09-08 14:49:33 | 2024-09-08 17:46:48 | 2:57:15 | 2:43:16 | 0:13:59 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725808895.353598 mon.a (mon.0) 554 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894396 |
|
2024-09-08 12:49:46 | 2024-09-08 14:52:44 | 2024-09-08 18:13:21 | 3:20:37 | 3:02:49 | 0:17:48 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T15:20:59.367337+0000 mon.a (mon.0) 617 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894397 |
|
2024-09-08 12:49:48 | 2024-09-08 15:04:06 | 2024-09-08 17:57:01 | 2:52:55 | 2:37:33 | 0:15:22 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725809328.9742396 mon.a (mon.0) 547 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894398 |
|
2024-09-08 12:49:49 | 2024-09-08 15:11:48 | 2024-09-08 16:16:22 | 1:04:34 | 0:51:12 | 0:13:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894399 |
|
2024-09-08 12:49:50 | 2024-09-08 15:43:14 | 2024-09-08 18:50:34 | 3:07:20 | 2:58:05 | 0:09:15 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T16:03:06.983327+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894400 |
|
2024-09-08 12:49:51 | 2024-09-08 15:45:05 | 2024-09-08 18:22:22 | 2:37:17 | 2:27:56 | 0:09:21 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725811505.235082 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894401 |
|
2024-09-08 12:49:53 | 2024-09-08 15:46:35 | 2024-09-08 16:24:16 | 0:37:41 | 0:31:06 | 0:06:35 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894402 |
|
2024-09-08 12:49:54 | 2024-09-08 15:46:46 | 2024-09-08 19:31:38 | 3:44:52 | 3:33:28 | 0:11:24 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T16:10:07.403813+0000 mon.a (mon.0) 670 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894403 |
|
2024-09-08 12:49:55 | 2024-09-08 15:52:07 | 2024-09-08 19:13:02 | 3:20:55 | 3:12:25 | 0:08:30 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725811669.2037046 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894404 |
|
2024-09-08 12:49:57 | 2024-09-08 15:53:48 | 2024-09-08 16:54:04 | 1:00:16 | 0:50:48 | 0:09:28 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894405 |
|
2024-09-08 12:49:58 | 2024-09-08 16:01:23 | 2024-09-08 19:22:26 | 3:21:03 | 3:07:02 | 0:14:01 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T16:26:44.217299+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894406 |
|
2024-09-08 12:49:59 | 2024-09-08 16:03:44 | 2024-09-08 18:51:36 | 2:47:52 | 2:37:27 | 0:10:25 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725812692.9438276 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894407 |
|
2024-09-08 12:50:01 | 2024-09-08 16:03:55 | 2024-09-08 16:41:47 | 0:37:52 | 0:30:58 | 0:06:54 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T16:30:00.000235+0000 mon.smithi067 (mon.0) 330 : cluster [WRN] pg 1.0 is active+undersized+degraded, acting [3,0]" in cluster log |
||||||||||||||
| fail | 7894408 |
|
2024-09-08 12:50:02 | 2024-09-08 16:04:36 | 2024-09-08 19:23:14 | 3:18:38 | 3:09:39 | 0:08:59 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T16:23:43.859802+0000 mon.a (mon.0) 675 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894409 |
|
2024-09-08 12:50:03 | 2024-09-08 16:06:07 | 2024-09-08 19:09:49 | 3:03:42 | 2:55:03 | 0:08:39 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725812570.8852546 mon.a (mon.0) 169 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894410 |
|
2024-09-08 12:50:05 | 2024-09-08 16:08:28 | 2024-09-08 16:51:40 | 0:43:12 | 0:37:17 | 0:05:55 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894411 |
|
2024-09-08 12:50:06 | 2024-09-08 16:08:28 | 2024-09-08 19:33:01 | 3:24:33 | 3:16:09 | 0:08:24 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T16:26:01.751611+0000 mon.a (mon.0) 529 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894412 |
|
2024-09-08 12:50:07 | 2024-09-08 16:09:29 | 2024-09-08 18:58:59 | 2:49:30 | 2:42:13 | 0:07:17 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725812651.2300115 mon.a (mon.0) 169 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894413 |
|
2024-09-08 12:50:09 | 2024-09-08 16:09:50 | 2024-09-08 16:50:56 | 0:41:06 | 0:30:22 | 0:10:44 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894414 |
|
2024-09-08 12:50:10 | 2024-09-08 16:13:41 | 2024-09-08 20:04:10 | 3:50:29 | 3:39:18 | 0:11:11 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T16:45:12.082280+0000 mon.a (mon.0) 727 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894415 |
|
2024-09-08 12:50:11 | 2024-09-08 16:14:11 | 2024-09-08 19:12:01 | 2:57:50 | 2:48:53 | 0:08:57 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725813363.0185027 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894416 |
|
2024-09-08 12:50:12 | 2024-09-08 16:14:12 | 2024-09-08 16:57:30 | 0:43:18 | 0:36:56 | 0:06:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894417 |
|
2024-09-08 12:50:14 | 2024-09-08 16:14:32 | 2024-09-08 19:24:54 | 3:10:22 | 3:03:00 | 0:07:22 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T16:33:09.196695+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894418 |
|
2024-09-08 12:50:15 | 2024-09-08 16:15:43 | 2024-09-08 17:41:42 | 1:25:59 | 1:18:32 | 0:07:27 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/kernel_untar_build}} | 2 |
| fail | 7894419 |
|
2024-09-08 12:50:16 | 2024-09-08 16:16:44 | 2024-09-08 18:55:08 | 2:38:24 | 2:30:26 | 0:07:58 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725813131.4882088 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894420 |
|
2024-09-08 12:50:18 | 2024-09-08 16:17:14 | 2024-09-08 16:47:57 | 0:30:43 | 0:18:39 | 0:12:04 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7894421 |
|
2024-09-08 12:50:19 | 2024-09-08 16:22:36 | 2024-09-08 16:36:01 | 0:13:25 | 0:05:15 | 0:08:10 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
ceph version 18.2.4-817.gf8c883c3 was not installed, found 18.2.4-812.ga2042cb4.el9. |
||||||||||||||
| fail | 7894422 |
|
2024-09-08 12:50:21 | 2024-09-08 16:24:37 | 2024-09-08 16:37:50 | 0:13:13 | 0:06:16 | 0:06:57 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/reef-x/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks} | 2 |
Failure Reason:
ceph version 18.2.4-817.gf8c883c3 was not installed, found 18.2.4-812.ga2042cb4.el9. |
||||||||||||||
| fail | 7894423 |
|
2024-09-08 12:50:22 | 2024-09-08 16:24:37 | 2024-09-08 18:23:03 | 1:58:26 | 1:46:51 | 0:11:35 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1725814065.1162574 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894424 |
|
2024-09-08 12:50:23 | 2024-09-08 16:25:08 | 2024-09-08 17:09:05 | 0:43:57 | 0:36:46 | 0:07:11 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894425 |
|
2024-09-08 12:50:25 | 2024-09-08 16:25:58 | 2024-09-08 19:56:05 | 3:30:07 | 3:20:41 | 0:09:26 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T16:46:24.752375+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894426 |
|
2024-09-08 12:50:26 | 2024-09-08 16:28:29 | 2024-09-08 16:43:45 | 0:15:16 | 0:07:43 | 0:07:33 | smithi | main | centos | 9.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/reef 1-upgrade}} | 1 |
| fail | 7894427 |
|
2024-09-08 12:50:27 | 2024-09-08 16:28:40 | 2024-09-08 19:37:54 | 3:09:14 | 3:00:32 | 0:08:42 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725814200.0001159 mon.a (mon.0) 774 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
| pass | 7894428 |
|
2024-09-08 12:50:29 | 2024-09-08 16:30:42 | 2024-09-08 16:49:24 | 0:18:42 | 0:08:20 | 0:10:22 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/new_ops/{newops}}} | 2 |
| fail | 7894429 |
|
2024-09-08 12:50:30 | 2024-09-08 16:34:33 | 2024-09-08 19:51:59 | 3:17:26 | 3:08:12 | 0:09:14 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T16:52:56.351692+0000 mon.a (mon.0) 529 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894430 |
|
2024-09-08 12:50:31 | 2024-09-08 17:57:39 | 2024-09-08 20:45:12 | 2:47:33 | 2:37:31 | 0:10:02 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725819429.0391028 mon.a (mon.0) 361 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894431 |
|
2024-09-08 12:50:33 | 2024-09-08 18:01:40 | 2024-09-08 18:40:33 | 0:38:53 | 0:31:12 | 0:07:41 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894432 |
|
2024-09-08 12:50:34 | 2024-09-08 18:03:41 | 2024-09-08 21:24:29 | 3:20:48 | 3:04:41 | 0:16:07 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T18:30:43.798900+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894433 |
|
2024-09-08 12:50:35 | 2024-09-08 18:08:32 | 2024-09-08 20:58:38 | 2:50:06 | 2:38:23 | 0:11:43 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725820353.485656 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894434 |
|
2024-09-08 12:50:37 | 2024-09-08 18:10:53 | 2024-09-08 18:56:31 | 0:45:38 | 0:36:46 | 0:08:52 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894435 |
|
2024-09-08 12:50:38 | 2024-09-08 18:13:34 | 2024-09-08 21:52:58 | 3:39:24 | 3:33:09 | 0:06:15 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T18:31:19.825810+0000 mon.a (mon.0) 693 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894436 |
|
2024-09-08 12:50:39 | 2024-09-08 18:13:44 | 2024-09-08 21:17:15 | 3:03:31 | 2:56:11 | 0:07:20 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725820058.5479865 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894437 |
|
2024-09-08 12:50:40 | 2024-09-08 18:13:45 | 2024-09-08 18:53:48 | 0:40:03 | 0:31:10 | 0:08:53 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894438 |
|
2024-09-08 12:50:42 | 2024-09-08 18:16:46 | 2024-09-08 21:22:26 | 3:05:40 | 2:52:26 | 0:13:14 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T18:40:16.856045+0000 mon.a (mon.0) 566 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894439 |
|
2024-09-08 12:50:43 | 2024-09-08 18:22:37 | 2024-09-08 20:56:40 | 2:34:03 | 2:26:08 | 0:07:55 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725820804.801241 mon.a (mon.0) 504 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894440 |
|
2024-09-08 12:50:44 | 2024-09-08 18:23:18 | 2024-09-08 19:23:18 | 1:00:00 | 0:50:49 | 0:09:11 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894441 |
|
2024-09-08 12:50:46 | 2024-09-08 18:26:19 | 2024-09-08 22:30:49 | 4:04:30 | 3:44:32 | 0:19:58 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T18:58:54.937254+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894442 |
|
2024-09-08 12:50:47 | 2024-09-08 18:36:51 | 2024-09-08 21:52:30 | 3:15:39 | 3:02:39 | 0:13:00 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725822162.6759188 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894443 |
|
2024-09-08 12:50:48 | 2024-09-08 18:40:52 | 2024-09-08 19:30:29 | 0:49:37 | 0:31:37 | 0:18:00 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894444 |
|
2024-09-08 12:50:49 | 2024-09-08 18:50:44 | 2024-09-08 22:37:41 | 3:46:57 | 3:35:28 | 0:11:29 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T19:22:19.343746+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894445 |
|
2024-09-08 12:50:51 | 2024-09-08 18:51:55 | 2024-09-08 21:57:53 | 3:05:58 | 2:54:21 | 0:11:37 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725822927.1100738 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894447 |
|
2024-09-08 12:50:52 | 2024-09-08 18:54:06 | 2024-09-08 19:53:07 | 0:59:01 | 0:51:01 | 0:08:00 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894448 |
|
2024-09-08 12:50:54 | 2024-09-08 18:55:27 | 2024-09-08 21:01:47 | 2:06:20 | 1:58:38 | 0:07:42 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
Command failed (workunit test rbd/test_librbd.sh) on smithi022 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' |
||||||||||||||
| fail | 7894449 |
|
2024-09-08 12:50:55 | 2024-09-08 18:56:47 | 2024-09-08 21:58:28 | 3:01:41 | 2:52:33 | 0:09:08 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725823019.5023255 mon.a (mon.0) 674 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894450 |
|
2024-09-08 12:50:56 | 2024-09-08 18:59:18 | 2024-09-08 22:55:07 | 3:55:49 | 3:34:43 | 0:21:06 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi138 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f03a10869dbcdcf78fc7c60470b0f6dfddc7d42e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7894451 |
|
2024-09-08 12:50:58 | 2024-09-08 19:10:00 | 2024-09-08 22:17:36 | 3:07:36 | 2:59:08 | 0:08:28 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T19:30:09.715438+0000 mon.a (mon.0) 659 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894452 |
|
2024-09-08 12:50:59 | 2024-09-08 19:12:11 | 2024-09-08 21:42:16 | 2:30:05 | 2:22:17 | 0:07:48 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725823871.749252 mon.a (mon.0) 655 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894453 |
|
2024-09-08 12:51:01 | 2024-09-08 19:13:12 | 2024-09-08 19:59:52 | 0:46:40 | 0:31:19 | 0:15:21 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T19:50:00.000188+0000 mon.smithi119 (mon.0) 312 : cluster [WRN] pg 1.0 is active+undersized+degraded, acting [3,0]" in cluster log |
||||||||||||||
| fail | 7894454 |
|
2024-09-08 12:51:02 | 2024-09-08 19:22:44 | 2024-09-08 23:48:12 | 4:25:28 | 4:13:43 | 0:11:45 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T19:53:34.543050+0000 mon.a (mon.0) 561 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 7894455 |
|
2024-09-08 12:51:03 | 2024-09-08 19:23:25 | 2024-09-08 22:33:20 | 3:09:55 | 2:59:27 | 0:10:28 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725824687.256354 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894456 |
|
2024-09-08 12:51:04 | 2024-09-08 19:23:35 | 2024-09-08 19:44:07 | 0:20:32 | 0:12:25 | 0:08:07 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} | 2 |
| fail | 7894457 |
|
2024-09-08 12:51:06 | 2024-09-08 19:25:06 | 2024-09-08 22:16:21 | 2:51:15 | 2:39:27 | 0:11:48 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T19:48:55.860382+0000 mon.a (mon.0) 680 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894458 |
|
2024-09-08 12:51:07 | 2024-09-08 19:30:48 | 2024-09-08 20:14:28 | 0:43:40 | 0:36:25 | 0:07:15 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894459 |
|
2024-09-08 12:51:09 | 2024-09-08 19:31:48 | 2024-09-08 22:06:49 | 2:35:01 | 2:26:55 | 0:08:06 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725824992.911906 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894460 |
|
2024-09-08 12:51:10 | 2024-09-08 19:33:19 | 2024-09-08 23:03:29 | 3:30:10 | 3:17:59 | 0:12:11 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T19:54:14.576452+0000 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894461 |
|
2024-09-08 12:51:11 | 2024-09-08 19:38:10 | 2024-09-08 20:19:48 | 0:41:38 | 0:30:49 | 0:10:49 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T20:10:00.000123+0000 mon.smithi060 (mon.0) 339 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down" in cluster log |
||||||||||||||
| fail | 7894462 |
|
2024-09-08 12:51:13 | 2024-09-08 19:42:42 | 2024-09-08 23:10:01 | 3:27:19 | 3:20:12 | 0:07:07 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725825553.520384 mon.a (mon.0) 508 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894463 |
|
2024-09-08 12:51:14 | 2024-09-08 19:42:42 | 2024-09-08 20:07:21 | 0:24:39 | 0:17:16 | 0:07:23 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7894464 |
|
2024-09-08 12:51:15 | 2024-09-08 19:44:23 | 2024-09-08 23:03:58 | 3:19:35 | 3:04:26 | 0:15:09 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T20:10:40.457998+0000 mon.a (mon.0) 703 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894465 |
|
2024-09-08 12:51:17 | 2024-09-08 19:52:15 | 2024-09-08 22:33:15 | 2:41:00 | 2:33:30 | 0:07:30 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725826315.4614701 mon.a (mon.0) 678 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894466 |
|
2024-09-08 12:51:18 | 2024-09-08 19:53:26 | 2024-09-08 20:38:45 | 0:45:19 | 0:37:02 | 0:08:17 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894467 |
|
2024-09-08 12:51:19 | 2024-09-08 19:55:36 | 2024-09-08 23:20:24 | 3:24:48 | 3:13:52 | 0:10:56 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T20:27:14.852031+0000 mon.a (mon.0) 705 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894468 |
|
2024-09-08 12:51:21 | 2024-09-08 19:56:17 | 2024-09-08 22:56:00 | 2:59:43 | 2:45:17 | 0:14:26 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725826888.969908 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894469 |
|
2024-09-08 12:51:22 | 2024-09-08 20:00:08 | 2024-09-08 20:35:05 | 0:34:57 | 0:22:21 | 0:12:36 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/blogbench}} | 2 |
| pass | 7894470 |
|
2024-09-08 12:51:23 | 2024-09-08 20:04:09 | 2024-09-08 20:41:33 | 0:37:24 | 0:30:29 | 0:06:55 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894471 |
|
2024-09-08 12:51:25 | 2024-09-08 20:04:30 | 2024-09-08 22:54:42 | 2:50:12 | 2:40:55 | 0:09:17 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T20:25:20.725160+0000 mon.a (mon.0) 689 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894472 |
|
2024-09-08 12:51:26 | 2024-09-08 20:07:31 | 2024-09-08 22:41:50 | 2:34:19 | 2:25:55 | 0:08:24 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725827016.9951537 mon.a (mon.0) 372 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894473 |
|
2024-09-08 12:51:28 | 2024-09-08 20:08:31 | 2024-09-08 21:14:01 | 1:05:30 | 0:52:14 | 0:13:16 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/dbench}} | 2 |
| fail | 7894474 |
|
2024-09-08 12:51:29 | 2024-09-08 20:14:13 | 2024-09-08 20:57:32 | 0:43:19 | 0:35:46 | 0:07:33 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894475 |
|
2024-09-08 12:51:30 | 2024-09-08 20:14:43 | 2024-09-09 00:19:31 | 4:04:48 | 3:52:35 | 0:12:13 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T20:36:31.538806+0000 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894476 |
|
2024-09-08 12:51:32 | 2024-09-08 20:20:05 | 2024-09-08 23:38:47 | 3:18:42 | 3:00:57 | 0:17:45 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725828470.7058785 mon.a (mon.0) 514 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894477 |
|
2024-09-08 12:51:33 | 2024-09-08 20:30:57 | 2024-09-08 21:12:16 | 0:41:19 | 0:30:25 | 0:10:54 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894478 |
|
2024-09-08 12:51:34 | 2024-09-08 20:35:18 | 2024-09-09 00:02:57 | 3:27:39 | 3:13:55 | 0:13:44 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T21:01:04.121278+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894479 |
|
2024-09-08 12:51:36 | 2024-09-08 20:38:59 | 2024-09-08 23:31:42 | 2:52:43 | 2:39:56 | 0:12:47 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1725829377.0894053 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894480 |
|
2024-09-08 12:51:37 | 2024-09-08 20:41:50 | 2024-09-08 21:28:35 | 0:46:45 | 0:35:46 | 0:10:59 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894481 |
|
2024-09-08 12:51:38 | 2024-09-08 20:45:31 | 2024-09-09 00:30:37 | 3:45:06 | 3:25:57 | 0:19:09 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T21:14:38.277960+0000 mon.a (mon.0) 673 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894482 |
|
2024-09-08 12:51:40 | 2024-09-08 20:56:54 | 2024-09-09 00:04:42 | 3:07:48 | 2:59:51 | 0:07:57 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1725830032.2404437 mon.a (mon.0) 501 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894483 |
|
2024-09-08 12:51:41 | 2024-09-08 20:57:45 | 2024-09-09 00:12:08 | 3:14:23 | 3:06:33 | 0:07:50 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T21:16:35.732742+0000 mon.a (mon.0) 694 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894484 |
|
2024-09-08 12:51:42 | 2024-09-08 20:58:55 | 2024-09-08 21:44:57 | 0:46:02 | 0:36:55 | 0:09:07 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894485 |
|
2024-09-08 12:51:44 | 2024-09-08 21:01:56 | 2024-09-08 23:52:46 | 2:50:50 | 2:43:32 | 0:07:18 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725830401.9168408 mon.a (mon.0) 503 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894486 |
|
2024-09-08 12:51:45 | 2024-09-08 21:02:07 | 2024-09-09 00:25:49 | 3:23:42 | 3:06:24 | 0:17:18 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T21:30:06.894040+0000 mon.a (mon.0) 674 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894487 |
|
2024-09-08 12:51:46 | 2024-09-08 21:12:29 | 2024-09-09 00:10:18 | 2:57:49 | 2:49:26 | 0:08:23 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725831128.682947 mon.a (mon.0) 586 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894488 |
|
2024-09-08 12:51:48 | 2024-09-08 21:14:20 | 2024-09-08 21:54:54 | 0:40:34 | 0:30:12 | 0:10:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894489 |
|
2024-09-08 12:51:49 | 2024-09-08 21:17:31 | 2024-09-09 00:36:54 | 3:19:23 | 3:04:37 | 0:14:46 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T21:44:30.539861+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894490 |
|
2024-09-08 12:51:50 | 2024-09-08 21:22:42 | 2024-09-08 22:23:52 | 1:01:10 | 0:49:23 | 0:11:47 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/dbench}} | 2 |
| fail | 7894491 |
|
2024-09-08 12:51:52 | 2024-09-08 21:24:43 | 2024-09-09 00:08:57 | 2:44:14 | 2:29:23 | 0:14:51 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725832276.5921135 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894492 |
|
2024-09-08 12:51:53 | 2024-09-08 21:28:44 | 2024-09-08 22:25:33 | 0:56:49 | 0:36:36 | 0:20:13 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894493 |
|
2024-09-08 12:51:54 | 2024-09-08 21:42:27 | 2024-09-09 01:48:29 | 4:06:02 | 3:56:26 | 0:09:36 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T22:02:56.144450+0000 mon.a (mon.0) 676 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894494 |
|
2024-09-08 12:51:56 | 2024-09-08 21:45:08 | 2024-09-08 22:11:44 | 0:26:36 | 0:12:14 | 0:14:22 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/fsstress}} | 2 |
| fail | 7894495 |
|
2024-09-08 12:51:57 | 2024-09-08 21:52:39 | 2024-09-09 00:58:12 | 3:05:33 | 2:58:12 | 0:07:21 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725833389.0374093 mon.a (mon.0) 543 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894496 |
|
2024-09-08 12:51:58 | 2024-09-08 21:53:10 | 2024-09-08 22:34:28 | 0:41:18 | 0:31:37 | 0:09:41 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894497 |
|
2024-09-08 12:52:00 | 2024-09-08 21:55:11 | 2024-09-09 00:53:09 | 2:57:58 | 2:48:09 | 0:09:49 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T22:13:32.057204+0000 mon.a (mon.0) 366 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894498 |
|
2024-09-08 12:52:01 | 2024-09-08 21:58:12 | 2024-09-09 00:23:49 | 2:25:37 | 2:19:10 | 0:06:27 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725833781.4434075 mon.a (mon.0) 654 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894499 |
|
2024-09-08 12:52:02 | 2024-09-08 21:58:42 | 2024-09-08 22:50:22 | 0:51:40 | 0:35:39 | 0:16:01 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894500 |
|
2024-09-08 12:52:04 | 2024-09-08 22:07:04 | 2024-09-09 02:02:21 | 3:55:17 | 3:40:02 | 0:15:15 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T22:33:58.502844+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894501 |
|
2024-09-08 12:52:05 | 2024-09-08 22:11:55 | 2024-09-09 01:38:23 | 3:26:28 | 3:12:02 | 0:14:26 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725835267.9023979 mon.a (mon.0) 368 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7894502 |
|
2024-09-08 12:52:06 | 2024-09-08 22:16:37 | 2024-09-08 22:55:08 | 0:38:31 | 0:30:45 | 0:07:46 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894503 |
|
2024-09-08 12:52:08 | 2024-09-08 22:17:47 | 2024-09-09 01:49:48 | 3:32:01 | 3:15:21 | 0:16:40 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T22:51:14.412878+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894504 |
|
2024-09-08 12:52:09 | 2024-09-08 22:24:09 | 2024-09-09 01:37:37 | 3:13:28 | 3:01:53 | 0:11:35 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725835624.291858 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894505 |
|
2024-09-08 12:52:10 | 2024-09-08 22:25:50 | 2024-09-08 22:52:22 | 0:26:32 | 0:13:42 | 0:12:50 | smithi | main | centos | 9.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/quincy 1-client 2-upgrade 3-compat_client/yes}} | 3 |
| pass | 7894506 |
|
2024-09-08 12:52:12 | 2024-09-08 22:31:11 | 2024-09-08 22:50:27 | 0:19:16 | 0:07:58 | 0:11:18 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} | 2 |
| fail | 7894507 |
|
2024-09-08 12:52:13 | 2024-09-08 22:33:32 | 2024-09-09 01:43:32 | 3:10:00 | 3:01:57 | 0:08:03 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T22:49:28.739409+0000 mon.a (mon.0) 376 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894508 |
|
2024-09-08 12:52:14 | 2024-09-08 22:33:32 | 2024-09-09 01:34:04 | 3:00:32 | 2:52:07 | 0:08:25 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725835728.3175113 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894509 |
|
2024-09-08 12:52:16 | 2024-09-08 22:34:43 | 2024-09-08 23:50:43 | 1:16:00 | 1:05:42 | 0:10:18 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| pass | 7894510 |
|
2024-09-08 12:52:17 | 2024-09-08 22:37:54 | 2024-09-08 23:09:01 | 0:31:07 | 0:19:45 | 0:11:22 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7894511 |
|
2024-09-08 12:52:18 | 2024-09-08 22:42:05 | 2024-09-09 01:40:01 | 2:57:56 | 2:43:03 | 0:14:53 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T23:10:00.000186+0000 mon.a (mon.0) 787 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is offline; 1 filesystem is online with fewer MDS than max_mds" in cluster log |
||||||||||||||
| fail | 7894512 |
|
2024-09-08 12:52:20 | 2024-09-08 22:50:37 | 2024-09-09 01:25:57 | 2:35:20 | 2:28:47 | 0:06:33 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725836942.6699467 mon.a (mon.0) 681 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894513 |
|
2024-09-08 12:52:21 | 2024-09-08 22:50:47 | 2024-09-08 23:29:50 | 0:39:03 | 0:30:39 | 0:08:24 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T23:20:00.000198+0000 mon.smithi017 (mon.0) 503 : cluster [WRN] osd.5 (root=default,host=smithi155) is down" in cluster log |
||||||||||||||
| fail | 7894514 |
|
2024-09-08 12:52:22 | 2024-09-08 22:52:38 | 2024-09-09 03:03:06 | 4:10:28 | 3:56:51 | 0:13:37 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T23:17:20.282911+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894515 |
|
2024-09-08 12:52:24 | 2024-09-08 22:54:59 | 2024-09-09 02:11:12 | 3:16:13 | 3:06:32 | 0:09:41 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725837385.862765 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894516 |
|
2024-09-08 12:52:25 | 2024-09-08 22:55:19 | 2024-09-08 23:35:00 | 0:39:41 | 0:32:01 | 0:07:40 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894517 |
|
2024-09-08 12:52:26 | 2024-09-08 22:55:20 | 2024-09-09 02:07:23 | 3:12:03 | 3:03:58 | 0:08:05 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T23:13:50.505291+0000 mon.a (mon.0) 663 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894518 |
|
2024-09-08 12:52:28 | 2024-09-08 22:56:11 | 2024-09-09 01:40:49 | 2:44:38 | 2:30:04 | 0:14:34 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725837641.1055205 mon.a (mon.0) 599 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894519 |
|
2024-09-08 12:52:29 | 2024-09-08 23:03:42 | 2024-09-08 23:47:44 | 0:44:02 | 0:35:57 | 0:08:05 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894520 |
|
2024-09-08 12:52:30 | 2024-09-08 23:04:13 | 2024-09-09 02:28:31 | 3:24:18 | 3:12:48 | 0:11:30 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-08T23:25:19.852762+0000 mon.a (mon.0) 524 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894521 |
|
2024-09-08 12:52:32 | 2024-09-08 23:09:14 | 2024-09-09 02:27:27 | 3:18:13 | 3:11:19 | 0:06:54 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725838079.7639542 mon.a (mon.0) 656 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894522 |
|
2024-09-08 12:52:33 | 2024-09-08 23:10:15 | 2024-09-08 23:59:49 | 0:49:34 | 0:31:45 | 0:17:49 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-09-08T23:50:00.000222+0000 mon.smithi087 (mon.0) 596 : cluster [WRN] pg 2.2 is active+undersized+degraded, acting [1,0]" in cluster log |
||||||||||||||
| fail | 7894523 |
|
2024-09-08 12:52:34 | 2024-09-08 23:20:37 | 2024-09-09 02:45:30 | 3:24:53 | 3:08:13 | 0:16:40 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-08T23:46:38.135795+0000 mon.a (mon.0) 526 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894524 |
|
2024-09-08 12:52:36 | 2024-09-08 23:29:59 | 2024-09-09 02:37:17 | 3:07:18 | 2:58:30 | 0:08:48 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725839144.5863614 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894525 |
|
2024-09-08 12:52:37 | 2024-09-08 23:32:00 | 2024-09-09 00:18:29 | 0:46:29 | 0:35:33 | 0:10:56 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894526 |
|
2024-09-08 12:52:38 | 2024-09-08 23:35:11 | 2024-09-09 03:23:35 | 3:48:24 | 3:34:16 | 0:14:08 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-09T00:01:29.279281+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894527 |
|
2024-09-08 12:52:39 | 2024-09-08 23:39:02 | 2024-09-09 02:52:15 | 3:13:13 | 2:54:43 | 0:18:30 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725841003.7610357 mon.a (mon.0) 540 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894528 |
|
2024-09-08 12:52:41 | 2024-09-08 23:47:54 | 2024-09-09 00:26:15 | 0:38:21 | 0:30:55 | 0:07:26 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894529 |
|
2024-09-08 12:52:42 | 2024-09-08 23:48:34 | 2024-09-09 02:45:54 | 2:57:20 | 2:48:16 | 0:09:04 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-09T00:08:19.853466+0000 mon.a (mon.0) 689 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7894530 |
|
2024-09-08 12:52:43 | 2024-09-08 23:50:55 | 2024-09-09 02:24:05 | 2:33:10 | 2:24:49 | 0:08:21 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725840590.0324893 mon.a (mon.0) 546 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894531 |
|
2024-09-08 12:52:44 | 2024-09-08 23:52:56 | 2024-09-09 00:43:03 | 0:50:07 | 0:35:34 | 0:14:33 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894532 |
|
2024-09-08 12:52:46 | 2024-09-09 00:00:08 | 2024-09-09 03:52:44 | 3:52:36 | 3:42:39 | 0:09:57 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-09T00:19:46.970984+0000 mon.a (mon.0) 527 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894533 |
|
2024-09-08 12:52:47 | 2024-09-09 00:04:35 | 2024-09-09 03:14:00 | 3:09:25 | 3:02:39 | 0:06:46 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725841125.698506 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894534 |
|
2024-09-08 12:52:48 | 2024-09-09 00:04:55 | 2024-09-09 00:46:03 | 0:41:08 | 0:30:41 | 0:10:27 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7894535 |
|
2024-09-08 12:52:49 | 2024-09-09 00:09:06 | 2024-09-09 03:19:07 | 3:10:01 | 2:58:57 | 0:11:04 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-09-09T00:33:12.500909+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7894536 |
|
2024-09-08 12:52:51 | 2024-09-09 00:10:37 | 2024-09-09 03:00:04 | 2:49:27 | 2:37:37 | 0:11:50 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"1725842033.671567 mon.a (mon.0) 176 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7894537 |
|
2024-09-08 12:52:52 | 2024-09-09 00:12:18 | 2024-09-09 00:41:50 | 0:29:32 | 0:12:26 | 0:17:06 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/reef 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/iozone}} | 2 |
| fail | 7894538 |
|
2024-09-08 12:52:53 | 2024-09-09 00:18:39 | 2024-09-09 01:03:11 | 0:44:32 | 0:35:54 | 0:08:38 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 7894539 |
|
2024-09-08 12:52:55 | 2024-09-09 00:19:50 | 2024-09-09 03:37:13 | 3:17:23 | 3:05:55 | 0:11:28 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-09-09T00:40:22.414185+0000 mon.a (mon.0) 530 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7894540 |
|
2024-09-08 12:52:56 | 2024-09-09 00:24:01 | 2024-09-09 03:37:25 | 3:13:24 | 3:05:09 | 0:08:15 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1725842556.753335 mon.a (mon.0) 506 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7894541 |
|
2024-09-08 12:52:57 | 2024-09-09 00:26:02 | 2024-09-09 01:54:19 | 1:28:17 | 1:19:50 | 0:08:27 | smithi | main | centos | 9.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/quincy 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/kernel_untar_build}} | 2 |
Pulpito