User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2024-04-09 14:58:21 | 2024-04-10 01:31:58 | 2024-04-10 06:05:55 | 4:33:57 | upgrade | wip-yuri4-testing-2024-04-08-1432 | smithi | 3a86697 | 21 | 49 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 7648854 | 2024-04-09 14:59:05 | 2024-04-10 01:31:58 | 2024-04-10 02:14:57 | 0:42:59 | 0:33:07 | 0:09:52 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648855 | 2024-04-09 14:59:06 | 2024-04-10 01:31:59 | 2024-04-10 02:00:56 | 0:28:57 | 0:19:21 | 0:09:36 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
fail | 7648856 | 2024-04-09 14:59:07 | 2024-04-10 01:31:59 | 2024-04-10 04:43:08 | 3:11:09 | 2:59:40 | 0:11:29 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:30:00.000153+0000 mon.a (mon.0) 1522 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
fail | 7648857 | 2024-04-09 14:59:08 | 2024-04-10 01:33:00 | 2024-04-10 02:36:31 | 1:03:31 | 0:52:49 | 0:10:42 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7648858 | 2024-04-09 14:59:09 | 2024-04-10 01:33:10 | 2024-04-10 02:38:17 | 1:05:07 | 0:51:48 | 0:13:19 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648859 | 2024-04-09 14:59:10 | 2024-04-10 01:33:10 | 2024-04-10 02:03:29 | 0:30:19 | 0:20:08 | 0:10:11 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 | |
fail | 7648860 | 2024-04-09 14:59:11 | 2024-04-10 01:34:11 | 2024-04-10 05:14:16 | 3:40:05 | 3:31:11 | 0:08:54 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
"2024-04-10T02:13:37.471439+0000 mon.a (mon.0) 16 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
fail | 7648861 | 2024-04-09 14:59:12 | 2024-04-10 01:34:11 | 2024-04-10 02:42:24 | 1:08:13 | 0:57:27 | 0:10:46 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648862 | 2024-04-09 14:59:13 | 2024-04-10 01:34:32 | 2024-04-10 02:15:34 | 0:41:02 | 0:32:14 | 0:08:48 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
fail | 7648863 | 2024-04-09 14:59:13 | 2024-04-10 01:34:32 | 2024-04-10 04:25:34 | 2:51:02 | 2:38:48 | 0:12:14 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:06:01.098790+0000 mon.a (mon.0) 197 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7648864 | 2024-04-09 14:59:14 | 2024-04-10 01:36:13 | 2024-04-10 02:21:56 | 0:45:43 | 0:32:08 | 0:13:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648865 | 2024-04-09 14:59:15 | 2024-04-10 01:38:03 | 2024-04-10 02:19:33 | 0:41:30 | 0:30:36 | 0:10:54 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks} | 2 | |
Failure Reason:
"1712714368.4796205 mon.a (mon.0) 511 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
pass | 7648866 | 2024-04-09 14:59:16 | 2024-04-10 01:38:24 | 2024-04-10 02:13:43 | 0:35:19 | 0:26:11 | 0:09:08 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
pass | 7648867 | 2024-04-09 14:59:17 | 2024-04-10 01:38:24 | 2024-04-10 01:58:35 | 0:20:11 | 0:09:58 | 0:10:13 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 | |
fail | 7648868 | 2024-04-09 14:59:18 | 2024-04-10 01:39:05 | 2024-04-10 03:40:05 | 2:01:00 | 1:48:00 | 0:13:00 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-10T02:50:00.000137+0000 mon.a (mon.0) 2518 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
pass | 7648869 | 2024-04-09 14:59:19 | 2024-04-10 01:40:35 | 2024-04-10 02:01:28 | 0:20:53 | 0:11:55 | 0:08:58 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 | |
fail | 7648870 | 2024-04-09 14:59:20 | 2024-04-10 01:40:36 | 2024-04-10 02:22:52 | 0:42:16 | 0:31:15 | 0:11:01 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a95001e0-f6dd-11ee-b64a-cb9ed24678a4 -e sha1=3a866975a60f6dc859246f6f19fd8ddb4db2cc2e -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' |
||||||||||||||
fail | 7648871 | 2024-04-09 14:59:21 | 2024-04-10 01:41:26 | 2024-04-10 03:18:35 | 1:37:09 | 1:26:18 | 0:10:51 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1712714496.0207624 mon.a (mon.0) 525 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 7648872 | 2024-04-09 14:59:22 | 2024-04-10 01:41:27 | 2024-04-10 05:07:42 | 3:26:15 | 3:15:48 | 0:10:27 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
"2024-04-10T02:20:00.000157+0000 mon.a (mon.0) 681 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
pass | 7648873 | 2024-04-09 14:59:22 | 2024-04-10 01:42:27 | 2024-04-10 02:32:06 | 0:49:39 | 0:38:35 | 0:11:04 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/kernel_untar_build}} | 2 | |
pass | 7648874 | 2024-04-09 14:59:23 | 2024-04-10 01:42:28 | 2024-04-10 02:13:30 | 0:31:02 | 0:19:50 | 0:11:12 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
fail | 7648875 | 2024-04-09 14:59:24 | 2024-04-10 01:43:48 | 2024-04-10 02:30:03 | 0:46:15 | 0:32:38 | 0:13:37 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648876 | 2024-04-09 14:59:25 | 2024-04-10 01:46:29 | 2024-04-10 05:27:18 | 3:40:49 | 3:30:02 | 0:10:47 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:09:13.850946+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
pass | 7648877 | 2024-04-09 14:59:26 | 2024-04-10 01:47:40 | 2024-04-10 02:30:42 | 0:43:02 | 0:32:18 | 0:10:44 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
fail | 7648878 | 2024-04-09 14:59:27 | 2024-04-10 01:47:40 | 2024-04-10 02:49:54 | 1:02:14 | 0:51:20 | 0:10:54 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648879 | 2024-04-09 14:59:28 | 2024-04-10 01:47:40 | 2024-04-10 02:19:38 | 0:31:58 | 0:21:27 | 0:10:31 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 | |
fail | 7648880 | 2024-04-09 14:59:29 | 2024-04-10 01:48:11 | 2024-04-10 05:09:20 | 3:21:09 | 3:11:13 | 0:09:56 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
"2024-04-10T02:30:00.000144+0000 mon.a (mon.0) 754 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
fail | 7648881 | 2024-04-09 14:59:30 | 2024-04-10 01:48:11 | 2024-04-10 02:33:26 | 0:45:15 | 0:33:34 | 0:11:41 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648882 | 2024-04-09 14:59:31 | 2024-04-10 01:50:22 | 2024-04-10 02:39:47 | 0:49:25 | 0:38:33 | 0:10:52 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7648883 | 2024-04-09 14:59:31 | 2024-04-10 01:50:32 | 2024-04-10 03:51:23 | 2:00:51 | 1:48:53 | 0:11:58 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-10T03:10:00.000094+0000 mon.a (mon.0) 3230 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log |
||||||||||||||
fail | 7648884 | 2024-04-09 14:59:32 | 2024-04-10 01:52:13 | 2024-04-10 03:29:26 | 1:37:13 | 1:28:26 | 0:08:47 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1712715171.255007 mon.a (mon.0) 524 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
pass | 7648885 | 2024-04-09 14:59:33 | 2024-04-10 01:52:13 | 2024-04-10 02:27:31 | 0:35:18 | 0:25:21 | 0:09:57 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
fail | 7648886 | 2024-04-09 14:59:34 | 2024-04-10 01:52:34 | 2024-04-10 04:37:48 | 2:45:14 | 2:34:57 | 0:10:17 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:23:27.734273+0000 mon.a (mon.0) 320 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
pass | 7648887 | 2024-04-09 14:59:35 | 2024-04-10 01:52:35 | 2024-04-10 02:19:43 | 0:27:08 | 0:16:35 | 0:10:33 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/fsstress}} | 2 | |
fail | 7648888 | 2024-04-09 14:59:36 | 2024-04-10 01:52:35 | 2024-04-10 02:44:53 | 0:52:18 | 0:40:34 | 0:11:44 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648889 | 2024-04-09 14:59:37 | 2024-04-10 01:53:46 | 2024-04-10 02:39:12 | 0:45:26 | 0:35:43 | 0:09:43 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
fail | 7648890 | 2024-04-09 14:59:38 | 2024-04-10 01:53:46 | 2024-04-10 05:25:11 | 3:31:25 | 3:20:30 | 0:10:55 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
"2024-04-10T04:00:00.000126+0000 mon.a (mon.0) 7127 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 1 scrub errors" in cluster log |
||||||||||||||
pass | 7648891 | 2024-04-09 14:59:39 | 2024-04-10 01:53:46 | 2024-04-10 02:23:36 | 0:29:50 | 0:19:38 | 0:10:12 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
fail | 7648892 | 2024-04-09 14:59:40 | 2024-04-10 01:54:27 | 2024-04-10 02:52:20 | 0:57:53 | 0:45:18 | 0:12:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648893 | 2024-04-09 14:59:41 | 2024-04-10 01:57:28 | 2024-04-10 02:22:34 | 0:25:06 | 0:15:46 | 0:09:20 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} | 2 | |
fail | 7648894 | 2024-04-09 14:59:42 | 2024-04-10 01:57:28 | 2024-04-10 04:53:35 | 2:56:07 | 2:45:00 | 0:11:07 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:21:19.294443+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7648895 | 2024-04-09 14:59:42 | 2024-04-10 01:59:59 | 2024-04-10 02:48:59 | 0:49:00 | 0:39:07 | 0:09:53 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7648896 | 2024-04-09 14:59:43 | 2024-04-10 01:59:59 | 2024-04-10 02:57:01 | 0:57:02 | 0:45:32 | 0:11:30 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648897 | 2024-04-09 14:59:44 | 2024-04-10 02:01:00 | 2024-04-10 02:30:40 | 0:29:40 | 0:20:11 | 0:09:29 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 | |
fail | 7648898 | 2024-04-09 14:59:45 | 2024-04-10 02:01:31 | 2024-04-10 04:17:01 | 2:15:30 | 2:04:06 | 0:11:24 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
Command failed (workunit test rbd/test_librbd.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' |
||||||||||||||
fail | 7648899 | 2024-04-09 14:59:46 | 2024-04-10 02:01:51 | 2024-04-10 02:46:04 | 0:44:13 | 0:33:25 | 0:10:48 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648900 | 2024-04-09 14:59:47 | 2024-04-10 02:02:42 | 2024-04-10 02:17:59 | 0:15:17 | 0:04:45 | 0:10:32 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_9.stream} 0-start 1-tasks} | 2 | |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific |
||||||||||||||
pass | 7648901 | 2024-04-09 14:59:48 | 2024-04-10 02:02:42 | 2024-04-10 02:38:18 | 0:35:36 | 0:25:32 | 0:10:04 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
fail | 7648902 | 2024-04-09 14:59:49 | 2024-04-10 02:02:53 | 2024-04-10 02:22:43 | 0:19:50 | 0:09:59 | 0:09:51 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 | |
Failure Reason:
Command failed on smithi136 with status 1: "sudo egrep 'FileStore has been deprecated and is no longer supported' /var/log/ceph/ceph-osd.1.log" |
||||||||||||||
fail | 7648903 | 2024-04-09 14:59:49 | 2024-04-10 02:03:13 | 2024-04-10 04:00:31 | 1:57:18 | 1:47:04 | 0:10:14 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-10T03:20:00.000128+0000 mon.a (mon.0) 3092 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log |
||||||||||||||
fail | 7648904 | 2024-04-09 14:59:50 | 2024-04-10 02:03:13 | 2024-04-10 02:52:14 | 0:49:01 | 0:39:35 | 0:09:26 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
pass | 7648906 | 2024-04-09 14:59:51 | 2024-04-10 02:03:17 | 2024-04-10 02:23:53 | 0:20:36 | 0:12:08 | 0:08:28 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 | |
fail | 7648908 | 2024-04-09 14:59:52 | 2024-04-10 02:03:18 | 2024-04-10 03:40:21 | 1:37:03 | 1:28:18 | 0:08:45 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1712715811.530643 mon.a (mon.0) 509 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
fail | 7648910 | 2024-04-09 14:59:53 | 2024-04-10 02:13:20 | 2024-04-10 05:39:35 | 3:26:15 | 3:15:41 | 0:10:34 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T02:42:15.379509+0000 mon.a (mon.0) 16 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
pass | 7648912 | 2024-04-09 14:59:54 | 2024-04-10 02:13:51 | 2024-04-10 02:45:00 | 0:31:09 | 0:19:07 | 0:12:02 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
fail | 7648914 | 2024-04-09 14:59:55 | 2024-04-10 02:15:42 | 2024-04-10 03:09:50 | 0:54:08 | 0:40:45 | 0:13:23 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648916 | 2024-04-09 14:59:56 | 2024-04-10 02:18:54 | 2024-04-10 05:42:48 | 3:23:54 | 3:14:21 | 0:09:33 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
"2024-04-10T02:40:50.521599+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7648918 | 2024-04-09 14:59:57 | 2024-04-10 02:18:54 | 2024-04-10 03:50:15 | 1:31:21 | 1:17:24 | 0:13:57 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed on smithi087 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fad5473c-f6e2-11ee-b64a-cb9ed24678a4 -e sha1=3a866975a60f6dc859246f6f19fd8ddb4db2cc2e -- bash -c 'ceph orch ps'" |
||||||||||||||
fail | 7648920 | 2024-04-09 14:59:57 | 2024-04-10 02:19:45 | 2024-04-10 02:44:02 | 0:24:17 | 0:11:24 | 0:12:53 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/dbench}} | 2 | |
Failure Reason:
Command failed on smithi190 with status 1: 'sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd' |
||||||||||||||
fail | 7648922 | 2024-04-09 14:59:58 | 2024-04-10 02:23:37 | 2024-04-10 03:17:19 | 0:53:42 | 0:43:59 | 0:09:43 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
pass | 7648924 | 2024-04-09 14:59:59 | 2024-04-10 02:24:17 | 2024-04-10 02:56:22 | 0:32:05 | 0:21:50 | 0:10:15 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 | |
fail | 7648926 | 2024-04-09 15:00:00 | 2024-04-10 02:24:38 | 2024-04-10 05:23:46 | 2:59:08 | 2:47:52 | 0:11:16 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T04:30:00.000142+0000 mon.a (mon.0) 7717 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 4 scrub errors" in cluster log |
||||||||||||||
fail | 7648928 | 2024-04-09 15:00:01 | 2024-04-10 02:24:49 | 2024-04-10 03:18:35 | 0:53:46 | 0:40:42 | 0:13:04 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7648930 | 2024-04-09 15:00:02 | 2024-04-10 02:30:51 | 2024-04-10 03:19:47 | 0:48:56 | 0:39:15 | 0:09:41 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
fail | 7648932 | 2024-04-09 15:00:03 | 2024-04-10 02:30:52 | 2024-04-10 04:38:52 | 2:08:00 | 1:58:09 | 0:09:51 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-04-10T02:51:55.008997+0000 mon.a (mon.0) 178 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
fail | 7648934 | 2024-04-09 15:00:04 | 2024-04-10 02:32:12 | 2024-04-10 04:26:01 | 1:53:49 | 1:40:53 | 0:12:56 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"1712718074.8551445 mon.a (mon.0) 509 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
pass | 7648936 | 2024-04-09 15:00:04 | 2024-04-10 02:34:24 | 2024-04-10 03:08:08 | 0:33:44 | 0:23:54 | 0:09:50 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
fail | 7648938 | 2024-04-09 15:00:05 | 2024-04-10 02:34:24 | 2024-04-10 06:05:55 | 3:31:31 | 3:19:51 | 0:11:40 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
"2024-04-10T04:30:00.000258+0000 mon.a (mon.0) 5883 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 55 scrub errors" in cluster log |
||||||||||||||
fail | 7648940 | 2024-04-09 15:00:06 | 2024-04-10 02:34:35 | 2024-04-10 04:07:58 | 1:33:23 | 1:17:10 | 0:16:13 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | |
Failure Reason:
Command failed on smithi063 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ace850f2-f6e5-11ee-b64a-cb9ed24678a4 -e sha1=3a866975a60f6dc859246f6f19fd8ddb4db2cc2e -- bash -c 'ceph orch ps'" |
||||||||||||||
fail | 7648943 | 2024-04-09 15:00:07 | 2024-04-10 02:39:17 | 2024-04-10 03:35:48 | 0:56:31 | 0:45:20 | 0:11:11 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |