| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2024-05-03 02:08:02 | 2024-05-06 10:53:49 | 2024-05-06 14:27:45 | 3:33:56 | upgrade | squid | smithi | 5291dd5 | 9 | 18 | 2 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7687140 |
|
2024-05-03 02:08:28 | 2024-05-06 10:53:39 | 2024-05-06 11:30:16 | 0:36:37 | 0:24:44 | 0:11:53 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| pass | 7687141 |
|
2024-05-03 02:08:29 | 2024-05-06 10:53:49 | 2024-05-06 11:13:49 | 0:20:00 | 0:10:01 | 0:09:59 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
| fail | 7687142 |
|
2024-05-03 02:08:33 | 2024-05-06 10:53:50 | 2024-05-06 12:47:18 | 1:53:28 | 1:42:26 | 0:11:02 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1714994482.5672474 mon.a (mon.0) 515 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7687143 |
|
2024-05-03 02:08:34 | 2024-05-06 10:55:20 | 2024-05-06 11:16:23 | 0:21:03 | 0:11:39 | 0:09:24 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7687144 |
|
2024-05-03 02:08:35 | 2024-05-06 10:55:21 | 2024-05-06 14:27:45 | 3:32:24 | 3:21:19 | 0:11:05 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T11:34:15.817978+0000 mon.a (mon.0) 16 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7687145 |
|
2024-05-03 02:08:37 | 2024-05-06 10:56:01 | 2024-05-06 13:49:54 | 2:53:53 | 2:44:13 | 0:09:40 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T13:00:00.000209+0000 mon.a (mon.0) 5687 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 5 scrub errors" in cluster log |
||||||||||||||
| fail | 7687146 |
|
2024-05-03 02:08:41 | 2024-05-06 10:56:02 | 2024-05-06 12:11:19 | 1:15:17 | 1:06:06 | 0:09:11 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed on smithi070 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de980788-0b98-11ef-bc97-c7b262605968 -e sha1=5291dd5b80eb965f911310b84039884edfa953fd -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\'' |
||||||||||||||
| fail | 7687147 |
|
2024-05-03 02:08:42 | 2024-05-06 10:56:02 | 2024-05-06 14:01:47 | 3:05:45 | 2:59:12 | 0:06:33 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T11:40:00.000147+0000 mon.a (mon.0) 1676 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7687148 |
|
2024-05-03 02:08:43 | 2024-05-06 10:56:13 | 2024-05-06 13:23:28 | 2:27:15 | 2:21:11 | 0:06:04 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T12:40:00.000211+0000 mon.a (mon.0) 6757 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 4 scrub errors" in cluster log |
||||||||||||||
| pass | 7687149 |
|
2024-05-03 02:08:44 | 2024-05-06 10:56:13 | 2024-05-06 11:27:13 | 0:31:00 | 0:21:49 | 0:09:11 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| dead | 7687150 |
|
2024-05-03 02:08:46 | 2024-05-06 10:56:13 | 2024-05-06 11:05:12 | 0:08:59 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | ||
Failure Reason:
Error reimaging machines: Expected smithi154's OS to be centos 9 but found ubuntu 22.04 |
||||||||||||||
| dead | 7687151 |
|
2024-05-03 02:08:48 | 2024-05-06 10:56:14 | 2024-05-06 11:07:13 | 0:10:59 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | ||
Failure Reason:
SSH connection to smithi154 was lost: 'sudo apt-get update' |
||||||||||||||
| pass | 7687152 |
|
2024-05-03 02:08:49 | 2024-05-06 10:59:25 | 2024-05-06 11:36:34 | 0:37:09 | 0:25:43 | 0:11:26 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7687153 |
|
2024-05-03 02:08:50 | 2024-05-06 10:59:25 | 2024-05-06 11:54:03 | 0:54:38 | 0:44:11 | 0:10:27 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7687154 |
|
2024-05-03 02:08:51 | 2024-05-06 11:00:05 | 2024-05-06 11:51:48 | 0:51:43 | 0:42:22 | 0:09:21 | smithi | main | ubuntu | 22.04 | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks} | 2 |
Failure Reason:
"1714995471.239485 mon.a (mon.0) 22 : cluster [ERR] Health check failed: 8 osds(s) are not reachable (OSD_UNREACHABLE)" in cluster log |
||||||||||||||
| pass | 7687155 |
|
2024-05-03 02:08:52 | 2024-05-06 11:00:06 | 2024-05-06 11:34:19 | 0:34:13 | 0:24:32 | 0:09:41 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7687156 |
|
2024-05-03 02:08:53 | 2024-05-06 11:00:36 | 2024-05-06 12:56:16 | 1:55:40 | 1:47:52 | 0:07:48 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-05-06T11:30:00.000141+0000 mon.a (mon.0) 864 : cluster 3 [WRN] OSD_DOWN: 1 osds down" in cluster log |
||||||||||||||
| fail | 7687157 |
|
2024-05-03 02:08:54 | 2024-05-06 11:00:37 | 2024-05-06 12:37:17 | 1:36:40 | 1:28:20 | 0:08:20 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1714994358.8403046 mon.a (mon.0) 660 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7687158 |
|
2024-05-03 02:08:55 | 2024-05-06 11:02:44 | 2024-05-06 12:16:07 | 1:13:23 | 1:06:33 | 0:06:50 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| pass | 7687159 |
|
2024-05-03 02:08:56 | 2024-05-06 11:02:54 | 2024-05-06 12:04:05 | 1:01:11 | 0:52:16 | 0:08:55 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/dbench}} | 2 |
| fail | 7687160 |
|
2024-05-03 02:08:57 | 2024-05-06 11:02:55 | 2024-05-06 14:13:05 | 3:10:10 | 3:00:08 | 0:10:02 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-05-06T12:50:00.000130+0000 mon.a (mon.0) 5329 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 8 scrub errors" in cluster log |
||||||||||||||
| fail | 7687161 |
|
2024-05-03 02:08:58 | 2024-05-06 11:05:25 | 2024-05-06 13:57:55 | 2:52:30 | 2:44:31 | 0:07:59 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"1714994707.2018006 mon.a (mon.0) 667 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7687162 |
|
2024-05-03 02:09:00 | 2024-05-06 11:06:46 | 2024-05-06 11:45:32 | 0:38:46 | 0:31:43 | 0:07:03 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7687163 |
|
2024-05-03 02:09:01 | 2024-05-06 11:06:46 | 2024-05-06 14:23:09 | 3:16:23 | 3:07:25 | 0:08:58 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T11:30:00.158667+0000 mon.a (mon.0) 931 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7687164 |
|
2024-05-03 02:09:03 | 2024-05-06 11:07:37 | 2024-05-06 12:03:42 | 0:56:05 | 0:44:35 | 0:11:30 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7687165 |
|
2024-05-03 02:09:04 | 2024-05-06 11:07:47 | 2024-05-06 11:39:47 | 0:32:00 | 0:22:36 | 0:09:24 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7687166 |
|
2024-05-03 02:09:06 | 2024-05-06 11:08:38 | 2024-05-06 12:07:41 | 0:59:03 | 0:51:33 | 0:07:30 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7687167 |
|
2024-05-03 02:09:06 | 2024-05-06 11:08:38 | 2024-05-06 14:00:24 | 2:51:46 | 2:44:48 | 0:06:58 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T12:00:00.000140+0000 mon.a (mon.0) 2108 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7687168 |
|
2024-05-03 02:09:08 | 2024-05-06 11:09:09 | 2024-05-06 13:44:19 | 2:35:10 | 2:25:43 | 0:09:27 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-05-06T12:50:00.000152+0000 mon.a (mon.0) 6143 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 1 scrub errors" in cluster log |
||||||||||||||
Pulpito