Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi162.front.sepia.ceph.com smithi True True 2024-04-16 13:37:45.227676 scheduled_leonidus@teuthology centos 9 x86_64 /home/teuthworker/archive/leonidus-2024-04-16_13:32:31-fs-main-distro-default-smithi/7658357
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7658357 2024-04-16 13:33:43 2024-04-16 13:37:45 2024-04-16 14:26:53 0:49:08 0:39:46 0:09:22 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce} 2
Failure Reason:

"2024-04-16T14:11:06.116935+0000 mds.a (mds.1) 1 : cluster [WRN] client.10391 isn't responding to mclientcaps(revoke), ino 0x20000000257 pending pAsLsXsFc issued pAsLsXsFcb, sent 90.076580 seconds ago" in cluster log

fail 7658157 2024-04-16 12:38:06 2024-04-16 12:39:02 2024-04-16 13:35:53 0:56:51 0:43:04 0:13:47 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7658011 2024-04-16 07:27:09 2024-04-16 07:27:26 2024-04-16 07:57:36 0:30:10 0:18:50 0:11:20 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
fail 7657844 2024-04-15 22:11:27 2024-04-16 01:25:47 2024-04-16 02:14:25 0:48:38 0:39:31 0:09:07 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7657800 2024-04-15 22:10:42 2024-04-16 00:59:47 2024-04-16 01:28:59 0:29:12 0:21:40 0:07:32 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7657763 2024-04-15 22:10:06 2024-04-16 00:30:54 2024-04-16 01:01:28 0:30:34 0:19:49 0:10:45 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7657710 2024-04-15 22:09:15 2024-04-15 23:55:24 2024-04-16 00:31:04 0:35:40 0:25:01 0:10:39 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7657622 2024-04-15 21:32:25 2024-04-15 22:32:25 2024-04-15 23:55:47 1:23:22 1:09:42 0:13:40 smithi main ubuntu 22.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/radosbench thrashosds-health} 4
fail 7657592 2024-04-15 21:11:20 2024-04-15 22:16:48 2024-04-15 22:32:57 0:16:09 0:04:28 0:11:41 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

fail 7657525 2024-04-15 21:10:12 2024-04-15 21:45:57 2024-04-15 22:04:53 0:18:56 0:07:22 0:11:34 smithi main ubuntu 22.04 orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

fail 7657458 2024-04-15 21:09:04 2024-04-15 21:16:59 2024-04-15 21:31:05 0:14:06 0:04:29 0:09:37 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

pass 7657323 2024-04-15 20:11:12 2024-04-15 20:47:28 2024-04-15 21:17:43 0:30:15 0:19:33 0:10:42 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7657293 2024-04-15 20:10:45 2024-04-15 20:11:39 2024-04-15 20:47:51 0:36:12 0:21:48 0:14:24 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7657214 2024-04-15 17:33:13 2024-04-15 17:55:31 2024-04-15 18:27:11 0:31:40 0:22:23 0:09:17 smithi main ubuntu 22.04 rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/tempest ubuntu_latest} 1
fail 7657151 2024-04-15 14:55:07 2024-04-15 15:08:43 2024-04-15 15:24:24 0:15:41 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quiesce} 2
Failure Reason:

Failed to reconnect to smithi162

fail 7657150 2024-04-15 14:55:07 2024-04-15 15:08:42 2024-04-15 15:16:07 0:07:25 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quiesce} 2
Failure Reason:

Command failed on smithi162 with status 1: 'sudo yum install -y kernel'

fail 7657033 2024-04-15 04:46:38 2024-04-15 05:03:14 2024-04-15 08:23:16 3:20:02 3:09:47 0:10:15 smithi main ubuntu 22.04 upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"2024-04-15T05:44:45.527276+0000 mon.a (mon.0) 184 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 7656993 2024-04-15 00:32:30 2024-04-15 02:29:13 2024-04-15 04:39:00 2:09:47 2:02:08 0:07:39 smithi main rhel 8.6 upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} 2
pass 7656958 2024-04-15 00:16:30 2024-04-15 02:07:43 2024-04-15 02:29:10 0:21:27 0:09:57 0:11:30 smithi main ubuntu 20.04 upgrade-clients:client-upgrade-pacific-quincy/pacific-client-x/rbd/{0-cluster/{openstack start} 1-install/pacific-client-x 2-workload/rbd_notification_tests supported/ubuntu_20.04} 2
pass 7656940 2024-04-14 22:06:25 2024-04-15 09:18:48 2024-04-15 09:40:37 0:21:49 0:10:38 0:11:11 smithi main ubuntu 22.04 rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1