Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi057.front.sepia.ceph.com smithi True True 2024-05-08 22:55:34.220686 scheduled_pdonnell@teuthology centos 8 x86_64 /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698159
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7698159 2024-05-08 19:26:28 2024-05-08 22:54:23 2024-05-09 00:00:55 1:07:45 smithi main centos 8.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
pass 7698106 2024-05-08 19:25:25 2024-05-08 22:00:04 2024-05-08 22:55:24 0:55:20 0:49:30 0:05:50 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/data-scan} 2
pass 7698024 2024-05-08 19:23:50 2024-05-08 20:36:47 2024-05-08 21:59:55 1:23:08 1:10:31 0:12:37 smithi main centos 9.stream fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-dbench} 3
pass 7697988 2024-05-08 19:23:10 2024-05-08 19:50:42 2024-05-08 20:36:37 0:45:55 0:31:36 0:14:19 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} 3
pass 7697903 2024-05-08 17:45:02 2024-05-08 18:11:11 2024-05-08 18:48:49 0:37:38 0:26:43 0:10:55 smithi main centos 9.stream rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/cloud_transition_s3tests} 1
pass 7697868 2024-05-08 17:44:17 2024-05-08 17:46:28 2024-05-08 18:11:40 0:25:12 0:14:14 0:10:58 smithi main centos 9.stream rgw/upgrade/{1-install/reef/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
pass 7697712 2024-05-08 15:05:03 2024-05-08 16:28:56 2024-05-08 17:44:07 1:15:11 1:04:36 0:10:35 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/radosbench} 2
fail 7697689 2024-05-08 15:04:36 2024-05-08 16:07:01 2024-05-08 16:25:45 0:18:44 0:07:35 0:11:09 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

Command failed on smithi062 with status 1: 'sudo fuser -v /var/lib/dpkg/lock-frontend'

pass 7697639 2024-05-08 15:03:36 2024-05-08 15:43:48 2024-05-08 16:07:38 0:23:50 0:11:56 0:11:54 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
pass 7697583 2024-05-08 15:02:27 2024-05-08 15:43:50 686 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7697577 2024-05-08 15:02:19 2024-05-08 15:02:48 2024-05-08 15:22:32 0:19:44 0:08:23 0:11:21 smithi main centos 9.stream rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 3
dead 7697429 2024-05-08 13:38:40 2024-05-08 13:45:15 2024-05-08 14:46:21 1:01:06 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds

dead 7697427 2024-05-08 13:38:38 2024-05-08 13:39:54 2024-05-08 13:47:48 0:07:54 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
Failure Reason:

SSH connection to smithi057 was lost: 'sudo apt-get update'

dead 7697426 2024-05-08 13:38:37 2024-05-08 13:39:53 2024-05-08 13:45:47 0:05:54 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi057's OS to be centos 9 but found ubuntu 22.04

fail 7697253 2024-05-08 04:01:27 2024-05-08 05:38:15 2024-05-08 06:53:38 1:15:23 1:02:09 0:13:14 smithi main centos 9.stream fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/kernel_untar_build}} 3
Failure Reason:

"2024-05-08T06:20:38.160506+0000 mds.b (mds.0) 39 : cluster [WRN] Scrub error on inode 0x10000011f35 (/volumes/qa/sv_1/412727ea-17a2-4eb7-b2fe-60c2f6ed057b/client.0/tmp/t/linux-6.5.11/scripts/kconfig) see mds.b log and `damage ls` output for details" in cluster log

pass 7697220 2024-05-08 04:00:58 2024-05-08 04:43:54 2024-05-08 05:37:18 0:53:24 0:39:46 0:13:38 smithi main centos 9.stream fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} 3
pass 7696788 2024-05-07 23:05:10 2024-05-08 03:20:05 2024-05-08 04:39:23 1:19:18 1:10:34 0:08:44 smithi main centos 9.stream rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} workloads/qemu_xfstests_luks2} 3
fail 7696760 2024-05-07 23:04:47 2024-05-08 02:54:55 2024-05-08 03:08:25 0:13:30 smithi main centos 9.stream rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/none min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} workloads/python_api_tests} 3
Failure Reason:

failed to install new kernel version within timeout

pass 7696732 2024-05-07 23:04:24 2024-05-08 02:12:37 2024-05-08 02:54:35 0:41:58 0:31:45 0:10:13 smithi main ubuntu 22.04 rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/ec features/layering msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 7696719 2024-05-07 23:04:14 2024-05-08 01:50:57 2024-05-08 02:10:04 0:19:07 0:08:57 0:10:10 smithi main centos 9.stream rbd/basic/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} tasks/rbd_lock_and_fence} 1